agent_executor.astream_events does not work with ChatGroq about langchain

[ccurme]

Hello, thank you for reporting this.

I was able to reproduce the issue. I believe it is resolved by omitting streaming=True when initializing the chat model.

This remains a bug but hopefully that will fix your use-case. Let me know if you continue to experience issues.

Minimal example:

from langchain.agents import AgentExecutor, create_tool_calling_agent
from langchain_core.prompts import ChatPromptTemplate
from langchain_core.tools import tool
from langchain_groq import ChatGroq

@tool
def magic_function(input: int) -> int:
    """Applies a magic function to an input."""
    return input + 2

tools = [magic_function]
llm = ChatGroq(model="llama-3.1-70b-versatile").bind_tools(tools)

prompt = ChatPromptTemplate.from_messages(
    [
        ("system","You are a helpful Search Assistant"),
        ("human","{input}"),
        ("placeholder","{agent_scratchpad}"),
    ]
)

agent = create_tool_calling_agent(llm, tools, prompt)

agent_executor = AgentExecutor(
    agent=agent, tools=tools, verbose=False,
)

events = []
async for event in agent_executor.astream_events(
    {"input": "what is the value of magic_function(3)?"},
    version="v1",
):
    events.append(event)