ChatDatabricks can't stream response: "KeyError: 'content'" about langchain

[mfeller2000]

Update: This may be an endpoint issue on the Databricks side. After trying a different Databricks endpoint (Llama 3), the stream works fine. But trying with an external model (like GPT-4) will cause the above mentioned error. Invoking works fine though.

[lucas-tucker]

I noticed that there is no langchain-databricks, and that the Databricks model is sourced from langchain_community, whereas other Chat models have all migrated to their own libraries (e.g. langchain-groq, langchain-huggingface)

[reslleygabriel]

Hi @mfeller2000 ,

I'm currently facing the same issue in Databricks and was wondering if you found a way to integrate streams with external models. Any insights you could share would be greatly appreciated!