BUG: Many chat models never uses SQLiteCache because of the cache instance's __repr__ method changes! about langchain

[eyurtsev]

Re-opened after reading a bit more carefully. @thiswillbeyourgithub if you're sharing a minimal example in the future, it's much better to share the example itself, and then any utility code to identify more cases. the utility code uses a bunch of functionality (e.g., exec) -- that made this look like spam on a first read

[eyurtsev]

Issue is here:

langchain/libs/core/langchain_core/language_models/chat_models.py

Line 393 in 61daa16

llm_string = dumps(self)

Likely affected by any other helper objects (e.g., client)

[thiswillbeyourgithub]

I'm writing a minimal example right now

[eyurtsev]

Hi @thiswillbeyourgithub, thanks!

I confirmed locally already, so we're all set :)

from langchain_anthropic import ChatAnthropic
from langchain_core.caches import InMemoryCache

cache = InMemoryCache()
model = ChatAnthropic(cache=InMemoryCache(), model_name='hello')
model._get_llm_string()

[thiswillbeyourgithub]

Alright, sorry for the extensive reproduction but at first I showed this on ChatOpenAI then noticed that the issue was so extensive (affecting at least 7 chat models) and is not only related to cache but sometimes to other attributes as well for example for Anthropic as you saw.

[thiswillbeyourgithub]

So my original code is a bit awkward but allows to quickly see a lower bound of what attributes of which model is posing problem