promtengineer / langchain-tutorilas Goto Github PK

Hello my friend!

I tested Chatbots-with-memory/chatbot_localGPT.ipynb with orca-mini and it worked!

Now Im testing different models, they get loaded by the jupyter, and a common error is this:
ValueError: Requested tokens exceed context window of 2048

I changed all values related to tokens in load_model, but the error persists, just the number changes.

I'm using CPU only, and all the models tested are supposedly to run in only CPU configurations. For example, I tested
TheBloke/stable-vicuna-13B-GGML/ stable-vicuna-13B.ggmlv3.q4_0.bin.

I can give more information if requested.

What could be the problem? Any hints?
Great work!

Hey @PromtEngineer

Saw you’re a maintainer for Langchain-Tutorials - we found a leaked key here. Have you seen unusual spend on your OpenAI account ? Happy to help out if possible!