[Bug] CUSTOM_MODELS Does not work when I upgraded to v2.11.3 about chatgpt-next-web

[steven-prybylynskyi]

Is it possible to use Claude 3 as a custom model?

[Kosette]

Sample for anyone having issues, until the update arrived with better built in support for Claude-3

* `CUSTOM_MODELS="+claude-3-haiku-20240307"`

* `ANTHROPIC_API_KEY="{your-api-key}"`

* `ANTHROPIC_API_VERSION="2023-06-01"` (currently the latest version)

* `ANTHROPIC_URL="https://api.anthropic.com/v1/messages"`

If you want to use selected models, add CUSTOM_MODELS=-all,+claude-3-sonnet-20240229,+[other models you need] in docker-compose.yml or all default models will be included in settings. Find exact model name in constant.ts.

For Claude, ANTHROPIC_API_KEY is necessary (if you use official service), others like ANTHROPIC_API_VERSION and ANTHROPIC_URL are optional. Use ANTHROPIC_URL if you access through a endpoint proxy (like third-party service provider).

[Kosette]

try to open in InPrivate mode. Check whether it works.

[weifeng12x]

try to open in InPrivate mode. Check whether it works.

I tried different broswer, it still doesn't work. Addtional, not only i can see the model list, but also can use it if the api key have permission.

[crbon]

Likely related issue, even after adding the ANTHROPIC_API_KEY the Calude-3 models don't show up in model the list.
Using: docker

[Kosette]

Likely related issue, even after adding the ANTHROPIC_API_KEY the Calude-3 models don't show up in model the list.

how did you start the container,docker run or docker compose?
Have you recreate the container after changing config?

Add ANTHROPIC_API_KEY and CUSTOM_MODELS(if you using), recreate(not restart) container, then refresh in browser.

[crbon]

Likely related issue, even after adding the ANTHROPIC_API_KEY the Calude-3 models don't show up in model the list.

how did you start the container,docker run or docker compose? Have you recreate the container after changing config?

Add ANTHROPIC_API_KEY and CUSTOM_MODELS(if you using), recreate(not restart) container, then refresh in browser.

Sorry, after adding the CUSTOM_MODELS environment variable, yes those custom models come through.
Although, I'm still not clear on how to add Anthropic's Claude-3 Haiku for instance to NextChat. I have the model open come in the GUI, however, I must be doing something wrong.

Could you provide a sample docker-compose.yml or docker run command that would add a Claude-3 model?

P.S. I was running NextChat with docker compose

[crbon]

I got it resolved.

Make sure to add of the following 3 environment variables to be able to use use Claude-3 (any model).

• CUSTOM_MODELS
• ANTHROPIC_API_KEY
• ANTHROPIC_API_VERSION
• ANTHROPIC_URL

---

Sample for anyone having issues, until the update arrived with better built in support for Claude-3

• CUSTOM_MODELS="+claude-3-haiku-20240307"
• ANTHROPIC_API_KEY="{your-api-key}"
• ANTHROPIC_API_VERSION="2023-06-01" (currently the latest version)
• ANTHROPIC_URL="https://api.anthropic.com/v1/messages"

[crbon]

Weird. It didn't work for me till I added the ANTHROPIC_API_VERSION.

I already had the ANTHROPIC_API_KEY, ANTHROPIC_URL and CUSTOM_MODELS, but without ANTHROPIC_API_VERSION it would fallback to GPT-3

[weifeng12x]

This bug has beed fixed in v2.12.2