Comments (5)
ChatGPT-Next-Web/app/client/platforms/openai.ts
Lines 119 to 134 in f55f04a
上传的请求不包含max_tokens可能导致此问题,aiproxy.io在不包含此值的情况下可能会冻结最大参数。
aiproxy文档
我的临时解决办法是模仿L131的vision model添加一个针对4o的max_tokens。
if (modelConfig.model.includes("4o")) { requestPayload["max_tokens"] = Math.max(modelConfig.max_tokens, 4000); }
from chatgpt-next-web.
Bot detected the issue body's language is not English, translate it automatically.
ChatGPT-Next-Web/app/client/platforms/openai.ts
Lines 119 to 134 in f55f04a
Uploading requests not containing max_tokens may cause this issue, aiproxy.io may freeze the max parameters without including this value https://docs.aiproxy.io/guide/deduction.
My temporary solution is to imitate the vision model of L131 and add a max_tokens for 4o.
if (modelConfig.model.includes("4o")) { requestPayload["max_tokens"] = Math.max(modelConfig.max_tokens, 4000); }
from chatgpt-next-web.
Bot detected the issue body's language is not English, translate it automatically.
Title: [Bug] An error occurs when using the gpt-4o model
from chatgpt-next-web.
感谢反馈!max_tokens应该是与具体模型绑定在一起的参数,我们也意识到了这个问题,并将在下个大版本中提供给用户自定义模型的能力,支持自定义每个模型的max_tokens,但是,在目前这个版本上我们不打算修改回早期时在chat接口中传递max_tokens参数,原因是,对于大模型来说,这个参数是非必传参数,传递了这个参数返回会限制和影响很多大模型返回新消息的准确性和完整性
from chatgpt-next-web.
Bot detected the issue body's language is not English, translate it automatically.
Thanks for the feedback! max_tokens should be a parameter bound to a specific model. We are also aware of this problem and will provide users with the ability to customize models in the next major version, supporting the customization of max_tokens for each model. However, at present, this In terms of version, we do not plan to change back to the early days of passing the max_tokens parameter in the chat interface. The reason is that for large models, this parameter is a mandatory parameter. Passing this parameter will limit and affect the accuracy of new messages returned by many large models. sex and integrity
from chatgpt-next-web.
Related Issues (20)
- [Bug] Setting `max_tokens` didn't work when using OpenAI models. HOT 1
- [Bug] signal is aborted without reason HOT 2
- [Bug] Icon is too large in macbook HOT 1
- [Feature Request]: server.js 如何打开 HTTPS HOT 2
- [Feature Request]: 目前GTP-4o中要如何上传word\excel文件 HOT 3
- [Feature Request]: 关于 max_tokens 用法的建议 HOT 3
- [Bug] 无法在cloudflare pages部署 HOT 5
- [Bug] 使用过程中(发送新消息时)报错,储存空间不够 (web 和 win exe都有) HOT 7
- [Feature Request] Support for PDF, TXT, audio files, and URL links for data analysis and transcription HOT 1
- [Bug] gpt-4-0314 模型选项不见了 HOT 7
- [Feature Request]: include attachments support (PDFs, images, etc) HOT 5
- [Feature Request]: Max Request Per IP etc HOT 3
- [Bug] 更新docker 镜像 v2.12.3 之后。新的模型不能使用,显示 400 Bad Request HOT 11
- [Bug] 更新docker 镜像 v2.12.3 之后 HOT 12
- [Bug] 本地API无法正常调用,request body:{} 为空 HOT 6
- [Feature Request]: 如何可以让聊天窗口默认全屏么,通过env什么的 HOT 1
- 支持阿里的通义千问吗。qwen。。。大降价。。1块钱可以买200万令牌 HOT 5
- [Bug] 更新Docker镜像到2.12.3之后,无法使用PROXY_URL字段 HOT 9
- [Feature Request]: Does it support the Qwen model? HOT 1
- [Bug] 无法导入本地的json数据 HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from chatgpt-next-web.