Comments (3)
Bot detected the issue body's language is not English, translate it automatically.
Title: [Feature Request]: Suggestions on max_tokens usage
Problem Description
The max_tokens parameter of different models is used in different ways. In some models, if the value passed in max_tokens is inappropriate, the request will be rejected or the enunciation will be interrupted. Adding additional settings of max_tokens to the visual model is due to this problem. Regarding whether max_tokens should be passed or not. There are also many issues discussed.
Solution Description
I would like to give a suggestion for this. You can set a toggle button on the front end to control whether the current conversation passes the max_tokens parameter to the model. This can appropriately reduce the hard coding work in the program when adapting to the new model, because in addition to the determination of isVisionModel, the user can directly pass max_tokens through the front-end control. I think this design can effectively reduce the conversation trouble caused by the max_tokens parameter.
Alternatives Considered
No response
Additional Context
No response
from chatgpt-next-web.
非常同意你对max_tokens的看法,目前看,max_tokens和具体模型是强关联的,因此,在新版本中,我们将会把max_tokens作为具体模型的参数,支持用户对于模型的max_tokens进行自定义
from chatgpt-next-web.
Bot detected the issue body's language is not English, translate it automatically.
I very much agree with your view on max_tokens. At present, max_tokens is strongly related to the specific model. Therefore, in the new version, we will use max_tokens as a parameter of the specific model to support users to customize the max_tokens of the model.
from chatgpt-next-web.
Related Issues (20)
- [Bug] Recurring QuotaExceeded error HOT 2
- [Feature Request] using CacheStorage to store image HOT 1
- [Bug] Gemini No Response HOT 3
- [Bug] 2.13 报错 DOMException: Failed to execute 'setItem' on 'Storage': Setting the value of 'chat-next-web-store' exceeded the quota HOT 3
- [Bug] 单独自定义azure模型的情况下无法生效 HOT 26
- [Bug] docker compose 部署 DEFAULT_MODEL 参数无法生效 HOT 5
- [Feature Request] 能否添加对Deepbricks这家API供应商的API支持 HOT 9
- [Feature Request] mac inter V2.13.0 为啥没有安装包 HOT 4
- [Feature Request] claude3.5 8k output limit HOT 1
- [Feature Request] 支持多个 LLM 同时对话 Support multiple LLM simultaneous conversations HOT 3
- google gemini 用不了了[Bug] HOT 16
- [Bug] HOT 2
- [Bug] [一些问题合集] 包括:[配置了代理的Gemini用不了、设定了默认模型后列表出现undefined等等] HOT 11
- [Feature Request] 添加百度AI的免费模型ENIRE Speed和ENIRE Lite HOT 3
- [Feature Request]对话框进度滑块显示优化 HOT 2
- 请求太大的问题[Bug] HOT 5
- [Bug] Default Model Set to 'gpt-3.5' but Option Displays ‘undefined’ HOT 4
- [Feature Request] app on mobile terminal
- 不太清楚怎么验证文件和sig签名文件[Feature Request] HOT 1
- [增加阿里云通义千问(qwen)的相关使用说明] HOT 22
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from chatgpt-next-web.