tylunasli / chatglm-web-stream-demo Goto Github PK
View Code? Open in Web Editor NEWChatGLM-6B HTTP流式解码API的Flask、FastAPI实现，以及开箱即用的Web页面。 a stream decoding demo of ChatGLM-6B using Flask or FastAPI, with web page out-of-the-box.
License: MIT License
chatglm-web-stream-demo's Issues
怎么启动这么慢
运行 python3 -u chatglm_service_fastapi.py --host 127.0.0.1 --port 7861 --quantize 4 --device 1,2,3
好几次卡在 starting server... 这一步。卡10分钟也没结果
EventSourceResponse
流式接口中EventSourceResponse不想return,想获取返回值需要怎么写
前端界面展示
请问下前端的static文件，是如何配置进行展示的？
输入内容点击发送后报错
\AppData\Roaming\Python\Python310\site-packages\torch\nn\modules\module.py", line 1269, in getattr
raise AttributeError("'{}' object has no attribute '{}'".format(
AttributeError: 'ChatGLMForConditionalGeneration' object has no attribute 'stream_chat'
并发请求下，fastapi的代码会阻塞
我只测试了fastapi的脚本，sse接口的并发越多而越来越慢。
我使用了官方的web_demo2，并发请求下速度并没有明显下降。
流式接口调用报错
RuntimeError: There is no current event loop in thread 'AnyIO worker thread'.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.