Comments (3)
seems there is some problem with the implementation in go-llama.cpp. needs to be revisited
from localai.
⚠️ ⚠️ ⚠️ ⚠️ ⚠️
Hi! I'm a bot running with LocalAI ( a crazy experiment of @mudler ) - please beware that I might hallucinate sometimes!
but.... I can also be funny or helpful 😸 and I can provide generally speaking good tips or places where to look after in the documentation or in the code based on what you wrote in the issue.
Don't engage in conversation with me,
I don't support (yet) replying!
⚠️ ⚠️ ⚠️ ⚠️ ⚠️
To help with the issue, I can suggest the following solutions:
- For the go-llama.cpp backend, you can use the version pinned by go-skynet as it is temporarily set to a specific version containing a fix for the issue. You can also try using the master version of llama.cpp and rebase on top of it to ensure that you have the latest changes.
- For go-gpt4all-j.cpp and go-gpt2.cpp, you can use the versions pinned by their respective repositories as they are already set to specific versions.
- For rwkv, you can use the version pinned by go-skynet as it is temporarily set to a specific version containing a fix for the issue. You can also try using the master version of rwkv and rebase on top of it to ensure that you have the latest changes.
To debug the issue further, you can check the code for each backend and see if the stopwords are implemented correctly and in accordance with the specifications. You can also check the documentation and examples provided by the respective repositories to ensure that you are using the correct approach for implementing stopwords.
Sources:
- https://github.com/go-skynet/LocalAI/tree/master/go.sum
- https://github.com/go-skynet/LocalAI/tree/master/Makefile
- https://github.com/go-skynet/LocalAI/tree/master/go.mod
from localai.
this is supported now
from localai.
Related Issues (20)
- 2.13.0 failes to build caused by missing path pkg/grpc/proto HOT 3
- parler-tts error HOT 1
- Bug: PyTorch error with OneApi 2024.1 HOT 3
- WebUI enhancements HOT 4
- Incorrect version causing formatting issue in docs HOT 4
- Add grpc service to query info about backend HOT 1
- Absolute paths not being respected in model configs HOT 2
- Templates cannot be outside models directory, models can HOT 2
- Support Rockchip RK3588 / NPU / Mali-G610 GPU HOT 2
- wired and missing api calls in /metrics HOT 1
- Fail to select GPU when OpenVINO returns multiple GPUs HOT 4
- OpenVINO on Arc A770 exception `Check 'written_size == size' ` HOT 3
- Italian ramblings? HOT 1
- Italian ramblings... HOT 2
- OpenVINO A770 segfaults after some number of tokens HOT 6
- GRPC Service Not Ready HOT 10
- Response needs to process functions [panic: Unrecognized schema: map[]] HOT 20
- WebUI: 'Authorization header missing' HOT 5
- docker compose up start failure HOT 1
- UI: Model Gallery: indicate trust_remote_code HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from localai.