Comments (6)
@mdrokz are you planning to main this project? I saw it uses a pretty old llama.cpp version.
I'm not getting time these days due to my job if somebody wants to maintain this project im happy to add them in the repo. I also merge any PR's when i get time.
from rust-llama.cpp.
Thank you for responding! I saw edgen starting their on fork at https://github.com/edgenai/llama_cpp-rs/tree/main, which is inspired by your work https://github.com/edgenai/llama_cpp-rs/blob/847d4f5d104c23b87a925618027942313badec2c/crates/llama_cpp_sys/build.rs#L8
Maybe we could unify all the rust efforts into a single package. pinging @pedro-devv and @scriptis
from rust-llama.cpp.
We will keep developing our own bindings for the foreseeable future. The bindings from this repository aren't exactly what we are looking for in our projects, which is why we chose to make our own to begin with. Regardless, I'll take this chance to thank you for your work done on these bindings! They were a great starting point for us, especially the compilation side of things.
from rust-llama.cpp.
@pedro-devv thank you for the respond! So it might make more sense to redirect people than to your bindings if you plan to maintain them and @mdrokz is not having the time at the moment.
For the Rust community it would be very nice if we can find 1 repo where all can contribute and work on.
from rust-llama.cpp.
Thank you for responding! I saw edgen starting their on fork at https://github.com/edgenai/llama_cpp-rs/tree/main, which is inspired by your work https://github.com/edgenai/llama_cpp-rs/blob/847d4f5d104c23b87a925618027942313badec2c/crates/llama_cpp_sys/build.rs#L8
Maybe we could unify all the rust efforts into a single package. pinging @pedro-devv and @scriptis
Yeah edgenai's project looks more advanced and cleaner than mine it might be an better alternative to my bindings
from rust-llama.cpp.
We will keep developing our own bindings for the foreseeable future. The bindings from this repository aren't exactly what we are looking for in our projects, which is why we chose to make our own to begin with. Regardless, I'll take this chance to thank you for your work done on these bindings! They were a great starting point for us, especially the compilation side of things.
Thank you! Can i ask what was missing in my bindings ? and what you were looking for ?
from rust-llama.cpp.
Related Issues (20)
- Not cloning llama.cpp submodule HOT 2
- Cant compile on Win64 HOT 2
- Cant build on Mac aarch64
- Cant build on Ubuntu 22.04 HOT 1
- Error in loading models HOT 5
- llama.cpp ./embedding HOT 4
- Feature flag metal: Fails to load model when n_gpu_layers > 0 HOT 8
- Slow Performance compared to Python Binding HOT 1
- Sometimes crashes with UTF8 error HOT 3
- `LLama` is not `Send` HOT 4
- Error when enabling CUDA on Windows HOT 12
- clang - fatal error: 'assert.h' file not found HOT 2
- remove or add a way to disable `println!("count {}", reverse_count);` HOT 1
- Error running Phi2 Models
- Using metal and `n_gpu_layers` produces no tokens HOT 5
- Support for GBNF Grammars HOT 2
- Include ggml-metal.metal file in source code HOT 1
- Bug cannot build correct in macos with m2 chip
- Compiling with metal feature has `ggml-metal.o` linker failure HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rust-llama.cpp.