Comments (5)
Bitsandbytes was not supported windows before, but my method can support windows.(yuhuang)
1 open folder J:\StableDiffusion\sdwebui,Click the address bar of the folder and enter CMD
or WIN+R, CMD 。enter,cd /d J:\StableDiffusion\sdwebui
2 J:\StableDiffusion\sdwebui\py310\python.exe -m pip uninstall bitsandbytes
3 J:\StableDiffusion\sdwebui\py310\python.exe -m pip uninstall bitsandbytes-windows
4 J:\StableDiffusion\sdwebui\py310\python.exe -m pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.41.1-py3-none-win_amd64.whl
Replace your SD venv directory file(python.exe Folder) here(J:\StableDiffusion\sdwebui\py310)
from bitsandbytes.
As a general concept, .so files (shared object) are the equivalent of .dll (dynamic linked library) on windows.
But .so is for linux and android.
Thus, I believe it would take a recompile for Windows before you would be able to run on Windows.
from bitsandbytes.
note - you may want to just run using Windows subsystem for Linux (WSL) and then you should be able to run as expected.
Alternatively, this is a cuda related file so you may want to check the nvidia forums as well.
from bitsandbytes.
Hi @SirWaffle !
Thanks for your message, you may want to check this issue: #17 as I think you had more or less the same issue but not sure
from bitsandbytes.
Currently, the library does not offer Windows support. It would be great if you can help us to make it work under Windows. For that, the first step is to compile from source on a Windows machine.
Let's move this discussion to issue #30.
from bitsandbytes.
Related Issues (20)
- about F.igemm error?
- NameError: name 'str2optimizer32bit' is not defined HOT 2
- Clarifying the quantization algorithm HOT 1
- Who owns bitsandbytes?
- CUDA Setup failed despite GPU being available HOT 1
- FLUTE Integration for Fast Inference HOT 6
- > I encountered the same issue on CUDA 11.6 and fixed it by building bitsandbytes from source. Below is my bash script for reference:
- bitsbytes 8bit quantized LLama 3.1 gets stuck sometimes when producing output
- Regarding bnb import error HOT 2
- RuntimeError: CUDA Setup failed despite GPU being available. Please run the following command to get more information: python -m bitsandbytes Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues
- dequantize_4bit() gives wrong output when working in cuda graph mode HOT 2
- Runtime Error, cannot import name 'get_keys_to_not_convert' from 'transformers.integrations' HOT 1
- Crash running FSDP on BF16-prequantized models HOT 4
- 4bit quantized model.dequantize() fails on CPU
- libbitsandbytes_cpu.so,libbitsandbytes_cuda124_nocublaslt124.so HOT 4
- libcudart.so Not Found HOT 1
- Unable to override PyTorch CUDA Version HOT 4
- Communicate blocksize constraints to kernels that take blocksize as a runtime argument HOT 6
- About fusion of **kdequantize kernel** and **simple bf16/fp16 matmul**
- where are the outliers stored in LLM.int8 quantization for inference suing transformers library on AMD GPU?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bitsandbytes.