Comments (4)
What ComfyUI commit are you on now and what was the last working one for you? What's your exllamav2 package version?
The latest commit (ae3e4e9
as of writing this) seems to be working correctly for me.
from comfyui-exllama-nodes.
What ComfyUI commit are you on now and what was the last working one for you? What's your exllamav2 package version? The latest commit (
ae3e4e9
as of writing this) seems to be working correctly for me.
@Zuellni After I ran update_comfyui_and_python_dependencies, torch did not work properly after upgrading to 2.1, even though I reinstalled the support library, but I finally redownloaded comfyui portable version and reinstalled the support library. Thank you for your response.
from comfyui-exllama-nodes.
I tried both the stable and nightly portable builds, and there appears to be an issue with exllamav2 wheels and torch 2.2 with the nightly.
ImportError: DLL load failed while importing exllamav2_ext: The specified procedure could not be found.
It might work if you compile the extension following the instructions in the exllamav2 repo but I can't do anything about this myself. Recommend using the stable release of comfyui with torch 2.1 for now.
from comfyui-exllama-nodes.
I tried both the stable and nightly portable builds, and there appears to be an issue with exllamav2 wheels and torch 2.2 with the nightly.
ImportError: DLL load failed while importing exllamav2_ext: The specified procedure could not be found.
It might work if you compile the extension following the instructions in the exllamav2 repo but I can't do anything about this myself. Recommend using the stable release of comfyui with torch 2.1 for now.
@Zuellni ok,thanks
from comfyui-exllama-nodes.
Related Issues (18)
- MAX_TOKENS in error HOT 1
- Load llm into free vram on multiple gpus HOT 5
- language model install HOT 3
- Nodes missing HOT 11
- Any plans to add more detailed instructions for using the nodes? Specifically the Replace node? HOT 1
- Model undefined not found? HOT 8
- cannot find nodes even after installing everything and no errors during startup HOT 1
- ModuleNotFoundError: No module named 'exllamav2' HOT 2
- I get this ominous error when trying to execute HOT 7
- name 'exllamav2_ext' is not defined HOT 6
- Which folder is the downloaded model in? HOT 5
- IndexError: list index out of range HOT 1
- The exllama plugin cannot be loaded properly HOT 6
- No module named 'exllama_ext' HOT 2
- No module named 'exllama' HOT 5
- ImportError: DLL load failed while importing exllamav2_ext: 找不到指定的程序。 HOT 5
- Comfyui cu version 121, unable to load bug fixes.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from comfyui-exllama-nodes.