Coder Social home page Coder Social logo

Comments (4)

Zuellni avatar Zuellni commented on August 24, 2024

What ComfyUI commit are you on now and what was the last working one for you? What's your exllamav2 package version?
The latest commit (ae3e4e9 as of writing this) seems to be working correctly for me.

from comfyui-exllama-nodes.

liulsg avatar liulsg commented on August 24, 2024

What ComfyUI commit are you on now and what was the last working one for you? What's your exllamav2 package version? The latest commit (ae3e4e9 as of writing this) seems to be working correctly for me.

@Zuellni After I ran update_comfyui_and_python_dependencies, torch did not work properly after upgrading to 2.1, even though I reinstalled the support library, but I finally redownloaded comfyui portable version and reinstalled the support library. Thank you for your response.

from comfyui-exllama-nodes.

Zuellni avatar Zuellni commented on August 24, 2024

I tried both the stable and nightly portable builds, and there appears to be an issue with exllamav2 wheels and torch 2.2 with the nightly.

ImportError: DLL load failed while importing exllamav2_ext: The specified procedure could not be found.

It might work if you compile the extension following the instructions in the exllamav2 repo but I can't do anything about this myself. Recommend using the stable release of comfyui with torch 2.1 for now.

from comfyui-exllama-nodes.

liulsg avatar liulsg commented on August 24, 2024

I tried both the stable and nightly portable builds, and there appears to be an issue with exllamav2 wheels and torch 2.2 with the nightly.

ImportError: DLL load failed while importing exllamav2_ext: The specified procedure could not be found.

It might work if you compile the extension following the instructions in the exllamav2 repo but I can't do anything about this myself. Recommend using the stable release of comfyui with torch 2.1 for now.

@Zuellni ok,thanks

from comfyui-exllama-nodes.

Related Issues (18)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.