Comments (5)
hydai
commented on September 27, 2024
@apepkuss
Do you know if we can convert the Qwem-VL into the GGUF format at this moment?
from wasmedge.
apepkuss
commented on September 27, 2024
Not sure if the model could be converted to GGUF. According to the descriptions on Qwen-VL and Qwen-VL-Chat, we will try Qwen-VL-Chat, and list it as a candidate in LlamaEdge #71.
from wasmedge.
apepkuss
commented on September 27, 2024
Failed to convert to gguf by the same issue.
from wasmedge.
thiner
commented on September 27, 2024
Yes, convert to GGUF seems not feasible currently. I think the only runnable quantized model is the GPTQ model provided officially.
from wasmedge.
hydai
commented on September 27, 2024
Since this should be an upstream issue, I'm closing it. We are happy to support it if the GGUF provides fundamental support for this kind of model.
from wasmedge.
Related Issues (20)
- Fails to build with GCC 14 HOT 26
- feat: disable wasi-logging installation in the installer v1 and v2
- [Call for Vote] Create wasmedge-llmc repo HOT 4
- libwasmedge exposes hundreds of C++ symbols (0.14.0 regression) HOT 6
- bug: wasmedge-ffmpeg is broken after applying `CXX_VISIBILITY_PRESET hidden` HOT 2
- bug: [CMake] WasmEdge package contains the non-self headers
- feat: Bump ffmpeg from 6.0 to 7.0.2 or downgrade to 5.1.6 LTS
- bug: the release assets file structure is changed between 0.14.1-rc.1 and 0.14.1-rc.2 [regression] HOT 4
- feat: support `audio translations` feature in whisper plugin HOT 1
- WasmEdge Community meeting on 3rd Sep HOT 9
- feat: Update `stable-diffusion` plugin to `master-64d231f` or above HOT 2
- feat: Provide a `whisper & piper` combo plugin HOT 2
- bug: WasmEdge 0.14.0 pre-built assets on Ubuntu 20.04 aarch64 doesn't contain AOT feature HOT 2
- bug: Regression on the release CI, manylinux builds for all plugins are missing
- bug: Tests fail on aarch64
- LFX Workspace: Create a Wasm-based LLM app for financial analysts [Term-3] HOT 6
- LFX Workspace: WASM Serializer with new proposals HOT 5
- LFX Workspace : Create an LLM app with deep understanding of a GitHub repo HOT 9
- Allocation-deallocation mismatch bug in function `lld::elf::ELFOptTable::parse()` HOT 1
- [CI] manylinux: WASI-NN Burn.rs HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from wasmedge.