Comments (3)
I successfully run on dual RTX3090s.
Try with CUDA_VISIBLE_DEVICES=0 python demo.py --cfg-path eval_configs/minigpt4_eval.yaml
.
from minigpt-4.
I successfully run on dual RTX3090s.
Try withCUDA_VISIBLE_DEVICES=0 python demo.py --cfg-path eval_configs/minigpt4_eval.yaml
.
Curious, what's your VRAM usage between the cards? With CUDA_VISIBLE_DEVICES=0 I can run the model in 8bit model but my second card is idle. I'm hoping to run the full 16bit model split between my two cards.
from minigpt-4.
One is 16GB and the other is no usage. CUDA_VISIBLE_DEVICES=0
just limit visibility from python program. e.g., CUDA_VISIBLE_DEVICES=0: only GPU_id = 0 is visible, CUDA_VISIBLE_DEVICES=1: only GPU_id = 1 is visible, and CUDA_VISIBLE_DEVICES=0,1: both GPU_id=0 and 1 are visible.
If you want to run the inference using two cards then you need to do something like this
from minigpt-4.
Related Issues (20)
- why only parts of the image_embeds are used? HOT 1
- increasing lr during minigptv2 finetune HOT 4
- error model output
- How to run MiniGPTV2 without Gradio
- Can I fine-tune minigpt-v2 on 4090? HOT 3
- I can't download the MiniGPT-v2 pretrained model checkpoint `MiniGPT-v2 (after stage-3)` HOT 1
- minigptv2_finetune script details
- MULTIPLE OBJECT in the images are not getting detected HOT 3
- no response during minigpt_v2 demo HOT 1
- how to process dataset HOT 1
- 中文部署文档?
- support multi machine and multi card training? HOT 3
- [bug] lora_r=0 HOT 1
- Minipt4 based on Vicuna7B weights has garbled characters
- use minigpt4 without gradio but command line, multichat, few-shot-cot and image-text answer
- Where to find refcoco_val.json
- Confusion around normalising the bounding boxes between (0, 100) for fine-tuning.
- I couldn't find the checkpoint for MiniGPT-4 (llama2) in stage1
- 功能需求:提供图片输入API接口,向API接口传输图片的base64编码,以及需要GPT执行的工作,返回结果 HOT 1
- _pickle.UnpicklingError: invalid load key, '<'. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from minigpt-4.