Strikethrough text (using a V100 graphics card) about minigpt-4

[TsuTikgiau]

Thanks for your interest in our work! People in this issue show similar problems to your case, and their reason looks like they don't add the delta weight of vicuna back to llama weight to get the final working weight. Note that the vicuna weight you directly download is a delta version. And you need to follow their instruction to add this delta weight back to the original llama weight, to get the final working weight of vicuna. The reason why we need this complex process is that llama doesn't allow us to distribute their weights, so vicuna has to release a delta weight version to bypass this rule

[Andy1621]

I also met the same issue...

[stevezhang88]

https://huggingface.co/lmsys/vicuna-13b-delta-v0) . I think this weight should be merged with LLaMa 13B weights. Then works .