jules552 / llama2-webui Goto Github PK
View Code? Open in Web Editor NEWThis project forked from liltom-eth/llama2-webui
Run Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Supporting Llama-2-7B/13B/70B (16bit, 8bit), GPTQ(4bit), GGML.
License: MIT License