tungllm Goto Github PK

agnai

AI Agnostic (Multi-user and Multi-bot) Chat with Fictional Characters. Designed with scale in mind.

chatbot-ui

The open-source AI chat interface for everyone.

exllama

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

exui

Web UI for ExLlamaV2

flash-attention

Fast and memory-efficient exact attention

gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.

gpt4all

gpt4all: open-source LLM chatbots that you can run anywhere

instantid

InstantID : Zero-shot Identity-Preserving Generation in Seconds 🔥

koboldai-client

koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

librechat

Enhanced ChatGPT Clone: Features OpenAI, Assistants API, Azure, Groq, GPT-4 Vision, Mistral, Bing, Anthropic, OpenRouter, Google Gemini, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. More features in development

llama-factory

Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)

lobe-chat

🤯 Lobe Chat - an open-source, modern-design LLMs/AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Perplexity / Bedrock / Azure / Mistral / Ollama ), Multi-Modals (Vision/TTS) and plugin system. One-click FREE deployment of your private ChatGPT chat application.

lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

melotts

High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.

mergekit

Tools for merging pretrained large language models.

runpod-containers

🐳 | Dockerfiles for the RunPod container images used for our official templates.

sillytavern

LLM Frontend for Power Users.

sillytavern-extras

Extensions API for SillyTavern.

skypilot

SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.

stable-diffusion-webui

Stable Diffusion web UI

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs