- Open LLMs for Commercial Use
- Huggingface Open LLM Leaderboard
- Build ChatGPT from GPT-3
- Comparison of self-hosted LLMs and OpenAI: cost, text generation quality, development speed, privacy
- text-generation-webui (fast inference on most local models)
- LocalAI (OpenAI drop-in alternative REST API)
- BionicGPT (onprem ChatGPT replacement)
- OpenAccess-AI-Collective/axolotl (fine-tune local models)
- LLaMA-Factory (easy finetuning framework for popular local models)
- Petals (bittorrent-like deployment of local models)
- ChatLangChain (interactive documentation)
- LangSmith (debugging, evaluating, monitoring agents)
- LangServe (deploy LangChain code)
- OpenGPTs (OSS alternative to OpenAIs Custom GPTs)
The notebooks include several examples on how to use LangChain
and are
located in DeepLearning.AI Notebooks
. Follow the instructions
in the README.md
in there to set up your environment and use either your
OpenAI API key
or LocalAI
to run the notebooks.
- LangChain Local LLMs
- LangChain + Streamlit + Llama Guide
- Llama v2.0, FAISS in Python using LangChain
- Answering Question About your Documents Using LangChain
- Using LLaMA 2.0, FAISS and LangChain for Question-Answering
- Unlocking the Power of LangChain: Building Applications with Large Language Models
Without LangChain:
- Building RAG from Scratch (with LlamaIndex)
- How to prompt Llama 2
- llama.cpp (also bindings for Python)
- Talk-Llama (local implementation with
llama.cpp
andwhisper
) - Quantize Llama models with GGML and llama.cpp
- TinyLlama (still being trained)
- Other Languages Support
- TLDR: Llama2 usage in other than English out-of-scope
- solutions:
- append "Answer in German" to initial prompt (in English)
- prompt in German
- use fine-tuned model for German (beware of licensing and quality)
- SauerkrautLM
- LeoLM
- German Assistant
- EM German LEO Mistral (quantized also available)
- Getting started with embeddings
- SBERT Transformer Embedding Models (local)
- HF text-embeddings-inference (local container)
- Chat with Anything - From PDFs Files to Image Documents
- Notebook with examples on file type detection, chunking, embedding
- Pinecone (free tier available for one index/project)