9tong Goto Github PK

9tong.github.io

my pages

annotated-transformer

An annotated implementation of the Transformer paper.

chinese-llama-alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

clip

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

deeplearning

深度学习入门教程, 优秀文章, Deep Learning Tutorial

deeplearningsystem

Deep Learning System core principles introduction.

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

generative-ai-for-beginners

12 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

groundingdino

Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"

how-to-use-transformers

Transformers 库快速入门教程

learning_nn

leptonai

A Pythonic framework to simplify AI service building

llama

Inference code for LLaMA models

llama-factory

Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)

llama_index

LlamaIndex (formerly GPT Index) is a data framework for your LLM applications

llm-analysis

Latency and Memory Analysis of Transformer Models for Training and Inference

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

mmda_mnbvc

multimodal document analysis

parallelformers

Parallelformers: An Efficient Model Parallelization Toolkit for Deployment

tensorrt-llm

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

testsd1-5

test notebook for stable diffusion 1.5 from huggingface

text-generation-inference

Large Language Model Text Generation Inference

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.