mard1no Goto Github PK

qsync

Official resporitory for "QSync: Adpative Mixed-Precision for Training Synchronization".

quanto

A pytorch Quantization Toolkit

quick

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference

quickmathhpp

a single-header math library

redpajama-data

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

s-lora

S-LoRA: Serving Thousands of Concurrent LoRA Adapters

sglang

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with LLMs faster and more controllable.

simplified_transformers

stable-fast

An ultra lightweight inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.

taichi-hackathon-akinasan

Akinasan team（秋名山车队）'s code base for the 0th Taichi Hackathon.

taichi-nerfs

Implementations of NeRF variants based on Taichi + PyTorch

tensorflow-internals

It is open source ebook about TensorFlow kernel and implementation mechanism.

tensorrt

TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.

tensorrt-llm

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

tiktoken

tiny-gpu

A minimal GPU design in Verilog to learn how GPUs work from the ground up

tools

Collect some useful code.

torch-int

This repository contains integer operators on GPUs for PyTorch.

triton

Development repository for the Triton language and compiler

triton-puzzles

Puzzles for learning Triton

tutorial-multi-gpu

Efficient Distributed GPU Programming for Exascale, an SC/ISC Tutorial

typst

A new markup-based typesetting system that is powerful and easy to learn.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

yhs_sample

Yinghan's Code Sample