mard1no Goto Github PK

ai-system

System for AI Education Resource.

aitemplate

AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.

appy

APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to OpenMP, and automatically compiles the annotated code to GPU kernels.

attorch

A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.

auto-round

SOTA Weight-only Quantization Algorithm for LLMs

awesome-gpu

Awesome resources for GPUs

awesome-llm-system-papers

awesome-system-for-machine-learning

A curated list of research in machine learning systems (MLSys). Paper notes are also provided.

baidu-allreduce

bytetransformer

optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052

cachegen

cachelib

Pluggable in-process caching engine to build and scale high performance services

causal-conv1d

Causal depthwise conv1d in CUDA, with a PyTorch interface

cccl

CUDA C++ Core Libraries

cmake-examples

Useful CMake Examples

concurrencyinaction

cpp-concurrency-in-action-2ed

C++11/14/17/20 multithreading, involving operating system principles and concurrent programming technology.

cuassembler

An unofficial cuda assembler, for all generations of SASS, hopefully ：）

cublas-test

cuda-ppt

cuda-samples

Samples for CUDA Developers which demonstrates features in CUDA Toolkit

cuda-training-series

Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)

cudalibrarysamples

CUDA Library Samples

cudnn-frontend

cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it

cute-gemm

cutlass-kernels

cutlass_ex

study of cutlass

cutlass_master

CUDA Templates for Linear Algebra Subroutines

cutlass_quant

Playing with quantization

cv-cuda

CV-CUDA™ is an open-source, graphics processing unit (GPU)-accelerated library for cloud-scale image processing and computer vision.