carryyu Goto Github PK

ai-4k

ailearning

AiLearning：数据分析+机器学习实战+线性代数+PyTorch+NLTK+TF2

bilibili-plus

课程视频、PPT和源代码：侯捷C++系列；台大郭彦甫MATLAB

cmake-examples-chinese

快速入门CMake,通过例程学习语法。在线阅读地址：https://sfumecjf.github.io/cmake-examples-Chinese/

code-samples

Source code examples from the Parallel Forall Blog

community

PaddlePaddle Developer Community

cuda-ppt

cuda_freshman

cutlass

CUDA Templates for Linear Algebra Subroutines

docs

Documentations for PaddlePaddle

fastertransformer

Transformer related optimization, including BERT, GPT

flash-attention

Fast and memory-efficient exact attention

flashinfer

FlashInfer: Kernel Library for LLM Serving

hello-algo

《Hello 算法》：动画图解、一键运行的数据结构与算法教程，支持 Java, C++, Python, Go, JS, TS, C#, Swift, Rust, Dart, Zig 等语言。

how-to-optim-algorithm-in-cuda

how to optimize some algorithm in cuda.

how_to_optimize_in_gpu

This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, sgemv, sgemm, etc. The performance of these kernels is basically at or near the theoretical limit.

interview

📚 C/C++

openmlsys-zh

《Machine Learning Systems: Design and Implementation》- Chinese Version

paddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

paddle-inference-demo

paddlefleetx

Paddle Distributed Training Examples. 飞桨分布式训练示例 Resnet Bert GPT MOE DataParallel ModelParallel PipelineParallel HybridParallel AutoParallel Zero Sharding Recompute GradientMerge Offload AMP DGC LocalSGD Wide&Deep

paddlehub

Awesome pre-trained models toolkit based on PaddlePaddle. (400+ models including Image, Text, Audio, Video and Cross-Modal with Easy Inference & Serving)

paddlenlp

👑 Easy-to-use and powerful NLP library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.

ppl.nn

A primitive library for neural network

stable-diffusion-webui

Stable Diffusion web UI

tensorrt-llm

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

xjtu-thesis

西安交通大学学位论文模板（LaTeX）（适用硕士、博士学位）An official LaTeX template for Xi'an Jiaotong University degree thesis (Chinese and English)