Coder Social home page Coder Social logo

Longzhi Wang's Projects

act icon act

Run your GitHub Actions locally 🚀

autogptq icon autogptq

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

awesome-llm-inference icon awesome-llm-inference

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

blocksparse icon blocksparse

Efficient GPU kernels for block-sparse matrix multiplication and convolution

botsharp icon botsharp

The Open Source AI Chatbot Platform Builder in 100% C# Running in .NET Core with Machine Learning algorithm.

camp icon camp

飞桨护航计划集训营

deepcache icon deepcache

[CVPR 2024] DeepCache: Accelerating Diffusion Models for Free

docs icon docs

Documentations for PaddlePaddle

eagle icon eagle

EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty

gemma.cpp icon gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.

gemma_pytorch icon gemma_pytorch

The official PyTorch implementation of Google's Gemma models

gligen-gui icon gligen-gui

An intuitive GUI for GLIGEN that uses ComfyUI in the backend

inferllm icon inferllm

a lightweight LLM model inference framework

kivi icon kivi

KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

kvquant icon kvquant

KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

learngit icon learngit

教程→ https://www.liaoxuefeng.com/wiki/896043488029600 推送请使用UTF-8编码

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.