aiworkspace Goto Github PK

prompttools

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate).

pycuda

CUDA integration for Python, plus shiny features

qlora

QLoRA: Efficient Finetuning of Quantized LLMs

radeonrays_sdk

Radeon Rays is ray intersection acceleration library for hardware and software multiplatforms using CPU and GPU

raft

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.

rag-stack

🤖 Deploy a private ChatGPT alternative hosted within your VPC. 🔮 Connect it to your organization's knowledge base and use it as a corporate oracle. Supports open-source LLMs like Llama 2, Falcon, and GPT4All.

rccl

ROCm Communication Collectives Library (RCCL)

rocm

AMD ROCm™ Platform - GitHub Home

rwkv-runner

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.

s.a.t.u.r.d.a.y

A toolbox for working with WebRTC, Audio and AI

scoop

Scoop - Prompt templates are similar to drawing scoops with a gourd

sentencepiece

Unsupervised text tokenizer for Neural Network-based text generation.

squeezellm

SqueezeLLM: Dense-and-Sparse Quantization

starcoder.cpp

C++ implementation for 💫StarCoder

streaming

A Data Streaming Library for Efficient Neural Network Training

sweep

Sweep is an AI junior developer

tensor2tensor

Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.

tiny-dream

Tiny Dream - An embedded, Header Only, Stable Diffusion C++ implementation

token-hawk

WebGPU LLM inference tuned by hand

torchscale

Transformers at any scale

transnormerllm

ucc

Unified Collective Communication Library

ucx

Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

usearch

Fastest search engine in a single file - supporting C++ 11, C 99, Python 3, JavaScript, Rust, Java, GoLang, Objective-C, Swift, Wolfram, on Linux, MacOS, Windows, iOS, Android, Docker, and WebAssembly 🔍

vega

AutoML tools chain

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

xla

A machine learning compiler for GPUs, CPUs, and ML accelerators

zep

Zep: A long-term memory store for LLM / Chatbot applications