0xdti Goto Github PK

0xdti.github.io

composable-datasets

Transform JSONL Q&A datasets to instruct format with ease

cpp-langchain

Tool for executing C/C++ code snippets with Langchain Agents.

gradientascent-jax

Custom gradient ascent solver (optimizer) for JAX/Flax models

griffin-jax

Jax implementation of "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"

hvm

A massively parallel, optimal functional runtime in Rust

jax-triton

jax-triton contains integrations between JAX and OpenAI Triton

kmeansops

PyKeops Powered K-Means Clustering Algorithms Module both on CPU & GPU

kserve

Standardized Serverless ML Inference Platform on Kubernetes

langchain

🦜🔗 Build context-aware reasoning applications

lmppl-cli-csv-wrapper

A tiny CLI wrapper around lmppl for Pre-Trained Language Models Perplexity Calculation for CSV files

longconv-jax

Jax/Flax/Linen implementation of "Simple Hardware-Efficient Long Convolutions for Sequence Modeling"

megabyte-pytorch-ds

Modificated DeepSpeed training setup fork of MEGABYTE - PyTorch by lucidrains, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

minif2f-code

Dataset of formal Olympiad-level mathematics problems solved with Python code instructions.

mixture-of-depths-jax

Jax module for the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"

mpi-ds

MPI Operator DeepSpeed Base Configuration for CIFAR-10

palm-rlhf-pytorch-ds

Modificated DeepSpeed training setup fork of RLHF (Reinforcement Learning with Human Feedback) by lucidrains on top of the PaLM architecture. Basically ChatGPT but with PaLM

python-template

Python Package Template is all you need

ring-attention-jax

Packaged Ring Attention with Blockwise Transformers for Near-Infinite Context implemented in Jax + Flax.

simba

A simpler Pytorch + Zeta Implementation of the paper: "SiMBA: Simplified Mamba-based Architecture for Vision and Multivariate Time series"

smooth-activations

Smooth ReLU activations in CUDA. Shamir, G., I. et al.

synthtot

SynthToT: Generate synthetic dataset for your training dataset through deliberate problem-solving et al S Yao, 2023.

tri-rmsnorm

Efficient kernel for RMS normalization with fused operations, includes both forward and backward passes, compatibility with PyTorch.

triton-activations

Collection of neural network activation function kernels for Triton Language Compiler by OpenAI

xlstm-jax

Jax implementation of x-LSTM: Extended Long Short-Term Memory by Beck et al. (2024)

xlstm-resources

Resources about xLSTM by Sepp Hochreiter

zeta

Build high-performance AI models with modular building blocks