habanaai Goto Github PK

autogptq

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

deepspeed_old

deepspeedexamples

Example models using DeepSpeed

dl1-workshop

drivers.accel.habanalabs.kernel

fairseq

gaudi-solutions

Full End-to-End examples showing how to use First-gen Gaudi and Gaudi2 in common use cases

gaudi-tutorials

Tutorials for running models on First-gen Gaudi and Gaudi2 for Training and Inference. The source files for the tutorials on https://developer.habana.ai/

gaudi2-workshop

gohlml

HABANA Management Library bindings for Go

habana-ai-operator

habana-container-runtime

Habana container runtime

habana_custom_kernel

Provides the examples to write and build Habana custom kernels using the HabanaTools

habanalabs-k8s-device-plugin

HABANA device plugin for Kubernetes

hccl_demo

hccl_ofi_wrapper

hl-thunk-open

Thunk library for HabanaLabs kernel driver

megatron-deepspeed

Intel Gaudi's Megatron DeepSpeed Large Language Models for training

model-references

TensorFlow and PyTorch Reference models for Gaudi(R)

neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

optimum-habana-fork

Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

papers

Academic papers by Habana research team

pyhlml

pytorch-lightning

The lightweight PyTorch wrapper for high-performance AI research. Scale your models, not the boilerplate.

setup_and_install

Setup and Installation Instructions for Habana binaries, docker image creation

slurm

Slurm: A Highly Scalable Workload Manager

snapshot_for_debug

Snapshot scripts for gathering information about the model and Habana training session for Habana analysis and debug

synapseai_core

SynapseAI Core is a reference implementation of the SynapseAI API running on Habana Gaudi

tpc_llvm

TPC-CLANG compiler that compiles a TPC C programming language which is used in HabanaLabs Deep-Learning Accelerators