aiworkspace Goto Github PK

gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.

ggml

Tensor library for machine learning

ggml-template

GGML Template Is All You Need

ggml.hpp

GGML rewrite in C++ Template

gloo

Collective communications library with various primitives for multi-machine training.

gpt-engineer

Specify what you want it to build, the AI asks for clarification, and then builds it.

gpt4all

gpt4all: an ecosystem of open-source chatbots trained on a massive collections of clean assistant data including code, stories and dialogue

gptcache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

gptq

Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

gpu_poor

Calculate GPU memory requirement & breakdown for training/inference of LLM models. Supports ggml/bnb quantization

grok-1

Grok open release

guidance

A guidance language for controlling large language models.

haystack

:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

hip

HIP: C++ Heterogeneous-Compute Interface for Portability

hipify

HIPIFY: Convert CUDA to Portable C++ Code

horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

json.c

Fast JSON parser for C

kasmvnc

Modern VNC Server and client, web based and secure

kompute

General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). Blazing fast, mobile-enabled, asynchronous and optimized for advanced GPU data processing usecases. Backed by the Linux Foundation.

kubeflow

Machine Learning Toolkit for Kubernetes

langchain

⚡ Building applications with LLMs through composability ⚡

langfuse

Open source observability and analytics for LLM applications

lavis

LAVIS - A One-stop Library for Language-Vision Intelligence

libfabric

Open Fabric Interfaces

llama

Inference code for LLaMA models

llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device.

llama.cpp

Port of Facebook's LLaMA model in C/C++

llama2.c

Inference Llama 2 in one file of pure C

llama3

The official Meta Llama 3 GitHub site

llamaapi-python