njhill Goto Github PK

argo

Argo Workflows: Get stuff done with Kubernetes.

client_java

Prometheus instrumentation library for JVM applications

concurrentlinkedhashmap

A ConcurrentLinkedHashMap for Java

curator

Mirror of Apache Curator

etcd

Distributed reliable key-value store for the most critical data of a distributed system

flash-attention

Fast and memory-efficient exact attention

grpc

The C based gRPC (C++, Python, Ruby, Objective-C, PHP, C#)

grpc-java

The Java gRPC implementation. HTTP/2 based RPC

guava

Google core libraries for Java

ibm-common-service-operator

Operator to install IBM Common Services

jamm

Java Agent for Memory Measurements

java-dogstatsd-client

a java statsd client library

jctools

kfserving

Serverless Inferencing on Kubernetes

litelinks-core

High-performance netty and thrift-based microservice RPC library for Java

manifestival

Create, manipulate, apply and delete Kubernetes resource manifests at runtime

metacontroller

Lightweight Kubernetes controllers as a service

mlserver

An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more

modelmesh

Distributed Model Serving Framework

modelmesh-runtime-adapter

Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods

netty

Netty project - an event-driven asynchronous network application framework

optimum

🏎️ Accelerate training and inference of 🤗 Transformers with easy to use hardware optimization tools

rest-proxy

KServe V2 Protocol Rest API Implementation Proxy

serving

A flexible, high-performance serving system for machine learning models

text-generation-inference

Large Language Model Text Generation Inference

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

transformers-bloom-inference

Fast Inference Solutions for BLOOM

vert.x

Vert.x is a tool-kit for building reactive applications on the JVM

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs