frankxyy Goto Github PK

alpa

Training and serving large-scale neural networks

dssm

A BiGRU-Attention DSSM implementation with tensorflow estimator.

fastllm

纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行

lightseq

LightSeq: A High Performance Library for Sequence Processing and Generation

llm_inference

onnx

Open standard for machine learning interoperability

rasa

💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants

server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

serving

A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）

spring-boot

Spring Boot

stopwords-json

Stopwords for 50 languages in JSON format

text-gen-service-launch

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

tvm2

tvm_mlir_learn

tvm learn

xlnet

XLNet: Generalized Autoregressive Pretraining for Language Understanding