xueweilnvidia Goto Github PK

followers: 1.0 following: 0.0 repos: 9.0 gists: 0.0

Type: User

xueweilnvidia's Projects

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch

flux

Official inference repo for FLUX.1 models

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

stablediffusion

High-Resolution Image Synthesis with Latent Diffusion Models

NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications.

tensorrt-llm

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

tensorrt-model-optimizer

TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization and sparsity. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM or TensorRT to optimize inference speed on NVIDIA GPUs.