vickyiii / ryzenai-sw

Ryzen™ AI Software Platform

Introduction

AMD Ryzen™ AI Software Platform includes the tools and runtime libraries for for optimizing and deploying AI inference on your AMD Ryzen™ AI based PC. It enables developers to quickly build and run a variety of AI applications for Ryzen™ AI. It is designed with high efficiency and ease-of-use in mind, unleashing the full potential of AI acceleration on Ryzen™ AI.

This repository contains the demos, examples and tutorials, demonstrating usage and capabilities of the Ryzen™ AI Software Platform. It is a subset of the Ryzen™ AI Software release.

Examples

• Run LLM OPT-1.3B model with ONNXRuntime
• Run LLM OPT-1.3B model with PyTorch
• Run Whipser-tiny model with ONNXRuntime
• Run multiple concurrent AI applications with ONNXRuntime
• Real-time object detection with Yolov8

Demos

• Cloud-to-Client demo on Ryzen AI
• Multiple model concurrency demo on Ryzen AI

Tutorials

• A Getting Started Tutorial with a ResNet50 model
• End-to-end Object Detection
• Quantization for Ryzen AI

Getting Started

To run the demos and examples in this repository, please follow the instructions of README.md in each directory.

Reference

• Ryzen™ AI Developer Guide
• ONNXRuntime Vitis-AI EP
• Quantization with Microsoft Olive
• AMD AI Developer Forum