crunch-mediaworks / nnstreamer

:twisted_rightwards_arrows: Neural Network (NN) Streamer, Stream Processing Paradigm for Neural Network Apps/Devices.

NNStreamer

Neural Network Support as Gstreamer Plugins.

NNStreamer is a set of Gstreamer plugins that allow Gstreamer developers to adopt neural network models easily and efficiently and neural network developers to manage stream pipelines and their filters easily and efficiently.

Architectural Description (WIP)

NNStreamer: Stream Processing Paradigm for Neural Networks ... [pdf/tech report]
GStreamer Conference 2018, NNStreamer [media] [pdf/slides]
Naver Tech Talk (Korean) [media] [pdf/slides]
ResearchGate Page of NNStreamer

Official Releases

Arch	Tizen	Ubuntu	Android/NDK Build	Android/APK	Yocto
	5.5	16.04/18.04	7.0/N	7.0/N	TBD
arm	Available	Available	Ready	WIP	WIP
arm64	Available	Available	Ready	WIP	Planned
x64	Available	Available	N/A	N/A	N/A
x86	Available	N/A	N/A	N/A	N/A

• Ready: CI system ensures build-ability and unit-testing. However, we do not have automated release & deployment system for this instance.
• Daily Release: (WIP)

Objectives

• Provide neural network framework connectivities (e.g., tensorflow, caffe) for gstreamer streams.

  • Efficient Streaming for AI Projects: Apply efficient and flexible stream pipeline to neural networks.
  • Intelligent Media Filters!: Use a neural network model as a media filter / converter.
  • Composite Models!: Multiple neural network models in a single stream pipeline instance.
  • Multi Modal Intelligence!: Multiple sources and stream paths for neural network models.

• Provide easy methods to construct media streams with neural network models using the de-facto-standard media stream framework, GStreamer.

  • Gstreamer users: use neural network models as if they are yet another media filters.
  • Neural network developers: manage media streams easily and efficiently.

Maintainers

• MyungJoo Ham

Reviewers

• Jijoong Moon
• Geunsik Lim
• Sangjung Woo
• Wook Song
• Jaeyun Jung
• Hyoungjoo Ahn
• Parichay Kapoor
• Dongju Chae

Components

Note that this project has just started and many of the components are in design phase. In Component Description page, we describe nnstreamer components of the following three categories: data type definitions, gstreamer elements (plugins), and other misc components.

Getting Started

For more details, please access the following manual.

• Press Here

Usage Examples

• Example apps (stable)
• Wiki page usage example screenshots (stable)

CI Server

• CI service status
• TAOS-CI config files for nnstreamer.