rexryu / bodypixbarracuda

BodyPix for Unity Barracuda

BodyPixBarracuda

BodyPixBarracuda is an implementation of the BodyPix person segmentation and pose estimation model that runs on the Unity Barracuda neural network inference library.

System requirements

• Unity 2020.3 LTS or later

About the ONNX file

I converted the original BodyPix model (provided as tfjs) into ONNX using tfjs-to-tf and tf2onnx. See the Colab notebook for further details.

ResNet support

This package supports the ResNet architecture (more accurate but slower and bigger models) but doesn't contain those ONNX files due to the file size limit of GitHub and npm.js. You can download them from here instead.

To use those models, create a new BodyPix ResourceSet file and set the model, architecture, and stride fields accordingly.

How to install

This package uses the scoped registry feature to resolve package dependencies. Open the Package Manager page in the Project Settings window and add the following entry to the Scoped Registries list:

• Name: Keijiro
• URL: https://registry.npmjs.com
• Scope: jp.keijiro

Now you can install the package from My Registries page in the Package Manager window.