jesus-333 / unity-hand-tracking

In this repository I will upload a personal project that use a combination of python script and C# script to create a Unity application with hand tracking and gesture recognition

Unity-Python hand tracking and gesture recognition application

In this repository I uploaded a personal project that use a combination of python script and C# script to create a Unity application with hand tracking and gesture recognition. I use a python script to detect the hand movement and the relative gesture.

A simple video demo is aviable at this link(1). I also made another video demo with a far mored advance hand tracking method that use always the same technique to link Python and Unity. You could find the video at this link(2).

For the code of the advance hand tracking see my other project called Hand Tracking Pytorch. You could find the repository on my profile or following this link.

I upload a pdf report that describe in all details how the code and the unity integration work.

Requirements

The Project NEED Vuforia to work. If you want to install by yourself you can only download the Asset folder (inside the Unity Project folder).

Contacs

If you ever use this code please cite me 🙏 ❤️

If you need to contact my you could write me at [email protected] or [email protected] .

unity-hand-tracking's Issues

Integration of Python and Unity

Hello, Thanks for the codebase. Can you kindly describe how you integrated Python with Unity?

Need help for Human Pose Estimation project using OpenCV and MediaPipe in Unity

Hello, This is not an issue I need some help from you with the following scenario :

I have to work on a Human Pose Estimation project using OpenCV and MediaPipe in Unity. In that, I need to track multiple persons using web camera and I have to generate a 3D coordinates for body joints also I need to control the player using human gestures detection.

Can you please share some of the references for this scenario implementation.

Thanks in advance.

How can you do it for toes?