tommyteavee / freehandvr

In Depth Real Time Hand Tracking and Shape Detection for VR

FreeHandVR

Originally created in our school hackathon, Hack HW 2019. Won first place. VR Game in Unity with more immersion via real time xyz hand tracking and hand shape detection (reflects in-game). Many bugs as of now, but will be smoothed out and hopefully turned into an usable Unity plugin for all.

Games utilizing these features will be developed in separate branch or repo.

Old Hackathon Repo: https://github.com/bitsbywill/freehandvr

Created by:

• Will Liu (BitsByWill)
• Lukas Seklir (lukasswiss)
• Will Farhat (willf668)
• Yvette Copeland (yvettejade)
• Kosi Nwabueze (kosinw)

Roadmap (Lukas) :

1. Auto-calibration
2. Larger range in skin tone
3. Depth
4. Hand shapes
5. Finger tracking
6. Finger rotation
7. Improving accuracy
8. Hand size tracking
9. Use shaders, convolution filters, and image kernels to improve tracking and accuracy (hopefully, even use GPGPU)