leapmotion / vrcollage

Experiment w/ Leap Motion and Virtual Reality

Virtual Reality Collage Viewer

View a photo collection from the archives of the (glorious) Union Pacific Railroad in virtual reality, with the benefit of Oculus Rift, Leap Motion, and Mozilla's VR API.

Requires Mozillas Nightly VR build, available here: http://vrhelloworld.com/builds/

Touch photos to slide them accross the screen. Grab photos to move them forwards or backwards in the z-plane.

vrcollage's Issues

Incorrect distortion

Probably need to pass in the correct viewing angles. This should be a good example:

https://github.com/dmarcos/vrHelloWorld/tree/master/examples/webgl
http://swimminglessonsformodernlife.com/vrHelloWorld/examples/webgl/

Lock cards to hand

It would be nifty to have a "hold card" gesture. E.g. hold hand flat, palm facing you, fingers horizontal, and slightly behind and image. Then bring thumb down in front of image to cause a pinch/grab, which holds the image to the palm.

~Currently tracking here is a bit iffy, but it still may be worth exploring.

Measure InteractablePlane performance

Two key methods should be stress tested: getPosition and getZReposition (which is currently known to be slow.)

Travis doesn't help out with this at all: travis-ci/travis-ci#352
Something like this would be ideal: https://www.dartlang.org/performance/

For starters we can just write a test, and manually log the results when they're run. These could potentially even be run in travis

Something like this could get the test results and add them to a graph: https://github.com/travis-ci-examples/webhook

Support bent interactable planes

Planes should be able to be fit to a specific curvature, e.g., a sphere around the user

Support Angled InteractablePlanes

Can't get past Leap mode selection dialog

On Firefox Nightly 39a01 on OSX using DK2 and Leap Motion sensor mounted on HMD. Head and hand tracking both working. Can "highlight" Oculus mounted option but no way to confirm selection. Am I missing a key button or other control mechanism? If I stick my head past dialog I can sometimes see what I believe to be the photo window so I'm guessing the dialog just isn't dismissing properly.

TypeError: this.pointOverlap is not a function

1. Start VRCollage demo in latest FF nightly (36.0a1)
2. Highlight HMD sprite and left click with mouse to begin demo
3. As soon as a hand intersects with collage UI, demo freezes and "TypeError: this.pointOverlap is not a function" is last line of console log (Three.MeshIntersection.js:72)

Allow images to be rotated

by putting one finger behind the frame, and one in front, and causing a torque.

Support deformable interatable planes

e.g., cloth deformation

Add fist-movement gesture

Experiment with Audio

It could be really cool to hear a low-bass note when touching planes. Especially with something like this:

https://www.kickstarter.com/projects/1382889335/woojer-feel-the-sound

Desk mount option not working

The viewport freezes and nothing happens when I select the desk mount option on startup.

Oculus mounted version works.

Hands in the demo are inverted

The hands in the live demo on the gh-page has both hands inverted, you move the right hand and the displayed left hand moves.

Add "ghost hand" instructions

A hand should appear, going through the actions of a motion, explaining to the user how to perform an action

Optimize leap.proximity performance

1: do an audit
2: Notice several large methods, which resist optimization, make them smaller
3: profit

Fix issue where repeatedly closing and opening a stack will cause images to get quite far away

Release Interactable Plane and proximity as standalone libraries

Allow movement of a closed stack