karenpeng / motionemotion

emotion & gesture-based arpeggiator and synthesizer

motionEmotion

motionEmotion is an emotion & gesture-based arpeggiator and synthesizer.
It uses the webcam to detect points of motion on the screen and tracks the user's emotion. It draws triangles between the points of motion, and each triangle represents a note in an arpeggio/scale that is determined by the user's emotion.

Libraries

• clmtrackr.js Face tracking / emotion detection
• Tone.js Sound synthesis / sequencing
• delaunay.js Delaunay triangulation

Collaborators

• Karen Peng motion detection and visual design
• Jason Sigal sound design
• Special Thanks for T.K. Broderick and Yotam Mann for music suggestion and inspiration.

motionemotion's Issues

Upgrade Tone.JS / Web Audio

Web Audio API changes have caused the version of Tone.js (r2) to stop working in newer versions of Chrome. Tone is now on r7, I need to see how much the API has changed or if a simple upgrade will do the trick.

camra doesn't work in chrome

limiter!

This is really cool!

I'd add a limiter, if possible. It sent a few bursts to my machine, one of which was monstrous (see pic).

does not work on my machine

motionemotion.herokuapp.com/:4 Mixed Content: The page at 'https://motionemotion.herokuapp.com/' was loaded over HTTPS, but requested an insecure stylesheet 'http://fonts.googleapis.com/css?family=Play'. This content should also be served over HTTPS.
Tone.js:62 The Web Audio autoplay policy will be re-enabled in Chrome 70 (October 2018). Please check that your website is compatible with it. https://goo.gl/7K7WLu
(anonymous) @ Tone.js:62
root.define @ Tone.js:28
(anonymous) @ Tone.js:38
Tone.js:580 Tone.js r2
11Tone.js:647 Uncaught TypeError: Failed to set the 'value' property on 'AudioParam': The provided float value is non-finite.
    at Tone.Signal.setValue (Tone.js:647)
    at triggerBass (arp.js:202)
    at TimelineEvent.doCallback (Tone.js:3927)
    at processIntervals (Tone.js:3438)
    at Tone.Transport._processTick (Tone.js:3395)
    at Tone.js:3220
Tone.Signal.setValue @ Tone.js:647
triggerBass @ arp.js:202
TimelineEvent.doCallback @ Tone.js:3927
processIntervals @ Tone.js:3438
Tone.Transport._processTick @ Tone.js:3395
(anonymous) @ Tone.js:3220
setTimeout (async)
Tone.Clock._processBuffer @ Tone.js:3216
camera.js:44 [Deprecation] URL.createObjectURL with media streams is deprecated and will be removed in M71, around December 2018. Please use HTMLMediaElement.srcObject instead. See https://www.chromestatus.com/features/5618491470118912 for more details.
(anonymous) @ camera.js:44
13Tone.js:647 Uncaught TypeError: Failed to set the 'value' property on 'AudioParam': The provided float value is non-finite.
    at Tone.Signal.setValue (Tone.js:647)
    at triggerBass (arp.js:202)
    at TimelineEvent.doCallback (Tone.js:3927)
    at processIntervals (Tone.js:3438)
    at Tone.Transport._processTick (Tone.js:3395)
    at Tone.js:3220
Tone.Signal.setValue @ Tone.js:647
triggerBass @ arp.js:202
TimelineEvent.doCallback @ Tone.js:3927
processIntervals @ Tone.js:3438
Tone.Transport._processTick @ Tone.js:3395
(anonymous) @ Tone.js:3220
setTimeout (async)
Tone.Clock._processBuffer @ Tone.js:3216