qdot / syncydink

A web based video player that supports multiple viewing modes, haptic formats, and output devices

SYNCYDINK IS NO LONGER MAINTAINED

This repo has been archived and neither it or the app will be updated anymore. If you would like to fork and create your own version, feel free. There's more info in this github issue.

SyncyDink

SyncyDink is (going to be) a web based video player and encoder (once we're done with it), using:

• vue.js for frontend
• video.js for 2D movies
• aframe for 180SBS/360 Spherical movies

On top of these systems, Syncydink provides a way for users to load haptics files to synchronize with movies. Supported haptics hardware includes:

• Fleshlight Launch
• Lovense Toys
• Vorze A10 Cyclone
• XInput Gamepads
• Anything else the Buttplug library for your platform might support

This hardware can be accessed via:

• WebBluetooth in Chrome on Linux, macOS, ChromeOS, and Android 6 or higher (All except gamepads)
• buttplug-csharp on Windows

Supported Haptic File Formats:

• Funscript Format (json format)
• Feelme Format (json format)
• VirtualRealPlayer Format (ini format)
• RealTouchScripter Format (RealTouch format)

Support The Project

If you find this project helpful, you can support our projects via Patreon! Every donation helps us afford more hardware to reverse, document, and write code for!

License

Syncydink is BSD licensed.

Copyright (c) 2017-2018, Nonpolynomial Labs LLC
All rights reserved.

Redistribution and use in source and binary forms, with or without
modification, are permitted provided that the following conditions are met:

* Redistributions of source code must retain the above copyright notice, this
  list of conditions and the following disclaimer.

* Redistributions in binary form must reproduce the above copyright notice,
  this list of conditions and the following disclaimer in the documentation
  and/or other materials provided with the distribution.

* Neither the name of the project nor the names of its
  contributors may be used to endorse or promote products derived
  from this software without specific prior written permission.

THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE
FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

syncydink's Issues

Add haptic file playback

Use the haptic-movie-file-utils package to read haptic commands and play them back when the player time updates.

Sidenav not scrollable on Mobile Safari iOS 10.3

Action:
Made sidenav large enough to need scrolling (connect to buttplug server, scan, show device)

Expected:
Can scroll up/down

Actual:
Cannot scroll

• Chrome 59 Linux/Android: Works
• Firefox 56 Nightly (Windows/Linux): Works
• Safari iOS 10.3: Broken
• Safari macOS 10.1.1: Works
• Microsoft Edge 40.15063: Works

Implement Code splitting to keep buttplug-js from being uglified

Currently we have webpack add everything to one big chunk, which is then minified by UglifyJSPlugin. This mangling ends up breaking buttplug, as we make some hard assumptions about class naming/fetching that screw up when classes are changed. We should split Buttplug into its own webpack chunk that won't be minified against the rest of the project.

Integrate AFrame component for VR movie playing

Add a patreon button to the UI

Should show up in top right corner, disappear on movie load.

Add a toy selection mechanism for VRP haptic files with Kiiroo/Lovense commands

Some VirtualRealPorn files contain haptic commands for both Kiiroo and Lovense. Allow the user to choose which one of these to use.

Mobile should play inline and force user to choose fullscreen

Auto-fullscreening mobile loses the user access to the side menu. Make user specifically choose fullscreen.

Add animation to show that scanning is happening

UI not responding to different media sizes

For all of the work we're doing with things like material, the UI is not currently showing up as reactive. We probably need some top level containers we're missing or something.

Fix video.js font inclusion

vue-video-player uses require to bring in a font file. We're apparently not copying it to the right place, because we can never see the font in the player.

Selection area on video timeline is way too small

The selection area on the video timeline is like, 3-5px high. It's almost impossible to hit on the first time with a mouse click.

Devices should stop on pause or deselecting in device list

If the users pauses a video, or deselects a device while a video is playing, that device should stop whatever it's doing.

Bring up syncydink website

Welp. We now own syncydink.com. Just bring up a simple single page app website for it, point to repo and buttplug.world installation.

Create "About" tab on side panel

Need to show license links, github repo, more patreon, etc.

"Stop Scanning" button should go back to "Start Scanning" on ScanningFinished message

Create simple timeline in d3

Should just load points and zoom.

Add handling for Kiiroo translation to Launch

Translate code from Kiiroo emulator in Buttplug.

Rewrite vue-video-player in typescript

The vue-video-player is a fairly simple wrapper around video.js, that works ok enough. However, it lacks type symbols, some of the font loading doesn't seem to play well with our type system, etc. It should be fairly easy to reimplement it in typescript, and gives us more flexibility in working with video.js, since we may be doing odd stuff with it.

Show ping timeout/connection error messages in UI

If there is a disconnection for some reason, we don't display why it happened.

Log messages not showing up in log panel

Make video player take up as much of screen as possible

Right now the video player just takes up a set height. It should maximize to the size of the browser.

DeviceRemoved should remove from device list

Right now we only add, don't remove.

Clear device list on disconnect

If we're disconnected, we shouldn't list any devices.

Throw errors on haptics files without proper time sorting

Assume all event files should be sorted by time. Throw if not.

Show warning dialog on lack of proper bluetooth radio

If a user doesn't have a radio that will work for Syncydink, they should be warned after hitting the "start scanning" button. This warning should ideally emit from buttplug-js.

Buttplug Panel hamburger button UI

The hamburger button should:

• Turn red and stay visible when not connected to a buttplug server
• Turn green and fade out when connected.
  • Should fade in when pointer comes within a certain proximity.
  • Should be visible when video paused or stopped

iOS video controls show up under lower browser bar

Using 100vh to maximize video player height on inline causes the movie controls to render under the lower browser controls in portrait mode on iOS.

Everything is fucking horrible.

Swipe gestures don't work on top of sidenav in Chrome 59 (Android)

Action:
Swipe left on top of sidenav to close

Expected:
sidenav closes

Actual:
sidenav doesn't move

• Chrome 59 Linux/Android: Broken
• Firefox 56 Nightly (Windows/Linux): Works
• Safari iOS 10.3: Works
• Safari macOS 10.1.1: Works
• Microsoft Edge 40.15063: Works

Create right sidenav for encoding

Create right sidenav for encoding options. Should be swipable similar to left sidenav. May also need its own hamburger or something.

Only send messages to devices selected in device list

Don't reference outside font sets

We fetch video.js and material fontsets from CDNs right now. Syncydink is supposed to be completely self-hosted, so we need to make sure we fold those sets into this.

Add large background image to start

Just use the buttplug logo until we figure out something for an actual logo.

Add script timeshift feature

Scripts should be playable even when movies have different in/out points. Provide a way for users to shift script time to match movies manually.

Create movie and haptic file selection UI

Start application by asking for movie and haptic file to load. Should show side by side file inputs, with icons (?) to help.

encydink: built-in haptic video encoder

Build basic video encoding capabilities into Syncydink. This should basically replicate the Blender UI for the moment, meaning:

• Zoomable timeline with all actions
• Points on timeline should be selectable/movable/deletable
• Keyboard overrides
  • move forward/backward in movie
  • 0-9 for position entry
• Output to funscript (other formats can come later)
• Timeline playhead position should follow movie if movie is play. Similarly, if playhead is scrubbed, movie should react accordingly

Buttplug panel needs client name setter

Currently syncydink announces to the buttplug server that it is "Buttplug Panel". Applications consuming the panel control should be able to set the client name so that it's clear what's connected to the server.

Add starting helper text to UI

Prompt users to swipe right or hit hamburger button

Add panel tabs for buttplug connection and movie management

Add tabs to the slideout component, so we can choose between buttplug connection config and movie config (client, movie/haptics reloading, etc)

Change hierarchy of haptics/movie playing components

Haptics should live above all the movie player components, so we can just have one place to load/fetch/convert commands, no matter what our player is.

Buttplug message names getting mangled by uglifier?

2017-07-13 09:28:27.9933|TRACE|ButtplugJsonMessageParser|Got JSON Message: [{"t":{"Id":5,"ClientName":"SyncyDink Video Player"}}]
2017-07-13 09:28:27.9933|TRACE|ButtplugJsonMessageParser|Message serialized to: [{"Error":{"ErrorCode":3,"ErrorMessage":"Message does not conform to schema: ArrayItemNotValid: #/[0]\n{\n  NoAdditionalPropertiesAllowed: #/[0].t\n}\n","Id":0}}]

Only seems to throw in certain browser instances, so may be a caching thing?

Show what devices we support on the platform syncydink is running on.

Implement WebVR Viewer

Implement WebVR based movie viewer with haptics sync

Divide aframe/VR Capabilities into own component and module

Being able to lazy load the VR stuff would reduce our first paint time by somewhere around 30%. It's the bulkiest part of our bundle at the moment.

Show server connection status somehow.

We don't know when we are/aren't connected right now.

Add translation from Launch to Vibration

Translate launch position to vibration with 3 ramp styles:

• Linear
• Linear-V (Go bottom then back to top on each command, mostly for Cock Hero)
• Logarithmic
• Exponential

Create events every .05-.1s between launch events.

Add Kiiroo command to launch translation

Translate https://github.com/metafetish/buttplug-csharp/blob/master/Buttplug.Apps.KiirooEmulatorGUI/KiirooMessageTranslator.cs into typescript

Fix license type comment on Fleshlight Simulator

Should be BSD-3-Clause, not MIT.

https://github.com/metafetish/syncydink/blob/43a2e5390cdac791cf60c24f394a3677304b5cba/src/components/ButtplugSimulator/FleshlightLaunchSimulator/FleshlightLaunchSimulator.ts#L88

Implement VrVideoPlayer component for Aframe scene setup

Implement a new Vue component that takes care of aframe setup for movie viewing

Force wss:// only when hosted from https

Probably also need to figure out how to present this to users.

Add Vorze message conversion

Convert Funscript haptics commands for use with the Vorze A10 Cyclone SA. ScriptPlayer already has this functionality, can probably borrow from there for now.