Coder Social home page Coder Social logo

Add video plugin about zeo HOT 2 OPEN

exokitxr avatar exokitxr commented on August 25, 2024
Add video plugin

from zeo.

Comments (2)

blizking avatar blizking commented on August 25, 2024

We want to add video and audio support inside zeo.
Currently there are no ways to bring in media except for 3D models, which you could drag and drop in. We did have full media support in the old build but took it out to optimize it later i.e. now.

What we essentially need is a plane video player and mono audio output, out of a 'speaker'. Which we can configure later as 2.1, 5.1, 7.1, etc. channels. The plane video player has to be scalable and the ability to make it curved or 360 would be a plus. Currently support for mp4, mkv and avi should be sufficient and mp3 support for audio should be enough too.

This feature has to work both in the Vive and PC.

There are tonnes of resources available for adding 2D/360 video, Here's a link that you might find useful for audio.
http://smus.com/spatial-audio-web-vr/

from zeo.

blizking avatar blizking commented on August 25, 2024

A few other notes for the video playback, The video would be streamed across all users and websocket messages would be used to communicate play, pause and scrubbing between players.

We would also have to add a draw distance to stop video playback for each particular user as they navigate away from the screen. Instead of manually (re-)implementing draw distance and persistence across restarts, we can just make the speakers/screen be objects in the objects module. The objects module already handles loading/unloading based on range and saving data to the backend.

For the audio spatialiazation you can find support for it in our core API over here.
https://github.com/modulesio/zeo/blob/master/core/engines/somnifer/client.js

from zeo.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.