clouds-interactive-documentary / clouds

CLOUDS Interactive Documentary

CLOUDS

June 12 2014

We're opening up the CLOUDS repo as the beginning of a conversation, as a learning tool. We've all learned a lot from working on this project and had a blast doing it, and we feel like sharing the work is the next step. We hope you enjoy it and find it useful, and would love to hear what you do with it.

Not everything is going to work out of the box, but we'll be adding components and how-tos as we move forward. If you have any questions or problems, open an issue and we'll be happy to help.

Set Up

1. Download the CLOUDS branch of openFrameworks from here.

2. Clone CLOUDS into the OF/apps directory.

3. Run the cloneaddons.sh script to pull all required addons in the appropriate location. Run the following commands in your Terminal:

   cd OF/apps/CLOUDS
   cloneaddons.sh
   

4. While we fix a few things with the open source version, you'll also need to follow the few extra fixes listed here: #41

Structure

• A Visual System is a code module that can be configured to present dynamic generative and interactive graphics. The Visual Systems are artworks and algorithmic examples contributed by artists featured in the documentary, as well as collaborators on the project.
  • Some Visual Systems are original commissioned works by artists represented in the film.
  • Others are canonical examples of algorithms and libraries commonly used in creative coding. Topics explored include computer vision, generative graphics, audio-reactive feedback, physics simulation, and more.
• A Standalone is a project that runs a single Visual System. Standalones can compile for up to three different targets: desktop, Oculus Rift, and Kinect v2 (through OSC). You can find Standalones in the OF/apps/CLOUDS/VSStandaloneName directories.
• The main CLOUDS project is located in the OF/apps/CLOUDS/CLOUDS directory. It currently won't run as it's missing dependencies, but we're working on it. Stay tuned.

Navigation

• f to toggle fullscreen mode
• h to toggle the GUI
• e r t y to re-arrange the GUI

clouds's Issues

VSCircuit

• Slow performance, need to move blip dot offset to shader
• Clipping planes messed up occassionally
• feels empty a lot, needs glow or background or fill mesh

VSWorld

• Replace chroma from default shader
• Additive blending modes for trails
• sphere culling

Intro refinements

• Look-around interactive camera for more dynamic tunnel
• shorter wait time for questions
• Questions closer together
• fix Hold to Select / Click to Select text positioning
• move the cursor to middle and hide it in mouse mode idle
• Bonus: change wireframe geometry to act like Paradox system aesthetically

Questions show up closer to the beginning of acts

VSOpenP5DrawingMachine broken on Windows

Crash on default interlude

When an act ends with no good interlude( no more topics ) it defaults to resetting the system and occasionally crashes. Need a better default interlude.

Mouse Interaction Refinements

• Home Button activation navigational gui at any time
• Add reset click text
• Add link to cluster map to ask new questions
• On Interlude, Reset Continue on click
• Click to begin text instead of circles
• Click activates question nodes in all settings

Lower thirds too close

The lower thirds are too close to my face. I couldn't read the far left or far right.

Missing ofBaseSoundPlayer.cpp

I've poked around in the feature-64bit branch of openFrameworks for this file but it doesn't exist and therefore, a number of the Standalone's can not compile under OS X.

Is this one of CLOUDS missing dependencies?

This is the error:

clang: error: no such file or directory: '/Users/myusername/Desktop/my_root/development/CLOUDS-openFrameworks/openFrameworks/libs/openFrameworks/sound/ofBaseSoundPlayer.cpp'

VSVerletForm

Many of the presets are dark

VHX streaming tests

First steps along the way to having a streaming version working in conjunction VHX

• Mac streaming test
• Windows streaming test
• Log on system test with OAuth + ofxVHX
• Answer on how to handle MP3 Music

VSPhotoglitch 'desktop' preset causes infinite loop

infinite loop in only the desktop preset, not sure why -- disabled this preset for now but want to understand what's happening to be sure it won't happen to others

Some lower thirds did not have a border.

I noticed it on a Casey clip in act one.

VSVectorMath

• Add proper camera projection so the line extends from the cursor
• Find a way to draw lines even if no one is moving the mouse so it doesn't look broken

VSWormholes

• Culling is inverted in x64 version

RTAudio Pop

On Mac RT Audio pops terribly on start up. Happens at RTAudio openStream.

May have to do with the jump from RTAudio 4.0.11 to 4.0.12

Mixer and tonic sound are currently disabled.

Opacity attenuator for cursor

need to be able to control the mouse cursor opacity to hide it when no one is active. can you rig your drawCursor function to take an opacity attenuator from 0.0 - 1.0 so we can fade it in and out

Portal transition a little wonky

When exiting an interview by selecting a side portal, we see a freeze frame for about a second after the current scene fades out and before the next scene fades in.

Barbican Installation Checklist

• loader splash on start up screen
• desktop backgrounds
• auto shut down start up
• ProcessAlive relauncher
• positioning cluster map window for secondary display
• edit registry to show no UI crash dialog

Paths do not work on CloudsVisualSystemEditor

Windows VO needs to be loaded on thread

it causes a serious glitch when loaded on the main thread

Disable EasyCam on MOUSE_INPUT target

Some RGBD interviews are not playing

One was Fernanda, the other I'm not sure. Audio still played though. Maybe a clipping issue?

LIA bio doesn't show up in secondary display

must be a meta data glitch

VSMetaballs

Many presets need visual refinement

• add faceted option for triangulated flat shaded effect
• needs more colors, too many monochrome presets
• many presets are too dark or oversaturated
• dot grids do not obey depth test and feel messy and too dense

LSystem very slow to load & openGL error

LSystem is throwing GL errors and presets cause massive hangs, even in release mode with no debugger attached.

look at gmunk's 01a preset for a reference. just added a VS2012 standalone

If someone isn't interacting, they should get a prompt

Just did a test, people are selecting questions but then are not actively interacting afterwords.

or systems that are interactive, if the mouse doesn't move for a period of time let's give them a slight prompt to interact like we do with the kinect

CLOUDS Installers for Windows & Mac

• Windows installer system
  • Install codecs
  • Install Visual Studio re-distributable
  • Install OAList.exe
  • put CloudsData in programfiles
• MAC installer
  • DMG file
  • Data is packaged within the app

VSSeaOfLines

Many of the new presets could benefit from filling the screen much more

LIA's system path bug

Cleanup 2D Video

2D video has several videos that are attached to disabled presets. Let's clean em out

VSVectorMath doesn't draw when the viewer is clicking

VSNeurons

Still needs aesthetic refinements

• Refactor to use meshes
• Change blending modes

Subtitles are showing up as big blocks of text

seems like alpha bug but alpha is enabled. other type is working fine.

Video player volume doesn't actually fade

seems like the direct show video player volume is not actually working, causing bad glitches at the end of statements

Clean up Photoglitch assets

Lets remove all unused assets from this visual system.

Cleanup Twitter

Twitter has a lot of unnecessary and large files in the ignored folder. @samatt can you make a minimum version of this and pass it along to me?

VSMazeGenerator

• Swap out custom cameras with system level cameras
• Remove clipping artifacts from Oculus

VS Xstatic

Review and slow down several presets

Tonic sounds should work from MP3s

Currently the tonic sounds for Visual Systems only work for aiff files, which creates pretty insane bloated file sizes.

we need a way to compress these and come up with x-platform solution for reading them.

VS Machine

Too slow!! optimize with VBOs

Barcelona/Hangar RGBD video clip is stuck on freeze frame

VSCity

• Remove custom post processor
• Fix color missing on some presets

VSSchlabberbox crashes on windows

array out of bounds errors in a lot of places, also looks like may have unitilaized variables.

disabling for now. @underdoeg want to take a look?

how to fix this?

every time try to build clouds i get this

clang: error: no such file or directory: '/Volumes/GhOsT/Creative Coding/OF/openFrameworks/libs/openFrameworks/sound/ofBaseSoundPlayer.cpp'
clang: warning: -lpthread: 'linker' input unused
Command /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang failed with exit code 1
with exit code 1
how can i fixed

Script for copying only active presets to build folder

Need a system to copy across only enabled presets to the build folder, ignoring those that are not used.

vs complied issue

sorry to open up issue here,does vs version really complied? i download the feature-64bit version,but seems missing some files,etc..
i'll add details here tomorrow,
cheers

alex

VSSwim

• Textures not loading still
• Create new presets that enhance flocking

VSSchlabberbox crashes on windows

array out of bounds errors in a lot of places, also looks like may have unitilaized variables.

disabling for now. @underdoeg want to take a look?

"Interfaces" VO still has no Visual System, disabling for now