"The Legend of ConductVR" is an interactive Virtual Reality musical conducting experience themed around the "The Legend of Zelda" video games. Using a Gametrak controller, users can direct the pace and quality of sound of virtual "performers" as they play a piece of music.

Binaries (Windows)

ConductVR requires an Occulus Rift (tested using DK2) and a Gametrak controller.

Instructions:

• Hold both wires of the Gametrak at roughly chest height. Your right hand will be used to "conduct" the pace of the music, and your left hand will be used to control the audio quality of individual performers.
• Sharply whip your right hand down and then back up again to cue each new note of the melody. Don't try to conduct a steady beat: instead, your goal should be to conduct a new downbeat for each new note in the melody. The circles at the top of your view are an indicator of when each new beat should happen: conduct a new downbeat when a solid circle lines up inside the empty circle.
• Your left hand is used to control the sound quality of individual performers. To select a performer to control, look at that performer (they should change color and start hovering up and down), then push the foot pedal on the Gametrak. Your left hand should now control the sound quality of that performer: raise and lower you hand to adjust the volume, and move your hand forward and backward to dampen or release that performer's higher audio frequencies. Release the foot pedal when that performer's instrument sounds as you want it to.

Source

Source files - ofxChucK - ofxOculusDK2

"The Legend of ConductVR" was developed using ofxChucK in OpenFrameworks. In addition to ofxChucK, the ofxOculusDK2 addon was also used. Both of these addons were modified for compatibility purposes (namely, to work in a Windows Code::Blocks installation), so the source files used during development are linked to above. Development was done under Windows 10 using Code::Blocks 13.12.

Screenshots (click for full image)