Figure 15. The "control object" block in VRAPL enables users to control the physics of virtual objects using audio signals.
Here, the user starts with a bongo that plays an impact sound when hit. Then, they write the program "5.34 + 5.30 * SqrOsc( freq = 1 )" to inform the force in the y direction on a drumstick-like cylinder. This results in a signal that alternates between roughly 10 (enough to overcome gravity and allow the cylinder to rise up) and roughly 0 (allowing the cylinder to fall back down).
Next in the video, the user looks through and then enters a portal that shows the world without the programming blocks, leaving the user in a world that behaves how they have programmed it.
(See the main page for the journal article.)