David Glowacki and Joseph Hyde - Danceroom Spectroscopy: Generating Coupled Graphics & Sound by Modelling Humans as Energy Fields

Tue, 01/28/2014 - 8:00pm - 9:30pm
CCRMA Classroom, The Knoll 2nd floor, Rm 217
Event Type: 
Guest Lecture
 In this talk, Dr. David Glowacki (Department of Computer Science &  Chemistry, Stanford University & Bristol University) and Professor Joseph Hyde (Department of Music, Bath Spa University) will jointly describe and show danceroom Spectroscopy (dS) – a system which allows an arbitrary number of people to interactively manipulate a molecular physics simulation, and has both scientific and artistic applications. dS works by real-time 3d image capture of people’s motion. The captured images are then processed by a suite of GPU-accelerated algorithms that interpret people’s movements as perturbations within a virtual energy field, embedding them within a real-time molecular simulation, where their movement sculpts the molecular dynamics. A suite of on-the-fly analysis methods are then utilised to analyse and subsequently sonify the molecular dynamics. For example, simple methods such as collision detection, along with more complicated methods that involve dynamical fourier analysis, can be combined and interlaced to construct a generative system whereby users can sculpt real-time soundscapes. The sonic interactivity also works in the opposite direction, allowing a musician to select compositional features which are capable of controlling a range of the physical simulation variables. In this talk, we will present the theory that guides system function, describe some of its recent applications in both artistic & scientific domains, and show the system in action in a number of settings.
Open to the Public
Syndicate content