Motivation

This piece is composed by a series of recordings that are created by a combination of real-time audio tracking, tracking a section of a piece of electronic music, and finally tracking a sounds recorded in an arctic wildlife preserve. Software instruments that track these pieces of audio are programmed to spread their signal within a binaural mix depending on the position of the spectral centroid of the original signal.

I decided to vary the software instruments used to track the various realtime and pre-recorded audio components listed above so that they would be most responsive to their audio-counterparts. Often varying the length of the frequency envelope for the software instruments led to interesting results. In addition to generating sounds by singing into the microphone, I decided to track the sound of myself typing away on the keyboard. I tracked this sound by the Stk saxophony instrument, and used it as the introduction to my final audio track. You can listen to the entire track below. I would recommend waring a pair of headphones, since the track is recorded in binaural stereo.

FFT-Based Real-Time Tracking

Final Stereo File: "Synthetic Birds," RealTimeTracking.wav (wear headphones)

Downloads

Chuck

You can listen to the audio file and download the chuck source code files here:

• InstrumentFileTracker.ck
• Binaural4.ck
• StereoRecorder.ck

Intermediate Audio Files

• mandarin.wav
• nature-13.wav
• naturesounds.wav
• rhythmic.wav
• sax.wav
• score.wav

My score of birds and seals in the nature-13 sound file