Music 256a Homework #2

FaceDeux

“Face1”

About

FaceDeux is an entertaining and whimsical sonic visualizer. It uses sound taken from the computer's built-in microphone, calculates time-domain and frequency-domain representations of the signal, and visualizes different aspects of the sound using these two representations. The features of the visualizer and the sound features they use are broken down below.

  • Eyes: The eyes are visualizing the instantaneous amplitude of the signal. In reality, this is not instantaneous, but rather the successive audio buffers taken from the audio input. For all intents and purposes though, it can be thought of as instantaneous, as it reacts with very low latency to the sound input. This is the classic representation of the signal seen in most audio editing software. However, the signal is mapped to a circle rather than drawn linearly as is typical, thus creating the eyes.
  • Mouth: Both the top and bottom lip are a waterfall plot of the spectral content of the sound. The frequencies are plotted logarithmically along the x-axis, with their amplitudes plotted in the y-axis, and the spectral history plotted in the negative z-axis. The bottom lip also responds to the volume of the sound. The volume can be thought of as a decaying collection of the instantaneous amplitude of the signal; it is analogous to the RMS level of the signal. Thus, the bottom lip moves in response to the loudness of the signal, but in a less reactive way than the eyes do.
  • Color: The colors of both the face and background are more-or-less randomly generated, but the rate at which they change is controlled by the volume measure described above. Thus, they will not change if no sound is present.
  • Other features of the visualizer are described below:

  • Eyebrows: The eyebrows (generated by pressing b) are waterfall plots of the spectral content of the sound, similar to the top lip of the mouth.
  • Confetti: The confetti (generated by pressing c) is another representation of the volume of the sound. As the loudness increases, more confetti is generated.
  • Motion: Motion of the face (generated by pressing space) is randomly-generated, and not controlled by any aspect of the sound.
  • Additional faces: Faces can be added or removed by pressing the + and - buttons respectively. The features of these additional faces are generated in the same manner as the original face.
  • “Face2”

    Project Files

  • README
  • ProjectZip