Gesture Signal Processing and Music

From CCRMA Wiki

(Difference between revisions)
Jump to: navigation, search
(Gesture and Measuring Movement)
(Gesture and Measuring Movement)
Line 19: Line 19:
** Proportional to force (Newton's 2nd law of motion: F = ma )
** Proportional to force (Newton's 2nd law of motion: F = ma )
* Jerk: j = da/dt
* Jerk: j = da/dt
 +
 +
== Interlude #1: Open Sound Control ==
 +
* Open Sound Control: http://opensoundcontrol.org/
 +
* iPod Touch has 3 axis accelerometer
 +
* We will use TouchOSC to transmit accelerometer data as OSC messages over wifi to Max/Pd
 +
** http://hexler.net/software/touchosc
 +
 +
== Interlude #2: Filtering of Audio Signals ==
 +
* Can view any sound as being composed of sinusiodal waves at different frequencies
 +
* A filter removes energy at only certain frequencies:
 +
**A low-pass filter removes high freqs.
 +
**A high-pass filter removes low freqs. 
 +
** A band-pass only lets certain middle frequencies through.

Revision as of 00:28, 12 October 2009

Contents

Gesture and Measuring Movement

  • What is a gesture? Physical. Bodily: hands, face, posture. Non-verbal. What do gestures communicate? Is a gesture more like a button or a handle?
  • What is a musical gesture?

Techniques for measuring human movement

Really basic physics

  • Position: x
  • Velocity: v = dx/dt
  • Acceleration: a = dv/dt
    • Proportional to force (Newton's 2nd law of motion: F = ma )
  • Jerk: j = da/dt

Interlude #1: Open Sound Control

Interlude #2: Filtering of Audio Signals

  • Can view any sound as being composed of sinusiodal waves at different frequencies
  • A filter removes energy at only certain frequencies:
    • A low-pass filter removes high freqs.
    • A high-pass filter removes low freqs.
    • A band-pass only lets certain middle frequencies through.
Personal tools