With emphasis on the audio and haptic components of
virtual reality design
Course Schedule
Week 1:
Monday, June 26
- Morning Lecture (9:00-12:00):
- Historical: views of perception
- Opening remarks and Virtural Reality overview (Brent)
- History of Virtual Reality (Brent)
- History of Music Technology (Craig)
- Gestalt theory in historical context (Dan)
- Behaviorial Psychology, Cognitive Psychology (Dan)
- Afternoon Laboratory (2:00-5:00):
- Group discussion: History of synthesis technology. With DX7, VL1, & NeXT demos (2:00-3:00)
- Hands on events (in rotating groups) (3:00-4:00)
- Tape-editing (Sile)
- Protoboards, oscilloscopes, potentiometers (Craig and Brent)
- Studio mixing (Dan)
- Instrument Scour (4:00-4:10)
- Convene in Studio for Event Recording. (4:15-5:00).
Tuesday, June 27
- Morning Lecture (9:00-12:00):
- Psychological:
- Introduction to Projects (Brent)
- Experiment design and execution (Dan)
- Modern Gestalt theory with demonstrations (Dan)
- Demonstrations of apparent motion (Dan)
- Physiological:
- Auditory Sensors . by Deborah Zetes, Applied Mechanics, Stanford
- Special Session (1:00-2:00):
- NeXT Tutorial (Craig and Brent)
- Afternoon Laboratory (2:00-3:30):
- Auditory Demonstrations (Dan)
- Them Skulls
- The Basilar Mime
- Tour of the Archive of Recorded Sound (3:30-5:00)
Wednesday, June 28
- Morning Lecture (9:00-12:00):
- Physiological:
- Psychological:
- Somatosensory, Hierarchical Control (Brent)
- Anticipatory Control, Motor Learning (Brent)
- Gesture Recognition with the CyberGlove by Sid Fels
- Afternoon Laboratory (2:00-5:00):
- Armchair Psychophysics
- Human Telerobot
- Echo Experiment
- Source Localization Experiment
- Radar ears
- Wednesday evening: Cocktail Party effect (Group experiment)
Thursday, June 29
- Morning Lecture (9:00-12:00):
- Dimensional: aspects of Psychoacoustics
- Wave physics (Brent)
- Bark scale, dB scale, contours of equal loudness (Craig)
- Comparative perception in the visual, aural, and haptic domains (Sile)
- Special Session (1:00-2:00)
- Early Computer Music in Argentina by Fernando von Reichenbach
- Afternoon Laboratory (2:00-3:30):
- Spectrum Analysis
- Mini-lecture: The missing fundamental (Craig)
- Fun with a spectrum analyser
- Graphing personal Fletcher-Munsen equal-loudness curves
- Introduction to Facilities (in rotating groups) (3:30-5:00)
- BioMuse (Bill Putnam)
- Touchback Keyboard (Brent)
- MIDI Studio / NeXT sound demo (Craig)
- Radio Drum (Fernando)
Friday, June 30
- Morning Lecture (9:00-12:00):
- Perceptual:
- Haptic Interface Design (Brent)
- Motor control: The virtual wall (Brent)
- Pitch perception (Sile) (JRP?)
- Distance perception (Craig)
- Flanging and reverberation (Sile)
- Masking (Craig)
- The Doppler effect (Brent)
- Afternoon Laboratory (2:00-5:00):
- Mini-lecture on projects (participants present project proposals)
- McGurk effect (Craig)
- Navigation by ear, echo location (Sile)
Saturday, July 1
- Special Guests: Karon MacLean (MIT) and Paul Millman (Northwestern) available intermittently for consultation on haptics projects!
- Instructors available for consulting on projects
Week 2:
In the second week, half of each laboratory session is devoted to
assisted work on individual projects.
Monday, July 3
- Morning Lecture (9:00-12:00):
- Voice lectures by Perry Cook (CCRMA)
- Audio Quality Measures by Bill Putnam (CCRMA)
- Afternoon Laboratory (2:00-5:00):
- Voice acoustics: getting in touch with your hidden articulators. (Perry)
- Simultaneity Study (Brent)
- Mini-lecture: The head-related transfer function (HRTF) (Brent)
Tuesday, July 4
- Field trip to the Musee Mechanique (Cliff House) and the
Exploratorium
in San Francisco. Watch the fireworks at Crissy Fields (back at 11:00 pm).
Picnic may be scheduled.
Wednesday, July 5
- Morning Lecture (10:00-1:00):
- Sense of Time in Music George Barth
- 3D Audio by Beth Wenzel (NASA)
- Afternoon Laboratory (2:00-5:00):
- Periodicity and pitch perception.
- Impulse Engine Demonstrations by Louis Rosenberg (Immersion Corp.)
Thursday, July 6
- Morning Lecture (9:00-12:00):
- Binaural Demonstrations by Dick Duda (SJ State University)
- Computational source segregation/Speech synthesis and recognition
by Malcolm Slaney (Interval Research)
- Afternoon Laboratory (2:00-5:00):
- Field Trip to
DesignSpace, Stanford CDR (Tim Lacey)
- Precedence Effect
- Participant project presentations
Friday, July 7
- Interaction Design by Bill Verplank
- Closing Comments (Brent)
- Participant project presentations
- diploma/doughnut distribution.
Saturday, July 8
- Nothing -- classes ended Friday!
- However, instructors will be available to assist porting projects to home platforms.
Pictures of Moose, and the celletto/javelin: