Course Information
Class: M+W 12:30-2:20pm
Location: CCRMA Classroom (the Knoll)
Required Textbook: Ge Wang. Artful Design: Technology in Search of the
Sublime. Stanford University Press, 2018. (Available in the Stanford Bookstore)
Prerequisite: prior programming experience
Course Summary
This lab and project-based course explores how we can physically interact with real-time electronic sound. Students learn to use and design sensors, circuits, embedded computers, communication protocols and sound synthesis. Advanced topics include real-time media, haptics, sound synthesis using physical model analogs, and Human-Computer Interaction (HCI) theory and practice. Course culminates in musical performance with or exhibition of completed design projects.
Topics include:
- Sound synthesis (i.e., waveshape, additive, subtractive, AM, FM, sample-based, granular, physical modeling, etc.)
- Sound processing/audio effects (i.e., modulation, flanging, phasing, chorus, echo, reverb, pitch shift, vocoder, wah/filtering, etc.)
- The Faust programming language
- Microcontrollers (Teensy) programming
- Fundamentals of electronics, sensors, and prototyping
- Embedded (RPI) and mobile (Android and iOS) systems
- Computer Assisted Design (CAD) and digital fabrication (3D printing and laser cutting)
- Digital lutherie and musical interface design
- Haptics
Assignments
There will be assignments every week until week 5 after which students will be able to focus on final projects. Assignments are due the following week on Wednesday before class. Late days are not allowed.
Grading
- Assignments: 50%
- Final project: 50%
Schedule
Week 1
Jan. 7: Intro + Overview of the Field of New Interfaces for Musical Expression
Jan. 9: Sound Synthesis Basics in Faust
Lab/Assignment: Faust Basics
Week 2
Jan. 14: Guest Lecture by Ge Wang: Bodies Matter: The Art of Interface Design
Jan. 16: Electronic Basics + Sensors + Mapping + MIDI Control in Faust
Lab/Assignment: Sensors Control in Faust
Week 3
Jan. 21: Advanced Sound Synthesis in Faust
Jan. 23: History of Music Controllers
Lab/Assignment: "Hybrid" Instruments
Week 4
Jan. 28: Digital Fabrication I
Jan. 30: Digital Fabrication II
Lab/Assignment: Prototyping, Manufacturing, and Digital Fabrication
Week 5
Feb. 4: Embedded and Mobile Systems
Feb. 6: Haptics
Lab/Assignment: Haptics
Week 6
Feb. 11: Guest Lecture by Roger Linn
Week 7
Feb. 18: Guest Lecture by Jordan Rudess
Support/Resources
- Faust Website: https://faust.grame.fr
- Faust Kadenze Course: https://www.kadenze.com/courses/real-time-audio-signal-processing-in-faust/info
- Teensy Website: https://www.pjrc.com/teensy