Summer
Workshops 2008:
Digital Signal Processing: Spectral and Physical Models (DSP)
- Instructors:
Course Description
This course will cover analysis and synthesis of sounds based on spectral and physical models. Models and methods for synthesizing real-world sounds as well as musical sounds will be presented. The course will be organized into morning lectures covering theoretical aspects of the models, and afternoon labs. The morning lectures will present topics such as Fourier theory, spectrum analysis, the phase vocoder, digital waveguides, digital filter theory, pitch detection, linear predictive coding (LPC), high-level feature extraction, and various aspects of signal processing of interest in sound applications.
The afternoon labs will be hands-on sessions using an implementation of SMS in Matlab/Octave, the Synthesis ToolKit in C++, and other software systems and utilities. Familiarity with engineering, mathematics, physics, and programming is a plus, but the lectures and labs will be geared to a musical audience with basic experience in math and science. Most of the programs used in the workshop will be available to take home.
Given the short duration of the workshop and the broad spectrum of topics to cover, the lectures will necessarily be fairly high level in nature. However, a full complement of in-depth readings will be provided for those who wish to investigate the details of the material. Also, the last two days of the workshop will include a more detailed treatment of some advanced topics and the corresponding afternoon labs will give the students a chance to solve some specific problems of their interest.
Schedule
Morning lectures go from 9:00am to 10:30am and from 11:00am to 12:30pm. Afternoon labs go from 2pm to 4pm. Syllabus will be updated daily with links for slides and other material shown in lectures (most documents in .pdf format). For Perry's PCLabs, type </usr/ccrma/web/html/workshops/dsp2008/prc/SETUP#> in your shell[This script will create a 'PRCode' subdirectory in your directory with files with which to work in Lab sessions. # should be substituted with the Lab number of the day]
|
Date |
Time |
Contents |
|
|
Monday, June 23 |
|
Welcome and workshop overview. ( |
|
|
|
|
Basic software tools (snd, ...) (PRC, XJS) Matlab and audio processing (lab-1) (XJS) PCLab1, Fun in the Time Domain (PRC) |
|
|
Tuesday, June 24 |
|
Introduction to spectral processing (slides) (XJS) Digital filters, Modal Synthesis (PRC) |
|
|
|
|
Sounds and their spectra (lab-2) (XJS) PCLab2, Convolution, Filters (PRC) |
|
|
Wednesday, June 25 |
|
The Fourier Transform (slides) (XJS) FFT, Spectral Modeling, Spectral Vocoders (PRC) |
|
|
|
|
Properties of the DFT (lab-3) (XJS) PCLab3 (PRC) |
|
|
Thursday, June 26 |
|
Strings, Bars, Non-Linearity (PRC) The Short-time Fourier transform (slides)(XJS) |
|
|
|
|
PCLab4 (PRC) The STFT (lab-4) (XJS) |
|
|
Friday, June 27 |
|
Tubes and Air Chambers (PRC) Sinusoidal and Sinusoidal+Residual Modeling (I) (slides) (XJS) |
|
|
|
|
PCLab5 (PRC) Spectral Peaks (lab-5) (XJS) |
|
|
Weekend * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * |
|||
|
Monday, June 30 |
|
Sinusoidal and Sinusoidal+Residual Modeling (II) (slides) (XJS) Musical Features from Spectral Analysis (slides) (XJS) |
|
|
|
|
Sinusoidal Modeling (lab-6). (XJS) Harmonic Modeling (lab-7). (XJS) |
|
|
Tuesday, July 1 |
|
Two and Three Dimensional Physical Models (PRC) FOFs, Wavelets, Statistical Particles (PRC) Approaches to Sinusoidal plus Residual Modeling (slides, references) (XJS) |
|
|
|
|
PCLab6. (PRC) Sinusoidal plus Residual Modeling (SMS) (lab-8). (XJS) |
|
|
Wednesday, July 2 |
|
LPC (PRC) Voice Modeling (PRC) |
|
|
|
|
PCLab7. (PRC) PCLab8. (PRC) |
|
|
Thursday, July 3 |
|
Sound and Music Description (slides). XJS) Excitation and Control. Controllers (NIMEPaper, SMACPaper)
(PRC) |
|
|
|
|
PCLab9. (PRC) Spectral Transformations (lab-9). (XJS) |
|
|
Friday, July 4 |
|
Systems, Future Directions. (PRC) Applications based on Sinusoidal plus Residual Modeling (slides) (XJS) |
|
|
|
|
Individual student project time. |
|
References
General Information: Feel free to browse through the "CCRMA Guides" which highlights the available facilities and how to best use them. The document also includes a link to the FAQ's (Frequently Asked Questions)... try to browse through them before asking questions....
|
|
©2008 |
