CCRMA Summer Workshops 2008:

Digital Signal Processing: Spectral and Physical Models (DSP)


* Course Description

This course will cover analysis and synthesis of sounds based on spectral and physical models. Models and methods for synthesizing real-world sounds as well as musical sounds will be presented. The course will be organized into morning lectures covering theoretical aspects of the models, and afternoon labs. The morning lectures will present topics such as Fourier theory, spectrum analysis, the phase vocoder, digital waveguides, digital filter theory, pitch detection, linear predictive coding (LPC), high-level feature extraction, and various aspects of signal processing of interest in sound applications.

The afternoon labs will be hands-on sessions using an implementation of SMS in Matlab/Octave, the Synthesis ToolKit in C++, and other software systems and utilities. Familiarity with engineering, mathematics, physics, and programming is a plus, but the lectures and labs will be geared to a musical audience with basic experience in math and science. Most of the programs used in the workshop will be available to take home.

Given the short duration of the workshop and the broad spectrum of topics to cover, the lectures will necessarily be fairly high level in nature. However, a full complement of in-depth readings will be provided for those who wish to investigate the details of the material. Also, the last two days of the workshop will include a more detailed treatment of some advanced topics and the corresponding afternoon labs will give the students a chance to solve some specific problems of their interest.


* Schedule

Morning lectures go from 9:00am to 10:30am and from 11:00am to 12:30pm. Afternoon labs go from 2pm to 4pm. Syllabus will be updated daily with links for slides and other material shown in lectures (most documents in .pdf format). For Perry's PCLabs, type </usr/ccrma/web/html/workshops/dsp2008/prc/SETUP#> in your shell[This script will create a 'PRCode' subdirectory in your directory with files with which to work in Lab sessions. # should be substituted with the Lab number of the day]

Date

Time

Contents

Monday,

June 23

9:00am -12:30pm

Welcome and workshop overview. (PRC, XJS)
Sound and Music Computing Research: Trends and Challenges (slides) (XJS)
Digital Audio / PCM / Psychoacoustics Intro (PRC)


2-4pm

Basic software tools (snd, ...) (PRC, XJS)

Matlab and audio processing (lab-1) (XJS)

PCLab1, Fun in the Time Domain (PRC)

Tuesday,

June 24

9:00am-12:30pm

Introduction to spectral processing (slides) (XJS)

Digital filters, Modal Synthesis (PRC)


2-4pm

Sounds and their spectra (lab-2) (XJS)

PCLab2, Convolution, Filters (PRC)

Wednesday,

June 25

9:00am-12:30pm

The Fourier Transform (slides) (XJS)

FFT, Spectral Modeling, Spectral Vocoders (PRC)


2-4pm

Properties of the DFT (lab-3) (XJS)

PCLab3 (PRC)

Thursday,

June 26

9:00-12:30am

Strings, Bars, Non-Linearity (PRC)

The Short-time Fourier transform (slides)(XJS)


2-4pm

PCLab4 (PRC)

The STFT (lab-4) (XJS)

Friday,

June 27

9:00am -12:30pm

Tubes and Air Chambers (PRC)

Sinusoidal and Sinusoidal+Residual Modeling (I) (slides) (XJS)


2-4pm

PCLab5 (PRC)

Spectral Peaks (lab-5) (XJS)

Weekend * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *

Monday,

June 30

9:00am-12:30pm

Sinusoidal and Sinusoidal+Residual Modeling (II) (slides) (XJS)

Musical Features from Spectral Analysis (slides) (XJS)



2-4pm

Sinusoidal Modeling (lab-6). (XJS)

Harmonic Modeling (lab-7). (XJS)


Tuesday,

July 1

9:00am-12:30pm

Two and Three Dimensional Physical Models (PRC)

FOFs, Wavelets, Statistical Particles (PRC)

Approaches to Sinusoidal plus Residual Modeling (slides, references) (XJS)



2-4pm

PCLab6. (PRC)

Sinusoidal plus Residual Modeling (SMS) (lab-8). (XJS)


Wednesday,

July 2

9:00am-12:30pm

LPC (PRC)

Voice Modeling (PRC)



2-4pm

PCLab7. (PRC)

PCLab8. (PRC)


Thursday,

July 3

9:00am-12:30pm

Sound and Music Description (slides). XJS)

Excitation and Control. Controllers (NIMEPaper, SMACPaper) (PRC)



2-4pm

PCLab9. (PRC)

Spectral Transformations (lab-9). (XJS)


Friday,

July 4

9:00am-12:30pm

Systems, Future Directions. (PRC)

Applications based on Sinusoidal plus Residual Modeling (slides) (XJS)



2-4pm

Individual student project time.



* References


General Information: Feel free to browse through the "CCRMA Guides" which highlights the available facilities and how to best use them. The document also includes a link to the FAQ's (Frequently Asked Questions)... try to browse through them before asking questions....


ccrma-small-logo

2008 Xavier Serra and Perry Cook. All Rights Reserved.