DIA
From CCRMA Wiki
Contents
DIA: Do It A Cappella and iDIA
Premise / Idea
- Very little objective feedback in a capella rehearsal
- Singers need a way to visualize their performance so they can reflect upon it
- Need a visual feedback system for a cappella singers that can be used alone or together as an ensemble
- Learning tool to train the voice and the ears are very helpful
- Want management tools which a director can use to better monitor performers
Motivation
- A large population of amateur a cappella singers who lack the necessary ear training to effectively self-correct
- Need for an objective method of performance evaluation to eliminate confusion over "who's hearing it right"
- Desire to explore basic real-time audio information retrieval techniques
- The appeal of a game that can help you improve!
What is DIA?
- Above all, DIA is a real-time visualization tool for use by one or more vocal performers
- A network application allowing multiple singers to use laptops to see personalized visualizations provided by a host computer
- Vocal training application providing error and deviance visualization and post-performance statistics
- A music learning tool for people who can't read music
- Or, for those who just want to have fun!
Design
- Multi-track MIDI file loaded on start-up, to which voices are to be compared
- Multiple inputs connect to one host computer (Server/Director)
- Networked client computers can connect to the Server
- Clients, however, do almost no processing, but instead display information sent from the server
- Clients will receive channel-specific data from the server, like pitch
- Pitch information will be determined by implementing a version of the YIN pitch detection algorithm
- Clients may also listenfor data from other users
- Performance error will be calculated with respect to deviation from MIDI arrangement
- Deviation from both the closest note and the 'correct' midi note are represented both numerically and visually
Testing / Usage
- The Harmonics, a Stanford a cappella group, will be able to put DIA through comprehensive, rigorous testing (hopefully starting this Winter)
- System allows for easy addition of features
- As the program becomes more comprehensive, it will have added value for the user
- Effectiveness of execution will be judged based on ability to provide accurate and useful visual feedback to the user
Team
- the DIA Team
- Charlie Forkish - Jay Bhat
Milestones (Revised)
- DATE 1: 11/15 - accurate and robust implementation of YIN pitch detection algorithm with one input and playback of midi files
- DATE 2: 12/4 - support for multiple inputs and polished visual feedback
- DATE 3: 12/10 - distribution to multiple client computers over network and statistics report
Future Work / Addons
- Brightness Feedback
- Tonal/Vowel Information
- More 'musical' display (e.g. notes, accidentals)
- Playback of MIDI scores
- Pausing
- Starting Mid-way, Resuming, Jumping in
- Pitch Bend
- More extensive report card
iDIA
- Extension of DIA planned as a more single-user oriented model
- Meant to be able to sing along with any track of any Midi file
- Ultimately meant for normal people to learn to sing their favorite songs better
- Performances are scored and stored for later playback
- Concept of being able to sing along with other people who did the same thing
- Being able to only hear other people in your own locality
- Still a work in progress!