320C 2021 Joss Project

From CCRMA Wiki
Revision as of 00:21, 15 April 2021 by Joss (Talk | contribs) (Structure & Timeline)

Jump to: navigation, search

Project Proposal

Create a plugin which performs "color sonification," using the colors of a video to modulate an accompanying piece of music/audio.

Structure & Timeline

  1. (By End of Week 4): Create script (most likely in Python) which takes a video file as input and outputs three "audio" tracks to be imported into a DAW for use with plugin.
    • Each frame of the video will be subjected to a "color averaging" algorithm
    • Average color will be broken down into its RGB values, one value per track.
    • For initial purposes, restricting project to 24fps video and 48000Hz sampling rate for best compatibility
  2. (By End of Week 5): Design a plugin that uses a single track's information as a "side chain" to control multiband EQ setting specified by user.
    For example, the "Green" track's values might control how much of the EQ'ing is applied at any time.
    • Will likely build off of Faust EQ demo.
  3. four
    four def one
    this looks like a continuation