Research Presentation/Artist Talk: A Show-and-Tell with Joachim Gossmann and Max Neupert
Preview of our research to be presented at the mmix/icme in San Jose: A Remix Instrument Based on Fragment Feature- Analysis. We present an innovative remix-instrument that allows to create music from a collection of audio-visual media fragments. A three-dimensional scatter plot derived from feature-analysis becomes a Theremin-inspired instrument that enables exploration, intuitive navigation and embodied performance of the media fragments on a granular level. As an example, we are using the audiovisual recording of an instrmental performance as source for interactive remix.
Our system provides an alternative interface to the musical instrument’s audiovisual corpus: as the instrument’s sound and behavior can be accessed in ways which are not possible on the original instrument, the resulting non-linear playback of the grains generates an instant remix in a cut-up aesthetic–a novel strategy to access and re-use media fragments in the domain of musical interfaces.