CANCELED: Using Neural Nets for Sonic Interaction Design
This workshop has been canceled; we are planning to offer it again in 2022.
Advances in the field of AI and Machine learning have enabled musicians new opportunities for music generation and sound detection. In this workshop, we explore how to design interactions that use sound detection algorithms, and how to perform lightweight music generation. Workshop participants will be introduced to these tools and taught how to incorporate them into interactive applications. After exploring a simple example interaction participants will be free to explore their own ideas for interaction.
This workshop is intended for musicians, makers, engineers, computer scientists, etc. Basic programming capability is assumed, but the workshop is open to everyone who is game to try something new.
Participants will need to bring their own laptops for this workshop. We will provide further details on installing software prior to the workshop.
About the Instructors
Wendy Ju is an Associate Professor in the Dept. of Information Science at Cornell Tech's Jacobs Technion-Cornell Institute, where she leads the Future Autonomy Research (FAR) Lab. Her work focuses on ways that interactive devices like robots and autonomous vehicles can communicate with people without interrupting or intruding.
Professor Ju taught Physical Interaction Design at CCRMA from 2008-2012, and collaborated with Professor Edgar Berdahl to create CCRMA Satellite, a platform for building embedded musical instruments and embedded art installations. She holds a PhD in Mechanical Engineering from Stanford, and a MS in Media Arts & Sciences from MIT. Her monograph, The Design of Implicit Interactions, is available from Morgan and Claypool.
David Goedicke is a PhD Candidate at Cornell Tech in Wendy Ju’s Lab. David has been playing, composing and experimenting with music since he was five. For his research, David prototypes systems to design and test behaviors of autonomous systems. His work has involved a variety of technical fields, from realtime audio generation in Max and C++, over embedded systems development for interactive devices to Virtual and Augmented Reality.