Difference between revisions of "MakerFaire"

From CCRMA Wiki
Jump to: navigation, search
(Introduction)
Line 6: Line 6:
 
Maker Faire website: [http://makerfaire.com]
 
Maker Faire website: [http://makerfaire.com]
  
==Magnjo - The Magnetically Augmented Banjo==
+
== Touchboard==
[[Image:Magnjo.jpg]]
+
Magnjo is a fretless banjo that has magnets under its fingerboard to provide haptic feedback to a performer. The magnets are oriented in harmonic locations (similarly to frets) to inform the performer of tonal locations along the string. In order to feel the magnets, the performer must wear finger wrappings with iron fabric in them. Thus the performer's fingers are informed of the locations along the fingerboard corresponding to notes in the chromatic scale.
+
  
 +
ADD PICTURE
  
==Haptic Drum ==
+
The Touchboard is a hand-made music controller fashioned out of a
[[Image:HapticDrum.jpg]]
+
solid block of Padauk.  It was motivated by an interest in the
 +
interaction with physical objects and the types of gestures these
 +
objects invite. In my experience, objects that possess external beauty
 +
generate a presence unto themselves, and thus influence the resulting
 +
musical interactions.  In addition to providing fifteen  touch-sensitive sensors, the Touchboard's objective is to inspire the creation of customized and satisfying software performance systems.  
  
The word haptic comes from Greek and pertains to the sense of touch.
+
The Touchboard is based on sensors that detect position and pressure
The haptic drum harnesses the power of force-feedback to assist drummers
+
applied by the performers fingertips.  The controller also sports
in playing parts that would otherwise be difficult or impossible. This
+
eight LED lights and an encoder.  Using an Arduino microcontroller
patent-pending device consists of a drum pad, a DSP, an amplifier, and a
+
board, sensor data is transmitter between the touchboard and a  
woofer. Whenever a drumstick impacts the drum pad, the woofer
+
computer via USB.  
gives a small push in the upward direction, adding energy to the
+
bouncing drumstick.  
+
  
== Kalichord==
 
[[Image:Kalichord.jpg]]
 
  
The Kalichord is a two-handed electro-acoustic instrument which acts as a controller for a physical string model.  The user plucks virtual strings with one hand while playing bass lines with the other. 
+
==OOCSCC==
  
==GRIP MAESTRO ==
+
ADD PICTURE
[[Image:Grip.jpg]]
+
  
 +
The ooscc is an open source/hardware controller that communicates over  
 +
ethernet via the open sound control protocol.  It is meant to be an  
 +
open platform for computer music control.
  
The GRIP MAESTRO is a hand-exerciser that has been modified into a resistive one- or two-handed musical controller. The GRIP MAESTRO Mach 1 uses magnets and Hall Effect Sensors to detect the position of each of the exerciser's six pad-springs and sends this information to ChucK to drive musical synthesis, or other sound manipulation. The GRIP MAESTRO Mach 2 (presently in development) expands on this control structure by adding accelerometer data into the mix and by giving the player two GRIP MAESTOs, one for each hand. The goal of this interface is to provide real force resistance as feedback to the performer and thereby establish an engaging relationship between the performer and his/her audience.
+
ooscc:
 +
stands for open open sound control controller.
 +
is an open source/hardware controller that communicates via the open sound control protocol.
 +
is intended as a replacement for common MIDI controllers.  
 +
is meant to help DIYers transition from MIDI to better methods of communication.  
 +
communicates via ethernet (via wi-fi is a future goal).
 +
can be powered by USB or a 5V DC adapter. Battery power is also a possibility.
 +
is open-ended, and will eventually allow interfacing with both analog and digital inputs and outputs.
 +
is currently very much in beta stages.
 +
http://www.experimentalistsanonymous.com/ooscc/
  
== Turntable Gestures for Computer Mediated Performance==
+
== Lattice Harp==
[[Image:DJs.jpg]]
+
  
Imagine if a computer can recognize turntablist moves, and depending
+
ADD PICTURE
on your scratch, respond musically!!!
+
  
Turntable Gestures for Computer Mediated Performance by Jason Sadural
+
The Lattice Harp is a two-dimensional stringed instrument which  
and Mike Gao explores the exciting field of gesture recognition
+
simultaneously functions as a musical instrument and controller.  
applied to turntable techniques.
+
  
Utilizing ChucK, pD and Max MSP, turntable gestures used by two scratch
+
https://ccrma.stanford.edu/~craffel/hardware/latticeharp/
DJs are sent across the network via OSC, to a single computer far far away.
+
  
When this computer recognizes that a particular move has been executed
+
==ReactPad==
by one of the DJs,the gesture is decomposed, and the pertaining data is sent back across
+
the network. Movements on the turntable are used to:
+
  
- seed algorithmic composition
+
ADD PICTURE
- seed algorithmic sound design
+
- control Ableton Live
+
- control algorithmic adjustment of groove / micro-timing
+
- facilitate scalar navigation of a tonal space
+
- control visuals
+
  
As an added novel bonus, a regular optical mouse has been converted
+
The ReactPad is a music app for the iPhone based on the ReacTable. By adding pieces to the ReactPad, you can create different types of sounds and explore different shapes of music synthesis. Each piece has assigned one different function, that you can modify by rotating it. The ReactPad can also use your voice as an input, save and load patches over the Internet, and even use the accelerometer to move the pieces around the pad!
into an infrared turntable tracker, providing an inexpensive DIY
+
The ReactPad makes use of the accelerometer, audio, and OpenGL, STK and the Mopho API.
interface for turntable gesture capture.
+
https://ccrma.stanford.edu/~urinieto/256b/ReactPad/
  
==JSASSynth - Modular Audio Synthesis for the Web==
+
==Growl Hero==
JSASSynth is a graphical programming environment, similar to Max/MSP or PD, that is written for the web. It uses HTML, CSS and Javascript for its user interface and Flash for its audio synthesis engine.  This means that it is a portable solution for modular audio synthesis, since most of the web browsing public already uses these features.  This project is an example of integrating synthesized audio into a webpage without depending on Flash for the user interface.  By using Flash's ExternalInterface API, JSASSynth can create and control a modular synthesizer that is playing inside of a hidden Flash animation.
+
Growl Hero is a beta game that detects your Growls/Screams while you sing a metal song. Like Singstar/Rockband but it detects screams. It is a a free, open-source app for Mac (Linux version coming soon) developed by Uri Nieto as the final project for the course Music-256a, at CCRMA, Stanford University.
  
 +
https://ccrma.stanford.edu/~urinieto/256/GrowlHero/
 +
 +
 +
==Edgar Robothands==
 +
 +
 +
In 1963, Max Mathews wrote that any perceivable sound could be produced using digital sound synthesis. However, any perceivable sound can also be produced using mechanical sound synthesis: states of the digital sound synthesis algorithm can be implemented mechanically. In other words, some of the digital bits used by the algorithm can be represented by mechanical vibrating objects rather than purely electronic bits. Today implementing these mechanical connections is expensive, so in practice, we are limited to only a few points of mechanical/haptic interconnection.
 +
 +
Edgar Robothands explores mechanical sound synthesis by employing robots to play physical percussion instruments. There are five points of mechanical interconnection. At the first four points, a shaker, egg, tambourine, and snare drum are played by "slave" robots. The fifth point is the "master" robot that Edgar holds in his hand. He can play any of the physical instruments by teleoperating it through the master robot with force feedback. During teleoperation, the trajectory of the master robot is recorded into wavetable loops in Max/MSP. At later times during the piece, these loops are played back, providing for mechanical synthesis with an especially human feel, even when the loops are played back irregularly or at superhuman speeds.
 +
 +
Edgar Berdahl is a visiting scholar at CCRMA. He has been studying how force feedback can be incorporated into the design of novel musical instruments.
 +
 +
==kat 6 ==
 +
 +
kat 6 is an interactive art installation and data visualization/sonification project which at its core is a musical instrument.  It sources a local or network based meteorological database
 +
from the National Oceanographic and Atmospheric Administration (NOAA) consisting of weather data (wind speed, direction, atmospheric density and geographic location) for Hurricane Katrina.  The user 'plays' the instrument by moving through the hurricane with a special 3 dimensional mouse, analogous to flying through the storm and experiencing what it
 +
might be like at that location and elevation in the hurricane itself, not unlike a 'Hurricane Hunter' aircraft from which some of the data
 +
originates.
 +
 +
A sound and video system surrounds the player who interacts with the
 +
database using a haptic 3­D mouse/controller typically used for gaming.
 +
The storm characteristics at the area pointed to by the mouse are
 +
rendered by an actual physical model of the atmosphere in that spot.
 +
The storm experience is simultaneously represented with sound
 +
(noise/storm sounds), visuals (violent cloud movement), and haptics
 +
(vibration/jerking) from the controller.  With the controller, the user
 +
can move from the calm extremities of the storm into the more violent
 +
areas near the eye and experience a physically modeled representation of
 +
what it might sound, look and feel like.
 +
 +
 +
==GRIP MAESTRO ==
 +
 +
ADD PICTURE
 +
 +
The GRIP MAESTRO is a hand-exerciser re-imagined as a musical instrument via its augmentation with sensors and communication with software mappings.   Magnet/Hall effect sensor pairs are placed under each of four finger-pads and two beneath a palm-pad, to measure their displacement by the performer's hand, and an accelerometer is used to capture the performer's gestures with the instrument in space.  Connected to a computer through an Arduino nano microcontroller, the signals from these sensors are carefully mapped using Max/MSP and then passed to ChucK for sound (or video) creation and manipulation.
 +
 +
== El Dinosaurio==
 +
 +
ADD PICTURE
 +
El Dinosaurio is an analog synthesizer I designed and built from scratch a long time ago (it was finished in 1981). It stayed silent for a long time but after adding a MIDI to CV interface a couple of years ago it is now being used live in concert in some of my pieces.
 +
 +
==Sounds of mimes ==
 +
 +
This project incorporates graphics and sound with the use of an
 +
innovative controller by madcatz.  The controller consists of a box on
 +
the floor with wires that come out and connect to gloves that the
 +
player wears.  While wearing the glove and watching the screen, a
 +
player can imitate actions such as bowling, fishing, and bow and arrow
 +
to make the appropriate sonic response through multiple speakers.
 +
There is even a sonic wall where someone can act like a mime and knock
 +
on the invisible wall.
  
==Catch Your Breath==
 
Catch Your Breath is an installation version of an interactive auditory bio-feedback project currently underway with the Stanford medical school, which is designed to reduce respiratory irregularity in patients undergoing 4D CT scans for oncological diagnosis. It is a potential means to reduce motion-induced distortion in CT and MRI images. The installation version consists of a pendant donning a fiduciary marker. This marker is detected by a webcam and the motion of the subject's breathing is tracked and interpreted as real-time variable tempo adjustment to a stored musical file. The subject can then adjust his/her breathing to synchronize with a separate music track consisting of an accompaniment to the subject's music. When the breathing is regular and at the desired tempo the audible result sounds synchronous and harmonious.
 
  
 
==Software Tools==
 
==Software Tools==
Line 90: Line 139:
 
Pd, Jack and Jaaa - Real-time audio tools
 
Pd, Jack and Jaaa - Real-time audio tools
  
==Hardware Tools==
 
In our [http://ccrma.stanford.edu/courses/250a/ courses], we use a prototyping kit based on Atmel AVR microcontrollers, with Pascal Stang's [http://hubbard.engr.scu.edu/embedded/avr/boards/index.html#avrminiv40 AVRmini] at the core. To the AVRmini, we attach an I2C LCD display, solderless breadboard strips, a loudspeaker and sometimes a MIDI jack. In student lab exercises and for prototyping, we hook up sensor circuits on the breadboard and send control signals to a Linux PC over USB, serial, MIDI or Ethernet in order to control open source real-time sound synthesis and processing software. These prototypes are then often built into larger-scale music and interactive sound art projects like the ones below that we will demonstrate at the Maker Faire.
 
  
[[Image:Avrboard.jpg]]
+
 
  
  

Revision as of 21:20, 30 March 2010

Kalichord.jpg

Introduction

The Center for Computer Research in Music and Acoustics (CCRMA -- pronounced "karma") is an interdisciplinary center at Stanford University dedicated to artistic and technical innovation at the intersection of music and technology. We are a place where musicians, engineers, computer scientists, designers, and researchers in HCI and psychology get together to develop technologies and make art. In recent years, the question of how we interact physically with electronic music technologies has fostered a growing new area of research that we call Physical Interaction Design for Music. We emphasize practice-based research, using DIY physical prototying with low-cost and open source tools to develop new ways of making and interacting with sound. At the Maker Faire, we will demonstrate the low-cost hardware prototyping kits and our customized open source Linux software distribution that we use to develop new sonic interactions, as well as some exciting projects that have been developed using these tools. Below you will find photos and descriptions of the projects and tools we will demonstrate.

Maker Faire website: [1]

Touchboard

ADD PICTURE

The Touchboard is a hand-made music controller fashioned out of a solid block of Padauk.  It was motivated by an interest in the interaction with physical objects and the types of gestures these objects invite. In my experience, objects that possess external beauty generate a presence unto themselves, and thus influence the resulting musical interactions.  In addition to providing fifteen touch-sensitive sensors, the Touchboard's objective is to inspire the creation of customized and satisfying software performance systems.

The Touchboard is based on sensors that detect position and pressure applied by the performers fingertips.  The controller also sports eight LED lights and an encoder.  Using an Arduino microcontroller board, sensor data is transmitter between the touchboard and a computer via USB.


OOCSCC

ADD PICTURE

The ooscc is an open source/hardware controller that communicates over   ethernet via the open sound control protocol.  It is meant to be an   open platform for computer music control.

ooscc: stands for open open sound control controller. is an open source/hardware controller that communicates via the open sound control protocol. is intended as a replacement for common MIDI controllers. is meant to help DIYers transition from MIDI to better methods of communication. communicates via ethernet (via wi-fi is a future goal). can be powered by USB or a 5V DC adapter. Battery power is also a possibility. is open-ended, and will eventually allow interfacing with both analog and digital inputs and outputs. is currently very much in beta stages. http://www.experimentalistsanonymous.com/ooscc/

Lattice Harp

ADD PICTURE

The Lattice Harp is a two-dimensional stringed instrument which   simultaneously functions as a musical instrument and controller.

https://ccrma.stanford.edu/~craffel/hardware/latticeharp/

ReactPad

ADD PICTURE

The ReactPad is a music app for the iPhone based on the ReacTable. By adding pieces to the ReactPad, you can create different types of sounds and explore different shapes of music synthesis. Each piece has assigned one different function, that you can modify by rotating it. The ReactPad can also use your voice as an input, save and load patches over the Internet, and even use the accelerometer to move the pieces around the pad! The ReactPad makes use of the accelerometer, audio, and OpenGL, STK and the Mopho API. https://ccrma.stanford.edu/~urinieto/256b/ReactPad/

Growl Hero

Growl Hero is a beta game that detects your Growls/Screams while you sing a metal song. Like Singstar/Rockband but it detects screams. It is a a free, open-source app for Mac (Linux version coming soon) developed by Uri Nieto as the final project for the course Music-256a, at CCRMA, Stanford University.

https://ccrma.stanford.edu/~urinieto/256/GrowlHero/


Edgar Robothands

In 1963, Max Mathews wrote that any perceivable sound could be produced using digital sound synthesis. However, any perceivable sound can also be produced using mechanical sound synthesis: states of the digital sound synthesis algorithm can be implemented mechanically. In other words, some of the digital bits used by the algorithm can be represented by mechanical vibrating objects rather than purely electronic bits. Today implementing these mechanical connections is expensive, so in practice, we are limited to only a few points of mechanical/haptic interconnection.

Edgar Robothands explores mechanical sound synthesis by employing robots to play physical percussion instruments. There are five points of mechanical interconnection. At the first four points, a shaker, egg, tambourine, and snare drum are played by "slave" robots. The fifth point is the "master" robot that Edgar holds in his hand. He can play any of the physical instruments by teleoperating it through the master robot with force feedback. During teleoperation, the trajectory of the master robot is recorded into wavetable loops in Max/MSP. At later times during the piece, these loops are played back, providing for mechanical synthesis with an especially human feel, even when the loops are played back irregularly or at superhuman speeds.

Edgar Berdahl is a visiting scholar at CCRMA. He has been studying how force feedback can be incorporated into the design of novel musical instruments.

kat 6

kat 6 is an interactive art installation and data visualization/sonification project which at its core is a musical instrument.  It sources a local or network based meteorological database from the National Oceanographic and Atmospheric Administration (NOAA) consisting of weather data (wind speed, direction, atmospheric density and geographic location) for Hurricane Katrina.  The user 'plays' the instrument by moving through the hurricane with a special 3 dimensional mouse, analogous to flying through the storm and experiencing what it might be like at that location and elevation in the hurricane itself, not unlike a 'Hurricane Hunter' aircraft from which some of the data originates.

A sound and video system surrounds the player who interacts with the database using a haptic 3­D mouse/controller typically used for gaming. The storm characteristics at the area pointed to by the mouse are rendered by an actual physical model of the atmosphere in that spot. The storm experience is simultaneously represented with sound (noise/storm sounds), visuals (violent cloud movement), and haptics (vibration/jerking) from the controller.  With the controller, the user can move from the calm extremities of the storm into the more violent areas near the eye and experience a physically modeled representation of what it might sound, look and feel like.


GRIP MAESTRO

ADD PICTURE

The GRIP MAESTRO is a hand-exerciser re-imagined as a musical instrument via its augmentation with sensors and communication with software mappings.   Magnet/Hall effect sensor pairs are placed under each of four finger-pads and two beneath a palm-pad, to measure their displacement by the performer's hand, and an accelerometer is used to capture the performer's gestures with the instrument in space.  Connected to a computer through an Arduino nano microcontroller, the signals from these sensors are carefully mapped using Max/MSP and then passed to ChucK for sound (or video) creation and manipulation.

El Dinosaurio

ADD PICTURE El Dinosaurio is an analog synthesizer I designed and built from scratch a long time ago (it was finished in 1981). It stayed silent for a long time but after adding a MIDI to CV interface a couple of years ago it is now being used live in concert in some of my pieces.

Sounds of mimes

This project incorporates graphics and sound with the use of an innovative controller by madcatz.  The controller consists of a box on the floor with wires that come out and connect to gloves that the player wears.  While wearing the glove and watching the screen, a player can imitate actions such as bowling, fishing, and bow and arrow to make the appropriate sonic response through multiple speakers. There is even a sonic wall where someone can act like a mime and knock on the invisible wall.


Software Tools

Planet CCRMA at Home is a collection of open source programs that you can add to a computer running Fedora Linux to transform it into an audio/multi-media workstation with a low-latency kernel, current audio drivers and a nice set of music, midi, audio and video applications (with an emphasis on real-time performance). It replicates most of the Linux environment we have been using for years here at CCRMA for our daily work in audio and computer music production and research. Planet CCRMA is easy to install and maintain, and can be upgraded from our repository over the web. Bootable CD and DVD install images are also available. This software is free.

http://ccrma.stanford.edu/planetccrma/software


Ardour sm.png

Ardour - Multitrack Sound Editor


[[Image: Hydrogen sm.png]]

Hydrogen - Drum Sequencer


Pd-jack-jaaa sm.png

Pd, Jack and Jaaa - Real-time audio tools