Rasterpiece

This paper introduces Rasterpiece, a multimedia environment for direct real-time sound synthesis from images based on the method of raster scanning combining scanning variables (such as sample rate and probe size) with image processing filters.
Rasterpiece enables cross-modal integration of image and sound. By providing an arbitrary number of image windows, each with independent control of sonification parameters and image processing, Raster piece supports simultaneous playback, mixing, and recording of multiple sonification results. Applications include diagnostic exploration of visual data, creative sound design and composition, and real-time multimedia performance. Special attention is paid to its use as a sound particle design tool for pulsar synthesis.

• OS X 10.4 (not compatible with 10.3)
• with Graphic card supporting CoreImage (see here for details)

• Executable: Rasterpiece.zip (Universal binary)
• Xcode project and source codes will be available soon.
• To run this program, StkX should be installed. Installation instruction can be found here, too (RECOMMENDED).

• Run the application, and an empty window (a canvas) will show up.
• Click on the canvas to load an image (Open File dialog box).
• You can move the current marquee, or draw a new one by mouse-dragging. Every mouse event will evoke the sonification process.
• Right-click (or CTRL-click) on canvas will change the play mode of current canvas.
• Use inspector panel to change play rate, volume, pan settings, and apply visual filters.