Home > english, Interaction, My Experiments > Interactive Media Installation: Sound Drawings

Interactive Media Installation: Sound Drawings

February 18th, 2011 Leave a comment Go to comments

In the end of november I was a part of the Sound & Vision 4 concert for Music and Media Technology at the Anton Bruckner University.The Sound & Vision concert serie allows young musician and audio-visual artists to present their new experimental artworks and installations.

Poster

Programme #1

Programme #2

 

 

 

 

 

 

 

In my installation "Sound Drawings" the musicians can use their instruments for drawing an abstract painting. The pitch and the volume of their instruments paint the canvas with an harmonious-sensitive-line-based brush (a digital ribbon brush). The installation tries to put the aesthetic experience of music and visual on an equipollent level. Usually , the music defines the visual experience (see the battle between DJs and VJs) or vice versa. The realtime visual feedback gives the musicians an additional channel for improving and influencing their improvised perfomance. The musicians are oriented towards the visual aesthetics of their drawing and their bandmates. New sounds and musical aesthetics can emerge.

Emily Stewart (violin) and Mira Lu Kovacs (singer) performed three different parts. These parts were influnced by transforming the coordinate systems of the canvas.

  1. Part: Against each other : Volume axis are  reflected | Painting | MP3
  2. Satz: Rotation : Volume and Pitch axis are rotated through 90° | Painting | MP3
  3. Satz: Together : Both using the same coordinate system | Painting | MP3

Drawing Part No. 1

Drawing Part No. 2

Drawing Part No. 3

 

 

 

 

 

 

 

Technical implementation:

The whole software is written in Max/MSP/Jitter. The ribbon brush is strongly based on Mr. Doob's Harmony Drawing application. For this installation I ported the original Web JavaScript version to a Max MSP working version. After the porting process I extended the application with a multiple brush ability. In the end it was possible to use several brushes at the same time. The sound and pitch tracking is done by the external Max MSP object Fiddler. This object works nice for voices and string instruments. Also the color management uses the data of the Fiddler object in combination with a pre-defined color set.

Equipment:
- Dell Latitude E6400 2,66GHZ Notebook
- M-Audio Fast Track Ultra Soundkarte (2 channels)
- HD Beamer
- Max/MSP 5 (Software)
- Harmony Open Source Project (JavaScript)
- Fiddler Project

Acknowledgement:

Big thanks to Andreas Weixler for the technical support, his great advice to use the Fiddler object for sound analyzing, and of course for getting the invitation for his Sound & Vision concert serie. Furthermore, big thanks to Mira and Emily for their great performance, feedback  and their patience during calibrate the software. The whole work was a real pleasure. Thx!

  1. April 16th, 2013 at 21:49 | #1

    A very nice project about the harmonics of visual and auditive signals.

    The Harmonic Series

  2. admin
    May 25th, 2013 at 16:25 | #2

    Again another nice project space palette of combining visuals and music together

    http://spacepalette.com/
    http://blog.makezine.com/2013/05/17/space-palette-music-and-visuals-in-one-fluid-motion/

  3. admin
    May 25th, 2013 at 17:54 | #3

    Additionally, Tunetrace – iOS app by Ed Burton converts drawings to music

  1. February 23rd, 2011 at 13:49 | #1
  2. July 27th, 2011 at 15:58 | #2