der hess » Interaction http://blog.derhess.de am medialen werkeln Wed, 01 Feb 2012 12:00:38 +0000 en hourly 1 http://wordpress.org/?v=3.3.1 My most important Twitter Messages #12 http://blog.derhess.de/2011/11/26/my-most-important-twitter-messages-12/ http://blog.derhess.de/2011/11/26/my-most-important-twitter-messages-12/#comments Sat, 26 Nov 2011 20:45:57 +0000 admin http://blog.derhess.de/?p=1723
  • My most important Twitter Messages #6
  • My most important Twitter Messages #10
  • My most important Twitter Messages #11
    • ]]>     Twitter von der hess
    A small summary of my Twitter messages from August - November 2011:

    Allgemein (General)

    Generative Art:

    • Our lecture from the "Design the Future" series at Carnegie Mellon University is now online

    Info Design and Visualization

    UX and Interaction Design:

    Projekte und Experimente (Projects and experiments)

    Neue Technologie (new Technologies)

    Programmierung und Software Design (Programming)

    Physical Computing

    Game Developing:

    Flash and Flex

    Related posts:

    1. My most important Twitter Messages #6
    2. My most important Twitter Messages #10
    3. My most important Twitter Messages #11

    flattr this!

    ]]>     http://blog.derhess.de/2011/11/26/my-most-important-twitter-messages-12/feed/ 0 "     My most important Twitter Messages #11 http://blog.derhess.de/2011/08/31/my-most-important-twitter-messages-11-2/ http://blog.derhess.de/2011/08/31/my-most-important-twitter-messages-11-2/#comments Wed, 31 Aug 2011 10:00:29 +0000 admin http://blog.derhess.de/?p=1683
  • My most important Twitter Messages #6
  • My most important Twitter Messages #4
  • My most important Twitter Messages #5
    • ]]>     Twitter von der hess
    A small summary of my Twitter messages from June - August 2011:

    Allgemein (General)

    Generative Art:

    Info Design and Visualization

    UX and Interaction Design:

    Projekte und Experimente (Projects and experiments)

    Neue Technologie (new Technologies)

    Programmierung und Software Design (Programming)

    Physical Computing

    Game Developing:

    Flash and Flex

    Related posts:

    1. My most important Twitter Messages #6
    2. My most important Twitter Messages #4
    3. My most important Twitter Messages #5

    flattr this!

    ]]>     http://blog.derhess.de/2011/08/31/my-most-important-twitter-messages-11-2/feed/ 0 "     My most important Twitter Messages #10 http://blog.derhess.de/2011/06/09/my-most-important-twitter-messages-10/ http://blog.derhess.de/2011/06/09/my-most-important-twitter-messages-10/#comments Thu, 09 Jun 2011 10:27:54 +0000 admin http://blog.derhess.de/?p=1585
  • My most important Twitter Messages #5
  • My most important Twitter Messages #6
  • My most important Twitter Messages #12
    • ]]>     Twitter von der hess
    A small summary of my Twitter messages from March - June 2011:

    Allgemein (General)

    Generative Art:

    Info Design and Visualization

    UX and Interaction Design:

    Projekte und Experimente (Projects and experiments)

    Neue Technologie (new Technologies)

    Programmierung und Software Design (Programming)

    Physical Computing

    Game Developing:

    Flash and Flex

    Related posts:

    1. My most important Twitter Messages #5
    2. My most important Twitter Messages #6
    3. My most important Twitter Messages #12

    flattr this!

    ]]>     http://blog.derhess.de/2011/06/09/my-most-important-twitter-messages-10/feed/ 0 "     My most important Twitter Messages #9 http://blog.derhess.de/2011/03/24/my-most-important-twitter-messages-9/ http://blog.derhess.de/2011/03/24/my-most-important-twitter-messages-9/#comments Thu, 24 Mar 2011 12:03:53 +0000 admin http://blog.derhess.de/?p=1551
  • My most important Twitter Messages #6
  • My most important Twitter Messages #11
  • My most important Twitter Messages #4
    • ]]>     Twitter von der hess
    A small summary of my Twitter messages from January - March 2011:

    Allgemein (General)

    Generative Art:

    Info Design and Visualization

    UX and Interaction Design:

    Projekte und Experimente (Projects and experiments)

    Neue Technologie (new Technologies)

    Programmierung und Software Design (Programming)

    Physical Computing

    Game Developing:

    Flash and Flex

    Related posts:

    1. My most important Twitter Messages #6
    2. My most important Twitter Messages #11
    3. My most important Twitter Messages #4

    flattr this!

    ]]>     http://blog.derhess.de/2011/03/24/my-most-important-twitter-messages-9/feed/ 0 "     Harmony in Max / MSP with multiple brushes http://blog.derhess.de/2011/02/23/harmony-in-max-msp-with-multiple-brushes/ http://blog.derhess.de/2011/02/23/harmony-in-max-msp-with-multiple-brushes/#comments Wed, 23 Feb 2011 11:47:33 +0000 admin http://blog.derhess.de/?p=1524
  • Mr. Doobs Harmony drawing APP ported to MAX / MSP
  • Mr. Doobs Harmony project ported to Flash AS3
  • My most important Twitter Messages #9
    • ]]>     For my interactive installation "Sound Drawings" I decided to use the Harmony Drawing application. Meanwhile, the single brush version worked pretty stable with the sound analyzing. There was still one thing missing. It would be much cooler if more than one person can draw on the canvas. From the technical view it was very easy to implement. In the beginning I was a little bit scared if the realtime feedback is still good with more brushes at the same time. It was! For this reason here is the source code and my versions of testing for you.

    I prepared a screencast for getting an idea and overview how it works. The principles are exactly the same as in the first version. The only exception is the "brushID" as a new parameter. Every API call uses this syntax:

    apiFunctionName brushID parameter1 parameter2 ...

    For creating a new brush use the command "setBrush brushID brushType". Afterwards you can use the API command "setCoordinate brushID xPos yPos" for drawing programmatically. If you want to use the mouse for drawing you must use the API command "selectBrush brushID" before drawing directly on the canvas!

    All JavaScript codes and Max / MSP patches are included in the example file. For the sound drawing patch you must install the Max MSP Fiddler object, before you can try experimenting.

    Download Harmony with multible brushes

    Related posts:

    1. Mr. Doobs Harmony drawing APP ported to MAX / MSP
    2. Mr. Doobs Harmony project ported to Flash AS3
    3. My most important Twitter Messages #9

    flattr this!

    ]]>     http://blog.derhess.de/2011/02/23/harmony-in-max-msp-with-multiple-brushes/feed/ 0 "     Interactive Media Installation: Sound Drawings http://blog.derhess.de/2011/02/18/interactive-media-installation-sound-drawings/ http://blog.derhess.de/2011/02/18/interactive-media-installation-sound-drawings/#comments Fri, 18 Feb 2011 11:03:42 +0000 admin http://blog.derhess.de/?p=1515
  • Interaktive Installation: Sound Drawings
  • Bewerbungen für den Master in Interactive Media
  • AS3: Interactive Webcam Package 1.2
    • ]]>     In the end of november I was a part of the Sound & Vision 4 concert for Music and Media Technology at the Anton Bruckner University.The Sound & Vision concert serie allows young musician and audio-visual artists to present their new experimental artworks and installations.

    Poster

    Programme #1

    Programme #2

     

     

     

     

     

     

     

    In my installation "Sound Drawings" the musicians can use their instruments for drawing an abstract painting. The pitch and the volume of their instruments paint the canvas with an harmonious-sensitive-line-based brush (a digital ribbon brush). The installation tries to put the aesthetic experience of music and visual on an equipollent level. Usually , the music defines the visual experience (see the battle between DJs and VJs) or vice versa. The realtime visual feedback gives the musicians an additional channel for improving and influencing their improvised perfomance. The musicians are oriented towards the visual aesthetics of their drawing and their bandmates. New sounds and musical aesthetics can emerge.

    Emily Stewart (violin) and Mira Lu Kovacs (singer) performed three different parts. These parts were influnced by transforming the coordinate systems of the canvas.

    1. Part: Against each other : Volume axis are  reflected | Painting | MP3
    2. Satz: Rotation : Volume and Pitch axis are rotated through 90° | Painting | MP3
    3. Satz: Together : Both using the same coordinate system | Painting | MP3

    Drawing Part No. 1

    Drawing Part No. 2

    Drawing Part No. 3

     

     

     

     

     

     

     

    Technical implementation:

    The whole software is written in Max/MSP/Jitter. The ribbon brush is strongly based on Mr. Doob's Harmony Drawing application. For this installation I ported the original Web JavaScript version to a Max MSP working version. After the porting process I extended the application with a multiple brush ability. In the end it was possible to use several brushes at the same time. The sound and pitch tracking is done by the external Max MSP object Fiddler. This object works nice for voices and string instruments. Also the color management uses the data of the Fiddler object in combination with a pre-defined color set.

    Equipment:
    - Dell Latitude E6400 2,66GHZ Notebook
    - M-Audio Fast Track Ultra Soundkarte (2 channels)
    - HD Beamer
    - Max/MSP 5 (Software)
    - Harmony Open Source Project (JavaScript)
    - Fiddler Project

    Acknowledgement:

    Big thanks to Andreas Weixler for the technical support, his great advice to use the Fiddler object for sound analyzing, and of course for getting the invitation for his Sound & Vision concert serie. Furthermore, big thanks to Mira and Emily for their great performance, feedback  and their patience during calibrate the software. The whole work was a real pleasure. Thx!

    Related posts:

    1. Interaktive Installation: Sound Drawings
    2. Bewerbungen für den Master in Interactive Media
    3. AS3: Interactive Webcam Package 1.2

    flattr this!

    ]]>     http://blog.derhess.de/2011/02/18/interactive-media-installation-sound-drawings/feed/ 2 "     Interaktive Installation: Sound Drawings http://blog.derhess.de/2011/02/17/interaktive-installation-sound-drawings/ http://blog.derhess.de/2011/02/17/interaktive-installation-sound-drawings/#comments Thu, 17 Feb 2011 12:45:14 +0000 admin http://blog.derhess.de/?p=1493
  • Interactive Media Installation: Sound Drawings
  • Medien: Ist der interaktive Film schon tot?
    • ]]>     Ende November nahm ich an dem Sound & Vision 4 Konzert für Musik und Medientechnologie an der Anton Bruckner Universität mit meiner Installation "Sound Drawings" teil. Die Sound & Vision Konzertreihe gibt Musikern und Audio-visuellen Programmieren die Möglichkeit ihre neuen experiementellen Klangwelten und Visualisierungen der Öffentlichkeit zu präsentieren.

    Plakat

    Programm Flyer Seite 1

    Programm Flyer Seite 2












    Bei meiner Installation "Sound Drawings" zeichnen Musiker mit Hilfe ihrer Instrumente ein abstraktes Farbenbild von harmonisch schwingenden Linien. Die Tonhöhe und die Lautstärke lässt den digitalen Pinsel an verschiedenen Positionen an der Leinwand gleiten. Die Installation versucht die ästhetischen Erfahrungen zwischen musikalischer und visueller Wahrnehmung auf ein gleichberechtigtes Level zuheben. Normalerweise gibt die Musik den Ton für die Visualisierung, oder und umgehkehrt. Durch das visuelle in Echtzeit generierte Feedback entsteht für die Musiker eine neue Improvisationserfahrungen. Diese neue Erfahrung beeinflusst die Interaktion zwischen den Musikern zusätzlich, und verändert somit die musikalische Ästhetik.

    Emily Stewart an der Violine und Mira Lu Kovacs mit ihrer Stimmen improvisierten drei verschiedene Sätze. Diese drei Improvisationen wurden zusätzlich durch die Manipulation des Koordinatensystems beeinflusst.

    1. Satz: Gegeneinander: Lautstärken Achsen sind gespiegelt | Bild | MP3
    2. Satz: Rotation: Lautstärke und Tonhöhe ist um 90° Grad verdreht | Bild | MP3
    3. Satz: Miteinander: Beide benutzen das gleiche Koordinatensystem | Bild | MP3

    Bild Satz Nr. 1

    Bild Satz Nr. 2

    Bild Satz Nr. 3












    Technische Umsetzung:
    Die Umsetzung dieser Installation erfolgte mit Hilfe von Max/MSP und Jitter. Für die technische Umsetzung des Malens und des Ribbon Pinsels wurde sich stark an die Harmony Malen Applikation von Mr. Doob orientiert. Diese Applikation wurde eigens für dieses Projekt von der ursprünglichen Web JavaScript Version zu einer Max/MSP tauglichen Version portiert. Für die Soundanalyse wurde das externe Fiddler Max/MSP Objekt verwendet. Dieses Objekt kann die Tonhöhe des jeweiligen Instruments und/oder Stimme herausfiltern, und gibt die entsprechende Note zurück.

    Ausrüstung:
    - Dell Latitude E6400 2,66GHZ Notebook
    - M-Audio Fast Track Ultra Soundkarte (2 Kanäle)
    - HD Beamer
    - Max/MSP 5 (Software)
    - Harmony Open Source Project (JavaScript)
    - Fiddler Project

    Danksagung:
    Ich danke Andreas Weixler sehr für den technischen Support, den Tipp mit dem Fiddler Objekt, und der Möglichkeit auf seiner Sound & Vision Konzertreihe auftreten zu dürfen. Weiterer großer Dank geht an Mira und Emily für ihr Feedback und natürlich für ihre super Perfomance! Selten so ein freies und ungezwungenes Experementieren gehabt. Danke!

    Related posts:

    1. Interactive Media Installation: Sound Drawings
    2. Medien: Ist der interaktive Film schon tot?

    flattr this!

    ]]>     http://blog.derhess.de/2011/02/17/interaktive-installation-sound-drawings/feed/ 0 "     Academic research in (multi-touch) gestures for screen interfaces http://blog.derhess.de/2010/12/13/academic-research-in-multi-touch-gestures-for-screen-interfaces/ http://blog.derhess.de/2010/12/13/academic-research-in-multi-touch-gestures-for-screen-interfaces/#comments Mon, 13 Dec 2010 12:46:50 +0000 admin http://blog.derhess.de/?p=1402
  • Technical Paper: Designing gestures for (multi-touch) screens
    • ]]>     Last semester I joined the Journal Club lecture at our University. I continued my research in gesture based interaction for screen-based environments. This little paper research was based on the question how the screen size influences the gesture design. In the end I created a short presentation about important conferences for gesture design, and summarized the results of 4 papers. Thanks to Martin Kaltenbrunner for his useful advices!

    Multi(Touch) Gesture Research

    View more presentations from Florian Weil.

    Furthermore, I found a bunch of very interesting papers for designing gestures in screen-based environments. I want to share these papers with you. You are welcome to add comments about the papers or recommend other nice projects! (use the tooltip for only reading the titles of the papers)

    Gesture design in general

    Andrew Bragdon, Robert Zeleznik, Brian Williamson, Timothy Miller, and Joseph J. LaViola, Jr.. 2009. GestureBar: improving the approachability of gesture-based interfaces. In Proceedings of the 27th international conference on Human factors in computing systems (CHI '09). ACM, New York, NY, USA, 2269-2278.

    Justin Matejka, Tovi Grossman, Jessica Lo, and George Fitzmaurice. 2009. The design and evaluation of multi-finger mouse emulation techniques. In Proceedings of the 27th international conference on Human factors in computing systems (CHI '09). ACM, New York, NY, USA, 1073-1082.

    Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-defined gestures for surface computing. In Proceedings of the 27th international conference on Human factors in computing systems (CHI '09). ACM, New York, NY, USA, 1083-1092.

    Stößel, C.; Wandke, H. & Blessing, L. Kopp, S. & Wachsmuth, I. (Eds.) Gestural Interfaces for Elderly Users: Help or Hindrance? Gesture in Embodied Communication and Human-Computer Interaction, Springer Berlin / Heidelberg, 2010, 5934, 269-280

    Kenrick Kin, Maneesh Agrawala, and Tony DeRose. 2009. Determining the Benefits of Direct-Touch, Bimanual, and Multifinger Input on a Multitouch Workstation

    Gesture design for small screens

    Anne Roudaut, Eric Lecolinet, and Yves Guiard. 2009. MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb. In Proceedings of the 27th international conference on Human factors in computing systems (CHI '09). ACM, New York, NY, USA, 927-936.

    Patrick Baudisch and Gerry Chu. 2009. Back-of-device interaction allows creating very small touch devices. In Proceedings of the 27th international conference on Human factors in computing systems (CHI '09). ACM, New York, NY, USA, 1923-1932.

    Gesture design for medium screens

    Tomer Moscovich and John F. Hughes. 2008. Indirect mappings of multi-touch input using one and two hands. In Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (CHI '08). ACM, New York, NY, USA, 1275-1284.

    Chi Tai Dang, Martin Straub, and Elisabeth Andre;. 2009. Hand distinction for multi-touch tabletop interaction. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 101-108.

    Dustin Freeman, Hrvoje Benko, Meredith Ringel Morris, and Daniel Wigdor. 2009. ShadowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 165-172

    Thomas Seifried, Michael Haller, Stacey D. Scott, Florian Perteneder, Christian Rendl, Daisuke Sakamoto, and Masahiko Inami. 2009. CRISTAL: a collaborative home media and device controller based on a multi-touch display. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 33-40.

    Gesture design for big screens

    Peter Peltonen, Esko Kurvinen, Antti Salovaara, Giulio Jacucci, Tommi Ilmonen, John Evans, Antti Oulasvirta, and Petri Saarikko. 2008. It's Mine, Don't Touch!: interactions at a large multi-touch display in a city centre. In Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (CHI '08). ACM, New York, NY, USA, 1285-1294.

    Masatomo Kobayashi and Takeo Igarashi. 2008. Ninja cursors: using multiple cursors to assist target acquisition on large screens. In Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (CHI '08). ACM, New York, NY, USA, 949-958.

    Martha Abednego, Joong-Ho Lee, Won Moon, and Ji-Hyung Park. 2009. I-Grabber: expanding physical reach in a large-display tabletop environment through the use of a virtual grabber. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 61-64.

    Alexander Schick, Florian van de Camp, Joris Ijsselmuiden, and Rainer Stiefelhagen. 2009. Extending touch: towards interaction with large-scale surfaces. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 117-124

    Gesture design for pen/stylus devices

    Dzimitry Aliakseyeu, Pourang Irani, Andres Lucero, and Sriram Subramanian. 2008. Multi-flick: an evaluation of flick-based scrolling techniques for pen interfaces. In Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (CHI '08). ACM, New York, NY, USA, 1689-1698

    Caroline Appert and Shumin Zhai. 2009. Using strokes as command shortcuts: cognitive benefits and toolkit support. In Proceedings of the 27th international conference on Human factors in computing systems (CHI '09). ACM, New York, NY, USA, 2289-2298

    Mathias Frisch, Jens Heydekorn, and Raimund Dachselt. 2009. Investigating multi-touch and pen gestures for diagram editing on interactive surfaces. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 149-156.

    Related posts:

    1. Technical Paper: Designing gestures for (multi-touch) screens

    flattr this!

    ]]>     http://blog.derhess.de/2010/12/13/academic-research-in-multi-touch-gestures-for-screen-interfaces/feed/ 3 "     Technical Paper: Designing gestures for (multi-touch) screens http://blog.derhess.de/2010/12/06/technical-paper-designing-gestures-for-multi-touch-screens/ http://blog.derhess.de/2010/12/06/technical-paper-designing-gestures-for-multi-touch-screens/#comments Mon, 06 Dec 2010 13:14:03 +0000 admin http://blog.derhess.de/?p=1400
  • Academic research in (multi-touch) gestures for screen interfaces
  • Designing Subspaces: Hermits in our digital Age
  • Book review: Designing Interactions
    • ]]>     For several months I worked on technical paper about designing gestures for screen-based environments. Finally, it is finished and you can read it. Here is the abstract:

    This paper analyses gesture design for pointing devices in screen-based environments. By exploring design patterns the analysis investigated the gesture design of five different end-user products: Desktop operating systems, mobile operating systems, 3rd Party software, small software products, and common hardware products. The beginning of the paper defines what a gesture is, and the various kinds of gestures. Afterwards the analysis merges the gesture design results with the basic commands for pointing devices. This approach points out which gestures are often used, and in which context they are used. The results give interaction designers and software engineers a guide for implementing gestures in their own products. Furthermore, the paper proposes solutions for gesture documentation, and a conceptual framework for complicated gestures. The last section takes an industrial design perspective on pointing devices as an input channel. It discusses the evolution of interface design from a hardware driven to a software driven approach.

    Please note:

    Unfortunately, I got sick on a long-term disease. Therefore it took me so long for writing this paper and that is also the reason why the data of the analysis is from January of 2010. However, in my opinion the results of my analysis are still valid. For more up-to-date data, please check the Touch Gesture Reference from LukeW.

    Acknowledgement:

    I am very happy about the support from my teachers, friends, and fellow students. Big thanks to Mahir M. Yavuz and Mathias Stäbler for the content feedback. Vesela Mihaylova for a great Adobe Illustrator and graphic design support. Tim Devine for transforming over 30 pages of my bad english in a readable form, and marking some unclear points of my paper. Dudes, thank you so much!

    Download

    web version |   print version

    Related posts:

    1. Academic research in (multi-touch) gestures for screen interfaces
    2. Designing Subspaces: Hermits in our digital Age
    3. Book review: Designing Interactions

    flattr this!

    ]]>     http://blog.derhess.de/2010/12/06/technical-paper-designing-gestures-for-multi-touch-screens/feed/ 8 "     Book review: Designing Interactions http://blog.derhess.de/2010/11/15/book-review-designing-interactions/ http://blog.derhess.de/2010/11/15/book-review-designing-interactions/#comments Mon, 15 Nov 2010 13:25:08 +0000 admin http://blog.derhess.de/?p=1433
  • Book Review: The Elements of User Experience
  • Book Review: Laws of Simplicity
  • Book review: Form + Code (Generative Art & Design)
    • ]]>     The book Designing Interaction from Bill Moggridge was already published in 2006. Even it is quite old for a technology book the content is still valid. The first six chapters give a perfect history background of human-computer interaction. The evolution of input devices and the computer itself is very good explained. Also the original comments from the designers and engineers are very interesting to read.  In the end the reader gets a very good introduction how and why the computer evolved as it is today. Even the described history is a strongly based on the authors view.  The chapters Adopting Technology and Multisensory and Multimedia gives a nice introduction into tangible interaction. It also helps beginners to understand how to leave the desktop metaphor. The whole book describes very easily how product designer, industrial designer, psychologist and engineers working together for developing the new devices. The texts about their development and thinking processes gives a very good insight. The last chapters about The Internet, Futures and Alternatives Nows, and People and Prototypes are nice to read, but with some comments I can't agree. For this reason, the aspects of Emotional Design and Prototyping are little bit weak in my opinion. However, reading the first six chapters is very useful for human-computer interaction beginners. It makes their knowledge around the history of Interaction Design more stable. The last chapters are nice to read, but not very obligatory. Unfortunately, the multimedia CD of the book I never really checked.  So I can't say if it is good or not. For professional interaction designer is almost nothing new in this book, so I can't recommend it for them.

    Related posts:

    1. Book Review: The Elements of User Experience
    2. Book Review: Laws of Simplicity
    3. Book review: Form + Code (Generative Art & Design)

    flattr this!

    ]]>     http://blog.derhess.de/2010/11/15/book-review-designing-interactions/feed/ 0 "