A small summary of my Twitter messages from January - March 2011:
For my interactive installation "Sound Drawings" I decided to use the Harmony Drawing application. Meanwhile, the single brush version worked pretty stable with the sound analyzing. There was still one thing missing. It would be much cooler if more than one person can draw on the canvas. From the technical view it was very easy to implement. In the beginning I was a little bit scared if the realtime feedback is still good with more brushes at the same time. It was! For this reason here is the source code and my versions of testing for you.
I prepared a screencast for getting an idea and overview how it works. The principles are exactly the same as in the first version. The only exception is the "brushID" as a new parameter. Every API call uses this syntax:
|
1 |
apiFunctionName <em>brushID</em> parameter1 parameter2 ... |
For creating a new brush use the command "setBrush brushID brushType". Afterwards you can use the API command "setCoordinate brushID xPos yPos" for drawing programmatically. If you want to use the mouse for drawing you must use the API command "selectBrush brushID" before drawing directly on the canvas!
All JavaScript codes and Max / MSP patches are included in the example file. For the sound drawing patch you must install the Max MSP Fiddler object, before you can try experimenting.
In the end of november I was a part of the Sound & Vision 4 concert for Music and Media Technology at the Anton Bruckner University.The Sound & Vision concert serie allows young musician and audio-visual artists to present their new experimental artworks and installations.
Poster
Programme #1
Programme #2
In my installation "Sound Drawings" the musicians can use their instruments for drawing an abstract painting. The pitch and the volume of their instruments paint the canvas with an harmonious-sensitive-line-based brush (a digital ribbon brush). The installation tries to put the aesthetic experience of music and visual on an equipollent level. Usually , the music defines the visual experience (see the battle between DJs and VJs) or vice versa. The realtime visual feedback gives the musicians an additional channel for improving and influencing their improvised perfomance. The musicians are oriented towards the visual aesthetics of their drawing and their bandmates. New sounds and musical aesthetics can emerge.
A small summary of my Twitter messages from October - December 2010:
Last semester I joined the Journal Club lecture at our University. I continued my research in gesture based interaction for screen-based environments. This little paper research was based on the question how the screen size influences the gesture design. In the end I created a short presentation about important conferences for gesture design, and summarized the results of 4 papers. Thanks to Martin Kaltenbrunner for his useful advices!
Furthermore, I found a bunch of very interesting papers for designing gestures in screen-based environments. I want to share these papers with you. You are welcome to add comments about the papers or recommend other nice projects! (use the tooltip for only reading the titles of the papers)
Read more...
For several months I worked on technical paper about designing gestures for screen-based environments. Finally, it is finished and you can read it. Here is the abstract:
This paper analyses gesture design for pointing devices in screen-based environments. By exploring design patterns the analysis investigated the gesture design of five different end-user products: Desktop operating systems, mobile operating systems, 3rd Party software, small software products, and common hardware products. The beginning of the paper defines what a gesture is, and the various kinds of gestures. Afterwards the analysis merges the gesture design results with the basic commands for pointing devices. This approach points out which gestures are often used, and in which context they are used. The results give interaction designers and software engineers a guide for implementing gestures in their own products. Furthermore, the paper proposes solutions for gesture documentation, and a conceptual framework for complicated gestures. The last section takes an industrial design perspective on pointing devices as an input channel. It discusses the evolution of interface design from a hardware driven to a software driven approach.
Please note:
Unfortunately, I got sick on a long-term disease. Therefore it took me so long for writing this paper and that is also the reason why the data of the analysis is from January of 2010. However, in my opinion the results of my analysis are still valid. For more up-to-date data, please check the Touch Gesture Reference from LukeW.
Acknowledgement:
I am very happy about the support from my teachers, friends, and fellow students. Big thanks to Mahir M. Yavuz and Mathias Stäbler for the content feedback. Vesela Mihaylova for a great Adobe Illustrator and graphic design support. Tim Devine for transforming over 30 pages of my bad english in a readable form, and marking some unclear points of my paper. Dudes, thank you so much!
Download
A small summary of my Twitter messages from July - October 2010:
In my class PublicSpaces 2.0 from the space & design strategies department we discussed the connections between social media and public spaces. Also some design theory aspects were included into the discussion. In my case I introduced the lifestyle of hermits. Hermits create a kind of subspaces in urban or nature environments. These subspaces have got their own system and rules. Our current culture is characterized by fast technical developments and accelerated lifestyles. That includes travelling over big distances, moving often, huge information perception via social media services, etc. In some life periods these circumstances are not healthy. They cause long-term stress symptoms, losing creativity and so on. In this case the lifestyle of hermits can give an inspiration for creating a subspace in our urban environment. A subspace, which minimize these aspects of acceleration and creating an appropriate environment for each individual. In my presentation and in my paper I don't say that the solitary lifestyle of the hermits is optimal. A good environment has to provide also a stable social enviromnent with friends and partners. I am just using the hermit lifestyle for some design approaches and for getting inspired.
Furthermore, I describe in my paper how people become unconsciously and consciously an hermit. Becoming unconsciously a hermit could lead to some conflicts in our society. The key aspects of Reduction and Filtering in designing Intertactive Media play an important role for solving this issues. More detailed explanations of my thoughts are written down in my PDF paper.
PDF PAPER: Hermits in our digital Age
For exploring the JavaScript API in MAX / MSP / Jitter I decided to port the Harmony Web Application by Mr. Doob. I really fall in love with the different brush styles. MAX / MSP / Jitter is pretty cool for doing audio visual stuff, and I think the different brush style might be nice for this. Fortunately, Mr. Doob published the source code and the code is nice, too! Therefore, it was not so difficult to understand the code. During my porting process I had to consider four things: Read more...
A small summary of my Twitter messages from March - June 2010: