Home > Design, english, Interaction > Academic research in (multi-touch) gestures for screen interfaces

Academic research in (multi-touch) gestures for screen interfaces

December 13th, 2010 Leave a comment Go to comments

Last semester I joined the Journal Club lecture at our University. I continued my research in gesture based interaction for screen-based environments. This little paper research was based on the question how the screen size influences the gesture design. In the end I created a short presentation about important conferences for gesture design, and summarized the results of 4 papers. Thanks to Martin Kaltenbrunner for his useful advices!

Furthermore, I found a bunch of very interesting papers for designing gestures in screen-based environments. I want to share these papers with you. You are welcome to add comments about the papers or recommend other nice projects! (use the tooltip for only reading the titles of the papers)

Gesture design in general

Andrew Bragdon, Robert Zeleznik, Brian Williamson, Timothy Miller, and Joseph J. LaViola, Jr.. 2009. GestureBar: improving the approachability of gesture-based interfaces. In Proceedings of the 27th international conference on Human factors in computing systems (CHI '09). ACM, New York, NY, USA, 2269-2278.

Justin Matejka, Tovi Grossman, Jessica Lo, and George Fitzmaurice. 2009. The design and evaluation of multi-finger mouse emulation techniques. In Proceedings of the 27th international conference on Human factors in computing systems (CHI '09). ACM, New York, NY, USA, 1073-1082.

Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-defined gestures for surface computing. In Proceedings of the 27th international conference on Human factors in computing systems (CHI '09). ACM, New York, NY, USA, 1083-1092.

Stößel, C.; Wandke, H. & Blessing, L. Kopp, S. & Wachsmuth, I. (Eds.) Gestural Interfaces for Elderly Users: Help or Hindrance? Gesture in Embodied Communication and Human-Computer Interaction, Springer Berlin / Heidelberg, 2010, 5934, 269-280

Kenrick Kin, Maneesh Agrawala, and Tony DeRose. 2009. Determining the Benefits of Direct-Touch, Bimanual, and Multifinger Input on a Multitouch Workstation

Gesture design for small screens

Anne Roudaut, Eric Lecolinet, and Yves Guiard. 2009. MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb. In Proceedings of the 27th international conference on Human factors in computing systems (CHI '09). ACM, New York, NY, USA, 927-936.

Patrick Baudisch and Gerry Chu. 2009. Back-of-device interaction allows creating very small touch devices. In Proceedings of the 27th international conference on Human factors in computing systems (CHI '09). ACM, New York, NY, USA, 1923-1932.

Gesture design for medium screens

Tomer Moscovich and John F. Hughes. 2008. Indirect mappings of multi-touch input using one and two hands. In Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (CHI '08). ACM, New York, NY, USA, 1275-1284.

Chi Tai Dang, Martin Straub, and Elisabeth Andre;. 2009. Hand distinction for multi-touch tabletop interaction. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 101-108.

Dustin Freeman, Hrvoje Benko, Meredith Ringel Morris, and Daniel Wigdor. 2009. ShadowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 165-172

Thomas Seifried, Michael Haller, Stacey D. Scott, Florian Perteneder, Christian Rendl, Daisuke Sakamoto, and Masahiko Inami. 2009. CRISTAL: a collaborative home media and device controller based on a multi-touch display. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 33-40.

Gesture design for big screens

Peter Peltonen, Esko Kurvinen, Antti Salovaara, Giulio Jacucci, Tommi Ilmonen, John Evans, Antti Oulasvirta, and Petri Saarikko. 2008. It's Mine, Don't Touch!: interactions at a large multi-touch display in a city centre. In Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (CHI '08). ACM, New York, NY, USA, 1285-1294.

Masatomo Kobayashi and Takeo Igarashi. 2008. Ninja cursors: using multiple cursors to assist target acquisition on large screens. In Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (CHI '08). ACM, New York, NY, USA, 949-958.

Martha Abednego, Joong-Ho Lee, Won Moon, and Ji-Hyung Park. 2009. I-Grabber: expanding physical reach in a large-display tabletop environment through the use of a virtual grabber. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 61-64.

Alexander Schick, Florian van de Camp, Joris Ijsselmuiden, and Rainer Stiefelhagen. 2009. Extending touch: towards interaction with large-scale surfaces. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 117-124

Gesture design for pen/stylus devices

Dzimitry Aliakseyeu, Pourang Irani, Andres Lucero, and Sriram Subramanian. 2008. Multi-flick: an evaluation of flick-based scrolling techniques for pen interfaces. In Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (CHI '08). ACM, New York, NY, USA, 1689-1698

Caroline Appert and Shumin Zhai. 2009. Using strokes as command shortcuts: cognitive benefits and toolkit support. In Proceedings of the 27th international conference on Human factors in computing systems (CHI '09). ACM, New York, NY, USA, 2289-2298

Mathias Frisch, Jens Heydekorn, and Raimund Dachselt. 2009. Investigating multi-touch and pen gestures for diagram editing on interactive surfaces. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 149-156.

  1. admin
    October 20th, 2011 at 12:52 | #1

    nice User interface for TouchScreen:
    TapSense: Enhancing Finger Interaction on Touch Surfaces

  2. July 17th, 2013 at 10:06 | #2

    Google Scholar delivers a really great overview of Human Computer Interaction Conferences

    http://scholar.google.com/citations?view_op=top_venues&hl=en&vq=eng_humancomputerinteraction

    Very useful if you are looking for some references and research things

  3. September 21st, 2016 at 09:47 | #3

    Very nice article about interaction and gestures with your thumb on small screen devices by Samantha Ingram. Furthermore, her article has also some nice references and links at the end.

    https://www.smashingmagazine.com/2016/09/the-thumb-zone-designing-for-mobile-users/

  1. December 13th, 2010 at 15:52 | #1
  2. January 29th, 2011 at 18:36 | #2