short-paper

A multi-touch-recognizer for gesturecards

Authors:

Volker GruhnAuthors Info & Claims

EICS '17: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems

Pages 75 - 80

https://doi.org/10.1145/3102113.3102132

Published: 26 June 2017 Publication History

Abstract

Software engineers and testers have to understand what requirements engineers and UI designers created during early development phases to implement a suitable software system and adequate testing environments. Interaction matters however are often implicitly defined in low-fidelity prototypes without proper specification and documentation. Especially gestures are becoming a powerful interaction channel used with various devices ranging from small mobile phones to large wall-sized displays. Consequently, a need specification and documentation methods arises. Common gesture notations focus on pure textual or graphical approaches, but we argue that hybrid solutions have various advantages, especially in early prototyping phases with cross-functional teams. We present GestureCards, a hybrid gesture notation, and an accompanying gesture recognizer.

References

[1]

Bashar Altakrouri and Andreas Schrader. 2015. Challenging Documentation Practices for Interactions in Natural User Interfaces. In 1st Workshop on Large-scale and Model-based Interactive Systems: Approaches and Challenges (LMIS 2015) (CEUR Workshop Proceedings). 29--34. http://ceur-ws.org/Vol-1380/paper4.pdf

[2]

Lisa Anthony and Jacob O. Wobbrock. 2010. A Lightweight Multi-stroke Recognizer for User Interface Prototypes. In Proceedings of Graphics Interface 2010 (GI '10). Canadian Information Processing Society, Toronto, Ont., Canada, 245--252.

[3]

Ann Blandford. 2013. Engineering works: What is (and is not) "Engineering" for Interactive Computer Systems?. In Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems (EICS '13). ACM Press, New York, New York, USA, 285.

Digital Library

[4]

Roman Ganhör and Wolfgang Spreicer. 2014. Monox: Extensible Gesture Notation for Mobile Devices. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services (MobileHCI '14). ACM, New York, NY, USA, 203--212.

Digital Library

[5]

Marc Hesenius, Tobias Griebe, Stefan Gries, and Volker Gruhn. 2014. Automating UI Tests for Mobile Applications with Formal Gesture Descriptions. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services (MobileHCI '14). ACM, New York, NY, USA, 213--222.

Digital Library

[6]

Marc Hesenius and Volker Gruhn. 2016. Introducing GestureCards: A Prototyping Gesture Notation. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI '16). ACM, New York, NY, USA, Article 111, 6 pages.

Digital Library

[7]

Marc Hesenius, Markus Kleffmann, and Volker Gruhn. 2016. Sketching Gesture-Based Applications in a Collaborative Working Environment with Wall-Sized Displays. In 2016 International Conference on Collaboration Technologies and Systems (CTS). IEEE Conference Publications, 327--336.

[8]

Lode Hoste and Beat Signer. 2014. Criteria, Challenges and Opportunities for Gesture Programming Languages. In Proc. 1st Workshop on Engineering Gestures for Multimodal Interfaces. 22--29. http://ceur-ws.org/Vol-1190/paper4.pdf

[9]

D. Kammer, D. Henkens, C. Henzen, and R. Groh. 2015. Gesture Formalization for Multitouch. Software: Practice and Experience 45, 4 (2015), 527--548.

Digital Library

[10]

Ju-Whan Kim and Tek-Jin Nam. 2013. EventHurdle: Supporting Designers' Exploratory Interaction Prototyping with Gesture-based Sensors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 267--276.

Digital Library

[11]

Kenrick Kin, Björn Hartmann, Tony DeRose, and Maneesh Agrawala. 2012. Proton++: A Customizable Declarative Multitouch Framework. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (2012). ACM, 477--486.

Digital Library

[12]

Jill H. Larkin and Herbert A. Simon. 1987. Why a Diagram is (Sometimes) Worth Ten Thousand Words. Cognitive Science 11, 1 (1987), 65 -- 100.

[13]

Effie Lai-Chong Law, Virpi Roto, Marc Hassenzahl, Arnold P.O.S. Vermeeren, and Joke Kort. 2009. Understanding, Scoping and Defining User Experience: A Survey Approach. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 719--728.

Digital Library

[14]

Hao Lü, James A. Fogarty, and Yang Li. 2014. Gesture Script: recognizing gestures and their structure using rendering scripts and interactively trained parts. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14. ACM Press, New York, New York, USA, 1685--1694.

Digital Library

[15]

Radu-Daniel Vatavu, Lisa Anthony, and Jacob O. Wobbrock. 2012. Gestures as point clouds. In Proc. 14th ACM intl. conf. on Multimodal interaction - ICMI '12. ACM Press, New York, New York, USA, 273.

Digital Library

[16]

Jacob O. Wobbrock, Andrew D. Wilson, and Yang Li. 2007. Gestures Without Libraries, Toolkits or Training: A $1 Recognizer for User Interface Prototypes. In Proc. 20th Annual ACM Symp. User Interface Software and Technology (UIST '07). ACM, New York, NY, USA, 159--168.

Digital Library

Cited By

Dong HZhang JWang WYang YChen QDu L(2023)Gesture Hub Design: A Remote User Study Method for Evaluating the Quality of Experience in Mobile Phone-Based Gesture InteractionHCI International 2023 – Late Breaking Papers10.1007/978-3-031-48038-6_3(37-53)Online publication date: 25-Nov-2023
https://doi.org/10.1007/978-3-031-48038-6_3
Börsting IHeikamp MHesenius MKoop WGruhn V(2022)Software Engineering for Augmented Reality - A Research AgendaProceedings of the ACM on Human-Computer Interaction10.1145/35322056:EICS(1-34)Online publication date: 17-Jun-2022
https://dl.acm.org/doi/10.1145/3532205
Hesenius MKleffmann MGruhn V(2021)AugIR Meets GestureCards: A Digital Sketching Environment for Gesture-Based ApplicationsInteracting with Computers10.1093/iwcomp/iwab017Online publication date: 10-May-2021
https://doi.org/10.1093/iwcomp/iwab017
Show More Cited By

Index Terms

A multi-touch-recognizer for gesturecards
1. Human-centered computing
  1. Interaction design
    1. Interaction design process and methods
      1. User interface design

Recommendations

GestureCards: A Hybrid Gesture Notation

Describing gestures in detail has various advantages for project teams: communication is simplified, interaction concepts are documented, and technical decisions are supported. Common gesture notations focus on textual or graphical elements only, but we ...
Introducing GestureCards: A Prototyping Gesture Notation
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction

Gesture-based applications are common nowadays, but developing gestures is still error-prone and causes software defects as well as misunderstandings and frustration among project team members and stakeholders. Precise specification and documentation is ...
An application oriented and shape feature based multi-touch gesture description and recognition method

In order to customize multi-touch gestures for different applications, and facilitate multi-touch gesture recognition, an application oriented and shape feature based multi-touch gesture description and recognition method is proposed. In this method, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

EICS '17: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems

June 2017

164 pages

ISBN:9781450350839

DOI:10.1145/3102113

Conference Chairs:
José Creissac Campos,
Nuno Nunes

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 June 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

EICS '17

Sponsor:

SIGCHI

EICS '17: ACM SIGCHI Symposium on Engineering Interactive Computing Systems

June 26 - 29, 2017

Lisbon, Portugal

Acceptance Rates

Overall Acceptance Rate 73 of 299 submissions, 24%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
106
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Dong HZhang JWang WYang YChen QDu L(2023)Gesture Hub Design: A Remote User Study Method for Evaluating the Quality of Experience in Mobile Phone-Based Gesture InteractionHCI International 2023 – Late Breaking Papers10.1007/978-3-031-48038-6_3(37-53)Online publication date: 25-Nov-2023
https://doi.org/10.1007/978-3-031-48038-6_3
Börsting IHeikamp MHesenius MKoop WGruhn V(2022)Software Engineering for Augmented Reality - A Research AgendaProceedings of the ACM on Human-Computer Interaction10.1145/35322056:EICS(1-34)Online publication date: 17-Jun-2022
https://dl.acm.org/doi/10.1145/3532205
Hesenius MKleffmann MGruhn V(2021)AugIR Meets GestureCards: A Digital Sketching Environment for Gesture-Based ApplicationsInteracting with Computers10.1093/iwcomp/iwab017Online publication date: 10-May-2021
https://doi.org/10.1093/iwcomp/iwab017
Hesenius MGruhn V(2019)GestureCardsProceedings of the ACM on Human-Computer Interaction10.1145/33311643:EICS(1-35)Online publication date: 13-Jun-2019
https://dl.acm.org/doi/10.1145/3331164

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents