research-article

Interactive prototyping of tabletop and surface applications

Authors:

Tulio de Souza Alcantara,

Jennifer Ferreira,

Frank MaurerAuthors Info & Claims

EICS '13: Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems

Pages 229 - 238

https://doi.org/10.1145/2494603.2480313

Published: 24 June 2013 Publication History

Abstract

Physically large touch-based devices, such as tabletops, afford numerous innovative interaction possibilities; however, for application development on these devices to be successful, users must be presented with interactions they find natural and easy to learn. User-centered design advocates the use of prototyping to help designers create software that is a better fit with user needs and yet, due to time pressures or inappropriate tool support, prototyping may be considered too costly to do. To address these concerns, we designed ProtoActive, a tool for designing and evaluating multi-touch applications on large surfaces via sketch-based prototypes. Our tool allows designers to define custom gestures and evaluate them without requiring any programming knowledge. The paper presents the results of pilot studies as well as in-the-wild usage of the tool.

References

[1]

Norman, D. A. (2007). The Design of Future Things. Ed. Basic Books.

[2]

Norman, D., Nielsen, J. (2010). Gestural interfaces: a step backward in usability. Interactions, vol 17, issue 5.

Digital Library

[3]

Hesselmann, T., & Boll, S. (2011). SCIVA: designing applications for surface computers. EICS 2011, 191--196.

Digital Library

[4]

Moggridge, B. (2007). Designing Interactions. MIT, Ch 10 - People and Prototypes. Press, Cambridge, MA.

[5]

Hinrichs, U., Carpendale, S. (2011). Gestures in the Wild?: Studying Multi-Touch Gesture Sequences on Interactive Tabletop Exhibits. CHI'11, 3023--3032.

Digital Library

[6]

Wobbrock, J. O., Morris, M. R., & Wilson, A. D. (2009). User-defined gestures for surface computing. CHI '09. Pages 1083--1092.

Digital Library

[7]

Khandkar, S. H., & Maurer, F. (2010). A Domain Specific Language to Define Gestures for Multi-Touch Applications, DSM '10, Article 2, 6 pages.

Digital Library

[8]

Lao, S., Heng, X., Zhang, G., Ling, Y., Wang, P. (2009). A gestural interaction design model for multitouch displays. BCS-HCI '09, 440--446.

Digital Library

[9]

Allan Christian Long, Jr., James A. Landay, and Lawrence A. Rowe. (1999). Implications for a gesture design tool. CHI '99. 40--47.

Digital Library

[10]

Lyons, K., Brashear, H., Westeyn, T., Kim, J. S., Starner, T. (2007). GART: the gesture and activity recognition toolkit. HCI'07. 718--727.

Digital Library

[11]

Anthony, L., Wobbrock, J. O. (2012). $N-protractor: a fast and accurate multistroke recognizer. GI'12.117--120.

Digital Library

[12]

Kin, K., Hartmann, B., DeRose, T., Agrawala, M. Proton: Multitouch Gestures as Regular Expressions. CHI'12, ACM 978-1-4503-1015-4/12/05.

Digital Library

[13]

Plimmer, B., Blagojevic, R., Hsiao-Heng Chang, S., Schmieder, P., Zhen, J. S. (2012). RATA: codeless generation of gesture recognizers. BCS-HCI '12, 137--146.

Digital Library

[14]

Wiethoff, A., Schneider, H., Rohs, M., & Butz, A. Greenberg, S. (2012). Sketch-a-TUI: low cost prototyping of tangible interactions using cardboard and conductive ink. Embodied Interaction, 1, 309--312.

Digital Library

[15]

Marco, J., Cerezo, E., Baldassarri, S. (2012). ToyVision: a toolkit for prototyping tabletop tangible games. EICS '12. 71--80.

Digital Library

[16]

Shaer, O., Jacob, R. J. K. (2009). A specification paradigm for the design and implementation of tangible user interfaces. CHI'09. 16, 4, Article 20, 39 pages.

Digital Library

[17]

Rudd, J., Stern, K., Isensee, S. (1996). Low vs. high-fidelity prototyping debate, interactions, v. 3, p. 76--85.

Digital Library

[18]

Sefelin, R., Tscheligi, M., Giller, V. (2003). Paper prototyping - what is it good for?: a comparison of paper and computer-based low-fidelity prototyping, CHI '03.

Digital Library

[19]

Virzi, R. A., Sokolov, J. L., Karis, D. (1996). Usability problem identification using both low- and high-fidelity prototypes, CHI'96, p. 236--243.

Digital Library

[20]

McCurdy, M., Connors, C., Pyrzak, G., Kanefsky, B., Vera, A. (2006). Breaking the fidelity barrier: an examination of our current characterization of prototypes and an example of a mixed-fidelity success. CHI '06. 1233--1242.

Digital Library

[21]

Youn-Kyung Lim, Stolterman, E., Tenenberg, J. (2008). The anatomy of prototypes: Prototypes as filters, prototypes as manifestations of design ideas. CHI'08. 15, 2, Article 7, 27 pages.

Digital Library

[22]

Derboven, J., Roeck, D. D., & Verstraete, M. (2010). Low-Fidelity Prototyping for Multi-Touch Surfaces. . Presented in the workshop Engineering Patterns for Multi-Touch Interfaces held in EICS'10.

[23]

Klaus Krippendorff. (2006). The Semantic Turn: A New Foundation for Design. Taylor & Francis, Boca Raton, FL.

[24]

Bill Buxton. (2007). Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.

Digital Library

[25]

Constantine, L. L. (2004). Beyond user-centered design and user experience: Designing for user performance. Cutter IT Journal, 17, 2.

[26]

Robertson, S., Robertson, J. (2006). Mastering the Requirements Process (2nd Edition). Chapter 12. Addison-Wesley Professional.

Digital Library

[27]

Rudd, J., Stern, K., and Isensee, S. (1996) Low vs. high fidelity prototyping debate. Interactions, 3, 1, 76--85.

Digital Library

[28]

Morris, M. R., Wobbrock, J. O., Wilson., A. D. (2010). Understanding users' preferences for surface gestures. GI '10. 261--268.

Digital Library

[29]

Gerken, J., Jetter, H. C., Schmidt, T., Reiterer, H. (2010) Can "touch" get annoying? ITS '10. 257--258.

Digital Library

[30]

Sinha, A. K., Landay, J. A. (2003). Capturing user tests in a multimodal, multidevice informal prototyping tool. ICMI '03. 117--124.

Digital Library

[31]

J. David Smith and T. C. Nicholas Graham. (2010). Raptor: sketching games with a tabletop computer. Futureplay '10. 191--198.

Digital Library

[32]

Obrenovic, Z., Martens, J. B. (2011). Sketching interactive systems with sketchify. ACM Trans. CHI'11. 18, 1, Article 4, 38 pages.

Digital Library

[33]

Segura V. C. V. B., Barbosa, S. D. J., Simões, F. P. (2012). UISKEI: a sketch-based prototyping tool for defining and evaluating user interface behavior. AVI '12. 18--25.

Digital Library

[34]

Bailey, B. P., Konstan, J. A., Carlis, J. V. (2001). DEMAIS: designing multimedia applications with interactive storyboards. MULTIMEDIA '01. 241--250.

Digital Library

[35]

Hosseini-Khayat, A., Seyed, T., Burns, C., Maurer, F. (2011). Low-Fidelity Prototyping of Gesture-based Applications. EICS'11. 289--294.

Digital Library

[36]

Balsamiq Mockups - Available at www.balsamiq.com. Accessed July 2012.

[37]

Axure RP: Interactive wireframe software and mockup tool. Available at http://www.axure.com/. Accessed October 2012.

[38]

Microsoft Sketchflow. Available at http://www.microsoft.com/expression/products/sketchflow_overview.aspx. Accessed March 2012.

[39]

ForeUI: Easy to use UI prototyping tool. Available at http://www.foreui.com/. Accessed October 2012.

[40]

Johnson, R., Rogers, Y., van der Linden, J., Bianchi-Berthouze, N. (2012). Being in the thick of in-the-wild studies: the challenges and insights of researcher participation. In Proceedings of CHI '12. 1135--1144.

Digital Library

[41]

Alcantara, T., Denzinger, J., Ferreira, J., Maurer, F. (2012). Learning gestures for interacting with low-fidelity prototypes. RAISE'12, 32--36.

[42]

Lethbridge, T. C., & Sim, S. E. (2005). Studying software engineers: Data collection techniques for software field studies. Empirical Software Engineering, 10(3), 311--341.

Digital Library

[43]

Wallace, J. R., Pape, J., Yu-Ling Betty Chang, McClelland, P. J., Graham, T. C. N., Scott, S. D. and Hancock, M. (2012). Exploring automation in digital tabletop board game. CSCW '12 231--234.

Digital Library

Cited By

Hesenius MKleffmann MGruhn V(2021)AugIR Meets GestureCards: A Digital Sketching Environment for Gesture-Based ApplicationsInteracting with Computers10.1093/iwcomp/iwab017Online publication date: 10-May-2021
https://doi.org/10.1093/iwcomp/iwab017
Xu XYu CWang YShi Y(2020)Recognizing Unintentional Touch on Interactive TabletopProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33810114:1(1-24)Online publication date: 18-Mar-2020
https://dl.acm.org/doi/10.1145/3381011
Yan YShi YYu CShi Y(2020)HeadCrossProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33809834:1(1-22)Online publication date: 14-Sep-2020
https://dl.acm.org/doi/10.1145/3380983
Show More Cited By

Index Terms

Interactive prototyping of tabletop and surface applications
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Lo-fi prototyping to design interactive-tabletop applications for children
IDC '10: Proceedings of the 9th International Conference on Interaction Design and Children

Interactive tabletops are an exiting new platform for supporting children's collaboration. With design guidelines and standardized interaction principles still immature, there is a considerable need for iterative prototyping to define the task and ...
Recognizing Unintentional Touch on Interactive Tabletop

A multi-touch interactive tabletop is designed to embody the benefits of a digital computer within the familiar surface of a physical tabletop. However, the nature of current multi-touch tabletops to detect and react to all forms of touch, including ...
Touchless circular menus: toward an intuitive UI for touchless interactions with large displays
AVI '14: Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces

Researchers are exploring touchless interactions in diverse usage contexts. These include interacting with public displays, where mouse and keyboards are inconvenient, activating kitchen devices without touching them with dirty hands, or supporting ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

EICS '13: Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems

June 2013

356 pages

ISBN:9781450321389

DOI:10.1145/2494603

General Chairs:
Peter Forbrig
University of Rostock, Germany
,
Prasun Dewan
University of North Carolina, Chapel Hill, USA
,
Program Chairs:
Michael Harrison
Queen Mary University London
,
Kris Luyten
Hasselt University, Belgium

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 June 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

EICS'13

Sponsor:

SIGCHI

EICS'13: ACM SIGCHI Symposium on Engineering Interactive Computing Systems

June 24 - 27, 2013

London, United Kingdom

Acceptance Rates

EICS '13 Paper Acceptance Rate 20 of 86 submissions, 23%;

Overall Acceptance Rate 73 of 299 submissions, 24%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
437
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hesenius MKleffmann MGruhn V(2021)AugIR Meets GestureCards: A Digital Sketching Environment for Gesture-Based ApplicationsInteracting with Computers10.1093/iwcomp/iwab017Online publication date: 10-May-2021
https://doi.org/10.1093/iwcomp/iwab017
Xu XYu CWang YShi Y(2020)Recognizing Unintentional Touch on Interactive TabletopProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33810114:1(1-24)Online publication date: 18-Mar-2020
https://dl.acm.org/doi/10.1145/3381011
Yan YShi YYu CShi Y(2020)HeadCrossProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33809834:1(1-22)Online publication date: 14-Sep-2020
https://dl.acm.org/doi/10.1145/3380983
Hesenius MGruhn V(2019)GestureCardsProceedings of the ACM on Human-Computer Interaction10.1145/33311643:EICS(1-35)Online publication date: 13-Jun-2019
https://dl.acm.org/doi/10.1145/3331164
Kolthoff KZimmermann TLawall JMarinov D(2019)Automatic generation of graphical user interface prototypes from unrestricted natural language requirementsProceedings of the 34th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE.2019.00148(1234-1237)Online publication date: 10-Nov-2019
https://dl.acm.org/doi/10.1109/ASE.2019.00148
Chechik MGrünbacher P(2018)Guest editorialAutomated Software Engineering10.1007/s10515-017-0222-525:1(45-46)Online publication date: 1-Mar-2018
https://dl.acm.org/doi/10.1007/s10515-017-0222-5
Kleffmann MRöhl SBook MGruhn V(2018)Evaluation of a traceability approach for informal freehand sketchesAutomated Software Engineering10.1007/s10515-017-0221-625:1(1-43)Online publication date: 1-Mar-2018
https://dl.acm.org/doi/10.1007/s10515-017-0221-6
Hesenius MKleffmann MGruhn V(2016)Sketching Gesture-Based Applications in a Collaborative Working Environment with Wall-Sized Displays2016 International Conference on Collaboration Technologies and Systems (CTS)10.1109/CTS.2016.0066(327-336)Online publication date: Oct-2016
https://doi.org/10.1109/CTS.2016.0066
Marco JCerezo EBaldassarri S(2016)Lowering the threshold and raising the ceiling of tangible expressiveness in hybrid board-gamesMultimedia Tools and Applications10.1007/s11042-014-2298-275:1(425-463)Online publication date: 1-Jan-2016
https://dl.acm.org/doi/10.1007/s11042-014-2298-2
Annett MGupta ABischof W(2014)Exploring and Understanding Unintended Touch during Direct Pen InteractionACM Transactions on Computer-Human Interaction10.1145/267491521:5(1-39)Online publication date: 21-Nov-2014
https://dl.acm.org/doi/10.1145/2674915
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents