research-article

jQMultiTouch: lightweight toolkit and development framework for multi-touch/multi-device web interfaces

Authors:

Michael Nebeling,

Moira NorrieAuthors Info & Claims

EICS '12: Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems

Pages 61 - 70

https://doi.org/10.1145/2305484.2305497

Published: 25 June 2012 Publication History

Abstract

Application developers currently have to deal with the increased proliferation of new touch devices and the diversity in terms of both the native platform support for common gesture-based interactions and touch input sensing and processing techniques, in particular, for custom multi-touch behaviours. This paper presents jQMultiTouch - a lightweight web toolkit and development framework for multi-touch interfaces that can run on many different devices and platforms. jQMultiTouch is inspired from the popular jQuery toolkit for implementing interfaces in a device-independent way based on client-side web technologies. Similar to jQuery, the framework resolves cross-browser compatibility issues and implementation differences between device platforms by providing a uniform method for the specification of multi-touch interface elements and associated behaviours that seamlessly translate to browser-specific code. At the core of jQMultiTouch is a novel input stream query language for filtering and processing touch event data based on an extensible set of match predicates and aggregate functions. We demonstrate design simplicity for developers along several example applications and discuss performance, scalability and portability of the framework.

References

[1]

Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Bouillon, L., and Vanderdonckt, J. A Unifying Reference Framework for Multi- Target User Interfaces. IWC 15 (2003).

[2]

Ceri, S., Daniel, F., Matera, M., and Facca, F. M. Model-driven Development of Context-Aware Web Applications. TOIT 7, 1 (2007).

Digital Library

[3]

Charland, A., and LeRoux, B. Mobile Application Development: Web vs. Native. CACM 54, 5 (2011).

Digital Library

[4]

Chen, Y., Ma, W., and Zhang, H. Detecting Web Page Structure for Adaptive Viewing on Small Form Factor Devices. In Proc. WWW (2003).

Digital Library

[5]

Dietz, P. H., and Leigh, D. DiamondTouch: A Multi-User Touch Technology. In Proc. UIST (2001).

Digital Library

[6]

Echtler, F., and Klinker, G. A Multitouch Software Architecture. In Proc. NordiCHI (2008).

Digital Library

[7]

Esenther, A., and Wittenburg, K. Multi-User Multi-Touch Games on DiamondTouch with the DTFlash Toolkit. In Proc. INTETAIN (2005).

Digital Library

[8]

8. Frăsincar, F., Houben, G.-J., and Barna, P. Hypermedia presentation generation in Hera. IS 35, 1 (2010).

Digital Library

[9]

Hansen, T. E., Hourcade, J. P., Virbel, M., Patali, S., and Serra, T. PyMT: A Post-WIMP Multi-Touch User Interface Toolkit. In Proc. ITS (2009).

Digital Library

[10]

Hattori, G., Hoashi, K., Matsumoto, K., and Sugaya, F. Robust Web Page Segmentation for Mobile Terminal Using Content-Distances and Page Layout Information. In Proc. WWW (2007).

Digital Library

[11]

Hinrichs, U., and Carpendale, S. Gestures in the Wild: Studying Multi-Touch Gesture Sequences on Interactive Tabletop Exhibits. In Proc. CHI (2011).

Digital Library

[12]

Kaltenbrunner, M., Bovermann, T., Bencina, R., and Costanza, E. TUIO: A Protocol for Table-Top Tangible User Interfaces. In Proc. GW (2005).

[13]

Kammer, D., Keck, M., Freitag, G., and Wacker, M. Taxonomy and Overview of Multi-touch Frameworks: Architecture, Scope and Features. In Proc. EICS, Workshop on Engineering Patterns for Multi-Touch Interfaces (2010).

[14]

Kin, K., Hartmann, B., DeRose, T., and Agrawala, M. Proton: Multitouch Gestures as Regular Expressions. In Proc. CHI (to appear).

Digital Library

[15]

Kratz, S. G., Westermann, T., Rohs, M., and Essl, G. CapWidgets: Tangible Widgets versus Multi-Touch Controls on Mobile Devices. In Proc. CHI Extended Abstracts (2011).

Digital Library

[16]

Laufs, U., Ruff, C., and Zibuschka, J. MT4j - A Cross-platform Multi-touch Development Framework. In Proc. EICS, Workshop on Engineering Patterns for Multi-Touch Interfaces (2010).

[17]

Nebeling, M., Grossniklaus, M., Leone, S., and Norrie, M. C. XCML: Providing Context-Aware Language Extensions for the Specification of Multi-Channel Web Applications. WWW 15, 4 (2012).

Digital Library

[18]

Niederhausen, M., van der Sluijs, K., Hidders, J., Leonardi, E., Houben, G.-J., and Meißner, K. Harnessing the Power of Semantics-Based, Aspect-Oriented Adaptation for AMACONT. In Proc. ICWE (2009).

Digital Library

[19]

Paternò F., Santoro, C., and Spano, L. MARIA: A Universal, Declarative, Multiple Abstraction-Level Language for Service-Oriented Applications in Ubiquitous Environments. TOCHI 16, 4 (2009).

Digital Library

[20]

Scholliers, C., Hoste, L., Signer, B., and Meuter, W. D. Midas: A Declarative Multi-Touch Interaction Framework. In Proc. TEI (2011).

Digital Library

[21]

Shen, C., Vernier, F., Forlines, C., and Ringel, M. DiamondSpin: an extensible toolkit for around-the-table interaction. In Proc. CHI (2004).

Digital Library

[22]

Signer, B., Kurmann, U., and Norrie, M. C. iGesture: A General Gesture Recognition Framework. In Proc. ICDAR (2007).

Digital Library

[23]

Wobbrock, J. O., Wilson, A. D., and Li, Y. Gestures without Libraries, Toolkits or Training: A $1 Recognizer for User Interface Prototypes. In Proc. UIST (2007).

Digital Library

[24]

Wu, M., and Balakrishnan, R. Multi-Finger and Whole Hand Gestural Interaction Techniques for Multi-User Tabletop Displays. In Proc. UIST (2003).

Digital Library

Cited By

Bateman SGutwin CMansoor HNacenta Mvan der Kamp MBaliesnyi MGagnon KRollheiser J(2023)WAMS: A Flexible API for Visual Workspaces Across Multiple SurfacesProceedings of the ACM on Human-Computer Interaction10.1145/35932367:EICS(1-40)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3593236
Brudy FLedo DPahud MHenry Riche NHolz CWaghmare ASurale HPeinado MZhang XJoyner SChandramouli BMinhas UGoldstein JBuxton WHinckley KIqbal SMacLean KChevalier FMueller S(2020)SurfaceFleet: Exploring Distributed Interactions Unbounded from Device, Application, User, and TimeProceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379337.3415874(7-21)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3379337.3415874
Brudy FHolz CRädle RWu CHouben SKlokmose CMarquardt NBrewster SFitzpatrick GCox AKostakos V(2019)Cross-Device TaxonomyProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300792(1-28)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300792
Show More Cited By

Index Terms

jQMultiTouch: lightweight toolkit and development framework for multi-touch/multi-device web interfaces
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

EICS '12: Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems

June 2012

350 pages

ISBN:9781450311687

DOI:10.1145/2305484

General Chairs:
Simone D.J. Barbosa
PUC Rio de Janeiro, Brazil
,
José Creissac Campos
University of Minho, Portugal
,
Program Chairs:
Rick Kazman
Carnegie Mellon University and University of Hawai'i, USA
,
Philippe Palanque
University of Toulouse 3, France
,
Michael Harrison
Newcastle University, UK
,
Steve Reeves
University of Waikato, New Zealand

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

EICS'12

Sponsor:

SIGCHI

EICS'12: ACM SIGCHI Symposium on Engineering Interactive Computing Systems

June 25 - 26, 2012

Copenhagen, Denmark

Acceptance Rates

Overall Acceptance Rate 73 of 299 submissions, 24%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
620
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)1

Reflects downloads up to 20 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bateman SGutwin CMansoor HNacenta Mvan der Kamp MBaliesnyi MGagnon KRollheiser J(2023)WAMS: A Flexible API for Visual Workspaces Across Multiple SurfacesProceedings of the ACM on Human-Computer Interaction10.1145/35932367:EICS(1-40)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3593236
Brudy FLedo DPahud MHenry Riche NHolz CWaghmare ASurale HPeinado MZhang XJoyner SChandramouli BMinhas UGoldstein JBuxton WHinckley KIqbal SMacLean KChevalier FMueller S(2020)SurfaceFleet: Exploring Distributed Interactions Unbounded from Device, Application, User, and TimeProceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379337.3415874(7-21)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3379337.3415874
Brudy FHolz CRädle RWu CHouben SKlokmose CMarquardt NBrewster SFitzpatrick GCox AKostakos V(2019)Cross-Device TaxonomyProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300792(1-28)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300792
Ledo DHouben SVermeulen JMarquardt NOehlberg LGreenberg SMandryk RHancock MPerry MCox A(2018)Evaluation Strategies for HCI Toolkit ResearchProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173610(1-17)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173610
Fetter MBimamisa DGross T(2017)TUIOFXProceedings of the ACM on Human-Computer Interaction10.1145/30958121:EICS(1-18)Online publication date: 30-Jun-2017
https://dl.acm.org/doi/10.1145/3095812
Chan EAnslow CSeyed TMaurer F(2017)Envisioning the Emergency Operations Centre of the FutureCollaboration Meets Interactive Spaces10.1007/978-3-319-45853-3_15(349-372)Online publication date: 10-Jan-2017
https://doi.org/10.1007/978-3-319-45853-3_15
Nielsen MElmqvist NGrønbæk KDuh HLueg CBillinghust MHuang W(2016)Scribble queryProceedings of the 28th Australian Conference on Computer-Human Interaction10.1145/3010915.3010951(381-390)Online publication date: 29-Nov-2016
https://dl.acm.org/doi/10.1145/3010915.3010951
Larkin H(2015)A framework for programmatically designing user interfaces in JavaScriptInternational Journal of Pervasive Computing and Communications10.1108/IJPCC-03-2015-001411:3(254-269)Online publication date: 7-Sep-2015
https://doi.org/10.1108/IJPCC-03-2015-0014
Geronimo LAras ENorrie M(2015)Tilt-and-TapProceedings of the 15th International Conference on Engineering the Web in the Big Data Era - Volume 911410.1007/978-3-319-19890-3_36(565-582)Online publication date: 23-Jun-2015
https://dl.acm.org/doi/10.1007/978-3-319-19890-3_36
Larkin HWang STao YChen LLee C(2014)Issues in Programmatically Designing User Interfaces in JavaScriptProceedings of the 12th International Conference on Advances in Mobile Computing and Multimedia10.1145/2684103.2684129(72-76)Online publication date: 8-Dec-2014
https://dl.acm.org/doi/10.1145/2684103.2684129
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents