poster

JerkTilts: using accelerometers for eight-choice selection on mobile devices

Authors:

Mathias Baglioni,

Eric Lecolinet,

Yves GuiardAuthors Info & Claims

ICMI '11: Proceedings of the 13th international conference on multimodal interfaces

Pages 121 - 128

https://doi.org/10.1145/2070481.2070503

Published: 14 November 2011 Publication History

Abstract

This paper introduces JerkTilts, quick back-and-forth gestures that combine device pitch and roll. JerkTilts may serve as gestural self-delimited shortcuts for activating commands. Because they only depend on device acceleration and rely on a parallel and independent input channel, these gestures do not interfere with finger activity on the touch screen. Our experimental data suggest that recognition rates in an eight-choice selection task are as high with JerkTilts as with thumb slides on the touch screen. We also report data confirming that JerkTilts can be combined successfully with simple touch-screen operation. Data from a field study suggest that inadvertent JerkTilts are unlikely to occur in real-life contexts. We describe three illustrative implementations of JerkTilts, which show how the technique helps to simplify and shorten the sequence of actions to reach frequently used commands.

References

[1]

Bragdon A., Nelson E., Li Y., Hinckley K. 2011. Experimental Analysis of Touch-Screen Gesture Designs in Mobile Environments. In Proc. CHI'11.

Digital Library

[2]

Crossan A., Williamson J., Brewster S., Murray-Smith. R 2008. Wrist rotation for interaction in mobile contexts. In Proc. MobileHCI '08. ACM, 435--438.

Digital Library

[3]

Dachselt, R., Buchholz, R. 2008. Natural Throw and Tilt Interaction between Mobile Phones and Distant Displays. In Proc. CHI '09 Extended Abstracts.

Digital Library

[4]

Dearman, D., Karlson, A., Meyers, B., and Bederson, B. 2010. Multi-modal text entry and selection on a mobile device. In Proc GI'10.

Digital Library

[5]

Francone, J., Bailly, G., Lecolinet, E., Mandran, N., and Nigay, L. 2010. Wavelet menus on handheld devices: stacking metaphor for novice mode and eyes-free selection for expert mode. In Proc. AVI'10. ACM.

Digital Library

[6]

Harrison, B. L., Fishkin, K. P., Gujar, A., Mochon, C.,Want, R. 1998. Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces. In Proc. CHI'98, ACM 17--24.

Digital Library

[7]

Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. 2000. Sensing techniques for mobile interaction. In Proc. UIST'00. ACM, 91--100.

Digital Library

[8]

Hinckley K., Song H., 2011. Sensor Synaesthesia: Touch in Motion, and Motion in Touch. In Proc. CHI'11. ACM.

Digital Library

[9]

Jones, E., Alexander, J., Andreou, A., Irani, P., and Subramanian, S. 2010. GesText: accelerometer-based gestural text-entry systems. In Proc. CHI '10. ACM. 2173--2182.

Digital Library

[10]

Guiard, Y. 1993. On Fitts' and Hooke's laws : simple harmonic movement in upper-limb cyclical aiming. Acta Psychologica, 82, 139--159.

[11]

Kauppila M. 2008. Filler Models for Accelerometer Based Continuous Gesture Recognition. Sc.Thesis, Dept. of Mathematical Sciences, University of Oulu, May 2008.

[12]

KNN: http://en.wikipedia.org/wiki/K_nearest_neighbor_algorithm

[13]

Kurtenbach, G. and Buxton, W. 1991. Issues in combining marking and direct manipulation techniques. In Proc UIST '91. ACM, 137--144.

Digital Library

[14]

Oakley, I. and Park, J. 2007. A motion-based mark-ing menu system. In Proc. CHI'07. ACM, New York, NY, 2597--2602.

Digital Library

[15]

Partridge, K., Chatterjee, S., Sazawal, V., Borriello, G., and Want, R. 2002. TiltType: accelerometer-supported text entry for very small devices. In Proc. UIST '02. ACM.

Digital Library

[16]

Pook, S., Lecolinet, E., Vaysseix, G., and Barillot, E. 2000. Context and interaction in zoomable user interfaces. In Proc. AVI '00. ACM, 227--231.

Digital Library

[17]

Rahman, M., Gustafson, S., Irani, P., and Subramanian, S. 2009. Tilt techniques: investigating the dexterity of wrist-based input. In Proc. CHI'09. ACM, 1943--1952.

Digital Library

[18]

Rekimoto, J. (1996). Tilting operations for small screen interfaces. In Proc. UIST '96. ACM, 167--168.

Digital Library

[19]

Rehm, M., Nikolaus, B., and André, E. 2008. Wave like an Egyptian: accelerometer based gesture recognition for culture specific interactions. In Proc. BCS-HCI '08, Vol. 1. British Computer Society, 13--22.

Digital Library

[20]

Roudaut A., Baglioni M. et Lecolinet E. 2009. TimeTilt: Using Sensor-Based Gestures to Travel Through Multiple Applications on a Mobile Device. In Proc. INTERACT'09. Springer-Verlag.

Digital Library

[21]

Ruiz J., Li Y. 2011 DoubleFlip: A Motion Gesture Delimiter for Mobile Interaction. In Proc. CHI '11. ACM.

Digital Library

[22]

Sazawal, V., Want, W., and Borriello, G. 2002. The Unigesture Approach. In Proc. Mobile HCI '02. Fabio Paternè (Ed.). Springer-Verlag, 256--270.

Digital Library

[23]

Van Tonder, B., and Wesson, J. 2010. Is tilt interaction better than keypad interaction for mobile map-based applications?. In Proc. SAICSIT '10. ACM, 322--331.

Digital Library

[24]

Wigdor, D. and Balakrishnan, R. 2003. TiltText: using tilt for text input to mobile phones. In Proc. UIST'03. ACM, 81--90.

Digital Library

Cited By

Yeh YMatulic FVogel D(2023)Phone Sleight of Hand: Finger-Based Dexterous Gestures for Physical Interaction with Mobile PhonesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581121(1-19)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581121
Zand GRen YArif A(2022)TiltWalker: Operating a Telepresence Robot with One-Hand by Tilt Controls on a SmartphoneProceedings of the ACM on Human-Computer Interaction10.1145/35677256:ISS(381-406)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567725
Yeh YMatulic FVogel D(2022)Demonstrating Finger-Based Dexterous Phone GesturesAdjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526114.3558645(1-3)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526114.3558645
Show More Cited By

Index Terms

JerkTilts: using accelerometers for eight-choice selection on mobile devices
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Gaze+Gesture: Expressive, Precise and Targeted Free-Space Interactions
ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

Humans rely on eye gaze and hand manipulations extensively in their everyday activities. Most often, users gaze at an object to perceive it and then use their hands to manipulate it. We propose applying a multimodal, gaze plus free-space gesture ...
Touch+Finger: Extending Touch-based User Interface Capabilities with "Idle" Finger Gestures in the Air
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

In this paper, we present Touch+Finger, a new interaction technique that augments touch input with multi-finger gestures for rich and expressive interaction. The main idea is that while one finger is engaged in a touch event, a user can leverage the ...
Impact of mobile tangible slider design and its reachability on pointing performance
IHM '16: Actes de la 28ième conference francophone sur l'Interaction Homme-Machine

Touch interaction is almost omnipresent on mobile devices and technological advances have made screens bigger. The users can then interact with more content displayed on screen but it is more difficult for the users to reach all the parts of the screen ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '11: Proceedings of the 13th international conference on multimodal interfaces

November 2011

432 pages

ISBN:9781450306416

DOI:10.1145/2070481

General Chairs:
Hervé Bourlard
Idiap Research Institute, Switzerland
,
Thomas S. Huang
University of Illinois, USA
,
Enrique Vidal
Universitat Politécnica Valéncia, Spain
,
Program Chairs:
Daniel Gatica-Perez
Idiap Research Institute, Switzerland
,
Louis-Philippe Morency
University of Southern California, USA
,
Nicu Sebe
University of Trento, Italy

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

ICMI'11

Sponsor:

SIGCHI

ICMI'11: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 14 - 18, 2011

Alicante, Spain

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
417
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yeh YMatulic FVogel D(2023)Phone Sleight of Hand: Finger-Based Dexterous Gestures for Physical Interaction with Mobile PhonesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581121(1-19)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581121
Zand GRen YArif A(2022)TiltWalker: Operating a Telepresence Robot with One-Hand by Tilt Controls on a SmartphoneProceedings of the ACM on Human-Computer Interaction10.1145/35677256:ISS(381-406)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567725
Yeh YMatulic FVogel D(2022)Demonstrating Finger-Based Dexterous Phone GesturesAdjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526114.3558645(1-3)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526114.3558645
Sun ZWang SLiu CMa X(2022)Metaphoraction: Support Gesture-based Interaction Design with Metaphorical MeaningsACM Transactions on Computer-Human Interaction10.1145/351189229:5(1-33)Online publication date: 20-Oct-2022
https://dl.acm.org/doi/10.1145/3511892
Lee HAshok VConlan OHerder E(2021)Towards Enhancing Blind Users' Interaction Experience with Online Videos via Motion GesturesProceedings of the 32nd ACM Conference on Hypertext and Social Media10.1145/3465336.3475116(231-236)Online publication date: 30-Aug-2021
https://dl.acm.org/doi/10.1145/3465336.3475116
Hueber SCherek CWacker PBorchers JVoelker S(2020)Headbang: Using Head Gestures to Trigger Discrete Actions on Mobile Devices22nd International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3379503.3403538(1-10)Online publication date: 5-Oct-2020
https://dl.acm.org/doi/10.1145/3379503.3403538
Liu CWu NZhang JSu W(2019)Tilt Space: A Systematic Exploration of Mobile Tilt for Design PurposeHuman-Computer Interaction – INTERACT 201910.1007/978-3-030-29387-1_29(497-517)Online publication date: 2-Sep-2019
https://dl.acm.org/doi/10.1007/978-3-030-29387-1_29
Liu CLiu CMao HSu W(2019)Tilt-Scrolling: A Comparative Study of Scrolling Techniques for Mobile DevicesIntelligent Computing Methodologies10.1007/978-3-030-26766-7_18(189-200)Online publication date: 24-Jul-2019
https://doi.org/10.1007/978-3-030-26766-7_18
Schwank JRupprecht FSchöffel S(2017)Orientation-Based Interaction on Mobile Devices and Desktops - An EvaluationApplied Mechanics and Materials10.4028/www.scientific.net/AMM.869.244869(244-262)Online publication date: Aug-2017
https://doi.org/10.4028/www.scientific.net/AMM.869.244
Di Geronimo LCanonica AHusmann MNorrie MCampos JNunes N(2017)Continuous tilting interaction techniques on mobile devices for controlling public displaysProceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3102113.3102120(21-26)Online publication date: 26-Jun-2017
https://dl.acm.org/doi/10.1145/3102113.3102120
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents