research-article

Multi-finger chords for hand-held tablets: recognizable and memorable

Authors:

Eric Lecolinet,

Ted SelkerAuthors Info & Claims

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2883 - 2892

https://doi.org/10.1145/2556288.2556958

Published: 26 April 2014 Publication History

Abstract

Despite the demonstrated benefits of multi-finger input, todays gesture vocabularies offer a limited number of postures and gestures. Previous research designed several posture sets, but does not address the limited human capacity of retaining them. We present a multi-finger chord vocabulary, introduce a novel hand-centric approach to detect the identity of fingers on off-the-shelf hand-held tablets, and report on the detection accuracy. A between-subjects experiment comparing "random" to a "categorized" chord-command mapping found that users retained categorized mappings more accurately over one week than random ones. In response to the logical posture-language structure, people adapted to logical memorization strategies, such as 'exclusion', 'order', and 'category', to minimize the amount of information to retain. We conclude that structured chord-command mappings support learning, short-, and long-term retention of chord- command mappings.

References

[1]

Anderson, F., and Bischof, W. F. Learning and performance with gesture guides. In CHI '13, ACM (2013), 1109--1118.

Digital Library

[2]

Annett, M., Grossman, T., Wigdor, D., and Fitzmaurice, G. Medusa: a proximity-aware multi-touch tabletop. In UIST '11, ACM (2011), 337--346.

Digital Library

[3]

Au, O. K.-C., and Tai, C.-L. Multitouch finger registration and its applications. In OZCHI '10, ACM (2010), 41--48.

Digital Library

[4]

Bailly, G., Demeure, A., Lecolinet, E., and Nigay, L. MultiTouch menu (MTM). In IHM '08, ACM (2008), 165--168.

Digital Library

[5]

Bailly, G., Lecolinet, E., and Guiard, Y. Finger-count & radial-stroke shortcuts: 2 techniques for augmenting linear menus on multi-touch surfaces. In CHI '10, ACM (2010), 591--594.

Digital Library

[6]

Bailly, G., Lecolinet, E., and Nigay, L. Flower menus: a new type of marking menu with large menu breadth, within groups and effficient expert mode memorization. In AVI '08, ACM (2008), 15--22.

Digital Library

[7]

Bau, O., and Mackay, W. E. OctoPocus: a dynamic guide for learning gesture-based command sets. In UIST '08, ACM (2008), 37--46.

Digital Library

[8]

Beaudouin-Lafon, M., Huot, S., Nancel, M., Mackay, W., Pietriga, E., Primet, R., Wagner, J., Chapuis, O., Pillias, C., Eagan, J., Gjerlufsen, T., and Klokmose, C. Multisurface interaction in the WILD room. Computer 45, 4 (2012), 48--56.

Digital Library

[9]

Benko, H., Wilson, A. D., and Baudisch, P. Precise selection techniques for multi-touch screens. In CHI '06, ACM (2006), 1263--1272.

Digital Library

[10]

Bower, G. H., Clark, M. C., Lesgold, A. M., and Winzenz, D. Hierarchical retrieval schemes in recall of categorized word lists. Journal of Verbal Learning and Verbal Behavior 8, 3 (June 1969), 323--343.

[11]

Buxton, W. An informal study of selection-positioning tasks. ACM (1982), 323--328.

[12]

Fix, E., and Hodges, J. L. Discriminatory analysis. nonparametric discrimination: Consistency properties. International Statistical Review / Revue Internationale de Statistique 57, 3 (Dec. 1989), 238--247.

[13]

Ghomi, E., Huot, S., Bau, O., Beaudouin-Lafon, M., and Mackay, W. E. Arpfiege: Learning multitouch chord gestures vocabularies. In ITS '13, ACM (2013), 209--218.

Digital Library

[14]

Jego, J.-F., Paljic, A., and Fuchs, P. User-defined gestural interaction: A study on gesture memorization. In 2013 IEEE Symposium on 3D User Interfaces (3DUI) (2013), 7--10.

[15]

Lepinski, G. J., Grossman, T., and Fitzmaurice, G. The design and evaluation of multitouch marking menus. In CHI '10, ACM (2010), 2233--2242.

Digital Library

[16]

Mandler, G. Organization and memory. The psychology of learning and motivation: I (1967), 381.

[17]

McDonald, J., Stone, J., and Liebelt, L. Searching for items in menus: The effects of organization and type of target. Proc. of the Human Factors and Ergonomics Society Annual Meeting 27, 9 (Oct. 1983), 834--837.

[18]

Miller, G. A. The magical number seven, plus or minus two: Some limits on our capacity for processing information. The Psychological Review 63, 2 (Mar. 1956), 81--97.

[19]

Missile, U. S. A. Human Engineering Design Data Digest. Human Engineering Laboratory Detachment, 1984.

[20]

Morris, M. R., Wobbrock, J. O., and Wilson, A. D. Understanding users' preferences for surface gestures. In GI '10, Canadian Information Processing Society (2010), 261--268.

Digital Library

[21]

Nacenta, M. A., Kamber, Y., Qiang, Y., and Kristensson, P. O. Memorability of pre-designed and user-defined gesture sets. In CHI '13, ACM (2013), 1099--1108.

Digital Library

[22]

Payne, S. J., and Green, T. R. G. Task-action grammars: A model of the mental representation of task languages. SIGCHI Bull. 19, 1 (July 1987), 93--133.

Digital Library

[23]

Peter, A. L., Foltz, P. W., and Polson, P. G. Memory for task-action mappings: Mnemonics, regularity, and consistency. International Journal of Human-Computer Studies 40 (1994), 771--794.

Digital Library

[24]

Ramakers, R., Vanacken, D., Luyten, K., Coninx, K., and Schöning, J. Carpus: a non-intrusive user Identification technique for interactive surfaces. In UIST '12, ACM (2012), 35--44.

Digital Library

[25]

Richter, S., Holz, C., and Baudisch, P. Bootstrapper: recognizing tabletop users by their shoes. In CHI '12, ACM (2012), 1249--1252.

Digital Library

[26]

Roudaut, A., Lecolinet, E., and Guiard, Y. MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb. In CHI '09, ACM (2009), 927--936.

Digital Library

[27]

Schmidt, D., Chong, M. K., and Gellersen, H. HandsDown: hand-contour-based user Identification for interactive surfaces. In NordiCHI '10, ACM (2010), 432--441.

Digital Library

[28]

Wang, F., Cao, X., Ren, X., and Irani, P. Detecting and leveraging finger orientation for interaction with direct-touch surfaces. In UIST '09, ACM (2009), 23--32.

Digital Library

[29]

Westerman, W. Hand Tracking, Finger Identification, and Chordic Manipulation on a Multi-Touch Surface. PhD thesis, University of Delaware, 1999.

[30]

Wobbrock, J. O., Morris, M. R., and Wilson, A. D. User-defined gestures for surface computing. In CHI '09, CHI '09, ACM (2009), 1083--1092.

Digital Library

[31]

Wu, M., Shen, C., Ryall, K., Forlines, C., and Balakrishnan, R. Gesture registration, relaxation, and reuse for multi-point direct-touch surfaces. In TABLETOP '06, IEEE Computer Society (2006), 185--192.10

Digital Library

Cited By

Jiang HWeng DDongye XLuo LZhang Z(2023)Commonsense Knowledge-Driven Joint Reasoning Approach for Object Retrieval in Virtual RealityACM Transactions on Graphics10.1145/361832042:6(1-18)Online publication date: 5-Dec-2023
https://dl.acm.org/doi/10.1145/3618320
Goguey AOrtega M(2023)Studies and guidelines for two concurrent stroke gesturesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102942170:COnline publication date: 1-Feb-2023
https://dl.acm.org/doi/10.1016/j.ijhcs.2022.102942
Bailly GMalacria S(2022)Command SelectionHandbook of Human Computer Interaction10.1007/978-3-319-27648-9_19-1(1-35)Online publication date: 12-Mar-2022
https://doi.org/10.1007/978-3-319-27648-9_19-1
Show More Cited By

Index Terms

Multi-finger chords for hand-held tablets: recognizable and memorable
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Finger identification and hand gesture recognition techniques for natural user interface
APCHI '13: Proceedings of the 11th Asia Pacific Conference on Computer Human Interaction

The natural user interface using hand gesture have been popular field in Human-Computer-Interaction(HCI). Many research papers have been proposed in this field. They proposed vision-based, glove-based and depth-based approach for hand gesture ...
Multi-scenario gesture recognition using Kinect
CGAMES '12: Proceedings of the 2012 17th International Conference on Computer Games: AI, Animation, Mobile, Interactive Multimedia, Educational & Serious Games (CGAMES)

Hand gesture recognition (HGR) is an important research topic because some situations require silent communication with sign languages. Computational HGR systems assist silent communication, and help people learn a sign language. In this article, a ...
Finger controller: natural user interaction using finger gestures
HCI'13: Proceedings of the 15th international conference on Human-Computer Interaction: interaction modalities and techniques - Volume Part IV

We present a new natural user interaction technique using finger gesture recognition and finger identification with Kinect depth data. We developed a gesture version drawing, multi-touch and mapping on 3d space interactions. We implemented three type ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2014

4206 pages

ISBN:9781450324731

DOI:10.1145/2556288

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI '14 Paper Acceptance Rate 465 of 2,043 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

34
Total Citations
View Citations
644
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)1

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jiang HWeng DDongye XLuo LZhang Z(2023)Commonsense Knowledge-Driven Joint Reasoning Approach for Object Retrieval in Virtual RealityACM Transactions on Graphics10.1145/361832042:6(1-18)Online publication date: 5-Dec-2023
https://dl.acm.org/doi/10.1145/3618320
Goguey AOrtega M(2023)Studies and guidelines for two concurrent stroke gesturesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102942170:COnline publication date: 1-Feb-2023
https://dl.acm.org/doi/10.1016/j.ijhcs.2022.102942
Bailly GMalacria S(2022)Command SelectionHandbook of Human Computer Interaction10.1007/978-3-319-27648-9_19-1(1-35)Online publication date: 12-Mar-2022
https://doi.org/10.1007/978-3-319-27648-9_19-1
Oh SPark CJeon YChoi S(2021)Identifying Contact Fingers on Touch Sensitive Surfaces by Ring-Based Vibratory CommunicationThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474745(208-222)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474745
Park KKim DHeo SLee GBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)MagTouch: Robust Finger Identification for a Smartwatch Using a Magnet Ring and a Built-in MagnetometerProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376234(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376234
Xiao YHe R(2019)The intuitive grasp interface: design and evaluation of micro-gestures on the steering wheel for driving scenarioUniversal Access in the Information Society10.1007/s10209-019-00647-0Online publication date: 5-Apr-2019
https://doi.org/10.1007/s10209-019-00647-0
Perelman GSerrano MBortolaso CPicard CDerras MDubois E(2019)Combining Tablets with Smartphones for Data AnalyticsHuman-Computer Interaction – INTERACT 201910.1007/978-3-030-29390-1_24(439-460)Online publication date: 2-Sep-2019
https://dl.acm.org/doi/10.1007/978-3-030-29390-1_24
Yan YYu CYi XShi Y(2018)HeadGestureProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/32870762:4(1-23)Online publication date: 27-Dec-2018
https://dl.acm.org/doi/10.1145/3287076
Perelman GSerrano MPicard CBortolaso CDerras MDubois EKubicki SGirard PCalvary GLavoué E(2018)Combination of tactile devices to interact with a spreadsheet on tabletProceedings of the 30th Conference on l'Interaction Homme-Machine10.1145/3286689.3286697(20-29)Online publication date: 23-Oct-2018
https://dl.acm.org/doi/10.1145/3286689.3286697
Fruchard BLecolinet EChapuis OCatarci TNorman KMecella M(2018)Impact of semantic aids on command memorization for on-body interaction and directional gesturesProceedings of the 2018 International Conference on Advanced Visual Interfaces10.1145/3206505.3206524(1-9)Online publication date: 29-May-2018
https://dl.acm.org/doi/10.1145/3206505.3206524
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten