research-article

Evaluating the Effects of Feedback Type on Older Adults' Performance in Mid-Air Pointing and Target Selection

Authors:

Arthur Theil Cabreira,

Faustina HwangAuthors Info & Claims

SUI '18: Proceedings of the 2018 ACM Symposium on Spatial User Interaction

Pages 111 - 119

https://doi.org/10.1145/3267782.3267933

Published: 13 October 2018 Publication History

Abstract

"Hands-free" pointing techniques used in mid-air gesture interaction require precise motor control and dexterity. Although being applied in a growing number of interaction contexts over the past few years, this input method can be challenging for older users (60+ years old) who experience natural decline in pointing abilities due to natural ageing process. We report the findings of a target acquisition experiment in which older adults had to perform "point-and-select" gestures in mid-air. The experiment investigated the effect of 6 feedback conditions on pointing and selection performance of older users. Our findings suggest that the bimodal combination of Visual and Audio feedback lead to faster target selection times for older adults, but did not lead to making less errors. Furthermore, target location on screen was found to play a more important role in both selection time and accuracy of point-and-select tasks than feedback type.

Supplementary Material

MP4 File (p111-cabreira.mp4)

Download
243.71 MB

References

[1]

Alex Butler, Shahram Izadi, and Steve Hodges. 2008. SideSight: multi-"touch" interaction around small devices. In Proceedings of the 21st annual ACM symposium on User interface software and technology (UIST '08). ACM, New York, NY, USA, 201--204.

Digital Library

[2]

Andy Cockburn and Stephen Brewster. 2005. Multimodal feedback for the acquisition of small targets. Ergonomics. 48, 9, 1129--1150.

[3]

Anna Dickinson, Roos Eisma, and Peter Gregor. 2011. The barriers that older novices encounter to computer use. Universal Access in the Information Society. 10, 3, 261--266.

Digital Library

[4]

Anne Köpsel, Päivi Majaranta, Poika Isokoski, Anke Huckauf. 2016. Effects of auditory, haptic and visual feedback on performing gestures by gaze or by hand. Behaviour & Information Technology. 35, 12: 1044--1062.

Digital Library

[5]

Aqueasha Martin-Hammond, Foad Hamidi, Tejas Bhalerao, Abdullah Ali, Catherine Hornback, Casey Means, and Amy Hurst. 2017. The Participatory Design of an Adaptive Interface to Support Users with Changing Pointing Ability. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17). ACM, New York, NY, USA, 343--344.

Digital Library

[6]

Arthur Theil Cabreira and Faustina Hwang. 2015. An analysis of mid-air gestures used across three platforms. In Proceedings of the 2015 British HCI Conference (British HCI '15). ACM, New York, NY, USA, 257--258.

Digital Library

[7]

Arthur Theil Cabreira and Faustina Hwang. 2016. How Do Novice Older Users Evaluate and Perform Mid-Air Gesture Interaction for the First Time?. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI '16). ACM, New York, NY, USA.

Digital Library

[8]

Caroline J. Ketcham and George E. Stelmach. 2001. Age-Related Declines in Motor Control. In Birren, J.E. & Schaie, K.W. (Eds.), Handbook of the Psychology of Aging. Academic Press.

[9]

Caroline J. Ketcham, Rachael D. Seidler, Arend W.A. Van Gemmert, and George E. Stelmach. 2002. Age-Related Kinematic Differences as Influenced by Task Difficulty, Target Size, and Movement. The Journals of Gerontology: Series B. 57, 1, 54--64.

[10]

Chris Harrison and Scott E. Hudson. 2009. Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (UIST '09). ACM, New York, NY, USA, 121--124.

Digital Library

[11]

Christian Stößel. 2009. Familiarity as a factor in designing finger gestures for elderly users. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '09).

Digital Library

[12]

Christian Winkler, Ken Pfeuffer, Enrico Rukzio. 2012. Investigating mid-air pointing interaction for projector phones. In Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces (ITS '12), 85--94.

Digital Library

[13]

Daniel Vogel and Ravin Balakrishnan. 2005. Distant freehand pointing and clicking on very large, high resolution displays. In Proceedings of the 18th annual ACM symposium on User interface software and technology (UIST '05), 33--42.

Digital Library

[14]

Euan Freeman, Stephen Brewster, and Vuokko Lantz. 2014. Tactile Feedback for Above-Device Gesture Interfaces: Adding Touch to Touchless Interactions. In Proceedings of the 16th International Conference on Multimodal Interaction (ICMI '14). ACM, New York, NY, USA, 419--426.

Digital Library

[15]

Euan Freeman, Stephen Brewster, and Vuokko Lantz. 2016. Do That, There: An Interaction Technique for Addressing In-Air Gesture Systems. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2319--2331.

Digital Library

[16]

Faizan Haque, Mathieu Nancel, Daniel Vogel. 2015. Myopoint: Pointing and Clicking Using Forearm Mounted Electromyography and Inertial Motion Sensors. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 3653--3656.

Digital Library

[17]

Faustina Hwang, Simeon Keates, Patrick Langdon, and P. John Clarkson. 2003. Multiple haptic targets for motion-impaired computer users. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 41--48.

Digital Library

[18]

Felicia Huppert. 2003. Designing for Older Users. In: P. John Clarkson, Roger Coleman, Simeon Keates, and Cherie Lebbon (Eds.), Inclusive Design: Design for the whole population. Springer, London.

[19]

Holly S. Vitense, Julie A. Jacko, and V. Kathlene Emery. 2002. Multimodal feedback: establishing a performance baseline for improved access by individuals with visual impairments. In Proceedings of the fifth international ACM conference on Assistive technologies (Assets '02). ACM, New York, NY, USA, 49--56.

Digital Library

[20]

Jan Bobeth, Susanne Schmehl, Ernst Kruijff, Stephanie Deutsch, and Manfred Tscheligi. 2012. Evaluating performance and acceptance of older adults using freehand gestures for TV menu control. In Proceedings of the 10th European Conference on Interactive TV and Video (EuroITV '12). ACM, New York, NY, USA, 35--44.

Digital Library

[21]

Jörg Müller, Matthias Geier, Christina Dicke, and Sascha Spors. 2014. The boomRoom: mid-air direct interaction with virtual sound sources. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 247--256.

Digital Library

[22]

Ju-Hwan Lee, Ellen Poliakoff, and Charles Spence. 2009. The Effect of Multimodal Feedback Presented via a Touch Screen on the Performance of Older Adults. In Proceedings of the 4th International Conference on Haptic and Audio Interaction Design (HAID '09). Springer, Berlin, Heidelberg, 128--135.

Digital Library

[23]

Julie Jacko, V. Kathlene Emery, Paula J. Edwards, Mahima Ashok, Leon Barnard, Thitima Kongnakorn, Kevin P. Moloney, and François Sainfort. 2004. The effects of multimodal feedback on older adults' task performance given varying levels of computer experience. Behaviour & Information Technology. 23, 4, 247--264.

[24]

Kathrin Gerling, Ian Livingston, Lennart Nacke, and Regan Mandryk. 2012. Full-body motion-based game interaction for older adults. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), 1873--1882.

Digital Library

[25]

Leah Findlater, Jon E. Froehlich, Kays Fattal, Jacob O. Wobbrock, and Tanya Dastyar. 2013. Age-related differences in performance with touchscreens compared to traditional mouse input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 343--346.

Digital Library

[26]

Mathieu Nancel, Emmanuel Pietriga, Olivier Chapuis, Michel Beaudouin- Lafon. 2015. Mid-Air Pointing on Ultra-Walls. ACM Trans. Comput.-Hum. Interact. 22, 5.

Digital Library

[27]

Mathieu Nancel, Julie Wagner, Emmanuel Pietriga, Olivier Chapuis, Wendy Mackay. 2011. Mid-air pan-and-zoom on wall-sized displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11), 177--186.

Digital Library

[28]

Motoyuki Akamastu, I. Scott MacKenzie, Thierry Hasbrouc. 1995. A comparison of tactile, auditory, and visual feedback in a pointing task using a mouse-type device. Ergonomics, 38, 816--827.

[29]

Peng Song, Wooi Boon Goh, William Hutama, Chi-Wing Fu, and Xiaopei Liu. 2012. A handle bar metaphor for virtual object manipulation with mid-air interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 1297--1306.

Digital Library

[30]

Sara J. Czaja and Chin Chin Lee. 2007. Information technology and older adults. In J. A. Jacko & A. Sears (Eds.), The Human Computer-Interaction Handbook (2nd ed., 777--792. Lawrence Erlbaum Associates, New York.

[31]

Sean Gustafson, Christian Holz, and Patrick Baudisch. 2011. Imaginary phone: learning imaginary interfaces by transferring spatial memory from a familiar device. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST '11). ACM, New York, NY, USA, 283--292.

Digital Library

[32]

Tom Carter, Sue Ann Seah, Benjamin Long, Bruce Drinkwater, and Sriram Subramanian. 2013. UltraHaptics: multi-point mid-air haptic feedback for touch surfaces. In Proceedings of the 26th annual ACM symposium on User interface software and technology (UIST '13). ACM, New York, NY, USA, 505--514.

Digital Library

[33]

Vanessa Vuibert, Wolfgang Stuerzlinger, and Jeremy R. Cooperstock. 2015. Evaluation of Docking Task Performance Using Mid-air Interaction Techniques. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction (SUI '15). ACM, New York, NY, USA, 44--52.

Digital Library

[34]

Vicki L. Hanson and Susan Crayne. 2005. Personalization of Web browsing: adaptations to meet the needs of older adults. Universal Access in the Information Society. 4, 1, 46--58.

Digital Library

[35]

Wijnand Ijsselsteijn, Henk Herman Nap, Yvonne de Kort, and Karolien Poels. 2007. Digital game design for elderly users. In Proceedings of the 2007 Conference on Future Play (Future Play '07). ACM, New York, NY, USA, 17--22.

Digital Library

[36]

Wei Lu, Zheng Tong, Jinghui Chu. 2016. Dynamic Hand Gesture Recognition With Leap Motion Controller. IEEE Signal Processing Letters. 23, 9: 1188--1192.

[37]

Ying Chih Wang, Richard W. Bohannon, Jay Kapellusch, Arun Garg, Richard C. Gershon. 2015. Dexterity as measured with the 9-Hole Peg Test (9-HPT) across the age span. Journal of Hand Therapy. 28, 1, 53--60.

Cited By

Thushara BAdithya VSreekanth N(2024)Gesture centric interaction: evaluating hand and head gestures in touchless cursor controlErgonomics10.1080/00140139.2024.2411302(1-21)Online publication date: 23-Oct-2024
https://doi.org/10.1080/00140139.2024.2411302
Schmid PLanger FMaier T(2021)Mid-Air Interaction by Way of a Virtual Slider in a Medical Use CaseProceedings of the 21st Congress of the International Ergonomics Association (IEA 2021)10.1007/978-3-030-74611-7_61(443-450)Online publication date: 8-May-2021
https://doi.org/10.1007/978-3-030-74611-7_61
Urbano IGuerreiro JNicolau H(2020)From skeuomorphism to flat design: age-related differences in performance and aesthetic perceptionsBehaviour & Information Technology10.1080/0144929X.2020.181486741:3(452-467)Online publication date: 2-Sep-2020
https://doi.org/10.1080/0144929X.2020.1814867
Show More Cited By

Index Terms

Evaluating the Effects of Feedback Type on Older Adults' Performance in Mid-Air Pointing and Target Selection
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Pointing

Recommendations

Movement Characteristics and Effects of GUI Design on How Older Adults Swipe in Mid-Air
ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

We conducted a study with 25 older adults that aimed to investigate how older users interact with swipe-based interactions in mid-air and how menu sizes may affect swipe characteristics. Our findings suggest that currently-implemented motion-based ...
How Do Novice Older Users Evaluate and Perform Mid-Air Gesture Interaction for the First Time?
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction

Mid-air gesture interaction is often considered as a "natural" and "intuitive" input method, however, there has been little investigation of how older adults perceive and interact with these interfaces. We report the preliminary results of an experiment ...
Understanding Older Adults' Perceptions of In-Home Sensors Using an Obtrusiveness Framework
Proceedings, Part II, of the 10th International Conference on Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience - Volume 9744

The aim of this study was to determine if dimensions and sub-categories of a previously-tested obtrusiveness framework were represented in interviews conducted with community-dwelling older adults at three- and six-month study visits during an in-home ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SUI '18: Proceedings of the 2018 ACM Symposium on Spatial User Interaction

October 2018

203 pages

ISBN:9781450357081

DOI:10.1145/3267782

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior

Conference

SUI '18

Sponsor:

SUI '18: Symposium on Spatial User Interaction

October 13 - 14, 2018

Berlin, Germany

Acceptance Rates

SUI '18 Paper Acceptance Rate 19 of 61 submissions, 31%;

Overall Acceptance Rate 86 of 279 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
217
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)4

Reflects downloads up to 14 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Thushara BAdithya VSreekanth N(2024)Gesture centric interaction: evaluating hand and head gestures in touchless cursor controlErgonomics10.1080/00140139.2024.2411302(1-21)Online publication date: 23-Oct-2024
https://doi.org/10.1080/00140139.2024.2411302
Schmid PLanger FMaier T(2021)Mid-Air Interaction by Way of a Virtual Slider in a Medical Use CaseProceedings of the 21st Congress of the International Ergonomics Association (IEA 2021)10.1007/978-3-030-74611-7_61(443-450)Online publication date: 8-May-2021
https://doi.org/10.1007/978-3-030-74611-7_61
Urbano IGuerreiro JNicolau H(2020)From skeuomorphism to flat design: age-related differences in performance and aesthetic perceptionsBehaviour & Information Technology10.1080/0144929X.2020.181486741:3(452-467)Online publication date: 2-Sep-2020
https://doi.org/10.1080/0144929X.2020.1814867
Abdullah Sani ZPetrie H(2019)Older Adults’ Number Entry Using Touchscreen and Keyboard-Mouse ComputersAdvances in Visual Informatics10.1007/978-3-030-34032-2_32(353-367)Online publication date: 2019
https://doi.org/10.1007/978-3-030-34032-2_32

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten