research-article

Personalized, Wearable Control of a Head-mounted Display for Users with Upper Body Motor Impairments

Authors:

Leah FindlaterAuthors Info & Claims

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Pages 221 - 230

https://doi.org/10.1145/2702123.2702188

Published: 18 April 2015 Publication History

Abstract

Head-mounted displays provide relatively hands-free interaction that could improve mobile computing access for users with motor impairments. To investigate this largely unexplored area, we present two user studies. The first, smaller study evaluated the accessibility of Google Glass, a head-mounted display, with 6 participants. Findings revealed potential benefits of a head-mounted display yet demonstrated the need for alternative means of controlling Glass-3 of the 6 participants could not use it at all. We then conducted a second study with 12 participants to evaluate a potential alternative input mechanism that could allow for accessible control of a head-mounted display: switch-based wearable touchpads that can be affixed to the body or wheelchair. The study assessed input performance with three sizes of touchpad, investigated personalization patterns when participants were asked to place the touchpads on their body or wheelchair, and elicited subjective responses. All 12 participants were able to use the touchpads to control the display, and patterns of touchpad placement point to the value of personalization in providing support for each user's motor abilities.

References

[1]

Anthony, L., Kim, Y., and Findlater, L. Analyzing usergenerated YouTube videos to understand touchscreen use by people with motor impairments. Proc. CHI'13, (2013), 1223--1232.

Digital Library

[2]

Ashbrook, D., Baudisch, P., and White, S. Nenya: subtle and eyes-free mobile input with a magnetically-tracked finger ring. Proc. CHI'11, (2011), 2043--2046.

Digital Library

[3]

Braun, V. and Clarke, V. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77--101.

[4]

Carrington, P., Hurst, A., and Kane, S.K. Wearables and Chairables: Inclusive Design of Mobile Input and Output Techniques for Power Wheelchair Users. Proc. CHI'14, (2014), 3103--3112.

Digital Library

[5]

Carrington, P., Hurst, A., Kane, S.K. The Gest-Rest: a pressure-sensitive chairable input pad for power wheelchair armrests. Proc. ASSETS'14, (2014), to appear.

Digital Library

[6]

Duff, S.N., Irwin, C.B., Skye, J.L., Sesto, M.E., and Wiegmann, D.A. The effect of disability and approach on touch screen performance during a number entry task. Proc. HFES'10, (2010), 566--570.

[7]

Froehlich, J., Wobbrock, J.O., and Kane, S.K. Barrier Pointing: Using Physical Edges to Assist Target Acquisition on Mobile Device Touch Screens. Proc. ASSETS'07, (2007), 19--26.

Digital Library

[8]

Guerreiro, T.J.V., Nicolau, H., Jorge, J., and Gonçalves, D. Assessing Mobile Touch Interfaces for Tetraplegics. Proc. MobileHCI'10, (2010), 31--34.

Digital Library

[9]

Gustafson, S., Holz, C., and Baudisch, P. Imaginary phone: learning imaginary interfaces by transferring spatial memory from a familiar device. Proc. UIST'11, (2011), 283--292.

Digital Library

[10]

Ha, K., Chen, Z., Hu, W., Richter, W., Pillai, P., and Satyanarayanan, M. Towards wearable cognitive assistance. Proc. MobiSys'14, (2014), 68--81.

Digital Library

[11]

Harrison, C. and Wilson, A.D. OmniTouch: wearable multitouch interaction everywhere. Proc. UIST'11, (2011), 441--450.

Digital Library

[12]

Huo, X., Park, H., Ghovanloo, M. Dual-mode tongue drive system. Proc. Wireless Health, (2012), 1--8.

Digital Library

[13]

International Organization for Standardization. Ergonomic requirements for office work with visual display terminals (VDTs)-Requirements for non-keyboard input devices (Ref. No. ISO 9241--9:2000(E)). 2002.

[14]

Irwin, C.B. and Sesto, M.E. Performance and touch characteristics of disabled and non-disabled participants during a reciprocal tapping task using touch screen technology. Applied Ergonomics 43, 6 (2012), 1038--1043.

[15]

Kane, S.K., Jayant, C., Wobbrock, J.O., and Ladner, R.E. Freedom to Roam: A Study of Mobile Device Adoption and Accessibility for People with Visual and Motor Disabilities. Proc. ASSETS'09, (2009), 115--122.

Digital Library

[16]

Kaufmann, B. and Buechley, L. Amarino. Proc. MobileHCI'10, (2010), 291.

Digital Library

[17]

Krevelen, D.W.F. Van and Poelman, R. A Survey of Augmented Reality Technologies, Applications and Limitations. Int'l J. of Virtual Reality 9, 2 (2010), 1.

[18]

Kumar, M., Paepcke, A., and Winograd, T. EyePoint. Proc. CHI'07, (2007), 421--430.

Digital Library

[19]

Kunze, K., Henze, N., and Kise, K. Wearable computing for older adults. UbiComp'14 Adjunct, (2014), 83--86.

Digital Library

[20]

Lee, T. and Hollerer, T. Handy AR: Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking. Proc. ISWC'07, (2007), 1--8.

Digital Library

[21]

Lyons, K., Nguyen, D.H., Ashbrook, D., and White, S. Facet: a multi-segment wrist worn system. Proc. UIST'12, (2012), 123--129.

Digital Library

[22]

Lyons, K., Starner, T., Plaisted, D., et al. Twiddler typing: one-handed chording text entry for mobile phones. Proc. CHI '04, (2004), 671--678.

Digital Library

[23]

Mathiowetz, V., Volland, G., Kashman, N., and Weber, K. Adult norms for the Box and Block Test of manual dexterity. American J. of Occupational Therapy 39, 6 (1985), 386--391.

[24]

Mazilu, S., Blanke, U., Hardegger, M., Tröster, G., Gazit, E., Hausdorff, J.M. GaitAssist: a daily-life support and training system for Parkinson's disease patients with freezing of gait. Proc. CHI'14, (2014), 2531--2540.

Digital Library

[25]

McNaney, R., Vines, J., Roggen, D., et al. Exploring the acceptability of Google Glass as an everyday assistive device for people with Parkinson's. Proc. CHI'14, (2014), 2551--2554.

Digital Library

[26]

Naftali, M. and Findlater, L. Accessibility in Context: Understanding the Truly Mobile Experience of Smartphone Users With Motor Impairments. Proc. ASSETS'14, (2014), To appear.

Digital Library

[27]

Olwal, A. and Feiner, S. SenseShapes: Using statistical geometry for object selection in a multimodal aug-mented reality system. Proc. ISMAR '03 (2003), 300.

Digital Library

[28]

Profita, H.P., Clawson, J., Gilliland, S., et al. Don't mind me touching my wrist. Proc. ISWC '13, (2013), 89.

[29]

Raya, R., Roa, J.O., Rocon, E., Ceres, R., and Pons, J.L. Wearable inertial mouse for children with physical and cognitive impairments. Sensors and Actuators A: Physical 162, 2 (2010), 248--259.

[30]

Rekimoto, J. GestureWrist and GesturePad: unobtrusive wearable interaction devices. Proc. ISCW'01, (2001), 21--27.

Digital Library

[31]

Saponas, T.S., Tan, D.S., Morris, D., Balakrishnan, R., Turner, J., and Landay, J.A. Enabling always-available input with muscle-computer interfaces. Proc. UIST'09, (2009), 167--176.

Digital Library

[32]

Shinohara, K. and Wobbrock, J.O. In the shadow of misperception. Proc. CHI'11, (2011), 705--714.

Digital Library

[33]

Trewin, S., Swart, C., and Pettick, D. Physical accessibility of touchscreen smartphones. Proc. ASSETS '13. Article 19, (2013), 1--8.

Digital Library

[34]

Wacharamanotham, C., Hurtmanns, J., Mertens, A., Kronenbuerger, M., Schlick, C., and Borchers, J. Evaluating swabbing: a touchscreen input method for elderly users with tremor. Proc. CHI'11, (2011), 623--626.

Digital Library

[35]

Wobbrock, J.O., Myers, B.A., and Kembel, J.A. EdgeWrite: A Stylus-Based Text Entry Method Designed for High Accuracy and Stability of Motion. Proc. UIST'03, (2003), 61--70.

Digital Library

[36]

Yamamoto, G., Kuroda, T., Yoshitake, D., et al. PiTaSu: wearable interface for assisting senior citizens with memory problems. Int'l Journal on Disability and Human Development 10, 4 (2011), 295--300.

[37]

Zhou, F., Duh, H.B.-L., and Billinghurst, M. Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. Proc. ISMAR'08, (2008), 193--202.

Digital Library

[38]

Zhou, H. and Hu, H. Human motion tracking for rehabilitation-A survey. Biomedical Signal Processing and Control 3, 1 (2008), 1--18.

Cited By

Lee JTjahjadi AKim JYu JPark MZhang JFroehlich JTian YZhao Y(2024)CookAR: Affordance Augmentations in Wearable AR to Support Kitchen Tool Interactions for People with Low VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676449(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676449
Sun QHu YFan MLi JWang S(2024)“Can It Be Customized According to My Motor Abilities?”: Toward Designing User-Defined Head Gestures for People with DystoniaProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642378(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642378
Andrei ABilius LVatavu R(2024)Take a Seat, Make a Gesture: Charting User Preferences for On-Chair and From-Chair Gesture InputProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642028(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642028
Show More Cited By

Index Terms

Personalized, Wearable Control of a Head-mounted Display for Users with Upper Body Motor Impairments
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Wearable Interactions for Users with Motor Impairments: Systematic Review, Inventory, and Research Implications
ASSETS '21: Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility

We conduct a systematic literature review on wearable interactions for users with motor impairments and report results from a meta-analysis of 57 scientific articles identified in the ACM DL and IEEE Xplore databases. Our findings show limited research ...
Understanding Gesture Input Articulation with Upper-Body Wearables for Users with Upper-Body Motor Impairments
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

We examine touchscreen stroke-gestures and mid-air motion-gestures articulated by users with upper-body motor impairments with devices worn on the wrist, finger, and head. We analyze users’ gesture input performance in terms of production time, ...
Exploring Accessible Smartwatch Interactions for People with Upper Body Motor Impairments
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Smartwatches are always-available, provide quick access to information in a mobile setting, and can collect continuous health and fitness data. However, the small interaction space of these wearables may pose challenges for people with upper body motor ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

April 2015

4290 pages

ISBN:9781450331456

DOI:10.1145/2702123

General Chairs:
Bo Begole
Huawei, USA
,
Jinwoo Kim
Yonsei University, Korea
,
Program Chairs:
Kori Inkpen
Microsoft Research, USA
,
Woontack Woo
KAIST, Korea

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

CHI '15

Sponsor:

SIGCHI

CHI '15: CHI Conference on Human Factors in Computing Systems

April 18 - 23, 2015

Seoul, Republic of Korea

Acceptance Rates

CHI '15 Paper Acceptance Rate 486 of 2,120 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

42
Total Citations
View Citations
985
Total Downloads

Downloads (Last 12 months)72
Downloads (Last 6 weeks)13

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lee JTjahjadi AKim JYu JPark MZhang JFroehlich JTian YZhao Y(2024)CookAR: Affordance Augmentations in Wearable AR to Support Kitchen Tool Interactions for People with Low VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676449(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676449
Sun QHu YFan MLi JWang S(2024)“Can It Be Customized According to My Motor Abilities?”: Toward Designing User-Defined Head Gestures for People with DystoniaProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642378(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642378
Andrei ABilius LVatavu R(2024)Take a Seat, Make a Gesture: Charting User Preferences for On-Chair and From-Chair Gesture InputProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642028(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642028
Yamagami MPortnova-Fahreeva AKong JWobbrock JMankoff J(2023)How Do People with Limited Movement Personalize Upper-Body Gestures? Considerations for the Design of Personalized and Accessible Gesture InterfacesProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608430(1-15)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3608430
Chi HSha JZhang Y(2023)Bring Environments to People – A Case Study of Virtual Tours in Accessibility Assessment for People with Limited MobilityProceedings of the 20th International Web for All Conference10.1145/3587281.3587292(96-103)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3587281.3587292
Bilius LUngurean OVatavu R(2023)An Expressivity-Complexity Tradeoff?: User-Defined Gestures from the Wheelchair Space are Mostly DeicticExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585695(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585695
Bilius LUngurean OVatavu R(2023)Understanding Wheelchair Users’ Preferences for On-Body, In-Air, and On-Wheelchair GesturesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580929(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580929
Dudley JYin LGaraj VKristensson P(2023)Inclusive Immersion: a review of efforts to improve accessibility in virtual reality, augmented reality and the metaverseVirtual Reality10.1007/s10055-023-00850-827:4(2989-3020)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1007/s10055-023-00850-8
Bedard AZhang Q(2023)Building an Inclusive Metaverse: Opening Doors to a Brighter Digital FutureHCI International 2023 – Late Breaking Papers10.1007/978-3-031-48041-6_23(333-351)Online publication date: 2-Dec-2023
https://doi.org/10.1007/978-3-031-48041-6_23
Sarsenbayeva ZVan Berkel NVelloso EGoncalves JKostakos V(2022)Methodological Standards in Accessibility Research on Motor Impairments: A SurveyACM Computing Surveys10.1145/354350955:7(1-35)Online publication date: 15-Dec-2022
https://dl.acm.org/doi/10.1145/3543509
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents