short-paper

Enabling accessibility through multimodality?: interaction modality choices of older adults

Authors:

Julia Himmelsbach,

Markus Garschall,

Sebastian Egger,

Susanne Steffek,

Manfred TscheligiAuthors Info & Claims

MUM '15: Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia

Pages 195 - 199

https://doi.org/10.1145/2836041.2836060

Published: 30 November 2015 Publication History

Abstract

In this work, we identify influencing factors on modality choices of older adults. In detail, we investigated when and why older adults prefer speech over touch interaction and vice versa when interacting with a mobile multimodal health and wellbeing service. We conducted a study with 19 older adults using a mobile application with a duration of three to six weeks. Due to this long duration of the study we were able to gain highly external valid insights as our results are based on real world experiences. We identify additional influencing factors within the areas of user characteristics, contextual factors and perceived system characteristics. We outline the impact of the factors and highlight the importance of several of these factors to enable accessible user interfaces. Our results provide first steps towards a more holistic model of modality choices taking into account interdependencies of different factors.

References

[1]

Bilici, V., Krahmer, E., Riele, S., and Veldhuis, R. 2000. Preferred modalities in dialogue systems. In Proceedings of the 6th International Conference on Spoken Language Processing (ICSLP '00), 727--730.

[2]

Cox, A. L., Cairns, P. A., Walton, A. and Lee, S. 2008. Tlk or txt? Using voice input for SMS composition. Personal Ubiquitous Computing 12, 8: 567--588.

Digital Library

[3]

D'Andrea, A., D'Ulizia, A. Ferri, F. and Grifoni, P. 2009. A multimodal pervasive framework for ambient assisted living. In Proceedings of the 2nd International Conference on PErvasive Technologies Related to Assistive Environments (PETRA '09), Article 39, 8 pages.

Digital Library

[4]

Dumas, B., Lalanne, D., Oviatt, S. 2009. Multimodal interfaces: A survey of principles, models and frameworks. Human Machine Interaction 5440: 3--26.

Digital Library

[5]

Flanagan, J. C. 1954. The Critical Incident Technique. Psychological bulletin 5, 4), 327--358.

[6]

Ghosh, S. and Joshi, A. 2013. Exploration of multimodal input interaction based on goals. In Proceedings of the 11th Asia Pacific Conference on Computer Human Interaction (APCHI '13), 83--92.

Digital Library

[7]

Hedicke, V. 2000. Multimodalität in Mensch-Maschine-Schnittstellen. In Mensch-Maschine-Systemtechnik, Timpe, K. P., Jürgensohn, T. and Kolrep (Eds.) Symposion Publishing, Düsseldorf, Germany, 203--230.

[8]

Jian, C., Shi, H., Sasse, N., Rachuy, C., Schafmeister, F., Schmidt, H. and von Steinbüchel, N. 2014. Modality Preference in Multimodal Interaction for Elderly Persons. In Biomedical Engineering Systems and Technologies, 6th International Joint Conference, BIOSTEC '13, Barcelona, Spain, February 11-14, 2013, Revised Selected Papers, 452, 378--393.

[9]

Kahneman, D., Krueger, A. B., Schkade, D. A., Schwarz, N., and Stone, A. A. 2004. A survey method for characterizing daily life experience: The day reconstruction method. Science 306, 5702: 1776--1780.

[10]

Kamvar, M. and Beeferman, D. 2010. Say what? Why users choose to speak their web queries. In Proceedings of 11th Annual Conference of the International Speech Communication Association (Interspeech '10), 1966--1969.

[11]

Lemmelä, S., Vetek, A., Mäkelä, K. and Trendafilov, D. 2008. Designing and evaluating multimodal interaction for mobile contexts. In Proceedings of the 10th international conference on Multimodal Interfaces (ICMI '08), 265--272.

Digital Library

[12]

Mayring, P.2014. Qualitative Content Analysis. Theoretical Foundation, Basic Procedures and Software Solution. Retrieved October, 2014 from Social Science Open Access Repository (SSOAR): http://nbn-resolving.de/urn:nbn:de:0168-ssoar-395173.

[13]

Naumann, A. N., Wechsung, I, Möller, S. 2008. Factors Influencing Modality Choice in Multimodal Applications. Perception in Multimodal Dialogue Systems. 4th IEEE Tutorial and Research Workshop on Perception and Interactive Technologies for Speech-Based Systems, PIT 2008, Kloster Irsee, Germany, June 16-18, 2008. Proceedings. Lecture Notes in Computer Science, 5078, 37--43.

Digital Library

[14]

Oviatt, S. L. 1999. Ten myths of multimodal interaction. Communications of the ACM 42, 11: 576--583.

Digital Library

[15]

Rudnicky, A. I. 1993. Mode preference in a simple data-retrieval task. In Proceedings of the workshop on Human Language Technology (HLT '93), 364--369.

Digital Library

[16]

Schaffer, S., Schleicher, R. and Möller, S. 2015. Modeling input modality choice in mobile graphical and speech interfaces. International Journal of Human-Computer Studies 75: 21--34.

Digital Library

[17]

Scheibelhofer, E. 2008. Combining Narration-Based Interviews with Topical Interviews: Methodological Reflections on Research Practices. International Journal of Social Research Methodology 11, 5: 403--416.

[18]

Schlögl, S., Garschall, M. and Tscheligi, M. 2014. Designing Natural Language User Interfaces with Elderly Users. Workshop on Designing Speech and Language Interactions at the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI '14).

[19]

Schüssel, F., Honold, F. and Michael W. 2013. Influencing factors on multimodal interaction during selection tasks. Journal on Multimodal User Interfaces 7, 4: 200--310.

[20]

Suhm, B., Myers, B. and Waibel, A. 1999. Model-based and empirical evaluation of multimodal interactive error correction. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI '99), 584--591.

Digital Library

[21]

Wasinger R. and Krüger, A. 2006. Modality preferences in mobile and instrumented environments. In Proceedings of the 11th international conference on Intelligent user interfaces (IUI '06), 336--338.

Digital Library

[22]

Wechsung, I. 2014. An Evaluation Framework for Multimodal Interaction. Determining Quality Aspects and Modality Choice. Springer International Publishing.

Digital Library

[23]

Wechsung, I., Engelbrecht, K.-P., Kühnel, C., Möller, S. and Weiss, B.2012. Measuring the Quality of Service and Quality of Experience of multimodal human-machine interaction. Journal on Multimodal User Interfaces 6, 1-2: 73--85.

[24]

Witzel, A. 2000. The Problem-Centered Interview. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research 1, 1: Retrieved October, 2014 from http://www.qualitative-research.net/index.php/fqs/article/view/1132/2521

Cited By

Rodriguez RSullivan BBarrera Machuca MBatmaz ATornatzky COrtega F(2024)An Artists' Perspectives on Natural Interactions for Virtual Reality 3D SketchingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642758(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642758
Adjagbodjou AKaufman G(2024)Envisioning Support-Centered Technologies for Language Practice and Use: Needs and Design Opportunities for Immigrant English Language Learners (ELLs)Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642236(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642236
El Kamali MAngelini LLalanne DAbou Khaled OMugellini E(2023)Older adults' perspectives on multimodal interaction with a conversational virtual coachFrontiers in Computer Science10.3389/fcomp.2023.11258955Online publication date: 7-Nov-2023
https://doi.org/10.3389/fcomp.2023.1125895
Show More Cited By

Index Terms

Enabling accessibility through multimodality?: interaction modality choices of older adults
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces
      2. Natural language interfaces
  2. Interaction design
    1. Interaction design process and methods
      1. User interface design

Recommendations

Mobile multimodal interaction for older and younger users: exploring differences and similarities
MUM '17: Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia

Since they can integrate a wide range of interactive modalities, multimodal interfaces are considered to improve accessibility for a variety of users, including older adults. However, only few works have actually explored how older adults approach ...
Effects of Multimodal Feedback on the Usability of Mobile Diet Diary for Older Adults
UAHCI '09: Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services

Globally, overweight is an increasing problem and this especially the case for older adults, facing physical challenges and who need to maintain a healthy diet. eHealth services, such as a digital diet diary could support them. Consequently, we designed ...
Polite or Direct? Conversation Design of a Smart Display for Older Adults Based on Politeness Theory
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Conversational interfaces increasingly rely on human-like dialogue to offer a natural experience. However, relying on dialogue involving multiple exchanges for even simple tasks can overburden users, particularly older adults. In this paper, we explored ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MUM '15: Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia

November 2015

442 pages

ISBN:9781450336055

DOI:10.1145/2836041

General Chairs:
Clemens Holzmann
University of Applied Sciences Upper Austria, Hagenberg, Austria
,
René Mayrhofer
Johannes Kepler University Linz, Linz, Austria
,
Program Chairs:
Jonna Häkkilä
University of Lapland
,
Enrico Rukzio
University of Ulm
,
Publications Chair:
Michael Roland
University of Applied Sciences Upper Austria

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

FH OOE: University of Applied Sciences Upper Austria
Johannes Kepler Univ Linz: Johannes Kepler Universität Linz

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 November 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

Österreichische Forschungsförderungsgesellschaft

Conference

MUM '15

Sponsor:

FH OOE
Johannes Kepler Univ Linz

MUM '15: 14th International Conference on Mobile and Ubiquitous Multimedia

November 30 - December 2, 2015

Linz, Austria

Acceptance Rates

MUM '15 Paper Acceptance Rate 33 of 89 submissions, 37%;

Overall Acceptance Rate 190 of 465 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
308
Total Downloads

Downloads (Last 12 months)41
Downloads (Last 6 weeks)3

Reflects downloads up to 01 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rodriguez RSullivan BBarrera Machuca MBatmaz ATornatzky COrtega F(2024)An Artists' Perspectives on Natural Interactions for Virtual Reality 3D SketchingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642758(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642758
Adjagbodjou AKaufman G(2024)Envisioning Support-Centered Technologies for Language Practice and Use: Needs and Design Opportunities for Immigrant English Language Learners (ELLs)Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642236(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642236
El Kamali MAngelini LLalanne DAbou Khaled OMugellini E(2023)Older adults' perspectives on multimodal interaction with a conversational virtual coachFrontiers in Computer Science10.3389/fcomp.2023.11258955Online publication date: 7-Nov-2023
https://doi.org/10.3389/fcomp.2023.1125895
Pednekar SDhirawani PShah RShekokar NGhag K(2023)Voice-Based Interaction for an Aging Population: A Systematic Review2023 3rd International Conference on Intelligent Communication and Computational Techniques (ICCT)10.1109/ICCT56969.2023.10075801(1-8)Online publication date: 19-Jan-2023
https://doi.org/10.1109/ICCT56969.2023.10075801
Sin JMunteanu CChen DThreatt J(2022)Avoiding mixed messages: research-based fact-checking the media portrayals of voice user interfaces for older adultsHuman–Computer Interaction10.1080/07370024.2022.209812938:3-4(235-258)Online publication date: 14-Jul-2022
https://doi.org/10.1080/07370024.2022.2098129
Paraschivoiu ISypniewski JLupp AGärtner MMiteva NGospodinova ZTruong KHeylen DCzerwinski MBerthouze NChetouani MNakano M(2020)Coaching Older Adults: Persuasive and Multimodal Approaches to Coaching for Daily LivingCompanion Publication of the 2020 International Conference on Multimodal Interaction10.1145/3395035.3425312(256-260)Online publication date: 25-Oct-2020
https://dl.acm.org/doi/10.1145/3395035.3425312
Pradhan ALazar AFindlater L(2020)Use of Intelligent Voice Assistants by Older Adults with Low Technology UseACM Transactions on Computer-Human Interaction10.1145/337375927:4(1-27)Online publication date: 16-Sep-2020
https://dl.acm.org/doi/10.1145/3373759
Schiavo GMich OFerron MMana N(2020)Trade-offs in the design of multimodal interaction for older adultsBehaviour & Information Technology10.1080/0144929X.2020.185176841:5(1035-1051)Online publication date: 3-Dec-2020
https://doi.org/10.1080/0144929X.2020.1851768
Baptista SWadley GBird DOldenburg BSpeight J(2019)User experiences with a type 2 diabetes coaching app: a qualitative study (Preprint)JMIR Diabetes10.2196/16692Online publication date: 31-Oct-2019
https://doi.org/10.2196/16692
Schiavo GMich OFerron MMana NHenze NWoźniak PVäänänen KWilliamson JSchneegass S(2017)Mobile multimodal interaction for older and younger usersProceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia10.1145/3152832.3156615(407-414)Online publication date: 26-Nov-2017
https://dl.acm.org/doi/10.1145/3152832.3156615
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents