Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3544548.3581447acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

“Where is history”: Toward Designing a Voice Assistant to help Older Adults locate Interface Features quickly

Published: 19 April 2023 Publication History

Abstract

Older adults often struggle to locate a function quickly in feature-rich user interfaces (UIs). Mobile UIs not only pack a ton of features in a small screen but also get frequent updates to their visual layouts—thereby exacerbating the problem. This paper explores a design solution where users could search for a UI feature using spoken-word queries. We investigated: 1) what type of questions older users ask when facing interaction challenges in unfamiliar scenarios, 2) how those query types compare with younger users’ inquiries, and 3) how older adults use a voice assistant design probe in a Wizard-of-Oz (WoZ) study. Results reveal five query types when verbally articulating interaction issues: validation, directed and undirected informational, navigational, and conceptual. In the WoZ study, older users typically asked for help following a series of non-unique or off-task feature selections (n = 13/15), and in 77% of those instances, they completed the task in the next interaction.

Supplementary Material

MP4 File (3544548.3581447-video-preview.mp4)
Video Preview
MP4 File (3544548.3581447-talk-video.mp4)
Pre-recorded Video Presentation

References

[1]
AARP. 2021. AARP Foundation - for a future without senior poverty. Retrieved December 12, 2022 from https://www.aarp.org/aarp-foundation/.
[2]
Sofianiza Abd Malik and Alistair DN Edwards. 2010. Investigation of cultural dependency in mobile technology and older adults. In CHI’10 Extended Abstracts on Human Factors in Computing Systems. 3835–3840.
[3]
Akiko Aizawa. 2003. An information-theoretic perspective of tf–idf measures. Information Processing & Management 39, 1 (2003), 45–65.
[4]
Amos Azaria, Jayant Krishnamurthy, and Tom M Mitchell. 2016. Instructable Intelligent Personal Agent. In AAAI, Vol. 4.
[5]
Yvonne Barnard, Mike D Bradley, Frances Hodgson, and Ashley D Lloyd. 2013. Learning to use new technologies by older adults: Perceived difficulties, experimentation behaviour and usability. Computers in Human Behavior 29, 4 (2013), 1715–1724.
[6]
Eva Brandt, Thomas Binder, Lone Malmborg, and Tomas Sokoler. 2010. Communities of everyday practice and situated elderliness as an approach to co-design for senior interaction. In Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction. 400–403.
[7]
Virginia Braun and Victoria Clarke. 2012. Thematic analysis.(2012).
[8]
Andrei Broder. 2002. A taxonomy of web search. In ACM Sigir forum, Vol. 36. ACM New York, NY, USA, 3–10.
[9]
Fan Bu, Xingwei Zhu, Yu Hao, and Xiaoyan Zhu. 2010. Function-based question classification for general QA. In Proceedings of the 2010 conference on empirical methods in natural language processing. 1119–1128.
[10]
L Buis, D Singer, E Solway, M Kirch, J Kullgren, and P Malani. 2020. Telehealth use among older adults before and during COVID-19. University of Michigan National Poll on Healthy Aging (2020).
[11]
Debaleena Chattopadhyay, Francesca Salvadori, Kenton O’hara, and Sean Rintel. 2018. Beyond presentation: Shared slideware control as a resource for collocated collaboration. Human–Computer Interaction 33, 5-6 (2018), 455–498.
[12]
Pei-Yu Chi, Sally Ahn, Amanda Ren, Mira Dontcheva, Wilmot Li, and Björn Hartmann. 2012. MixT: automatic generation of step-by-step mixed media tutorials. In Proceedings of the 25th annual ACM symposium on User interface software and technology. 93–102.
[13]
Sara J. Czaja, Walter R. Boot, Neil Charness, and Wendy A. Rogers. 2019. Designing for Older Adults: Principles and Creative Human Factors Approaches (3 ed.). CRC Press. https://doi.org/10.1201/b22189
[14]
Sara J Czaja and Chin Chin Lee. 2007. The impact of aging on access to technology. Universal access in the information society 5, 4 (2007), 341–349.
[15]
Mark Dunlop, Andreas Komninos, Emma Nicol, and Iain Hamiliton. 2014. Shake’n’Tap: a gesture enhanced keyboard for older adults. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services. 525–530.
[16]
Rahhal Errattahi, Asmaa El Hannani, and Hassan Ouahmane. 2018. Automatic speech recognition errors detection and correction: A review. Procedia Computer Science 128 (2018), 32–37.
[17]
Mingming Fan, Qiwen Zhao, and Vinita Tibdewal. 2021. Older adults’ think-aloud verbalizations and speech features for identifying user experience problems. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.
[18]
Carolyn L Foss. 1989. Detecting lost users: Empirical studies on browsing hypertext.
[19]
Helene Gelderblom, Tobie van Dyk, and Judy van Biljon. 2010. Mobile phone adoption: Do existing models adequately capture the actual usage of older adults?. In Proceedings of the 2010 annual research conference of the south african institute of computer scientists and information technologists. 67–74.
[20]
Ido Guy. 2016. Searching by talking: Analysis of voice queries on mobile web search. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. 35–44.
[21]
Graeme S Halford, Nelson Cowan, and Glenda Andrews. 2007. Separating cognitive capacity from knowledge: A new hypothesis. Trends in cognitive sciences 11, 6 (2007), 236–242.
[22]
Christina N Harrington, Radhika Garg, Amanda Woodward, and Dimitri Williams. 2022. “It’s Kind of Like Code-Switching”: Black Older Adults’ Experiences with a Voice Assistant for Health Information Seeking. (2022).
[23]
Rebecca Hill, Paul Beynon-Davies, and Michael D Williams. 2008. Older people and internet engagement: Acknowledging social moderators of internet adoption, access and use. Information Technology & People(2008).
[24]
Bora Jin, Junghwan Kim, and Lisa M Baumgartner. 2019. Informal learning of older adults in using mobile devices: A review of the literature. Adult Education Quarterly 69, 2 (2019), 120–141.
[25]
Xiaofu Jin, Xiaozhu Hu, Xiaoying Wei, and Mingming Fan. 2022. Synapse: Interactive Guidance by Demonstration with Trial-and-Error Support for Older Adults to Use Smartphone Apps. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 3 (2022), 1–24.
[26]
Brittne Kakulla. 2021. 2020 Tech Ownership and Use. Retrieved December 12, 2022 from https://doi.org/10.26419/res.00420.004.
[27]
Brittne Kakulla. 2021. 2021 Barriers and Digital Inequities. Retrieved December 12, 2022 from https://doi.org/10.26419/res.00420.003.
[28]
Brittne Kakulla. 2021. 2021 Tech Trends and the 50-Plus: Top 10 Biggest Trends.Retrieved December 12, 2022 from https://doi.org/10.26419/res.00420.011.
[29]
B Kakulla. 2021. 2021 Tech Trends and the 50+: Top 10 Biggest Trends.
[30]
Brittne Kakulla. 2021. 2022 Tech Trends and Adults 50-Plus.Retrieved December 12, 2022 from https://doi.org/10.26419/res.00493.001.
[31]
Pegah Karimi, Kallista Ballard, Pooja Vazirani, Ravi Teja Narasimha Jorigay, and Aqueasha Martin-Hammond. 2022. Designing Conversational Assistants to Support Older Adults’ Personal Health Record Access. In International Conference on Pervasive Computing Technologies for Healthcare. Springer, 253–271.
[32]
Sunyoung Kim and Abhishek Choudhury. 2021. Exploring older adults’ perception and use of smart speaker-based voice assistants: A longitudinal study. Computers in Human Behavior 124 (2021), 106914.
[33]
Bran Knowles and Vicki L Hanson. 2018. The Wisdom of Older Technology (Non-) Users. Commun. ACM 61, 3 (2018), 72–77.
[34]
Bran Knowles, Vicki L Hanson, Yvonne Rogers, Anne Marie Piper, Jenny Waycott, Nigel Davies, Aloha Hufana Ambe, Robin N Brewer, Debaleena Chattopadhyay, Marianne Dee, 2021. The harm in conflating aging with accessibility. Commun. ACM 64, 7 (2021), 66–71.
[35]
Mandy Korzetz, Romina Kühn, Lukas Büschel, Franz-Wilhelm Schumann, Uwe Aßmann, and Thomas Schlegel. 2020. Introducing Mobile Device-Based Interactions to Users: An Investigation of Onboarding Tutorials. In International Conference on Human-Computer Interaction. Springer, 428–442.
[36]
Qingchuan Li and Yan Luximon. 2016. Older adults and digital technology: A study of user perception and usage behavior. In Advances in physical ergonomics and human factors. Springer, 155–163.
[37]
Qingchuan Li and Yan Luximon. 2020. Older adults’ use of mobile device: usability challenges while navigating various interfaces. Behaviour & Information Technology 39, 8 (2020), 837–861.
[38]
Qingchuan Li, Yan Luximon, 2018. Understanding older adults’ post-adoption usage behavior and perceptions of mobile technology. (2018).
[39]
Toby Jia-Jun Li, Amos Azaria, and Brad A Myers. 2017. SUGILITE: creating multimodal smartphone automation by demonstration. In Proceedings of the 2017 CHI conference on human factors in computing systems. 6038–6049.
[40]
Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, and Jason Baldridge. 2020. Mapping natural language instructions to mobile UI action sequences. arXiv preprint arXiv:2005.03776(2020).
[41]
Jiao Liu, Yanling Li, and Min Lin. 2019. Review of intent detection methods in the human-machine dialogue system. In Journal of Physics: Conference Series, Vol. 1267. IOP Publishing, 012059.
[42]
Shareen Mahmud, Jessalyn Alvina, Parmit K Chilana, Andrea Bunt, and Joanna McGrenere. 2020. Learning through exploration: how children, adults, and older adults interact with a new feature-rich application. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14.
[43]
Matej Martinc, Blaž Škrlj, and Senja Pollak. 2020. TNT-KID: Transformer-based neural tagger for keyword identification. Natural Language Engineering(2020), 1–40.
[44]
Rui Mata, Lael J Schooler, and Jörg Rieskamp. 2007. The aging decision maker: cognitive aging and the adaptive selection of decision strategies.Psychology and aging 22, 4 (2007), 796.
[45]
Carolyn Pang, Zhiqin Collin Wang, Joanna McGrenere, Rock Leung, Jiamin Dai, and Karyn Moffatt. 2021. Technology Adoption and Learning Preferences for Older Adults: Evolving Perceptions, Ongoing Challenges, and Emerging Design Opportunities. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.
[46]
Andraž Petrovčič, Walter R Boot, Tomaž Burnik, and Vesna Vesna Dolničar. 2019. Improving the Measurement of Older Adults’ Mobile Device Proficiency: Results and Implications from a Study of Older Adult Smartphone Users. IEEE Access 7(2019), 150412–150422.
[47]
Research Center Pew. 2021. Mobile Fact Sheet. Retrieved October, 2021 from https://www.pewresearch.org/internet/fact-sheet/mobile/.
[48]
Anne Marie Piper, Raymundo Cornejo Garcia, and Robin N Brewer. 2016. Understanding the challenges and opportunities of smart mobile devices among the oldest old. International Journal of Mobile Human Computer Interaction (IJMHCI) 8, 2(2016), 83–98.
[49]
Alisha Pradhan, Amanda Lazar, and Leah Findlater. 2020. Use of intelligent voice assistants by older adults with low technology use. ACM Transactions on Computer-Human Interaction (TOCHI) 27, 4(2020), 1–27.
[50]
Jennifer C Romano Bergstrom, Erica L Olmsted-Hawala, and Matt E Jans. 2013. Age-related differences in eye tracking and usability performance: website usability for older adults. International Journal of Human-Computer Interaction 29, 8(2013), 541–548.
[51]
Daniel E Rose and Danny Levinson. 2004. Understanding user goals in web search. In Proceedings of the 13th international conference on World Wide Web. 13–19.
[52]
Nina Sakhnini and Debaleena Chattopadhyay. 2022. A Review of Smartphone Fact-Checking Apps and their (Non) Use Among Older Adults. In Adjunct Publication of the 24th International Conference on Human-Computer Interaction with Mobile Devices and Services. 1–8.
[53]
Neil Selwyn, Stephen Gorard, John Furlong, and Louise Madden. 2003. Older adults’ use of information and communications technology in everyday life. Ageing & Society 23, 5 (2003), 561–582.
[54]
Jack Sidnell and Tanya Stivers. 2012. The handbook of conversation analysis. Vol. 121. John Wiley & Sons.
[55]
Robyn Speer, Joshua Chin, and Catherine Havasi. 2017. Conceptnet 5.5: An open multilingual graph of general knowledge. In Thirty-first AAAI conference on artificial intelligence.
[56]
Brodrick Stigall and Kelly Caine. 2020. A Systematic Review of Human Factors Literature About Voice User Interfaces and Older Adults. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 64. SAGE Publications Sage CA: Los Angeles, CA, 13–17.
[57]
Brodrick Stigall, Jenny Waycott, Steven Baker, and Kelly Caine. 2019. Older adults’ perception and use of voice user interfaces: a preliminary review of the computing literature. In Proceedings of the 31st Australian Conference on Human-Computer-Interaction. 423–427.
[58]
Brendan Strahm, Colin M Gray, and Mihaela Vorvoreanu. 2018. Generating mobile application onboarding insights through minimalist instruction. In Proceedings of the 2018 Designing Interactive Systems Conference. 361–372.
[59]
Tiffany Tong, Mark Chignell, Mary C Tierney, and Jacques Lee. 2016. A serious game for clinical assessment of cognitive status: validation study. JMIR serious games 4, 1 (2016), e5006.
[60]
Joan Vermeulen, Jacques CL Neyens, Marieke D Spreeuwenberg, Erik van Rossum, Walther Sipers, Herbert Habets, David J Hewson, and Luc P De Witte. 2013. User-centered development and testing of a monitoring system that provides feedback regarding physical functioning to elderly people. Patient preference and adherence 7 (2013), 843.
[61]
Andrea Vianello, Luca Chittaro, Stefano Burigat, and Riccardo Budai. 2017. MotorBrain: a mobile app for the assessment of users’ motor performance in neurology. Computer methods and programs in biomedicine 143 (2017), 35–47.
[62]
John Vines, Stephen Lindsay, Gary W Pritchard, Mabel Lie, David Greathead, Patrick Olivier, and Katie Brittain. 2013. Making family care work: dependence, privacy and remote home monitoring telecare systems. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing. 607–616.
[63]
Lin Wang, Pei-Luen Patrick Rau, and Gavriel Salvendy. 2011. Older adults’ acceptance of information technology. Educational Gerontology 37, 12 (2011), 1081–1099.
[64]
Josh Wardini. 2022. Voice search statistics 2022: Smart speakers, VA, and users: Serpwatch. https://serpwatch.io/blog/voice-search-statistics/
[65]
Jenny Waycott, Frank Vetere, Sonja Pedell, Amee Morgans, Elizabeth Ozanne, and Lars Kulik. 2016. Not for me: Older adults choosing not to participate in a social isolation intervention. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 745–757.
[66]
Tzu-Ning Wen, Po-Liang Cheng, and Po-Lun Chang. 2017. Evaluate the usability of the mobile instant messaging software in the elderly. In MEDINFO 2017: Precision Healthcare through Informatics. IOS Press, 818–822.
[67]
Leigh Ann Wilson, Kate O’Loughlin, Robyn Hector, and Deborah Ann Black. 2021. Using a smartphone application (App) to assist older adults to navigate their local area during extreme weather events and changing environmental conditions: A qualitative study. Australasian Journal on Ageing 40, 1 (2021), e95–e99.
[68]
Jason Wu, Gabriel Reyes, Sam C White, Xiaoyi Zhang, and Jeffrey P Bigham. 2021. When can accessibility help? an exploration of accessibility feature recommendation on mobile devices. In Proceedings of the 18th International Web for All Conference. 1–12.
[69]
Ja Eun Yu and Debaleena Chattopadhyay. 2020. "Maps are hard for me": How Older Adults Struggle with Mobile Maps. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility. in press.
[70]
Ja Eun Yu and Debaleena Chattopadhyay. 2020. Supporting Older Adults in Locating Mobile Interface Features with Voice Input. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility. in press.
[71]
Mingyuan Zhong, Gang Li, Peggy Chi, and Yang Li. 2021. HelpViz: Automatic Generation of Contextual Visual Mobile Tutorials from Text-Based Instructions. In The 34th Annual ACM Symposium on User Interface Software and Technology. 1144–1153.
[72]
Jia Zhou, Pei-Luen Patrick Rau, and Gavriel Salvendy. 2012. Use and design of handheld computers for older adults: A review and appraisal. International Journal of Human-Computer Interaction 28, 12(2012), 799–826.

Cited By

View all
  • (2024)How Proficiency and Feelings impact the Preference and Perception of Mobile Technology Support in Older AdultsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3688520(1-5)Online publication date: 27-Oct-2024
  • (2024)Development and Evaluation of the Mobile Tech Support Questionnaire for Older AdultsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675661(1-18)Online publication date: 27-Oct-2024
  • (2024)Overcoming Barriers, Achieving Goals: A Case Study of an Older User's Technology AutonomyExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3637150(1-7)Online publication date: 11-May-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
April 2023
14911 pages
ISBN:9781450394215
DOI:10.1145/3544548
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 April 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. accessibility
  2. aging
  3. design
  4. mobile interface
  5. older adults
  6. speech input
  7. voice assistant

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

CHI '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)483
  • Downloads (Last 6 weeks)94
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)How Proficiency and Feelings impact the Preference and Perception of Mobile Technology Support in Older AdultsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3688520(1-5)Online publication date: 27-Oct-2024
  • (2024)Development and Evaluation of the Mobile Tech Support Questionnaire for Older AdultsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675661(1-18)Online publication date: 27-Oct-2024
  • (2024)Overcoming Barriers, Achieving Goals: A Case Study of an Older User's Technology AutonomyExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3637150(1-7)Online publication date: 11-May-2024
  • (2024)Reducing the Search Space on demand helps Older Adults find Mobile UI Features quickly, on par with Younger AdultsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642796(1-22)Online publication date: 11-May-2024
  • (2024)Elderly-Centric Chromatics: Unraveling the Color Preferences and Visual Needs of the Elderly in Smart APP InterfacesInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2338659(1-10)Online publication date: 15-Apr-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media