poster

Exploring requirements and opportunities of conversational user interfaces for the cognitively impaired

Authors:

Marc JennyAuthors Info & Claims

MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

Pages 119 - 126

https://doi.org/10.1145/3236112.3236128

Published: 03 September 2018 Publication History

Get Access

Abstract

Interacting with traditional user interfaces can be challenging for people with cognitive impairments. Speech-based conversational interfaces and virtual assistants such as Amazon's Alexa and Apple's Siri might provide great potential for this user group. Yet, knowledge about how cognitively impaired perceive such conversational interfaces and about the special requirements and opportunities is scarce. To gain first insights, we conducted a group interview with participants with mild to moderate cognitive impairments. They expressed their high expectations and imagined mobile conversational assistants for controlling vending machines, for example. Yet, they emphasized that smart assistants must not replace but rather complement personal contact with humans.

References

[1]

Clare Carroll, Catherine Chiodo, Adena Xin Lin, Meg Nidever, and Jayanth Prathipati. 2017. Robin: Enabling Independence For Individuals With Cognitive Disabilities Using Voice Assistive Technology. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17), 46--53.

Digital Library

Google Scholar

[2]

Danielle Elmasri and Anthony Maeder. 2016. A Conversational Agent for an Online Mental Health Intervention. In Brain Informatics and Health (Lecture Notes in Computer Science), 243--251.

Google Scholar

[3]

Peter Fröhlich, Antti Oulasvirta, Matthias Baldauf, and Antti Nurminen. 2011. On the Move, Wirelessly Connected to the World. Commun. ACM 54, 1: 132--138.

Digital Library

Google Scholar

[4]

Kyo-Joong Oh, Dongkun Lee, Byungsoo Ko, and Ho-Jin Choi. 2017. A Chatbot for Psychiatric Counseling in Mental Healthcare Service Based on Emotional Dialogue Analysis and Sentence Generation. In 2017 18th IEEE International Conference on Mobile Data Management (MDM), 371--375.

Crossref

Google Scholar

[5]

Srinivasan Ramakrishnan and Ibrahiem M. Emary. 2013. Speech Emotion Recognition Approaches in Human Computer Interaction. Telecommun. Syst. 52, 3: 1467--1478.

Digital Library

Google Scholar

[6]

Laurianne Sitbon and Shanjana Farhin. 2017. Co-designing Interactive Applications with Adults with Intellectual Disability: A Case Study. In Proceedings of the 29th Australian Conference on Computer-Human Interaction (OZCHI '17), 487--491.

Digital Library

Google Scholar

[7]

Yang Yang, Xiaojuan Ma, and Pascale Fung. 2017. Perceived Emotional Intelligence in Virtual Agents. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17), 2255--2262.

Digital Library

Google Scholar

[8]

Xiao Zhang, Wenzhong Li, Xu Chen, and Sanglu Lu. 2018. MoodExplorer: Towards Compound Emotion Detection via Smartphone Sensing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 4: 176:1--176:30.

Digital Library

Google Scholar

Cited By

View all

Rashik MJasim MKucher KSarvghad AMahyar N(2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661563
Zhang BTu ZWang CSun HChu D(2024)Requirements elicitation and response generation for conversational servicesApplied Intelligence10.1007/s10489-024-05454-654:7(5576-5592)Online publication date: 23-Apr-2024
https://doi.org/10.1007/s10489-024-05454-6
Boyle BO’Brolcháin F(2023)Understanding the Assistive Potential of Consumer Technologies: A Case Example of Smartphones, Smart Speakers, and Internet of Things TechnologiesTrends in Assistive Technologies10.5772/intechopen.110452Online publication date: 10-May-2023
https://doi.org/10.5772/intechopen.110452
Show More Cited By

Recommendations

Accessible conversational user interfaces: considerations for design
W4A '20: Proceedings of the 17th International Web for All Conference

Conversational user interfaces (CUIs), such as chatbots and voice assistants, are increasingly common in areas of day-to-day life, and can be expected to become ever more pervasive in the future. These interfaces are being designed for ever more complex ...
Conversational interfaces to robots

There is growing interest in robots that are designed specifically to interact with people and which respond to voice commands. Very little attention has been paid, however, to the kind of verbal interaction that is possible or desirable with robots. ...
Spoken Language, Conversational Assistive Systems for People with Cognitive Impairments?: Yes, If.
ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility

We analyzed autonomous conversational spoken interaction as a modality for assistive systems in initial groups of older adults and people with cognitive impairments; we had previously explored this in a WOz setup. Solving a simple task in the domain of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

September 2018

445 pages

ISBN:9781450359412

DOI:10.1145/3236112

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 September 2018

Check for updates

Author Tags

Qualifiers

Poster

Conference

MobileHCI '18

Sponsor:

SIGCHI

MobileHCI '18: 20th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 3 - 6, 2018

Barcelona, Spain

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
618
Total Downloads

Downloads (Last 12 months)60
Downloads (Last 6 weeks)6

Reflects downloads up to 20 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Rashik MJasim MKucher KSarvghad AMahyar N(2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661563
Zhang BTu ZWang CSun HChu D(2024)Requirements elicitation and response generation for conversational servicesApplied Intelligence10.1007/s10489-024-05454-654:7(5576-5592)Online publication date: 23-Apr-2024
https://doi.org/10.1007/s10489-024-05454-6
Boyle BO’Brolcháin F(2023)Understanding the Assistive Potential of Consumer Technologies: A Case Example of Smartphones, Smart Speakers, and Internet of Things TechnologiesTrends in Assistive Technologies10.5772/intechopen.110452Online publication date: 10-May-2023
https://doi.org/10.5772/intechopen.110452
Renz ANeff TBaldauf MMaier E(2023)Authentication methods for voice services on smart speakers – a multi-method study on perceived security and ease of usei-com10.1515/icom-2022-003922:1(67-81)Online publication date: 29-Mar-2023
https://doi.org/10.1515/icom-2022-0039
Iniesto FCoughlan TLister KDevine PFreear NGreenwood RHolmes WKenny IMcLeod KTudor R(2023)Creating ‘a Simple Conversation’: Designing a Conversational User Interface to Improve the Experience of Accessing Support for StudyACM Transactions on Accessible Computing10.1145/356816616:1(1-29)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3568166
Zobel TSteinbeck HMeinel C(2023)Towards Inclusive Education: A Review of and Guide to Accessible Features in Chatbots for MOOCs2023 IEEE Learning with MOOCS (LWMOOCS)10.1109/LWMOOCS58322.2023.10306062(1-5)Online publication date: 11-Oct-2023
https://doi.org/10.1109/LWMOOCS58322.2023.10306062
Sornalakshmi MAbinash MGopalakrishnan SKasthuri RNivedhitha Harini CBalamurugan K(2023)Deep Learning-Powered Face Recognition Attendance System: A Novel Approach to Automated Prediction2023 2nd International Conference on Automation, Computing and Renewable Systems (ICACRS)10.1109/ICACRS58579.2023.10405373(1076-1081)Online publication date: 11-Dec-2023
https://doi.org/10.1109/ICACRS58579.2023.10405373
Zubatiy TVickers KSaurman JGoldstein FRodriguez AMathur NMynatt E(2023)A Distributed Cognition Approach to Understanding Compensatory Calendaring Cognitive Systems of Older Adults with Mild Cognitive Impairment and Their Care PartnersProceedings of the 15th International Conference on Ubiquitous Computing & Ambient Intelligence (UCAmI 2023)10.1007/978-3-031-48306-6_19(190-201)Online publication date: 25-Nov-2023
https://doi.org/10.1007/978-3-031-48306-6_19
Renz ABaldauf MMaier EAlt F(2022)Alexa, It’s Me! An Online Survey on the User Experience of Smart Speaker AuthenticationProceedings of Mensch und Computer 202210.1145/3543758.3543765(14-24)Online publication date: 4-Sep-2022
https://dl.acm.org/doi/10.1145/3543758.3543765
Ilyas QAhmad MZaman NAlshamari MAhmed I(2022)Localized Text-Free User InterfacesIEEE Access10.1109/ACCESS.2021.313952510(2357-2371)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2021.3139525
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Accessible conversational user interfaces: considerations for design

Conversational interfaces to robots

Spoken Language, Conversational Assistive Systems for People with Cognitive Impairments?: Yes, If.