research-article

Open access

CARMEN: A Cognitively Assistive Robot for Personalized Neurorehabilitation at Home

Authors:

Dagoberto Cruz-Sandoval,

Elizabeth W. Twamley,

Laurel D. RiekAuthors Info & Claims

HRI '24: Proceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction

Pages 55 - 64

https://doi.org/10.1145/3610977.3634971

Published: 11 March 2024 Publication History

Abstract

Cognitively assistive robots (CARs) have great potential to extend the reach of clinical interventions to the home. Due to the wide variety of cognitive abilities and rehabilitation goals, these systems must be flexible to support rapid and accurate implementation of intervention content that is grounded in existing clinical practice. To this end, we detail the system architecture of CARMEN (Cognitively Assistive Robot for Motivation and Neurorehabilitation), a flexible robot system we developed in collaboration with our key stakeholders: clinicians and people with mild cognitive impairment (PwMCI). We implemented a well-validated compensatory cognitive training (CCT) intervention on CARMEN, which it autonomously delivers to PwMCI. We deployed CARMEN in the homes of these stakeholders to evaluate and gain initial feedback on the system. We found that CARMEN gave participants confidence to use cognitive strategies in their everyday life, and participants saw opportunities for CARMEN to exhibit greater levels of autonomy or be used for other applications. Furthermore, elements of CARMEN are open source to support flexible home-deployed robots. Thus, CARMEN will enable the HRI community to deploy quality interventions to robots, ultimately increasing their accessibility and extensibility.

Supplemental Material

ZIP File

Download
91.95 KB

References

[1]

P. Alves-Oliveira, M. Bavier, S. Malandkar, R. Eldridge, J. Sayigh, E. A. Björling, and M. Cakmak. Flexi: A robust and flexible social robot embodiment kit. In Designing Interactive Systems Conference, pages 1177--1191, 2022.

Digital Library

[2]

E. Arnáiz and O. Almkvist. Neuropsychological features of mild cognitive impairment and preclinical alzheimer's disease. Acta Neurologica Scandinavica, 107:34--41, 2003.

[3]

M. P. Aylett and C. J. Pidcock. The cerevoice characterful speech synthesiser sdk. In IVA, pages 413--414. Citeseer, 2007.

Digital Library

[4]

A. Bangor, P. T. Kortum, and J. T. Miller. An empirical evaluation of the system usability scale. Intl. Journal of Human--Computer Interaction, 24(6):574--594, 2008.

[5]

E. M. Bender, T. Gebru, A. McMillan-Major, and S. Shmitchell. On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 ACM conference on fairness, accountability, and transparency, pages 610--623, 2021.

Digital Library

[6]

A. S. Bhat, C. Boersma, M. J. Meijer, M. Dokter, E. Bohlmeijer, and J. Li. Plant robot for at-home behavioral activation therapy reminders to young adults with depression. ACM Transactions on Human-Robot Interaction (THRI), 10(3):1--21, 2021.

[7]

E. Björling and L. Riek. Designing for exit: How to let robots go. Proceedings of We Robot, 2022.

[8]

V. Braun and V. Clarke. Using thematic analysis in psychology. Qualitative research in psychology, 3(2):77--101, 2006.

[9]

V. Braun and V. Clarke. One size fits all? what counts as quality practice in (reflexive) thematic analysis? Qualitative research in psychology, 18(3):328--352, 2021.

[10]

J. Brooke. Sus: a ?quick and dirty'usability. Usability evaluation in industry, 189(3):189--194, 1996.

[11]

V. A. Canady. Fda approves first video game rx treatment for children with adhd. Mental Health Weekly, 30(26):1--7, 2020.

[12]

C. Clabaugh, K. Mahajan, S. Jain, R. Pakkar, D. Becerra, Z. Shi, E. Deng, R. Lee, G. Ragusa, and M. Matari?. Long-term personalization of an in-home socially assistive robot for children with autism spectrum disorders. Frontiers in Robotics and AI, 6:110, 2019.

[13]

C. Clabaugh, G. Ragusa, F. Sha, and M. Matari?. Designing a socially assistive robot for personalized number concepts learning in preschool children. In 2015 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), pages 314--319. IEEE, 2015.

[14]

D. Cruz-Sandoval and J. Favela. Incorporating conversational strategies in a social robot to interact with people with dementia. Dementia and geriatric cognitive disorders, 47(3):140--148, 2019.

[15]

S. W. Edison and G. L. Geissler. Measuring attitudes towards general technology: Antecedents, hypotheses and scale development. Journal of targeting, Measurement and Analysis for Marketing, 12:137--156, 2003.

[16]

J. Fasola and M. J. Matari?. A socially assistive robot exercise coach for the elderly. Journal of Human-Robot Interaction, 2(2):3--32, 2013.

Digital Library

[17]

R. Feingold Polak and S. L. Tzedek. Social robot for rehabilitation: expert clinicians and post-stroke patients' evaluation following a long-term intervention. In Proceedings of the 2020 ACM/IEEE international conference on human-robot interaction, pages 151--160, 2020.

Digital Library

[18]

N. Gasteiger, H. S. Ahn, C. Gasteiger, C. Lee, J. Lim, C. Fok, B. A. Macdonald, G. H. Kim, and E. Broadbent. Robot-delivered cognitive stimulation games for older adults: Usability and acceptability evaluation. ACM Transactions on Human-Robot Interaction (THRI), 10(4):1--18, 2021.

[19]

C. Guan, A. Bouzida, R. M. Oncy-Avila, S. Moharana, and L. D. Riek. Taking an (embodied) cue from community health: Designing dementia caregiver support technology to advance health equity. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pages 1--16, 2021.

Digital Library

[20]

D. V. Gunasekeran, R. M. W. W. Tseng, Y.-C. Tham, and T. Y. Wong. Applications of digital health for public health responses to covid-19: a systematic scoping review of artificial intelligence, telehealth and related technologies. NPJ digital medicine, 4(1):40, 2021.

[21]

E. Hargittai, A. M. Piper, and M. R. Morris. From internet access to internet skills: digital inequality among older adults. Universal Access in the Information Society, 18:881--890, 2019.

[22]

M. Huckans, L. Hutson, E. Twamley, A. Jak, J. Kaye, and D. Storzbach. Efficacy of cognitive rehabilitation therapies for mild cognitive impairment (mci) in older adults: working toward a theoretical model and evidence-based interventions. Neuropsychology review, 23:63--80, 2013.

[23]

S. Jeong, L. Aymerich-Franch, S. Alghowinem, R. W. Picard, C. L. Breazeal, and H. W. Park. A robotic companion for psychological well-being: A long-term investigation of companionship and therapeutic alliance. In Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, pages 485-- 494, 2023.

Digital Library

[24]

A. Kalegina, G. Schroeder, A. Allchin, K. Berlin, and M. Cakmak. Characterizing the design space of rendered robot faces. In Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, pages 96--104, 2018.

Digital Library

[25]

L. Klaming, L. Robbemond, P. Lemmens, and E. Hart de Ruijter. Digital compensatory cognitive training for older adults with memory complaints. Activities, Adaptation & Aging, 47(1):10--39, 2023.

[26]

M. Koverola, A. Kunnari, J. Sundvall, and M. Laakasuo. General attitudes towards robots scale (gators): A new instrument for social surveys. International Journal of Social Robotics, 14(7):1559--1581, 2022.

[27]

A. Kubota, D. Cruz-Sandoval, S. Kim, E. W. Twamley, and L. D. Riek. Cognitively assistive robots at home: Hri design patterns for translational science. In 2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pages 53--62. IEEE, 2022.

[28]

A. Kubota, R. Pei, E. Sun, D. Cruz-Sandoval, S. Kim, and L. D. Riek. Get smart: Collaborative goal setting with cognitively assistive robots. In Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, pages 44--53, 2023.

Digital Library

[29]

A. Kubota, M. Pourebadi, S. Banh, S. Kim, and L. Riek. Somebody that i used to know: The risks of personalizing robots for dementia care. Proceedings of We Robot, 2021.

[30]

O. Lambercy, R. Lehner, K. Chua, S. K. Wee, D. K. Rajeswaran, C. W. K. Kuah, W. T. Ang, P. Liang, D. Campolo, A. Hussain, et al. Neurorehabilitation from a distance: can intelligent technology support decentralized access to quality therapy? Frontiers in Robotics and AI, 8:612415, 2021.

[31]

M. Law, C. Sutherland, H. S. Ahn, B. A. MacDonald, K. Peri, D. L. Johanson, D.-S. Vajsakovic, N. Kerse, and E. Broadbent. Developing assistive robots for people with mild cognitive impairment and mild dementia: a qualitative study with older adults and experts in aged care. BMJ open, 9(9):e031937, 2019.

[32]

Z. Ma, Y. Mei, and Z. Su. Understanding the benefits and challenges of using large language model-based conversational agents for mental well-being support. arXiv preprint arXiv:2307.15810, 2023.

[33]

K. Mack, E. McDonnell, D. Jain, L. LuWang, J. E. Froehlich, and L. Findlater. What do we mean by ?accessibility research"? a literature survey of accessibility papers in chi and assets from 1994 to 2019. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pages 1--18, 2021.

Digital Library

[34]

H. T. Maddali, E. Dixon, A. Pradhan, and A. Lazar. Supporting remote participation when designing with people with dementia. In Conference Companion Publication of the 2020 on Computer Supported Cooperative Work and Social Computing, pages 335--340, 2020.

Digital Library

[35]

R. Marcilly et al. Exploring mhealths fit to workflow in homecare--a case study in sweden. Context Sensitive Health Informatics: Sustainability in Dynamic Ecosystems, 265:54, 2019.

[36]

A. Maseda, L. Lodeiro-Fernández, L. Lorenzo-López, L. Núñez-Naveira, A. Balo, and J. C. Millán-Calenti. Verbal fluency, naming and verbal comprehension: three aspects of language as predictors of cognitive impairment. Aging & mental health, 18(8):1037--1045, 2014.

[37]

N. McDonald, S. Schoenebeck, and A. Forte. Reliability and inter-rater reliability in qualitative research: Norms and guidelines for cscw and hci practice. Proceedings of the ACM on human-computer interaction, 3(CSCW):1--23, 2019.

Digital Library

[38]

S. Moharana, A. E. Panduro, H. R. Lee, and L. D. Riek. Robots for joy, robots for sorrow: community based robot design for dementia caregivers. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pages 458--467. IEEE, 2019.

[39]

G. Mois, B. A. Collete, L. M. Renzi-Hammond, L. Boccanfuso, A. Ramachandran, P. Gibson, K. G. Emerson, and J. M. Beer. Understanding robots' potential to facilitate piano cognitive training in older adults with mild cognitive impairment. In Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, pages 363--365, 2020.

Digital Library

[40]

A. A. Mullane. Cognitive Problems and Strategies Assessment: Validating a Cognitive Training Measure. PhD thesis, Alliant International University, 2013.

[41]

W. H. Organization et al. Global action plan on the public health response to dementia 2017--2025. 2017.

[42]

S. Pekkarinen, L. Hennala, O. Tuisku, C. Gustafsson, R.-M. Johansson-Pajala, K. Thommes, J. A. Hoppe, and H. Melkas. Embedding care robots into society and practice: Socio-technical considerations. Futures, 122:102593, 2020.

[43]

M. Quigley, K. Conley, B. Gerkey, J. Faust, T. Foote, J. Leibs, R. Wheeler, A. Y. Ng, et al. Ros: an open-source robot operating system. In ICRA workshop on open source software, volume 3, page 5. Kobe, Japan, 2009.

[44]

L. D. Riek. Robotics technology in mental health care. In Artificial intelligence in behavioral and mental health care, pages 185--203. Elsevier, 2016.

[45]

S. Spaulding, J. Shen, H. W. Park, and C. Breazeal. Lifelong personalization via gaussian process modeling for long-term hri. Frontiers in Robotics and AI, 8:683066, 2021.

[46]

K. Stypulkowski, E. Anquillare, E. W. Twamley, and R. E. Thayer. Feasibility of a telehealth compensatory cognitive training program for older adults with mild cognitive impairment. Clinical Gerontologist, pages 1--9, 2023.

[47]

N. Terblanche, J. Molyn, E. de Haan, and V. O. Nilsson. Comparing artificial intelligence and human coaching goal attainment efficacy. Plos one, 17(6):e0270255, 2022.

[48]

D. S. Thoft, M. Pyer, A. Horsbøl, and J. Parkes. The balanced participation model: Sharing opportunities for giving people with early-stage dementia a voice in

[49]

R. Van Patten, A. V. Keller, J. E. Maye, D. V. Jeste, C. Depp, L. D. Riek, and E. W. Twamley. Home-based cognitively assistive robots: maximizing cognitive functioning and maintaining independence in older adults without dementia. Clinical interventions in aging, pages 1129--1139, 2020.

[50]

K. Winkle, S. Lemaignan, P. Caleb-Solly, P. Bremner, A. J. Turton, and U. Leonards. In-situ learning from a domain expert for real world socially assistive robot deployment. In Robotics: Science and Systems, 2020.

Cited By

Auger CBoisvert AJobin KMichaud F(2024)Perception of the usefulness of socially assistive robots for adherence to home-based rehabilitation exercises for persons with chronic neurological conditionsProceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3652037.3663930(515-522)Online publication date: 26-Jun-2024
https://dl.acm.org/doi/10.1145/3652037.3663930

Index Terms

CARMEN: A Cognitively Assistive Robot for Personalized Neurorehabilitation at Home
1. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Robotics
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interactive systems and tools

Recommendations

Get SMART: Collaborative Goal Setting with Cognitively Assistive Robots
HRI '23: Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

Many robot-delivered health interventions aim to support people longitudinally at home to complement or replace in-clinic treatments. However, there is little guidance on how robots can support collaborative goal setting (CGS). CGS is the process in ...
JESSIE: Synthesizing Social Robot Behaviors for Personalized Neurorehabilitation and Beyond
HRI '20: Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction

JESSIE is a robotic system that enables novice programmers to program social robots by expressing high-level specifications. We employ control synthesis with a tangible front-end to allow users to define complex behavior for which we automatically ...
Cognitively Assistive Robots at Home: HRI Design Patterns for Translational Science
HRI '22: Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction

Much research in healthcare robotics explores extending rehabilitative interventions to the home. However, for adults, little guidance exists on how to translate human-delivered, clinic-based interventions into robot-delivered, home-based ones to support ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '24: Proceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction

March 2024

982 pages

ISBN:9798400703225

DOI:10.1145/3610977

General Chairs:
Dan Grollman
Plus One Robotics, USA
,
Elizabeth Broadbent
University of Auckland, New Zealand
,
Program Chairs:
Wendy Ju
Cornell Tech, USA
,
Harold Soh
National University of Singapore, Singapore
,
Tom Williams
Colorado School of Mines, USA

Copyright © 2024 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 March 2024

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

HRI '24

Sponsor:

HRI '24: ACM/IEEE International Conference on Human-Robot Interaction

March 11 - 15, 2024

CO, Boulder, USA

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
828
Total Downloads

Downloads (Last 12 months)828
Downloads (Last 6 weeks)169

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Auger CBoisvert AJobin KMichaud F(2024)Perception of the usefulness of socially assistive robots for adherence to home-based rehabilitation exercises for persons with chronic neurological conditionsProceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3652037.3663930(515-522)Online publication date: 26-Jun-2024
https://dl.acm.org/doi/10.1145/3652037.3663930

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents