research-article

AMIGO: Towards Social Robot based Motivation for Playful Multimodal Intervention in Dementia

Authors:

Sandra Schüssler,

Julia Zuschnegg,

Alexander Lerch,

Dimitrios ProdromouAuthors Info & Claims

PETRA '18: Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference

Pages 421 - 427

https://doi.org/10.1145/3197768.3203182

Published: 26 June 2018 Publication History

Abstract

The objective of the project AMIGO is to develop an innovative multisensory robot coach on the basis of the social robot Pepper and the playful training app amicasa for the entertaining motivation of people with dementia. The goal is to empower persons with dementia to perform daily stimulating activities in a concept of integrated multimodal intervention. The robot will additionally be capable to ask about the health status, remind important events or tasks, involve into dialogue, and provide entertainment like reading news from all over the world. A research objective is to adjust Pepper's dialogue and motivation style based on emotional feedback sensed in interaction. The system will motivate to perform personalized exercises, to stimulate cognitive processes and physical activities, and to maintain and extend social bonds. Sensors for eye tracking and motion analysis technologies will offer affordances for entertaining, sensorimotor sequences and for data capture and analysis of cognition and locomotion specific behavioral parameters. Easily usable interfaces enable planning and autonomous daily practice to formal as well as to the informal caregiver in a weekly rhythm so that people with dementia can stay longer at home and the progress of dementia is slowed down.

References

[1]

Global Health & Aging http://www.who.int/ageing/publications/global_health.pdf

[2]

Robert Koch Institut, 2015. Gesundheit in Deutschland Gesundheitsberichterstattung des Bundes. Gemeinsam getragen von RKI und Destatis. RKI, Berlin

[3]

Schüssler, 1, Dassen, T., Lohrmann, C. 2016. Care Dependency and Nursing Care Problems in Nursing Home Residents with and without dementia, Aging Clin Exp Res. 2016 Oct;28(5): 973--82.

[4]

Schüssler, Sandra, Lohrmann, Christa, Eds., 2017. Dementia in Nursing Homes, Springer.

[5]

Smarr et al., 2012. Older adults' preferences for an acceptance of robot assistance for everyday living tasks, Proc. 56th Annual Meeting of Human Factors and Ergonomics Society, 22-26 Oct., Human Factors and Ergonomics Society, Boston, pp. 153--157.

[6]

WHO (2007) Fact sheet, Investing in the health workforce enables stronger health systems.

[7]

IFR (2016). Studie: 31 Millionen Roboter helfen bis 2019 weltweit im Haushalt, International Federation of Robotics, APA 20. Dez. 2016. http://www. ots.at/presseaussendung/OTS_20161220_OTS0003/studie-31-millionen-roboter-helfen-bis-2019-weltweit-im-haushalt

[8]

Hurrell, A. (2017 March). The retirement homes of the future are being planned today. The Bristol Post.

[9]

Lorenz, T., Weiss, A. & Hirche, S. (2015). Synchrony and reciprocity: Key mechanisms for social companion robots in therapy and care. International Journal of Social Robotics, 8, 125--143.

[10]

Prakash, A., Kemp, C.C., & Rogers, W.A. (2014). Older adults' reactions to a robot's appearance in the context of home use. ACM International Conference on Human-Robot Interaction, 3--6-Mar-14, Bielefield, Germany, 268--269.

Digital Library

[11]

Sabelli, A.M., Kanda, T., & Hagita, N. (2011). A conversational robot in an elderly care center: an ethnographic study". ACM International Conference on Human-Robot Interaction, Lausanne, Switzerland. March 6-9. 37--44.

Digital Library

[12]

de Graaf, M.M.A., Allouch, S.B., & Klamer, T. (2015). Sharing a life with Harvey: Exploring the acceptance of and relationship-building with a social robot. Computers in Human Behavior, 43, 1--14.

Digital Library

[13]

Breazeal, C. (2003). Toward sociable robots. Robotics and Autonomous Systems, 42(3), 167--175.

[14]

Breazeal, C. (2003). Emotion and Sociable Humanoid Robots. International Journal of Human Computer Interaction, vol. 59, pp. 119--155.

Digital Library

[15]

Yueh-Hsuan Weng (2009). Toward the human-Robot Coexistence Society: on Safety intelligence for next Generation Robots, International Journal of Social Robotics, April 7, 2009.

[16]

Ogawa, Kohei (2011). Exploring the Natural Reaction of Young and Aged Person with Telenoid in a Real World. Journal of Advanced Computational Intelligence and Intelligent Informatics, pp- 592--597.

[17]

Wada, K. (2008). Robot Therapy for Elders affected by Dementia, Gerontechnology, July/August 2008.

[18]

(Softbank Robotics, 2015) Pepper - The world's first Personal Robot that Reads Emotions, Softbank Rob., http://bit.ly/2oUMtvj

[19]

Forstmeier, S. and Maercker, A. (2015) Motivational processes in mild cognitive impairment and Alzheimer's disease: results from the Motivational Reserve in Alzheimer's (MoReA) study. BMC Psychiatry (2015), 15:293.

[20]

Sergio E. Starkstein, Ricardo Jorge, and Romina Mizrahi (2006). The prevalence, clinical correlates and treatment of apathy in Alzheimer's disease. Eur. J. Psychiat. Vol. 20, N.° 2, (96--106).

[21]

Philippe H. Robert, Emmanuel Mulin, Patrick Malle, & Renaud David (2010). Apathy Diagnosis, Assessment, and Treatment in Alzheimer's Disease. CNS Neuroscience & Therapeutics, Blackwell Publishing Ltd.

[22]

Wilson RS, Schneider JA, Arnold SE, Bienias JL, Bennett DA (2007). Conscientiousness and the incidence of Alzheimer disease and mild cognitive impairment. Arch Gen Psychiatry. 2007;64:1204--12.

[23]

Maercker A, Forstmeier S. (2011). Healthy brain aging: the new concept of motivational reserve. Psychiatrist. 2011;35:175--8.

[24]

Wu et al. (2014). Acceptance of an assistive robot in older adults: a mixed-method study of human-robot interaction over a 1-month period in the Living Lab setting. Clin Interv Aging, 8;9:801--11.

[25]

Boman et al. (2014). Exploring the usability of a videophone mock-up for persons with dementia and their significant others, BMC Geriatrics, 14:49.

[26]

Span et al. (2013). Involving people with dementia in the development of supportive IT applications: a systematic review. Ageing Res Rev 12(2):535--51.

[27]

Maro et al. (2015). Indicators of perceived useful dementia care assistive technology: Caregivers' perspectives. Geriatr Gerontol Int 15(8):1049--57.

[28]

Lauriks et al. (2007). Review of ICT-based services for identified unmet needs in people with dementia, Ageing Research Reviews, 6: 223--246.

[29]

Mordoch et al. (2013). Use of social commitment robots in the care of elderly people with dementia: a literature review. Maturitas 4--20.

[30]

Bemelmans et al. (2012). Socially assistive robots in elderly care: a systematic review into effects and effectiveness. J Am Med Dir Assoc 13(2):114--120.e1.

[31]

Pino et al. (2015). Are we ready for robots that care for us? Attitudes and opinions of older adults toward socially assistive robots. Front Aging Neurosci. 23;7:141.

[32]

Wang et al. (2017). Robots to assist daily activities: views of older adults with Alzheimer's disease and their caregivers. Int Psychogeriatr 29(1):67--79.

[33]

Mann et al. (2015). People respond better to robots than computer tablets delivering healthcare instructions. Computers in Human Behavior 43:112--17.

Digital Library

[34]

McCallum, Simon; Boletsis, Costas, Dementia Games: A Literature Review of Dementia-Related Serious Games, in, Serious Games Development and Applications, Lecture Notes in Computer Science 2013; Volume 8101. p. 15--27, Springer Publishing.

[35]

Finn, M., & McDonald, S. (2011). Computerised cognitive training for older persons with mild cognitive impairment: A pilot study using a randomised controlled trial design. Brain Impairment, 12(3), 187--199.

[36]

Shipstead Z, Hicks K, Engle RW (2012). Cogmed working memory training: Does the evidence support the claims?, Journal of Applied Research in Memory and Cognition, 1 (3): 185--193.

[37]

Korczyn AD, Peretz C, Aharonson V, et al. - Computer based cognitive training with CogniFit improved cognitive performance above the effect of classic computer games: prospective, randomized, double blind intervention study in the elderly. Alzheimer's & Dementia: The Journal of the Alzheimer's Association 2007; 3(3):S171.

[38]

Shatil E, Metzer A, Horvitz O, Miller A. (2010) Home-based personalized cognitive training in MS patients: a study of adherence and cognitive performance. NeuroRehabilitation. 26(2):143--53.

[39]

Christofoletti, G.; Oliani, M. M.; Gobbi, S.; Stella, F.; Bucken Gobbi, L. T.; Renato Canineu, P. (2008): A controlled clinical trial on the effects of motor intervention on balance and cognition in institutionalized elderly patients with dementia. In: Clinical Rehabilitation 22/7:618--626

[40]

Paletta, L., Lerch, A., Kemp, C., Pittino, L., Steiner, J., Panagl, M. Künstner, M., Pszeida, M., and Fellner, M. (2018). Playful Multimodal Training for Persons with Dementia with Executive Function based Diagnostic Tool, Proc. Pervasive Technologies Related to Assistive Environments (PETRA), Corfu, Greece, June 26-29, 2018, ACM Press.

Digital Library

[41]

Paletta, Lucas, Pszeida, Martin, and Panagl, Mariella (2018). Towards Playful Monitoring of Executive Functions: Deficits in Inhibition Control as Indicator for Cognitive Impairment in First Stages of Alzheimer, Proc. 9th International Conference on Applied Human Factors and Ergonomics (AHFE 2018), Orlando, FL, 21-25 July, 2018, Springer.

[42]

Zhe Cao, Tomas Simon, Shih-En Wei, Yaser Sheikh (2017). Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields, Proc. CVPR 2017.

[43]

Wallenfels (2016) Die Zukunft der Pflege durch Roboter. ProCare 8:42--45.

[44]

Bedarf et al. (2015) Overview and Categorization of Robots Supporting Independent Living of Elderly People: What Activities Do They Support and How Far Have They Developed. Assist Technol 27(2):88--100

[45]

Bedarf et al. (2016) Can a Service Robot Which Supports Independent Living of Older People Disobey a Command? The Views of Older People, Informal Carers and Professional Caregivers on the Acceptability of Robots. International Journal of Social Robotics 8(3):409--420.

[46]

Bedarf et al. (2013) Which activities threaten independent living of elderly when becoming problematic: inspiration for meaningful service robot functionality. Disabil Rehabil Assist Technol. 9(6):445--52

[47]

Bekey et al. (2006) International assessment of research and development in robotics. World Technology Evaluation Center (WTEC) Baltimore, Maryland

[48]

Montero-Odasso et al. (2015) Mobility and Cognition in Seniors. Report from the 2008 Institute of Aging (CIHR) Mobility and Cognition Workshop. Canadian Geriatrics Journal 18(3):159--167.

[49]

(ADI 2013) World Alzheimer Report 2013: Journey of caring: an analysis of long-term care for dementia. ADI, London.

[50]

Sugihara et al. (2013) A technology roadmap of assistive technologies for dementia care in Japan. Dementia (London) 14(1):80--103.

[51]

Nordheim et al. (2015) Tablet-PC und ihr Nutzen für demenzerkrankte Heimbewohner Z Gerontol Geriat 48:543--549.

[52]

Abdi et al. (2018) Scoping review on the use of socially assistive robot technology in elderly care. BMJ Open. 12;8(2):e018815.

[53]

Ienca et al. (2017) Intelligent Assistive Technology for Alzheimer's Disease and Other Dementias: A Systematic Review. J Alzheimers Dis. 2017;56(4):1301--1340.

[54]

Pessoa, L. (2009). How do emotion and motivation direct executive control? Trends Cogn Sci.

[55]

Gregg, L., and Tarrier, N. (2007). Virtual reality in mental health. A review of the literature, Social Psychiatry and Psychiatric Epidemiology, 42(5):343--54.

[56]

Toure-Tillery & Fishbach (2014). How to Measure Motivation: A Guide for the Experimental Social Psychologist. Social and Personality Psychology Compass.

[57]

Finnema, E., Dröes, R.-M., Ettema, T.P., and van Tilburg, W. (2005). The effect of integrated emotion-oriented care versus usual care on elderly persons with dementia in the nursing home and on nursing assistants: A randomized clinical trial. International Journal of Geriatric Psychiatry, 20(4):330--43.

[58]

Alberts, J.W., Vastenburg, M.H., & Desmet, P.M.A. (2013). Mood Expression by seniors in digital communication; evaluative comparison of four mood-reporting instruments with elderly users. Proc. 5th International Congress of International Association of Societies of Design Research, August 26-30, 2013, Tokyo, Japan.

[59]

Desmet, P.M.A., Vastenburg, M.H., Van Bel, D., & Romero Herrera, N. (2012). Pick-A-Mood; development and application of a pictorial mood-reporting instrument. Proc. 8th International Design and Emotion Conference, London (UK), 11-14 September 2012.

[60]

McDuff, D., El Kaliouby, R., Cohn, J. F., & Picard, R. W. (2015). Predicting ad liking and purchase intent: Large-scale analysis of facial responses to ads. Affective Computing, IEEE Transactions, 6(3), 223--235.

[61]

T. Baltrusaitis, P. Robinson, L. Morency, OpenFace: an open source facial behavior analysis tool, Proc. Workshop on Applications of Computer Vision (WACV), IEEE, (2016).

Cited By

Linden KBremer MNeef CRichert A(2024) "Repeat After Me" – Exploring Robot-Assisted Speech Training for Varied Aphasia Severities * 2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN)10.1109/RO-MAN60168.2024.10731426(1042-1047)Online publication date: 26-Aug-2024
https://doi.org/10.1109/RO-MAN60168.2024.10731426
Coelho T(2022)Digital Technologies in Dementia CareDigital Therapies in Psychosocial Rehabilitation and Mental Health10.4018/978-1-7998-8634-1.ch006(115-140)Online publication date: 2022
https://doi.org/10.4018/978-1-7998-8634-1.ch006
Lima MWairagkar MGupta MRodriguez y Baena FBarnaghi PSharp DVaidyanathan R(2022)Conversational Affective Social Robots for Ageing and Dementia SupportIEEE Transactions on Cognitive and Developmental Systems10.1109/TCDS.2021.311522814:4(1378-1397)Online publication date: Dec-2022
https://doi.org/10.1109/TCDS.2021.3115228
Show More Cited By

Index Terms

AMIGO: Towards Social Robot based Motivation for Playful Multimodal Intervention in Dementia

Recommendations

Care Workers Making Use of Robots: Results of a Three-Month Study on Human-Robot Interaction within a Care Home
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Research on social robots in care has often focused on either the care recipients or the technology itself, neglecting the care workers who, in and through their collaborative and coordinative practices, will need to work with the robots. To better ...
A Social Robot in a Human-Animal Relationship at Home: A Field Study
HAI '17: Proceedings of the 5th International Conference on Human Agent Interaction

Pets are humanity'V?stra G?talands oldest friend since ancient times. People have been living with them since then, and the relationship between people and pets as family members at home is well researched. Recently, social robots are entering family ...
Ambient Assisted Living and Social Robots: Towards Learning Relations between User’s Daily Routines and Mood
UMAP '22 Adjunct: Adjunct Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization

Endowing social robots with the ability to learn and predict the user’s activities during the day is one of the main aims of research in the field of ambient assisted living. Social robots should support older adults with daily activity and, at the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '18: Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference

June 2018

591 pages

ISBN:9781450363907

DOI:10.1145/3197768

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

NSF: National Science Foundation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 June 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

PETRA '18

PETRA '18: The 11th PErvasive Technologies Related to Assistive Environments Conference

June 26 - 29, 2018

Corfu, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
500
Total Downloads

Downloads (Last 12 months)78
Downloads (Last 6 weeks)10

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Linden KBremer MNeef CRichert A(2024) "Repeat After Me" – Exploring Robot-Assisted Speech Training for Varied Aphasia Severities * 2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN)10.1109/RO-MAN60168.2024.10731426(1042-1047)Online publication date: 26-Aug-2024
https://doi.org/10.1109/RO-MAN60168.2024.10731426
Coelho T(2022)Digital Technologies in Dementia CareDigital Therapies in Psychosocial Rehabilitation and Mental Health10.4018/978-1-7998-8634-1.ch006(115-140)Online publication date: 2022
https://doi.org/10.4018/978-1-7998-8634-1.ch006
Lima MWairagkar MGupta MRodriguez y Baena FBarnaghi PSharp DVaidyanathan R(2022)Conversational Affective Social Robots for Ageing and Dementia SupportIEEE Transactions on Cognitive and Developmental Systems10.1109/TCDS.2021.311522814:4(1378-1397)Online publication date: Dec-2022
https://doi.org/10.1109/TCDS.2021.3115228
Nault EBaillie LBroz F(2022)Investigating the Usability of a Socially Assistive Robotic Cognitive Training Task with Augmented Sensory Feedback Modalities for Older Adults*2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN53752.2022.9900825(735-742)Online publication date: 29-Aug-2022
https://doi.org/10.1109/RO-MAN53752.2022.9900825
Łukasik STobis SSuwalska JŁojko DNapierała MProch MNeumann-Podczaska ASuwalska A(2021)The Role of Socially Assistive Robots in the Care of Older People: To Assist in Cognitive Training, to Remind or to Accompany?Sustainability10.3390/su13181039413:18(10394)Online publication date: 17-Sep-2021
https://doi.org/10.3390/su131810394
Tian LOviatt S(2021)A Taxonomy of Social Errors in Human-Robot InteractionACM Transactions on Human-Robot Interaction10.1145/343972010:2(1-32)Online publication date: 9-Feb-2021
https://dl.acm.org/doi/10.1145/3439720
Hong ALunscher NHu TTsuboi YZhang XFranco dos Reis Alves SNejat GBenhabib B(2021)A Multimodal Emotional Human–Robot Interaction Architecture for Social Robots Engaged in Bidirectional CommunicationIEEE Transactions on Cybernetics10.1109/TCYB.2020.297468851:12(5954-5968)Online publication date: Dec-2021
https://doi.org/10.1109/TCYB.2020.2974688
Miller JMcDaniel T(2021)Socially Assistive Robots for Storytelling and Other Activities to Support Aging in PlaceMultimedia for Accessible Human Computer Interfaces10.1007/978-3-030-70716-3_6(145-172)Online publication date: 19-Feb-2021
https://doi.org/10.1007/978-3-030-70716-3_6
Lambert ANorouzi NBruder GWelch G(2020)A Systematic Review of Ten Years of Research on Human Interaction with Social RobotsInternational Journal of Human–Computer Interaction10.1080/10447318.2020.180117236:19(1804-1817)Online publication date: 24-Aug-2020
https://doi.org/10.1080/10447318.2020.1801172

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents