Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3663548.3688523acmconferencesArticle/Chapter ViewAbstractPublication PagesassetsConference Proceedingsconference-collections
poster
Free access

Exploring Conversations between a Practitioner and a Person with Dementia

Published: 27 October 2024 Publication History

Abstract

In social service centers, practitioners engage in conversations with clients with dementia to facilitate their daily activities and provide support when they are distressed. However, the nature of the care demands the practitioner’s active engagement, which becomes difficult to deliver as the number of people who need care expands. Researchers have been investigating the efficacy of developing agents that assume conversational tasks to alleviate this work. To contribute to the future design of agents for caregiving, we collected and analyzed ten conversations between clients with mild dementia and practitioners who provide care. Our analyses of turn-taking dynamics and dialogue acts with 15k utterances uncovered patterns such as noticeable differences in clients’ and practitioners’ conversational dynamics and the prevalence of neutral-toned, question-oriented utterances by practitioners. We then prototyped a large language model-based script that generates responses to client utterances. We found potential approaches and challenges for making its utterance pattern more similar to that of a practitioner.

References

[1]
Sarah Alsawy, Sara Tai, Phil McEvoy, and Warren Mansell. 2020. ‘It’s nice to think somebody’s listening to me instead of saying “oh shut up”’. People with dementia reflect on what makes communication good and meaningful. Journal of Psychiatric and Mental Health Nursing 27, 2 (April 2020), 151–161. https://doi.org/10.1111/jpm.12559
[2]
Arlene J. Astell, Maggie P. Ellis, Norman Alm, Richard Dye, and Gary Gowans. 2010. Stimulating people with dementia to reminisce using personal and generic photographs. International Journal of Computers in Healthcare 1, 2 (2010), 177. https://doi.org/10.1504/IJCIH.2010.037461
[3]
Hervé Bredin. 2023. pyannote.audio 2.1 speaker diarization pipeline: principle, benchmark, and recipe. In Proc. INTERSPEECH 2023.
[4]
Hervé Bredin and Antoine Laurent. 2021. End-to-end speaker segmentation for overlap-aware resegmentation. In Interspeech. https://api.semanticscholar.org/CorpusID:233204561
[5]
Seamless Communication, Loïc Barrault, Yu-An Chung, Mariano Coria Meglioli, David Dale, Ning Dong, Mark Duppenthaler, Paul-Ambroise Duquenne, Brian Ellis, Hady Elsahar, Justin Haaheim, John Hoffman, Min-Jae Hwang, Hirofumi Inaguma, Christopher Klaiber, Ilia Kulikov, Pengwei Li, Daniel Licht, Jean Maillard, Ruslan Mavlyutov, Alice Rakotoarison, Kaushik Ram Sadagopan, Abinesh Ramakrishnan, Tuan Tran, Guillaume Wenzek, Yilin Yang, Ethan Ye, Ivan Evtimov, Pierre Fernandez, Cynthia Gao, Prangthip Hansanti, Elahe Kalbassi, Amanda Kallet, Artyom Kozhevnikov, Gabriel Mejia Gonzalez, Robin San Roman, Christophe Touret, Corinne Wong, Carleigh Wood, Bokai Yu, Pierre Andrews, Can Balioglu, Peng-Jen Chen, Marta R. Costa-jussà, Maha Elbayad, Hongyu Gong, Francisco Guzmán, Kevin Heffernan, Somya Jain, Justine Kao, Ann Lee, Xutai Ma, Alex Mourachko, Benjamin Peloquin, Juan Pino, Sravya Popuri, Christophe Ropers, Safiyyah Saleem, Holger Schwenk, Anna Sun, Paden Tomasello, Changhan Wang, Jeff Wang, Skyler Wang, and Mary Williamson. 2023. Seamless: Multilingual Expressive and Streaming Speech Translation. https://doi.org/10.48550/ARXIV.2312.05187 Version Number: 1.
[6]
Erin R Conway and Helen J Chenery. 2016. Evaluating the MESSAGE Communication Strategies in Dementia training for use with community‐based aged care staff working with people with dementia: a controlled pretest–post‐test study. Journal of Clinical Nursing 25, 7-8 (April 2016), 1145–1155. https://doi.org/10.1111/jocn.13134
[7]
Dagoberto Cruz-Sandoval, Jesus Favela, and Eduardo B. Sandoval. 2018. Strategies to Facilitate the Acceptance of a Social Robot by People with Dementia. In Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction. ACM, Chicago IL USA, 95–96. https://doi.org/10.1145/3173386.3177081
[8]
Dagoberto Cruz-Sandoval, Arturo Morales-Tellez, Eduardo Benitez Sandoval, and Jesus Favela. 2020. A Social Robot as Therapy Facilitator in Interventions to Deal with Dementia-related Behavioral Symptoms. In Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction. ACM, Cambridge United Kingdom, 161–169. https://doi.org/10.1145/3319502.3374840
[9]
Emma Dixon and Amanda Lazar. 2020. Approach Matters: Linking Practitioner Approaches to Technology Design for People with Dementia. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–15. https://doi.org/10.1145/3313831.3376432
[10]
Julen Etxaniz, Gorka Azkune, Aitor Soroa, Oier Lopez de Lacalle, and Mikel Artetxe. 2023. Do Multilingual Language Models Think Better in English?https://doi.org/10.48550/ARXIV.2308.01223 Version Number: 1.
[11]
Jesse Hoey, Krists Zutis, Valerie Leuty, and Alex Mihailidis. 2010. A tool to promote prolonged engagement in art therapy: design and development from arts therapist requirements. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility. ACM, Orlando Florida USA, 211–218. https://doi.org/10.1145/1878803.1878841
[12]
Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021. Lora: Low-rank adaptation of large language models. arXiv preprint arXiv:2106.09685 (2021).
[13]
D. Jurafsky, R. Bates, N. Coccaro, R. Martin, M. Meteer, K. Ries, E. Shriberg, A. Stolcke, P. Taylor, and C. Van Ess-Dykema. 1997. Automatic detection of discourse structure for speech recognition and understanding. In 1997 IEEE Workshop on Automatic Speech Recognition and Understanding Proceedings. IEEE, Santa Barbara, CA, USA, 88–95. https://doi.org/10.1109/ASRU.1997.658992
[14]
Keita Kiuchi, Kouyou Otsu, and Yugo Hayashi. 2023. Psychological insights into the research and practice of embodied conversational agents, chatbots and social assistive robots: a systematic meta-review. Behaviour & Information Technology (Nov. 2023), 1–41. https://doi.org/10.1080/0144929X.2023.2286528
[15]
Peter Klein and Martina Uhlig. 2016. Interactive Memories: technology-aided reminiscence therapy for people with dementia. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, Corfu Island Greece, 1–2. https://doi.org/10.1145/2910674.2935838
[16]
Noriaki Kuwahara, Shinji Abe, Kiyoshi Yasuda, and Kazuhiro Kuwabara. 2006. Networked reminiscence therapy for individuals with dementia by using photo and video sharing. In Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility. ACM, Portland Oregon USA, 125–132. https://doi.org/10.1145/1168987.1169010
[17]
Fong Yoke Leng, Donald Yeo, Stacey George, and Christopher Barr. 2014. Comparison of iPad applications with traditional activities using person-centred care approach: Impact on well-being for persons with dementia. Dementia 13, 2 (March 2014), 265–273. https://doi.org/10.1177/1471301213494514
[18]
Marie-Conception Leocadie, Jean-Manuel Morvillers, Sophie Pautex, and Monique Rothan-Tondeur. 2020. Characteristics of the skills of caregivers of people with dementia: observational study. BMC Family Practice 21, 1 (Dec. 2020), 149. https://doi.org/10.1186/s12875-020-01218-6
[19]
Bhavitvya Malik. 2024. bhavitvyamalik/DialogTag. https://github.com/bhavitvyamalik/DialogTag
[20]
M. Mast, R. Kompe, S. Harbeck, A. Kiessling, H. Niemann, E. Noth, E.G. Schukat-Talamazzini, and V. Warnke. 1996. Dialog act classification with the help of prosody. In Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP ’96, Vol. 3. IEEE, Philadelphia, PA, USA, 1732–1735. https://doi.org/10.1109/ICSLP.1996.607962
[21]
Deanne J. O’Rourke, Michelle M. Lobchuk, Genevieve N. Thompson, and Christina Lengyel. 2022. Connecting Through Conversation: A Novel Video-Feedback Intervention to Enhance Long-Term Care Aides’ Person-Centred Dementia Communication. Gerontology and Geriatric Medicine 8 (April 2022), 233372142211012. https://doi.org/10.1177/23337214221101266
[22]
Kyongok Park, Seonhye Lee, JeongEun Yang, Taekwon Song, and Gwi-Ryung Son Hong. 2019. A systematic review and meta-analysis on the effect of reminiscence therapy for people with dementia. International Psychogeriatrics 31, 11 (Nov. 2019), 1581–1597. https://doi.org/10.1017/S1041610218002168
[23]
Alexis Plaquet and Hervé Bredin. 2023. Powerset multi-class cross entropy loss for neural speaker diarization. In INTERSPEECH 2023. ISCA, 3222–3226. https://doi.org/10.21437/Interspeech.2023-205
[24]
Alec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, and Ilya Sutskever. 2023. Robust speech recognition via large-scale weak supervision. In Proceedings of the 40th International Conference on Machine Learning(ICML’23). JMLR.org. Place: Honolulu, Hawaii, USA.
[25]
Margherita Rampioni, Vera Stara, Elisa Felici, Lorena Rossi, and Susy Paolini. 2021. Embodied Conversational Agents for Patients With Dementia: Thematic Literature Analysis. JMIR mHealth and uHealth 9, 7 (July 2021), e25381. https://doi.org/10.2196/25381
[26]
Marc Rousseaux, Amandine Sève, Marion Vallet, Florence Pasquier, and Marie Anne Mackowiak-Cordoliani. 2010. An analysis of communication in conversation in patients with dementia. Neuropsychologia 48, 13 (Nov. 2010), 3884–3890. https://doi.org/10.1016/j.neuropsychologia.2010.09.026
[27]
Urška Smrke, Nejc Plohl, and Izidor Mlakar. 2022. Aging Adults’ Motivation to Use Embodied Conversational Agents in Instrumental Activities of Daily Living: Results of Latent Profile Analysis. International Journal of Environmental Research and Public Health 19, 4 (Feb. 2022), 2373. https://doi.org/10.3390/ijerph19042373
[28]
Vera Stara, Benjamin Vera, Daniel Bolliger, Susy Paolini, Michiel De Jong, Elisa Felici, Stephanie Koenderink, Lorena Rossi, Viviane Von Doellen, and Mirko Di Rosa. 2021. Toward the Integration of Technology-Based Interventions in the Care Pathway for People with Dementia: A Cross-National Study. International Journal of Environmental Research and Public Health 18, 19 (Oct. 2021), 10405. https://doi.org/10.3390/ijerph181910405
[29]
Andreas Stolcke, Klaus Ries, Noah Coccaro, Elizabeth Shriberg, Rebecca Bates, Daniel Jurafsky, Paul Taylor, Rachel Martin, Carol Van Ess-Dykema, and Marie Meteer. 2000. Dialogue act modeling for automatic tagging and recognition of conversational speech. Computational Linguistics 26, 3 (2000), 339–374. https://aclanthology.org/J00-3003 Place: Cambridge, MA Publisher: MIT Press.
[30]
Bob Woods, Aimee E Spector, Catherine A Jones, Martin Orrell, and Stephen P Davies. 2005. Reminiscence therapy for dementia. Cochrane Database of Systematic Reviews (April 2005). https://doi.org/10.1002/14651858.CD001120.pub2
[31]
Danni Yu, Luyang Li, Hang Su, and Matteo Fuoli. 2024. Assessing the potential of LLM-assisted annotation for corpus-based pragmatics and discourse analysis: The case of apology. International Journal of Corpus Linguistics (June 2024). https://doi.org/10.1075/ijcl.23087.yu
[32]
Tamara Zubatiy, Niharika Mathur, Larry Heck, Kayci L. Vickers, Agata Rozga, and Elizabeth D. Mynatt. 2023. "I don’t know how to help with that" - Learning from Limitations of Modern Conversational Agent Systems in Caregiving Networks. Proceedings of the ACM on Human-Computer Interaction 7, CSCW2 (Sept. 2023), 1–28. https://doi.org/10.1145/3610170

Index Terms

  1. Exploring Conversations between a Practitioner and a Person with Dementia
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Please enable JavaScript to view thecomments powered by Disqus.

          Information & Contributors

          Information

          Published In

          cover image ACM Conferences
          ASSETS '24: Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility
          October 2024
          1475 pages
          ISBN:9798400706776
          DOI:10.1145/3663548
          Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

          Sponsors

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 27 October 2024

          Check for updates

          Qualifiers

          • Poster
          • Research
          • Refereed limited

          Funding Sources

          • SMU-A*STAR Joint Lab in Social and Human-Centered Computing

          Conference

          ASSETS '24
          Sponsor:

          Acceptance Rates

          Overall Acceptance Rate 436 of 1,556 submissions, 28%

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • 0
            Total Citations
          • 32
            Total Downloads
          • Downloads (Last 12 months)32
          • Downloads (Last 6 weeks)32
          Reflects downloads up to 21 Nov 2024

          Other Metrics

          Citations

          View Options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          HTML Format

          View this article in HTML Format.

          HTML Format

          Login options

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media