Talk2Care: An LLM-based Voice Assistant for Communication between Healthcare Providers and Older Adults
Authors: 
Ziqi Yang, 
Xuhai Xu, 
Bingsheng Yao, Ethan Rogers, Shao Zhang, Stephen Intille, Nawar Shara, Guodong Gordon Gao, Dakuo WangAuthors Info & Claims
Article No.: 73, Pages 1 - 35
Abstract
Despite the plethora of telehealth applications to assist home-based older adults and healthcare providers, basic messaging and phone calls are still the most common communication methods, which suffer from limited availability, information loss, and process inefficiencies. One promising solution to facilitate patient-provider communication is to leverage large language models (LLMs) with their powerful natural conversation and summarization capability. However, there is a limited understanding of LLMs' role during the communication. We first conducted two interview studies with both older adults (N=10) and healthcare providers (N=9) to understand their needs and opportunities for LLMs in patient-provider asynchronous communication. Based on the insights, we built an LLM-powered communication system, Talk2Care, and designed interactive components for both groups: (1) For older adults, we leveraged the convenience and accessibility of voice assistants (VAs) and built an LLM-powered conversational interface for effective information collection. (2) For health providers, we built an LLM-based dashboard to summarize and present important health information based on older adults' conversations with the VA. We further conducted two user studies with older adults and providers to evaluate the usability of the system. The results showed that Talk2Care could facilitate the communication process, enrich the health information collected from older adults, and considerably save providers' efforts and time. We envision our work as an initial exploration of LLMs' capability in the intersection of healthcare and interpersonal communication.
References
[1]
2021. Handle Requests Sent by Alexa. https://developer.amazon.com/en-US/docs/alexa/custom-skills/handle-requests-sent-by-alexa.html
[2]
2021. IHMHCOVID-PhoneCallCheckInGuidelines. https://www.pih.org/sites/default/files/lc/MH%20Resource%20Library/PIHMHCOVID-PhoneCallCheckInGuidelines.pdf
[3]
2023. Advanced MD EHR System. https://www.advancedmd.com/
[4]
2023. Epic EHR System. https://www.epic.com/
[5]
2023. Get the Facts on Healthy Aging. https://ncoa.org/article/get-the-facts-on-healthy-aging
[6]
2023. OpenAI Platform. https://platform.openai.com
[7]
2023. Postoperative Instructions for Extractions/Oral Surgery. https://www.aapd.org/globalassets/media/policies_guidelines/r_postsurgery.pdf
[8]
2023. Prompt Engineering Guide. https://www.promptingguide.ai/
[9]
Monica Agrawal, Stefan Hegselmann, Hunter Lang, Yoon Kim, and David Sontag. 2022. Large Language Models are Few-Shot Clinical Information Extractors. http://arxiv.org/abs/2205.12689 arXiv:2205.12689 [cs].
[10]
Lakshmi Arbatti, Abhishek Hosamath, Vikram Ramanarayanan, and Ira Shoulson. 2023. What Do Patients Say About Their Disease Symptoms? Deep Multilabel Text Classification With Human-in-the-Loop Curation for Automatic Labeling of Patient Self Reports of Problems.
[11]
Diego Arguello, Ethan Rogers, Grant H. Denmark, James Lena, Troy Goodro, Quinn Anderson-Song, Gregory Cloutier, Charles H. Hillman, Arthur F. Kramer, Carmen Castaneda-Sceppa, and Dinesh John. 2023. Companion: A Pilot Randomized Clinical Trial to Test an Integrated Two-Way Communication and Near-Real-Time Sensing System for Detecting and Modifying Daily Inactivity among Adults >60 Years---Design and Protocol. Sensors 23, 4 (Feb. 2023), 2221.
[12]
Sanghwan Bae, Donghyun Kwak, Soyoung Kang, Min Young Lee, Sungdong Kim, Yuin Jeong, Hyeri Kim, Sang-Woo Lee, Woomyoung Park, and Nako Sung. 2022. Keep Me Updated! Memory Management in Long-term Conversations. https://doi.org/10.48550/arXiv.2210.08750 arXiv:2210.08750 [cs]
[13]
Vince Bartle, Liam Albright, and Nicola Dell. 2023. "This machine is for the aides": Tailoring Voice Assistant Design to Home Health Care Work. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1--19.
[14]
Vince Bartle, Janice Lyu, Freesoul El Shabazz-Thompson, Yunmin Oh, Angela Anqi Chen, Yu-Jan Chang, Kenneth Holstein, and Nicola Dell. 2022. "A Second Voice": Investigating Opportunities and Challenges for Interactive Voice Assistants to Support Home Health Aides. In CHI Conference on Human Factors in Computing Systems. ACM, New Orleans LA USA, 1--17.
[15]
Andrew Bates, DK Arvind, and Janek Mann. 2011. Wireless monitoring of post-operative respiratory complications. In Proceedings of the 2nd Conference on Wireless Health. 1--9.
[16]
Emma Beede, Elizabeth Baylor, Fred Hersch, Anna Iurchenko, Lauren Wilcox, Paisan Ruamviboonsuk, and Laura M Vardoulakis. 2020. A human-centered evaluation of a deep learning system deployed in clinics for the detection of diabetic retinopathy. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1--12.
[17]
Caterina Bérubé, Zsolt Ferenc Kovacs, Elgar Fleisch, and Tobias Kowatsch. 2021. Reliability of Commercial Voice Assistants' Responses to Health-Related Questions in Noncommunicable Disease Management: Factorial Experiment Assessing Response Rate and Source of Information. Journal of Medical Internet Research 23, 12 (Dec. 2021), e32161.
[18]
Johnna Blair and Saeed Abdullah. 2019. Understanding the Needs and Challenges of Using Conversational Agents for Deaf Older Adults. In Companion Publication of the 2019 Conference on Computer Supported Cooperative Work and Social Computing (CSCW '19 Companion). Association for Computing Machinery, New York, NY, USA, 161--165. https://doi.org/10.1145/3311957.3359487
[19]
Ann Blandford, Janet Wesson, René Amalberti, Raed AlHazme, and Ragad Allwihan. 2020. Opportunities and challenges for telehealth within, and beyond, a pandemic. The Lancet Global Health 8, 11 (2020), e1364-e1365.
[20]
Cati Boulanger, Adam Boulanger, Lilian de Greef, Andy Kearney, Kiley Sobel, Russell Transue, Z Sweedyk, Paul H Dietz, and Steven Bathiche. 2013. Stroke rehabilitation with a sensing surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1243--1246.
[21]
Robin Brewer, Casey Pierce, Pooja Upadhyay, and Leeseul Park. 2022. An Empirical Study of Older Adult's Voice Assistant Use for Health Information Seeking. ACM Transactions on Interactive Intelligent Systems 12, 2 (June 2022), 1--32.
[22]
John Brooke. 1995. SUS: A quick and dirty usability scale. Usability Eval. Ind. 189 (11 1995).
[23]
Patrick D Brophy. 2017. Overview on the challenges and benefits of using telehealth tools in a pediatric population. Advances in Chronic Kidney Disease 24, 1 (2017), 17--21.
[24]
Phyllis Butow and Ehsan Hoque. 2020. Using artificial intelligence to analyse and teach communication in healthcare. The breast 50 (2020), 49--55.
[25]
Julia Cambre, Alex C Williams, Afsaneh Razi, Ian Bicking, Abraham Wallin, Janice Tsai, Chinmay Kulkarni, and Jofish Kaye. 2021. Firefox Voice: An Open and Extensible Voice Assistant Built Upon the Web. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1--18.
[26]
Marco Cascella, Jonathan Montomoli, Valentina Bellini, and Elena Bignami. 2023. Evaluating the feasibility of ChatGPT in healthcare: an analysis of multiple clinical and research scenarios. Journal of Medical Systems 47, 1 (2023), 33.
[27]
Ana Paula Chaves and Marco Aurelio Gerosa. 2021. How Should My Chatbot Interact? A Survey on Social Characteristics in Human-Chatbot Interaction Design. International Journal of Human-Computer Interaction 37, 8 (May 2021), 729--758. https://doi.org/10.1080/10447318.2020.1841438 Publisher: Taylor & Francis_eprint: https://doi.org/10.1080/10447318.2020.1841438.
[28]
Yu Chen, Kingsley Travis Abel, John T Janecek, Yunan Chen, Kai Zheng, and Steven C Cramer. 2019. Home-based technologies for stroke rehabilitation: A systematic review. International journal of medical informatics 123 (2019), 11--22.
[29]
Amy K Chesser, Nikki Keene Woods, Kyle Smothers, and Nicole Rogers. 2016. Health literacy and older adults: A systematic review. Gerontology and geriatric medicine 2 (2016), 2333721416630492.
[30]
Chia-Fang Chung. 2017. Supporting patient-provider communication and engagement with personal informatics data. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers. ACM, Maui Hawaii, 335--338.
[31]
Chia-Fang Chung, Kristin Dew, Allison Cole, Jasmine Zia, James Fogarty, Julie A Kientz, and Sean A Munson. 2016. Boundary negotiating artifacts in personal informatics: patient-provider collaboration with patient-generated data. In Proceedings of the 19th ACM conference on computer-supported cooperative work & social computing. 770--786.
[32]
Chia-Fang Chung, Qiaosi Wang, Jessica Schroeder, Allison Cole, Jasmine Zia, James Fogarty, and Sean A. Munson. 2019. Identifying and Planning for Individualized Change: Patient-Provider Collaboration Using Lightweight Food Diaries in Healthy Eating and Irritable Bowel Syndrome. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 1, Article 7 (mar 2019), 27 pages. https://doi.org/10.1145/3314394
[33]
Maribel Cifuentes, Melinda Davis, Doug Fernald, Rose Gunn, Perry Dickinson, and Deborah J. Cohen. 2015. Electronic Health Record Challenges, Workarounds, and Solutions Observed in Practices Integrating Behavioral Health and Primary Care. The Journal of the American Board of Family Medicine 28, Supplement 1 (Sept. 2015), S63-S72. https://doi.org/10.3122/jabfm.2015.S1.150133 Publisher: American Board of Family Medicine Section: Original Research.
[34]
George H Crossley, Andrew Boyle, Holly Vitense, Yanping Chang, R Hardwin Mead, and Connect Investigators. 2011. The CONNECT (Clinical Evaluation of Remote Notification to Reduce Time to Clinical Decision) trial: the value of wireless remote monitoring with automatic clinician alerts. Journal of the American College of Cardiology 57, 10 (2011), 1181--1189.
[35]
Smit Desai and Jessie Chin. 2023. OK Google, Let's Learn: Using Voice User Interfaces for Informal Self-Regulated Learning of Health Topics among Younger and Older Adults. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1--21. https://doi.org/10.1145/3544548.3581507
[36]
Xianghua Ding, Yunan Chen, Zhaofei Ding, and Yiwen Xu. 2019. Boundary Negotiation for Patient-Provider Communication via WeChat in China. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 157 (nov 2019), 24 pages. https://doi.org/10.1145/3359259
[37]
Karen Donelan, Esteban A Barreto, Sarah Sossong, Carie Michael, Juan J Estrada, Adam B Cohen, Janet Wozniak, and Lee H Schwamm. 2019. Patient and clinician experiences with telehealth for patient follow-up care. Am J Manag Care 25, 1 (2019), 40--44.
[38]
E Ray Dorsey and Eric J Topol. 2016. State of telehealth. New England journal of medicine 375, 2 (2016), 154--161.
[39]
Shaun M Eack, Catherine G Greeno, and Bong-Jae Lee. 2006. Limitations of the Patient Health Questionnaire in identifying anxiety and depression in community mental health: many cases are undetected. Research on social work practice 16, 6 (2006), 625--631.
[40]
Marva V Foster and Kristen A Sethares. 2014. Facilitators and barriers to the adoption of telehealth in older adults: an integrative review. CIN: Computers, Informatics, Nursing 32, 11 (2014), 523--533.
[41]
David Fraile Navarro, A Baki Kocaballi, Mark Dras, and Shlomo Berkovsky. 2023. Collaboration, not confrontation: Understanding general practitioners' attitudes towards natural language and text automation in clinical practice. ACM Transactions on Computer-Human Interaction 30, 2 (2023), 1--34.
[42]
Michelle Louise Gatt, Maria Cassar, and Sandra C Buttigieg. 2022. A review of literature on risk prediction tools for hospital readmissions in older adults. Journal of Health Organization and Management 36, 4 (2022), 521--557.
[43]
Erik Grönvall and Nervo Verdezoto. 2013. Beyond self-monitoring: understanding non-functional aspects of home-based healthcare technology. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing. ACM, Zurich Switzerland, 587--596. https://doi.org/10.1145/2493432.2493495
[44]
Meghana Gudala, Mary Ellen Trail Ross, Sunitha Mogalla, Mandi Lyons, Padmavathy Ramaswamy, and Kirk Roberts. 2022. Benefits of, Barriers to, and Needs for an Artificial Intelligence-Powered Medication Information Voice Chatbot for Older Adults: Interview Study With Geriatrics Experts. JMIR Aging 5, 2 (April 2022), e32169. https://doi.org/10.2196/32169 Company: JMIR Aging Distributor: JMIR Aging Institution: JMIR Aging Label: JMIR Aging Publisher: JMIR Publications Inc., Toronto, Canada.
[45]
Kristen R Haase, Theodore Cosco, Lucy Kervin, Indira Riadi, and Megan E O'Connell. 2021. Older adults' experiences with using technology for socialization during the COVID-19 pandemic: Cross-sectional survey study. JMIR aging 4, 2 (2021), e28010.
[46]
Joseph L. Hall and Deven McGraw. 2014. For Telehealth To Succeed, Privacy And Security Risks Must Be Identified And Addressed. Health Affairs 33, 2 (Feb. 2014), 216--221. https://doi.org/10.1377/hlthaff.2013.0997 Publisher: Health Affairs.
[47]
Shane Halloran, Lin Tang, Yu Guan, Jian Qing Shi, and Janet Eyre. 2019. Remote monitoring of stroke patients' rehabilitation using wearable accelerometers. In Proceedings of the 2019 ACM International Symposium on Wearable Computers. 72--77.
[48]
Danny M. den Hamer, Perry Schoor, Tobias B. Polak, and Daniel Kapitan. 2023. Improving Patient Pre-screening for Clinical Trials: Assisting Physicians with Large Language Models. http://arxiv.org/abs/2304.07396 arXiv:2304.07396 [cs].
[49]
Christina N. Harrington, Radhika Garg, Amanda Woodward, and Dimitri Williams. 2022. "It's Kind of Like Code-Switching": Black Older Adults' Experiences with a Voice Assistant for Health Information Seeking. In CHI Conference on Human Factors in Computing Systems. ACM, New Orleans LA USA, 1--15.
[50]
Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139--183.
[51]
Thomas Hartvigsen, Saadia Gabriel, Hamid Palangi, Maarten Sap, Dipankar Ray, and Ece Kamar. 2022. Toxigen: A large-scale machine-generated dataset for adversarial and implicit hate speech detection. arXiv preprint arXiv:2203.09509 (2022).
[52]
Tsipi Heart, Ofir Ben-Assuli, and Itamar Shabtai. 2017. A review of PHR, EMR and EHR integration: A more personalized healthcare and public health policy. Health Policy and Technology 6, 1 (March 2017), 20--25. https://doi.org/10.1016/j.hlpt.2016.08.002
[53]
Jess Hohenstein and Malte Jung. 2018. AI-supported messaging: An investigation of human-human text conversation with AI support. In Extended abstracts of the 2018 CHI conference on human factors in computing systems. 1--6.
[54]
Perttu Hämäläinen, Mikke Tavast, and Anton Kunnari. 2023. Evaluating Large Language Models in Generating Synthetic HCI Research Data: a Case Study. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1--19. https://doi.org/10.1145/3544548.3580688
[55]
Oksana Iliashenko, Zilia Bikkulova, and Alissa Dubgorn. 2019. Opportunities and challenges of artificial intelligence in healthcare. In E3S Web of Conferences, Vol. 110. EDP Sciences, 02028.
[56]
Mohit Jain, Pratyush Kumar, Ishita Bhansali, Q. Vera Liao, Khai Truong, and Shwetak Patel. 2018. FarmChat: A Conversational Agent to Answer Farmer Queries. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 4, Article 170 (dec 2018), 22 pages. https://doi.org/10.1145/3287048
[57]
Badeia Jawhari, Dave Ludwick, Louanne Keenan, David Zakus, and Robert Hayward. 2016. Benefits and challenges of EMR implementations in low resource settings: a state-of-the-art review. BMC medical informatics and decision making 16, 1 (2016), 1--12.
[58]
Eunkyung Jo, Daniel A. Epstein, Hyunhoon Jung, and Young-Ho Kim. 2023. Understanding the Benefits and Challenges of Deploying Conversational AI Leveraging Large Language Models for Public Health Intervention. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1--16. https://doi.org/10.1145/3544548.3581503
[59]
Eric L Johnson and Eden Miller. 2022. Remote patient monitoring in diabetes: how to acquire, manage, and use all of the data. Diabetes Spectrum 35, 1 (2022), 43--56.
[60]
Hala F Kasim, Amina Ibrahim Salih, and Farah Mwafaq Attash. 2023. Usability of telehealth among healthcare providers during COVID-19 pandemic in Nineveh Governorate, Iraq. Public Health in Practice 5 (2023), 100368.
[61]
Anna Kawakami, Venkatesh Sivaraman, Hao-Fei Cheng, Logan Stapleton, Yanghuidi Cheng, Diana Qing, Adam Perer, Zhiwei Steven Wu, Haiyi Zhu, and Kenneth Holstein. 2022. Improving human-AI partnerships in child welfare: understanding worker practices, challenges, and desires for algorithmic decision support. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1--18.
[62]
Jay Kayser, Xu Wang, Zhenke Wu, Asha Dimoji, Xiaoling Xiang, et al. 2023. Layperson-Facilitated Internet-Delivered Cognitive Behavioral Therapy for Homebound Older Adults With Depression: Protocol for a Randomized Controlled Trial. JMIR Research Protocols 12, 1 (2023), e44210.
[63]
Maura Kennedy, Richard A Enander, Sarah P Tadiri, Richard E Wolfe, Nathan I Shapiro, and Edward R Marcantonio. 2014. Delirium risk prediction, healthcare use and mortality of elderly adults in the emergency department. Journal of the American Geriatrics Society 62, 3 (2014), 462--469.
[64]
A Baki Kocaballi, Kiran Ijaz, Liliana Laranjo, Juan C Quiroz, Dana Rezazadegan, Huong Ly Tong, Simon Willcock, Shlomo Berkovsky, and Enrico Coiera. 2020. Envisioning an artificial intelligence documentation assistant for future primary care consultations: A co-design study with general practitioners. Journal of the American Medical Informatics Association 27, 11 (Nov. 2020), 1695--1704.
[65]
Clemens Kruse, Joanna Fohn, Nakia Wilson, Evangelina Nunez Patlan, Stephanie Zipp, Michael Mileski, et al. 2020. Utilization barriers and medical outcomes commensurate with the use of telehealth among older adults: systematic review. JMIR medical informatics 8, 8 (2020), e20359.
[66]
Harsh Kumar, Yiyi Wang, Jiakai Shi, Ilya Musabirov, Norman A. S. Farb, and Joseph Jay Williams. 2023. Exploring the Use of Large Language Models for Improving the Awareness of Mindfulness. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA '23). Association for Computing Machinery, New York, NY, USA, Article 129, 7 pages. https://doi.org/10.1145/3544549.3585614
[67]
Tiffany H Kung, Morgan Cheatham, Arielle Medenilla, Czarina Sillos, Lorie De Leon, Camille Elepaño, Maria Madriaga, Rimel Aggabao, Giezel Diaz-Candido, James Maningo, et al. 2023. Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLoS digital health 2, 2 (2023), e0000198.
[68]
Bishal Lamichhane. 2023. Evaluation of chatgpt for nlp-based mental health applications. arXiv preprint arXiv:2303.15727 (2023).
[69]
Elina Laukka, Moona Huhtakangas, Tarja Heponiemi, Sari Kujala, Anu-Marja Kaihlanen, Kia Gluschkoff, and Outi Kanste. 2020. Health care professionals' experiences of patient-professional communication over patient portals: systematic review of qualitative studies. Journal of Medical Internet Research 22, 12 (2020), e21623.
[70]
Gibbeum Lee, Volker Hartmann, Jongho Park, Dimitris Papailiopoulos, and Kangwook Lee. 2023. Prompted LLMs as Chatbot Modules for Long Open-domain Conversation. In Findings of the Association for Computational Linguistics: ACL 2023. 4536--4554. https://doi.org/10.18653/v1/2023.findings-acl.277 arXiv:2305.04533 [cs]
[71]
Yuanchun Li, Fanglin Chen, Toby Jia-Jun Li, Yao Guo, Gang Huang, Matthew Fredrikson, Yuvraj Agarwal, and Jason I. Hong. 2017. PrivacyStreams: Enabling Transparency in Personal Data Processing for Mobile Apps. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 76 (sep 2017), 26 pages. https://doi.org/10.1145/3130941
[72]
Houjiang Liu, Anubrata Das, Alexander Boltz, Didi Zhou, Daisy Pinaroc, Matthew Lease, and Min Kyung Lee. 2023. Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AI. arXiv preprint arXiv:2308.07213 (2023).
[73]
Siru Liu, Aileen P Wright, Barron L Patterson, Jonathan P Wanderer, Robert W Turer, Scott D Nelson, Allison B McCoy, Dean F Sittig, and Adam Wright. 2023. Using AI-generated suggestions from ChatGPT to optimize clinical decision support. Journal of the American Medical Informatics Association 30, 7 (2023), 1237--1245.
[74]
Xi Lu, Yunan Chen, and Daniel A. Epstein. 2021. How Cultural Norms Influence Persuasive Design: A Study on Chinese Food Journaling Apps. In Designing Interactive Systems Conference 2021. 619--637.
[75]
I Madan and S Williams. 2012. Is pre-employment health screening by questionnaire effective? Occupational medicine 62, 2 (2012), 112--116.
[76]
Farah Magrabi, Elske Ammenwerth, Jytte Brender McNair, Nicolet F De Keizer, Hannele Hyppönen, Pirkko Nykänen, Michael Rigby, Philip J Scott, Tuulikki Vehko, Zoie Shui-Yee Wong, et al. 2019. Artificial intelligence in clinical decision support: challenges for evaluating AI and practical implications. Yearbook of medical informatics 28, 01 (2019), 128--134.
[77]
Lakmini P Malasinghe, Naeem Ramzan, and Keshav Dahal. 2019. Remote patient monitoring: a comprehensive study. Journal of Ambient Intelligence and Humanized Computing 10 (2019), 57--76.
[78]
Tami L Mark, Katherine Treiman, Howard Padwa, Kristen Henretty, Janice Tzeng, and Marylou Gilbert. 2022. Addiction treatment and telehealth: review of efficacy and provider insights during the COVID-19 pandemic. Psychiatric Services 73, 5 (2022), 484--491.
[79]
Hannah Mieczkowski, Jeffrey T Hancock, Mor Naaman, Malte Jung, and Jess Hohenstein. 2021. AI-Mediated Communication: Language Use and Interpersonal Effects in a Referential Communication Task. Proc. ACM Hum.-Comput. Interact. 5, CSCW1 (April 2021), 1--14.
[80]
Tracy L Mitzner, Jenay M Beer, Sara E McBride, Wendy A Rogers, and Arthur D Fisk. 2009. Older adults' needs for home health care and the potential for human factors interventions. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 53. SAGE Publications Sage CA: Los Angeles, CA, 718--722.
[81]
Sara Montagna, Stefano Ferretti, Lorenz Cuno Klopfenstein, Antonio Florio, and Martino Francesco Pengo. 2023. Data Decentralisation of LLM-Based Chatbot Systems in Chronic Disease Self-Management. In Proceedings of the 2023 ACM Conference on Information Technology for Social Good. 205--212.
[82]
Jessica Morley, Caio CV Machado, Christopher Burr, Josh Cowls, Indra Joshi, Mariarosaria Taddeo, and Luciano Floridi. 2020. The ethics of AI in health care: a mapping review. Social Science & Medicine 260 (2020), 113172.
[83]
Grazia Murtarelli, Anne Gregory, and Stefania Romenti. 2021. A conversation-based perspective for shaping ethical human-machine interactions: The particular challenge of chatbots. Journal of Business Research 129 (May 2021), 927--935. https://doi.org/10.1016/j.jbusres.2020.09.018
[84]
Varun Nair, Elliot Schumacher, and Anitha Kannan. 2023. Generating medically-accurate summaries of patient-provider dialogue: A multi-stage approach using large language models. http://arxiv.org/abs/2305.05982 arXiv:2305.05982 [cs].
[85]
Harsha Nori, Nicholas King, Scott Mayer McKinney, Dean Carignan, and Eric Horvitz. 2023. Capabilities of gpt-4 on medical challenge problems. arXiv preprint arXiv:2303.13375 (2023).
[86]
Rónán O'Caoimh, Nicola Cornally, Elizabeth Weathers, Ronan O'Sullivan, Carol Fitzgerald, Francesc Orfila, Roger Clarnette, Constança Paúl, and D William Molloy. 2015. Risk prediction in the community: A systematic review of case-finding instruments that predict adverse healthcare outcomes in community-dwelling older adults. Maturitas 82, 1 (2015), 3--21.
[87]
OpenAI. 2022. Introducing chatgpt. https://openai.com/blog/chatgpt
[88]
Shreya Pandit, San Tran, Yiwen Gu, Elham Saraee, Frederick Jansen, Saurabh Singh, Shirene Cao, Arezoo Sadeghi, Eugenia Shandelman, Terry Ellis, and Margrit Betke. 2019. ExerciseCheck: a scalable platform for remote physical therapy deployed as a hybrid desktop and web application. In Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, Rhodes Greece, 101--109. https://doi.org/10.1145/3316782.3321537
[89]
Sun Young Park, So Young Lee, and Yunan Chen. 2012. The effects of EMR deployment on doctors' work practices: A qualitative study in the emergency department of a teaching hospital. International journal of medical informatics 81, 3 (2012), 204--217.
[90]
Shachaf Poran, Gil Amsalem, Amit Beka, and Dmitri Goldenberg. 2022. With One Voice: Composing a Travel Voice Assistant from Repurposed Models. In Companion Proceedings of the Web Conference 2022 (Virtual Event, Lyon, France) (WWW '22). Association for Computing Machinery, New York, NY, USA, 383--387. https://doi.org/10.1145/3487553.3524228
[91]
Alisha Pradhan, Amanda Lazar, and Leah Findlater. 2020. Use of Intelligent Voice Assistants by Older Adults with Low Technology Use. ACM Transactions on Computer-Human Interaction 27, 4 (Aug. 2020), 1--27.
[92]
Pallavi Rao and Anirudha Joshi. 2020. Design Opportunities for Supporting Elderly in India in Managing their Health and Fitness Post-COVID-19. In IndiaHCI '20: Proceedings of the 11th Indian Conference on Human-Computer Interaction. ACM, Online India, 34--41. https://doi.org/10.1145/3429290.3429294
[93]
Office for Civil Rights (OCR). 2015. HIPAA for Professionals. https://www.hhs.gov/hipaa/for-professionals/index.html Last Modified: 2021-08-16T16:09:01-0400.
[94]
Steven I. Ross, Fernando Martinez, Stephanie Houde, Michael Muller, and Justin D. Weisz. 2023. The Programmer's Assistant: Conversational Interaction with a Large Language Model for Software Development. In Proceedings of the 28th International Conference on Intelligent User Interfaces (IUI '23). Association for Computing Machinery, New York, NY, USA, 491--514. https://doi.org/10.1145/3581641.3584037
[95]
Paul K Rubenstein, Chulayuth Asawaroengchai, Duc Dung Nguyen, Ankur Bapna, Zalán Borsos, Félix de Chaumont Quitry, Peter Chen, Dalia El Badawy, Wei Han, Eugene Kharitonov, et al. 2023. AudioPaLM: A Large Language Model That Can Speak and Listen. arXiv preprint arXiv:2306.12925 (2023).
[96]
Donald L Rubin, John Parmer, Vicki Freimuth, Terry Kaley, and Mumbi Okundaye. 2011. Associations between older adults' spoken interactive health literacy and selected health care and health communication outcomes. Journal of health communication 16, sup3 (2011), 191--204.
[97]
Hyeyoung Ryu, Soyeon Kim, Dain Kim, Sooan Han, Keeheon Lee, and Younah Kang. 2020. Simple and Steady Interactions Win the Healthy Mentality: Designing a Chatbot Service for the Elderly. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (Oct. 2020), 1--25. https://doi.org/10.1145/3415223
[98]
Jessica Schroeder, Jane Hoffswell, Chia-Fang Chung, James Fogarty, Sean Munson, and Jasmine Zia. 2017. Supporting patient-provider collaboration to identify individual triggers using food and symptom journals. In Proceedings of the 2017 ACM conference on computer supported cooperative work and social computing. 1726--1739.
[99]
Woosuk Seo, Ayse G Buyuktur, Sanya Verma, Hyeryoung Kim, Sung Won Choi, Laura Sedig, and Sun Young Park. 2021. Learning from healthcare providers' strategies: Designing technology to support effective child patient-provider communication. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--15.
[100]
Amanda Sharkey and Noel Sharkey. 2021. We need to talk about deception in social robotics! Ethics and Information Technology 23, 3 (Sept. 2021), 309--316. https://doi.org/10.1007/s10676-020-09573-9
[101]
Julia Shaver. 2022. The state of telehealth before and after the COVID-19 pandemic. Primary Care: Clinics in Office Practice 49, 4 (2022), 517--530.
[102]
Hua Shen, Chieh-Yang Huang, Tongshuang Wu, and Ting-Hao'Kenneth' Huang. 2023. ConvXAI: Delivering Heterogeneous AI Explanations via Conversations to Support Human-AI Scientific Writing. arXiv preprint arXiv:2305.09770 (2023).
[103]
James Simpson, Franziska Gaiser, Miroslav Macík, and Timna Breßgott. 2020. Daisy: A Friendly Conversational Agent for Older Adults. In Proceedings of the 2nd Conference on Conversational User Interfaces. ACM, Bilbao Spain, 1--3. https://doi.org/10.1145/3405755.3406166
[104]
Aaron Smith. 2014. Older adults and technology use. https://www.pewresearch.org/internet/2014/04/03/older-adults-and-technology-use/
[105]
Brendan Spillane, Emer Gilmartin, Christian Saam, Benjamin R Cowan, and Vincent Wade. 2018. ADELE: Care and Companionship for Independent Aging. In ICAHGCA@ AAMAS. 18--24.
[106]
Vera Stara, Benjamin Vera, Daniel Bolliger, Lorena Rossi, Elisa Felici, Mirko Di Rosa, Michiel De Jong, and Susy Paolini. 2020. Usability and Acceptance of the Embodied Conversational Agent Anne by People with Dementia and their Caregivers: an exploratory study in home environment settings (Preprint). JMIR mHealth and uHealth (Nov. 2020). https://doi.org/10.2196/25891
[107]
Gudrun Theile, Carsten Kruschinski, Marlene Buck, Christiane A Müller, and Eva Hummers-Pradier. 2011. Home visits-central to primary care, tradition or an obligation? A qualitative study. BMC family practice 12 (2011), 1--12.
[108]
Milka Trajkova and Aqueasha Martin-Hammond. 2020. "Alexa is a Toy": Exploring Older Adults' Reasons for Using, Limiting, and Abandoning Echo. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1--13. https://doi.org/10.1145/3313831.3376760
[109]
Reed V. Tuckson, Margo Edmunds, and Michael L. Hodgkins. 2017. Telehealth. New England Journal of Medicine 377, 16 (Oct. 2017), 1585--1592. https://doi.org/10.1056/NEJMsr1503323 Publisher: Massachusetts Medical Society_eprint: https://doi.org/10.1056/NEJMsr1503323.
[110]
Göran Umefjord, Herbert Sandström, Hans Malker, and Göran Petersson. 2008. Medical text-based consultations on the Internet: a 4-year study. International journal of medical informatics 77, 2 (2008), 114--121.
[111]
Shlomo Vinker, Michael Weinfass, Lior M Kasinetz, Eliezer Kitai, and Igor Kaiserman. 2007. Web-based question-answering service of a family physician---the characteristics of queries in a non-commercial open forum. Medical informatics and the Internet in medicine 32, 2 (2007), 123--129.
[112]
Suzanne Vugs, Niels Tjeerd Benjamin Scholte, Panos Markopoulos, and Eelko Ronner. 2023. Clinician Attitudes Towards Telemonitoring for Heart Failure Care: Opportunities for Design Research. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1--8.
[113]
Bryan Wang, Gang Li, and Yang Li. 2023. Enabling Conversational Interaction with Mobile UI Using Large Language Models. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI '23). Association for Computing Machinery, New York, NY, USA, Article 432, 17 pages. https://doi.org/10.1145/3544548.3580895
[114]
Ding Wang, Santosh D. Kale, and Jacki O'Neill. 2020. Please Call the Specialism: Using WeChat to Support Patient Care in China. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1--13.
[115]
Dakuo Wang, Liuping Wang, Zhan Zhang, Ding Wang, Haiyi Zhu, Yvonne Gao, Xiangmin Fan, and Feng Tian. 2021. "Brilliant AI Doctor" in Rural China: Tensions and Challenges in AI-Powered CDSS Deployment. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--18.
[116]
Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, and Furu Wei. 2023. Augmenting Language Models with Long-Term Memory. https://doi.org/10.48550/arXiv.2306.07174 arXiv:2306.07174 [cs]
[117]
Jing Wei, Sungdong Kim, Hyunhoon Jung, and Young-Ho Kim. 2023. Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data.
[118]
Chunhua Weng, Paul Appelbaum, George Hripcsak, Ian Kronish, Linda Busacca, Karina W Davidson, and J Thomas Bigger. 2012. Using EHRs to integrate research with patient care: promises and challenges. Journal of the American Medical Informatics Association 19, 5 (Sept. 2012), 684--687. https://doi.org/10.1136/amiajnl-2012-000878
[119]
Ziang Xiao, Q Vera Liao, Michelle Zhou, Tyrone Grandison, and Yunyao Li. 2023. Powering an AI Chatbot with Expert Sourcing to Support Credible Health Information Access. In Proceedings of the 28th International Conference on Intelligent User Interfaces. 2--18.
[120]
Ziang Xiao, Xingdi Yuan, Q Vera Liao, Rania Abdelghani, and Pierre-Yves Oudeyer. 2023. Supporting Qualitative Analysis with Large Language Models: Combining Codebook with GPT-3 for Deductive Coding. In Companion Proceedings of the 28th International Conference on Intelligent User Interfaces. 75--78.
[121]
Ziang Xiao, Michelle X Zhou, Q Vera Liao, Gloria Mark, Changyan Chi, Wenxi Chen, and Huahai Yang. 2020. Tell me about yourself: Using an AI-powered chatbot to conduct conversational surveys with open-ended questions. ACM Transactions on Computer-Human Interaction (TOCHI) 27, 3 (2020), 1--37.
[122]
Xuhai Xu, Prerna Chikersal, Afsaneh Doryab, Daniella K Villalba, Janine M Dutcher, Michael J Tumminia, Tim Althoff, Sheldon Cohen, Kasey G Creswell, J David Creswell, et al. 2019. Leveraging routine behavior and contextually-filtered features for depression detection among college students. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1--33.
[123]
Xuhai Xu, Xin Liu, Han Zhang, Weichen Wang, Subigya Nepal, Yasaman Sefidgar, Woosuk Seo, Kevin S Kuehn, Jeremy F Huckins, Margaret E Morris, et al. 2023. GLOBEM: Cross-Dataset Generalization of Longitudinal Human Behavior Modeling. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 4 (2023), 1--34.
[124]
Xuhai Xu, Bingshen Yao, Yuanzhe Dong, Saadia Gabriel, Hong Yu, James Hendler, Marzyeh Ghassemi, Anind K. Dey, and Dakuo Wang. 2023. Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data. arXiv:2307.14385 [cs.HC]
[125]
Xuhai Xu, Han Zhang, Yasaman Sefidgar, Yiyi Ren, Xin Liu, Woosuk Seo, Jennifer Brown, Kevin Kuehn, Mike Merrill, Paula Nurius, et al. 2022. GLOBEM Dataset: Multi-Year Datasets for Longitudinal Human Behavior Modeling Generalization. Advances in Neural Information Processing Systems 35 (2022), 24655--24692.
[126]
Xuhai Xu, Tianyuan Zou, Han Xiao, Yanzhang Li, Ruolin Wang, Tianyi Yuan, Yuntao Wang, Yuanchun Shi, Jennifer Mankoff, and Anind K Dey. 2022. TypeOut: leveraging just-in-time self-affirmation for smartphone overuse reduction. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1--17.
[127]
Qian Yang, Aaron Steinfeld, and John Zimmerman. 2019. Unremarkable AI: Fitting intelligent decision support into critical, clinical decision-making processes. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1--11.
[128]
Li Yunxiang, Li Zihan, Zhang Kai, Dan Ruilong, and Zhang You. 2023. Chatdoctor: A medical chat model fine-tuned on llama model using medical domain knowledge. arXiv preprint arXiv:2303.14070 (2023).
[129]
Dong Zhang, Shimin Li, Xin Zhang, Jun Zhan, Pengyu Wang, Yaqian Zhou, and Xipeng Qiu. 2023. SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities. http://arxiv.org/abs/2305.11000 arXiv:2305.11000 [cs].
[130]
Terry Yue Zhuo, Yujin Huang, Chunyang Chen, and Zhenchang Xing. 2023. Exploring ai ethics of chatgpt: A diagnostic analysis. arXiv preprint arXiv:2301.12867 (2023).
[131]
Tamara Zubatiy, Kayci L Vickers, Niharika Mathur, and Elizabeth D Mynatt. 2021. Empowering Dyads of Older Adults With Mild Cognitive Impairment And Their Care Partners Using Conversational Agents. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1--15. https://doi.org/10.1145/3411764.3445124
Index Terms
- Talk2Care: An LLM-based Voice Assistant for Communication between Healthcare Providers and Older Adults
Recommendations
Recruiting Older Adults in the Wild: Reflections on Challenges and Lessons Learned from Research Experience
PervasiveHealth '18: Proceedings of the 12th EAI International Conference on Pervasive Computing Technologies for HealthcareIt is important to understand the older adults prior to the design process. The understanding can better facilitate design conversations between the researchers and the older adults. In this paper, we discussed our experiences of building a relationship ...
Designing a wellness self-management tool for older adults: results from a field trial of YourWellness
PervasiveHealth '14: Proceedings of the 8th International Conference on Pervasive Computing Technologies for HealthcareIt is recognized that empowering individuals to manage their own health and wellbeing will result in more cost-effective healthcare systems, improved health outcomes and will encourage healthy individuals to remain that way. With the advent of the ...
Enhancing Smartphone Usability for Older Adults: A Voice-Assistant Approach
ACM-TURC '24: Proceedings of the ACM Turing Award Celebration Conference - China 2024Older adults are a marginalized group in technology use. Existing research focuses on simplifying the software design or providing third-party assistance to promote smartphone use among older adults. However, these methods overlook older adults’ needs, ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 15 May 2024
Published in IMWUT Volume 8, Issue 2
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 1,132Total Downloads
- Downloads (Last 12 months)1,132
- Downloads (Last 6 weeks)384
Reflects downloads up to 22 Sep 2024
Other Metrics
Citations
Cited By
View allView Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in