research-article

Explaining Call Recommendations in Nursing Homes: a User-Centered Design Approach for Interacting with Knowledge-Based Health Decision Support Systems

Authors:

Francisco Gutiérrez,

Vero Vanden Abeele,

Robin De Croon,

Katrien VerbertAuthors Info & Claims

IUI '22: Proceedings of the 27th International Conference on Intelligent User Interfaces

Pages 162 - 172

https://doi.org/10.1145/3490099.3511158

Published: 22 March 2022 Publication History

IUI '22: Proceedings of the 27th International Conference on Intelligent User Interfaces

Explaining Call Recommendations in Nursing Homes: a User-Centered Design Approach for Interacting with Knowledge-Based Health Decision Support Systems

Pages 162 - 172

Abstract
References

Abstract

Recommender systems are increasingly used in high-risk application domains, including healthcare. It has been shown that explanations are crucial in this context to support decision-making. This paper explores how to explain call recommendations to nursing home staff, providing insights into call priority, notifications, and resident information. We present the design and implementation of a recommender engine and a mobile application designed to support call recommendations and explain these recommendations that may contribute to residents’ safety and quality of care. More specifically, we report on the results of a user-centered design approach with residents (N=12) and healthcare professionals (N=4), and a final evaluation (N=12) after four months of deployment. The results show that our design approach provides a valuable tool for more accurate and efficient decision-making. The overall system encourages nursing home staff to provide feedback and annotate, resulting in more confidence in the system. We discuss usability issues, challenges, and reflections to be considered in future health recommender systems.

References

[1]

Haneen Ali, Astin Cole, Adam Sienkiewicz, and Tori Ho. 2020. Perspectives of Nursing Homes Staff on the Nature of Residents-Initiated Call Lights. SAGE Open Nursing 6(2020), 2377960820903546. https://doi.org/10.1177/2377960820903546 33415269.

[2]

Haneen Ali and Huiyang Li. 2020. Use of notification and communication technology (call light systems) in nursing homes: Observational study. Journal of medical Internet research 22, 3 (2020), e16252.

[3]

Judith Bonomi, Corrine Lindquist, Olivia Lemberger, and Elisabeth Garrison. 2021. Evaluating the effects of a high-tech call system on patient-staff communication. Nursing Management 52, 2 (2021), 13–17.

[4]

Leo Breiman. 2001. Random forests. Machine learning 45, 1 (2001), 5–32.

Digital Library

[5]

Patricia Flatley Brennan and Mary L McHugh. 1988. Clinical decision-making and computer support. Applied Nursing Research 1, 2 (1988), 89–93.

[6]

André Calero Valdez, Martina Ziefle, Katrien Verbert, A. Felfernig, and Andreas Holzinger. 2016. Recommender Systems for Health Informatics: State-of-the-Art and Future Perspectives. Lecture Notes in Computer Science 9605 (11 2016). https://doi.org/10.1007/978-3-319-50478-0_20

[7]

Joseph N. Cappella, Sijia Yang, and Sungkyoung Lee. 2015. Constructing Recommendation Systems for Effective Health Messages Using Content, Collaborative, and Hybrid Algorithms. The ANNALS of the American Academy of Political and Social Science 659, 1(2015), 290–306.

[8]

Gabriella Casalino, Giovanna Castellano, Vincenzo Pasquadibisceglie, and Gianluca Zaza. 2019. Contact-less real-time monitoring of cardiovascular risk using video imaging and fuzzy inference rules. Information 10, 1 (2019), 9.

[9]

Lian Duan, W Street, and D Lu. 2008. A nursing care plan recommender system using a data mining approach. In Proceedings of the 3rd INFORMS Workshop on Data Mining and Health Informatics. Citeseer, 1–6.

[10]

R. Farrell, C. Danis, S. Ramakrishnan, W. Kellogg, and T. J. Watson. 2012. Intrapersonal Retrospective Recommendation : Lifestyle Change Recommendations Using Stable Patterns of Personal Behavior.

[11]

Gerald C Gannod, Katherine M Abbott, Kimberly Van Haitsma, Nathan Martindale, and Alexandra Heppner. 2019. A machine learning recommender system to tailor preference assessments to enhance person-centered care among nursing home residents. The Gerontologist 59, 1 (2019), 167–176.

[12]

Chen He, Denis Parra, and Katrien Verbert. 2016. Interactive recommender systems: A survey of the state of the art and future research challenges and opportunities. Expert Systems with Applications 56 (2016), 9–27. https://doi.org/10.1016/j.eswa.2016.02.013

Digital Library

[13]

Andreas Holzinger. 2016. Interactive machine learning for health informatics: when do we need the human-in-the-loop?Brain Informatics 3, 2 (2016), 119–131.

[14]

Yucheng Jin, Nava Tintarev, and Katrien Verbert. 2018. Effects of Personal Characteristics on Music Recommender Systems with Different Levels of Controllability. In Proceedings of the 12th ACM Conference on Recommender Systems (Vancouver, British Columbia, Canada) (RecSys ’18). Association for Computing Machinery, New York, NY, USA, 13–21. https://doi.org/10.1145/3240323.3240358

Digital Library

[15]

Bart P Knijnenburg, Martijn C Willemsen, Zeno Gantner, Hakan Soncu, and Chris Newell. 2012. Explaining the user experience of recommender systems. User Modeling and User-Adapted Interaction 22, 4 (2012), 441–504.

Digital Library

[16]

Christine M Meade, Amy L Bursell, and Lyn Ketelsen. 2006. Effects of nursing rounds: on patients’ call light use, satisfaction, and safety. AJN The American Journal of Nursing 106, 9 (2006), 58–70.

[17]

Dan W Patterson. 1990. Introduction to artificial intelligence and expert systems. Prentice-hall of India.

[18]

F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825–2830.

Digital Library

[19]

Pearl Pu, Li Chen, and Rong Hu. 2012. Evaluating recommender systems from the user’s perspective: survey of the state of the art. User Modeling and User-Adapted Interaction 22, 4-5 (2012), 317–355.

Digital Library

[20]

Emilee Rader, Kelley Cotter, and Janghee Cho. 2018. Explanations as mechanisms for supporting algorithmic transparency. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–13.

Digital Library

[21]

Sheila A Ryan. 1985. An expert system for nursing practice. Journal of medical systems 9, 1 (1985), 29–41.

[22]

Ando Saabas. 2021. TreeInterpreter. https://github.com/andosa/treeinterpreter.

[23]

Hanna Schäfer, Santiago Hors-Fraile, Raghav Pavan Karumur, André Calero Valdez, Alan Said, Helma Torkamaan, Tom Ulmer, and Christoph Trattner. 2017. Towards Health (Aware) Recommender Systems. In Proceedings of the 2017 International Conference on Digital Health (London, United Kingdom) (DH ’17). Association for Computing Machinery, New York, NY, USA, 157–161. https://doi.org/10.1145/3079452.3079499

Digital Library

[24]

Emily Seto, Kevin J Leonard, Joseph A Cafazzo, Jan Barnsley, Caterina Masino, and Heather J Ross. 2012. Developing healthcare rule-based expert systems: case study of a heart failure telemonitoring system. International journal of medical informatics 81, 8(2012), 556–565.

[25]

Emre Sezgin and Sevgi Özkan. 2013. A systematic literature review on health recommender systems. In 2013 E-Health and Bioengineering Conference (EHB). IEEE, 1–4.

[26]

Jaime Lynn Speiser, Kathryn E Callahan, Denise K Houston, Jason Fanning, Thomas M Gill, Jack M Guralnik, Anne B Newman, Marco Pahor, W Jack Rejeski, and Michael E Miller. 2021. Machine learning in aging: an example of developing prediction models for serious fall injury in older adults. The Journals of Gerontology: Series A 76, 4 (2021), 647–654.

[27]

Nava Tintarev and Judith Masthoff. 2015. Explaining recommendations: Design and evaluation. In Recommender systems handbook. Springer, 353–382.

[28]

Kosetsu Tsukuda and Masataka Goto. 2020. Explainable Recommendation for Repeat Consumption. In Fourteenth ACM Conference on Recommender Systems (Virtual Event, Brazil) (RecSys ’20). Association for Computing Machinery, New York, NY, USA, 462–467.

Digital Library

[29]

Venmo. 2021. business-rules. https://github.com/venmo/business-rules.

[30]

Martin Wiesner and Daniel Pfeifer. 2014. Health recommender systems: concepts, requirements, technical basics and challenges. International journal of environmental research and public health 11, 3(2014), 2580–2607.

Cited By

De Croon RSegovia-Lizano DFinglas PVanden Abeele VVerbert K(2025)An Explanation Interface for Healthy Food Recommendations in a Real-Life Workplace Deployment: User-Centered Design StudyJMIR mHealth and uHealth10.2196/5127113(e51271-e51271)Online publication date: 11-Feb-2025
https://doi.org/10.2196/51271
Humer CHinterreiter ALeichtmann BMara MStreit M(2024)Reassuring, Misleading, Debunking: Comparing Effects of XAI Methods on Human DecisionsACM Transactions on Interactive Intelligent Systems10.1145/366564714:3(1-36)Online publication date: 22-May-2024
https://dl.acm.org/doi/10.1145/3665647
Bhattacharya AOoge JStiglic GVerbert K(2023)Directive Explanations for Monitoring the Risk of Diabetes Onset: Introducing Directive Data-Centric Explanations and Combinations to Support What-If ExplorationsProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584075(204-219)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584075
Show More Cited By

Index Terms

Explaining Call Recommendations in Nursing Homes: a User-Centered Design Approach for Interacting with Knowledge-Based Health Decision Support Systems

Index terms have been assigned to the content through auto-classification.

Recommendations

Nursing Care Quality in Nursing Homes: Cross-Sectional Versus Longitudinal Analysis

This empirical study of the relationship between nursing care adequacy and nursing care quality demonstrates that a positive relationship exists between the process and outcome dimensions of quality of nursing care. The results from the analysis of ...
Finding best evidence for evidence-based best practice recommendations in health care: the initial decision support system design

A major problem for Canadian health organizations is finding best evidence for evidence-based best practice recommendations. Medications are not always effectively used and misuse may harm patients. Drugs are the fastest-growing element of Canadian ...
Design and evaluation of a knowledge-based clinical decision support system for the psychiatric nursing process
Highlights
- The Psy-KBCDSS is an empirical patient-oriented nursing clinical decision-making support system.
Abstract Background and objectives
The nursing assessment in the psychiatric department differ from those used in other departments considerably. We developed a psychiatric knowledge-based clinical decision support system (Psy-KBCDSS)...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '22: Proceedings of the 27th International Conference on Intelligent User Interfaces

March 2022

888 pages

ISBN:9781450391443

DOI:10.1145/3490099

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 March 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Conference

IUI '22

Sponsor:

IUI '22: 27th International Conference on Intelligent User Interfaces

March 22 - 25, 2022

Helsinki, Finland

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
287
Total Downloads

Downloads (Last 12 months)54
Downloads (Last 6 weeks)3

Reflects downloads up to 23 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

De Croon RSegovia-Lizano DFinglas PVanden Abeele VVerbert K(2025)An Explanation Interface for Healthy Food Recommendations in a Real-Life Workplace Deployment: User-Centered Design StudyJMIR mHealth and uHealth10.2196/5127113(e51271-e51271)Online publication date: 11-Feb-2025
https://doi.org/10.2196/51271
Humer CHinterreiter ALeichtmann BMara MStreit M(2024)Reassuring, Misleading, Debunking: Comparing Effects of XAI Methods on Human DecisionsACM Transactions on Interactive Intelligent Systems10.1145/366564714:3(1-36)Online publication date: 22-May-2024
https://dl.acm.org/doi/10.1145/3665647
Bhattacharya AOoge JStiglic GVerbert K(2023)Directive Explanations for Monitoring the Risk of Diabetes Onset: Introducing Directive Data-Centric Explanations and Combinations to Support What-If ExplorationsProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584075(204-219)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584075
Zhang ZStorath CLiu YButz A(2023)Resilience Through Appropriation: Pilots’ View on Complex Decision SupportProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584056(397-409)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584056

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten