An Intelligent Coaching Prototype for Elderly Care
<p>The proposed coaching system architecture.</p> "> Figure 2
<p>User progress interface. The user can access his/her current game experience in terms of points and experience acquired and the corresponding level. All points earnt can be used to unlock additional content inside the application.</p> "> Figure 3
<p>Main page interface. The user can see his/her current progress as well as interact with the cognitive assistant and receive feedback from the system (messages to congratulate/encourage healthier behaviors).</p> "> Figure 4
<p>Representation of the five different emotional states of the cognitive assistant.</p> "> Figure 5
<p>Representation of a message exchanged by the cognitive assistant.</p> "> Figure 6
<p>Coaching plan details interface.</p> "> Figure 7
<p>Cognitive assistant marketplace and customization interfaces.</p> "> Figure 8
<p>Cognitive games interface.</p> "> Figure 9
<p>Simulation Results—1st Scenario.</p> "> Figure 10
<p>Simulation Results—2nd Scenario.</p> "> Figure 11
<p>Simulation Results—3rd Scenario.</p> ">
Abstract
:1. Introduction
2. Proposed Model
2.1. Coaching Application
- —corresponds to the number of goals achieved in the coaching plan currently established for the user.
- —corresponds to the total number of goals defined in the coaching plan currently established for the user.
- Sad—(0–1).
- Angry—(1–2).
- OK—(2–3).
- Happy—(3–4).
- Excited—(4–5).
2.2. API Gateway
- User Progress Microservice—This microservice was developed to manage the data related to user progress and actions within the coaching application. This includes all the information on current game experience/level/points; content unlocked; in-game purchases; cognitive play session results (games played, points and experience acquired, etc.); and virtual assistant configurations/emotional state.
- Coaching Microservice—This microservice was developed in a previous study [27], in which a generic mechanism was established to configure and evaluate coaching plans with health-related goals. These goals follow a certain health topic (for example, physical activity or smoking habits) and measure an input variable proided by the user as lower than/higher than/equal to a certain value or range. Another important aspect of these goals is the fact they can be dynamically updated with increasing/decreasing difficulty, depending on the performance of the user and whether he/she completed (or not) similar goals that were established for a certain coaching plan (following the example of smoking habits, a daily goal of smoking fewer than a certain number of cigarettes per day could be updated for the following days depending on whether the person achieved this goal or not) Additionally, this microservice provides information on user performance for each associated coaching plan (number of goals already achieved, number of goals failed, upcoming goals, goals’ difficulty, etc.).
- Agent Microservice—This microservice was developed in a previous study [29] and comprised a Multi-Agent System developed in Jade [31] with the definition of two main agents that communicate with each other: A Personal Agent that returns the interaction (message queue), to be sent directly to the user, and evaluates the feedback provided by the user in terms whether the user achieved a health goal after performing a certain interaction with him/her; A Coaching Agent that applies a Reinforcement Learning strategy (using a Q-Learning algorithm) to understand which interactions should next be sent to the user at specific moments of the day based on the information exchanged with the Personal Agent and the interactions with the user. This Reinforcement Learing strategy allows the system to learn from the older person as he/she provides more feedback and understands which messages are most influential to motivate the person to achieve their health goals. Then, future interactions can be adapted according to this information.
3. Results and Discussion
4. Conclusions and Future Work
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- United Nations. World Population Ageing Report; United Nations: San Francisco, CA, USA, 2019. [Google Scholar]
- World Health Organization. Ageing; World Health Organization: Geneva, Switzerland, 2020. [Google Scholar]
- Martinho, D.; Carneiro, J.; Corchado, J.M.; Marreiros, G. A systematic review of gamification techniques applied to elderly care. Artif. Intell. Rev. 2020, 53, 4863–4901. [Google Scholar] [CrossRef]
- Hermens, H.; op den Akker, H.; Tabak, M.; Wijsman, J.; Vollenbroek, M. Personalized Coaching Systems to support healthy behavior in people with chronic conditions. J. Electromyogr. Kinesiol. 2014, 24, 815–826. [Google Scholar] [CrossRef] [PubMed]
- Degeling, K.; Koffijberg, H.; Ijzerman, M.J. A systematic review and checklist presenting the main challenges for health economic modeling in personalized medicine: Towards implementing patient-level models. Expert Rev. Pharm. Outcomes Res. 2017, 17, 17–25. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Thakur, N.; Han, C.Y. Framework for a personalized intelligent assistant to elderly people for activities of daily living. Int. J. Recent Trends Hum. Comput. Interact. 2019, 9, 1–22. [Google Scholar]
- Costa, A.; Heras, S.; Palanca, J.; Jordán, J.; Novais, P.; Julián, V. Argumentation schemes for events suggestion in an e-Health platform. In Proceedings of the International Conference on Persuasive Technology, Amsterdam, The Netherlands, 4–6 April 2017; Springer: Berlin/Heidelberg, Germany, 2017; pp. 17–30. [Google Scholar]
- Costa, A.; Heras, S.; Palanca, J.; Novais, P.; Julián, V. A persuasive cognitive assistant system. In Proceedings of the International Symposium on Ambient Intelligence, Sevilla, Spain, 1–3 June 2016; Springer: Berlin/Heidelberg, Germany, 2016; pp. 151–160. [Google Scholar]
- Costa, A.; Heras, S.; Palanca, J.; Novais, P.; Julián, V. Persuasion and Recommendation System Applied to a Cognitive Assistant. Adv. Distrib. Comput. Artif. Intell. J. 2016, 5, 89–99. [Google Scholar] [CrossRef] [Green Version]
- Stokes, B. Videogames have changed: Time to considerSerious Games’? Dev. Educ. J. 2005, 11, 12. [Google Scholar]
- Whitehead, A.; Johnston, H.; Nixon, N.; Welch, J. Exergame effectiveness: What the numbers can tell us. In Proceedings of the 5th ACM SIGGRAPH Symposium on Video Games, Los Angeles CA, USA, 28–29 July 2010; ACM: New York, NY, USA, 2010; pp. 55–62. [Google Scholar]
- Hamari, J.; Koivisto, J.; Sarsa, H. Does gamification work?—A literature review of empirical studies on gamification. In Proceedings of the 2014 47th Hawaii International Conference on System Sciences (HICSS), Waikoloa, HI, USA, 6–9 January 2014; IEEE: Piscataway, NJ, USA, 2014; pp. 3025–3034. [Google Scholar]
- Schultz, T.; Putze, F.; Steinert, L.; Mikut, R.; Depner, A.; Kruse, A.; Franz, I.; Gaerte, P.; Dimitrov, T.; Gehrig, T. I-CARE-An Interaction System for the Individual Activation of People with Dementia. Geriatrics 2021, 6, 51. [Google Scholar] [CrossRef] [PubMed]
- Puig, J.; Echeverría, P.; Lluch, T.; Herms, J.; Estany, C.; Bonjoch, A.; Ornelas, A.; París, D.; Loste, C.; Sarquella, M. A Specific Mobile Health Application for Older HIV-Infected Patients: Usability and Patient’s Satisfaction. Telemed. e-Health 2021, 27, 432–440. [Google Scholar] [CrossRef] [PubMed]
- Gellner, C.; Buchem, I.; Müller, J. Application of the Octalysis Framework to Gamification Designs for the Elderly. In Proceedings of the European Conference on Games Based Learning, Brighton, UK, 23–24 September 2021; Academic Conferences International Limited: London, UK, 2021; p. 260-XIX. [Google Scholar]
- Kostopoulos, P.; Kyritsis, A.I.; Ricard, V.; Deriaz, M.; Konstantas, D. Enhance daily live and health of elderly people. Procedia Comput. Sci. 2018, 130, 967–972. [Google Scholar] [CrossRef]
- Balsa, J.; Félix, I.; Cláudio, A.P.; Carmo, M.B.; Silva, I.C.; Guerreiro, A.; Guedes, M.; Henriques, A.; Guerreiro, M.P. Usability of an Intelligent Virtual Assistant for Promoting Behavior Change and Self-Care in Older People with Type 2 Diabetes. J. Med. Syst. 2020, 44, 130. [Google Scholar] [CrossRef] [PubMed]
- Chan, J.; Nejat, G. Promoting engagement in cognitively stimulating activities using an intelligent socially assistive robot. In Proceedings of the 2010 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, Montreal, QC, Canada, 6–9 July 2020; pp. 533–538. [Google Scholar]
- Costa, A.; Novais, P.; Julian, V.A. A survey of cognitive assistants. In Personal Assistants: Emerging Computational Technologies; Springer: Berlin/Heidelberg, Germany, 2018; pp. 3–16. [Google Scholar]
- De Barcelos Silva, A.; Gomes, M.M.; da Costa, C.A.; da Rosa Righi, R.; Barbosa, J.L.V.; Pessin, G.; De Doncker, G.; Federizzi, G. Intelligent personal assistants: A systematic literature review. Expert Syst. Appl. 2020, 147, 113193. [Google Scholar] [CrossRef]
- Ramos, J.; Oliveira, T.; Satoh, K.; Neves, J.; Novais, P. Cognitive assistants—An analysis and future trends based on speculative default reasoning. Appl. Sci. 2018, 8, 742. [Google Scholar] [CrossRef] [Green Version]
- Le, N.-T.; Wartschinski, L. A Cognitive Assistant for improving human reasoning skills. Int. J. Hum.-Comput. Stud. 2018, 117, 45–54. [Google Scholar] [CrossRef]
- Kolenik, T.; Gams, M. Intelligent Cognitive Assistants for Attitude and Behavior Change Support in Mental Health: State-of-the-Art Technical Review. Electronics 2021, 10, 1250. [Google Scholar] [CrossRef]
- Chang, E. An Exploration of Virtual Pets and Our Relationships to Them. Ph.D. Thesis, University of California Santa Luz, San Diego, CA, USA, 2020. [Google Scholar]
- Ferwerda, B.; Lee, M. Tamagotchi++: A Serious, Personalized Game to Encourage Healthy Behavior. In Proceedings of the 24th International on Intelligent User Interfaces (IUI), CEUR-WS. Los Angeles, CA, USA, 16–20 March 2019. [Google Scholar]
- Cheok, A.D.; Zhang, E.Y. Emotional Relationships with Robotic Companions. In Human–Robot Intimate Relationships; Springer: Berlin/Heidelberg, Germany, 2019; pp. 153–158. [Google Scholar]
- Martinho, D.; Vieira, A.; Carneiro, J.; Martins, C.; Almeida, A.; Marreiros, G. A Definition of a Coaching Plan to Guide Patients with Chronic Obstructive Respiratory Diseases. In Proceedings of the World Conference on Information Systems and Technologies, Budva, Montenegro, 7–10 April 2020; Springer: Berlin/Heidelberg, Germany, 2020; pp. 54–64. [Google Scholar]
- Martinho, D.; Carneiro, J.; Novais, P.; Neves, J.; Corchado, J.; Marreiros, G. A conceptual approach to enhance the well-being of elderly people. In Proceedings of the EPIA Conference on Artificial Intelligence, Vila Real, Spain, 3–6 September 2019; Springer: Berlin/Heidelberg, Germany, 2019; pp. 50–61. [Google Scholar]
- Martinho, D.; Carneiro, J.; Neves, J.; Novais, P.; Corchado, J.; Marreiros, G. A Reinforcement Learning Approach to Improve User Achievement of Health-Related Goals. In Proceedings of the EPIA Conference on Artificial Intelligence, Virtual Event, 7–9 September 2021; Springer: Berlin/Heidelberg, Germany, 2021; pp. 266–277. [Google Scholar]
- Savelli, R.M.; de Beauclair Seixas, R. Tic-Tac-Toe and the Minimax Decision Algorithm. Available online: https://www.lua.org/gems/ (accessed on 28 December 2021).
- Bellifemine, F.; Poggi, A.; Rimassa, G. Developing multi-agent systems with JADE. In Proceedings of the International Workshop on Agent Theories, Architectures, and Languages, Montreal, QC, Canada, 19–20 August 1995; Springer: Berlin/Heidelberg, Germany, 2000; pp. 89–103. [Google Scholar]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Martinho, D.; Crista, V.; Carneiro, J.; Corchado, J.M.; Marreiros, G. An Intelligent Coaching Prototype for Elderly Care. Electronics 2022, 11, 460. https://doi.org/10.3390/electronics11030460
Martinho D, Crista V, Carneiro J, Corchado JM, Marreiros G. An Intelligent Coaching Prototype for Elderly Care. Electronics. 2022; 11(3):460. https://doi.org/10.3390/electronics11030460
Chicago/Turabian StyleMartinho, Diogo, Vítor Crista, João Carneiro, Juan Manuel Corchado, and Goreti Marreiros. 2022. "An Intelligent Coaching Prototype for Elderly Care" Electronics 11, no. 3: 460. https://doi.org/10.3390/electronics11030460
APA StyleMartinho, D., Crista, V., Carneiro, J., Corchado, J. M., & Marreiros, G. (2022). An Intelligent Coaching Prototype for Elderly Care. Electronics, 11(3), 460. https://doi.org/10.3390/electronics11030460