Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3472306.3478357acmconferencesArticle/Chapter ViewAbstractPublication PagesivaConference Proceedingsconference-collections
research-article

Do you mind if I ask?: Addressing the cold start problem in personalised relational agent conversation

Published: 14 September 2021 Publication History

Abstract

To personalise dialogue to different users, relational agents need to learn about the users' preferences for relational cues used by the agent. In the context of a virtual advisor to reduce students' study stress, we designed a between subjects study with three groups (empathic, neutral and adaptive) who either received all cues, no cues or helpful cues only, respectively, and compared rapport and changes in study stress scores. To avoid the cold start problem, we sought to train the agent and adapt its dialogue to include or exclude 10 relational cues based on the user's responses to whether an example of each relational cue is found helpful prior to the session with the virtual advisor. The results of an experiment with 111 students show that the rapport scores for the empathic and adaptive groups were significantly higher than the neutral group; change in rapport scores was significantly higher in the adaptive group than in the empathic group. Furthermore, study stress scores significantly reduced for the adaptive and empathic groups, but not for the neutral group. We found some relationships between the number of times students found helpful what they received and other variables. We also found that the number of discrepancies and matches between what relational cues users received and what they found helpful were greatest in the adaptive group. This indicates the effectiveness of this approach for dealing with the cold start problem.

References

[1]
Colhon, M. and Iftene, A. Recommendation Technique for the" Cold-Start" Problem. Romanian Journal of Human-Computer Interaction, 9, 3 (2016), 255.
[2]
Lim, M. Y., Dias, J., Aylett, R. and Paiva, A. Creating adaptive affective autonomous NPCs. Autonomous Agents and Multi-Agent Systems, 24, 2 (2012), 287--311.
[3]
Basiri, J., Shakery, A., Moshiri, B. and Hayat, M. Z. Alleviating the cold-start problem of recommender systems using a new hybrid approach. IEEE, City, 2010.
[4]
Devi, M. K., Samy, R. T., Kumar, S. V. and Venkatesh, P. Probabilistic neural network approach to alleviate sparsity and cold start problems in collaborative recommender systems. IEEE, City, 2010.
[5]
Lam, X. N., Vu, T., Le, T. D. and Duong, A. D. Addressing cold-start problem in recommendation systems. City, 2008.
[6]
Guo, H. Soap: Live recommendations through social agents. Citeseer, City, 1997.
[7]
Ranjbartabar, H., Richards, D., Bilgin, A. A., Kutay, C. and Mascarenhas, S. Adapting a Virtual Advisor's Verbal Conversation Based on Predicted User Preferences: A Study of Neutral, Empathic and Tailored Dialogue. Multimodal Technologies and Interaction, 4, 3 (2020), 55.
[8]
Bickmore, T. and Picard, R. Establishing and maintaining long-term human-computer relationships. ACM Transactions on Computer-Human Interaction (TOCHI), 12, 2 (2005), 293--327.
[9]
Richards, D., Bilgin, A. A. and Ranjbartabart, H. Users' perceptions of empathic dialogue cues: A data-driven approach to provide tailored empathy. ACM, City, 2018.
[10]
Hodges, S. D. and Klein, K. J. Regulating the costs of empathy: the price of being human. The Journal of socio-economics, 30, 5 (2001), 437--452.
[11]
Goldstein, A. P. and Michaels, G. Y. Empathy: Development, training, and consequences. Lawrence Erlbaum, 1985.
[12]
Hoffman, M. L. Empathy and moral development: Implications for caring and justice. Cambridge University Press, 2001.
[13]
Shea, S. C. Psychiatric Interviewing E-Book: The Art of Understanding: A Practical Guide for Psychiatrists, Psychologists, Counselors, Social Workers, Nurses, and Other Mental Health Professionals, with online video modules. Elsevier Health Sciences, 2016.
[14]
Bickmore, T., Gruber, A. and Picard, R. Establishing the computer-patient working alliance in automated health behavior change interventions. Patient education and counseling, 59, 1 (2005), 21--30.
[15]
Gratch, J., Wang, N., Gerten, J., Fast, E. and Duffy, R. Creating rapport with virtual agents. Springer, City, 2007.
[16]
Bickmore, T., Puskar, K., Schlenk, E. A., Pfeifer, L. M. and Sereika, S. M. Maintaining reality: relational agents for antipsychotic medication adherence. Interacting with Computers, 22, 4 (2010), 276--288.
[17]
Ranjbartabar, H. and Richards, D. Understanding Individual Differences in Users' Preferences and Responses to an Intelligent Virtual Advisor for Reducing Study Stress. Springer, City, 2019.
[18]
Lisetti, C., Amini, R., Yasavur, U. and Rishe, N. I can help you change! an empathic virtual agent delivers behavior change health interventions. ACM Transactions on Management Information Systems (TMIS), 4, 4 (2013), 19.
[19]
Morency, L.-P., Stratou, G., DeVault, D., Hartholt, A., Lhommet, M., Lucas, G., Morbini, F., Georgila, K., Scherer, S. and Gratch, J. SimSensei Demonstration: A Perceptive Virtual Human Interviewer for Healthcare Applications. City, 2015.
[20]
Leite, I. Using adaptive empathic responses to improve long-term interaction with social robots. Springer, City, 2011.
[21]
Brave, S., Nass, C. and Hutchinson, K. Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent. International journal of human-computer studies, 62, 2 (2005), 161--178.
[22]
Nguyen, H. and Masthoff, J. Designing empathic computers: the effect of multimodal empathic feedback using animated agent. ACM, City, 2009.
[23]
Bickmore, T. and Schulman, D. Practical approaches to comforting users with relational agents. ACM, City, 2007.
[24]
Klein, J., Moon, Y. and Picard, R. W. This computer responds to user frustration:: Theory, design, and results. Interacting with Computers, 14, 2 (2002), 119--140.
[25]
Rollnick, S. and Miller, W. R. What is motivational interviewing? Behavioural and cognitive Psychotherapy, 23, 4 (1995), 325--334.
[26]
Biancardi, B., Wang, C., Mancini, M., Cafaro, A., Chanel, G. and Pelachaud, C. A computational model for managing impressions of an embodied conversational agent in real-time. IEEE, City, 2019.
[27]
Nguyen, T.-H. D., Carstensdottir, E., Ngo, N., El-Nasr, M. S., Gray, M., Isaacowitz, D. and Desteno, D. Modeling warmth and competence in virtual characters. Springer, City, 2015.
[28]
Ritschel, H., Baur, T. and André, E. Adapting a Robot's linguistic style based on socially-aware reinforcement learning. IEEE, City, 2017.
[29]
Niculescu, A., van Dijk, B., Nijholt, A., Li, H. and See, S. L. Making social robots more attractive: the effects of voice pitch, humor and empathy. International journal of social robotics, 5, 2 (2013), 171--191.
[30]
McQuiggan, S. W. and Lester, J. C. Modeling and evaluating empathy in embodied companion agents. International Journal of Human-Computer Studies, 65, 4 (2007), 348--360.
[31]
Dias, J., Mascarenhas, S. and Paiva, A. Fatima modular: Towards an agent architecture with a generic appraisal framework. Springer, City, 2014.
[32]
Bickmore, T., Schulman, D. and Yin, L. Maintaining engagement in long-term interventions with relational agents. Applied Artificial Intelligence, 24, 6 (2010), 648--666.
[33]
Goldberg, L. R. A broad-bandwidth, public domain, personality inventory measuring the lower-level facets of several five-factor models. Personality psychology in Europe, 7, 1 (1999), 7--28.
[34]
Henry, J. D. and Crawford, J. R. The short-form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample. British journal of clinical psychology, 44, 2 (2005), 227--239.
[35]
David, D., Ron, A., Grace, B., Teresa, D., Ed, F., Alesia, G., Kallirroi, G., Jon, G., Arno, H., Margaux, L., Gale, L., Stacy, M., Fabrizio, M., Angela, N., Stefan, S., Giota, S., Apar, S., David, T., Rachel, W., Yuyu, X., Albert, R. and Louis-Philippe, M. SimSensei kiosk: a virtual human interviewer for healthcare decision support. In Proceedings of the Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems (Paris, France, 2014). International Foundation for Autonomous Agents and Multiagent Systems, [insert City of Publication], [insert 2014 of Publication].
[36]
Ranjbartabar, H. A virtual emotional freedom practitioner to deliver physical and emotional therapy (2016).
[37]
Astrid, M., Krämer, N. C., Gratch, J. and Kang, S.-H. "It doesn't matter what you are!" Explaining social effects of agents and avatars. Computers in Human Behavior, 26, 6 (2010), 1641--1650.
[38]
McCroskey, J. C., Hamilton, P. R. and Weiner, A. N. The effect of interaction behavior on source credibility, homophily, and interpersonal attraction. Human Communication Research, 1, 1 (1974), 42--52.
[39]
McCroskey, J. C. and McCain, T. A. The measurement of interpersonal attraction. Speech Communication, 41, 3 (1974), 261--266.

Cited By

View all
  • (2024)Situating Empathy in HCI/CSCW: A Scoping ReviewProceedings of the ACM on Human-Computer Interaction10.1145/36870528:CSCW2(1-37)Online publication date: 8-Nov-2024

Index Terms

  1. Do you mind if I ask?: Addressing the cold start problem in personalised relational agent conversation
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        IVA '21: Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents
        September 2021
        238 pages
        ISBN:9781450386197
        DOI:10.1145/3472306
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 14 September 2021

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. Agent's Expertise
        2. Cold Start Problem
        3. Empathic Dialogue
        4. Human-Agent Interaction
        5. Intelligent Virtual Agents
        6. Personalisation
        7. Relational Agents
        8. Virtual Advisor

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Conference

        IVA '21
        Sponsor:

        Acceptance Rates

        Overall Acceptance Rate 53 of 196 submissions, 27%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)37
        • Downloads (Last 6 weeks)4
        Reflects downloads up to 20 Nov 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)Situating Empathy in HCI/CSCW: A Scoping ReviewProceedings of the ACM on Human-Computer Interaction10.1145/36870528:CSCW2(1-37)Online publication date: 8-Nov-2024

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media