article

Evaluating a Computational Model of Emotion

Authors:

Jonathan Gratch,

Stacy MarsellaAuthors Info & Claims

Autonomous Agents and Multi-Agent Systems, Volume 11, Issue 1

Pages 23 - 43

https://doi.org/10.1007/s10458-005-1081-1

Published: 01 July 2005 Publication History

Abstract

Spurred by a range of potential applications, there has been a growing body of research in computational models of human emotion. To advance the development of these models, it is critical that we evaluate them against the phenomena they purport to model. In this paper, we present one method to evaluate an emotion model that compares the behavior of the model against human behavior using a standard clinical instrument for assessing human emotion and coping. We use this method to evaluate the Emotion and Adaptation (EMA) model of emotion Gratch and Marsella. The evaluation highlights strengths of the approach and identifies where the model needs further development.

References

[1]

1. J. Gratch and S. Marsella, "Tears and fears: Modeling emotions and emotional behaviors in synthetic agents," presented at Fifth International Conference on Autonomous Agents, Montreal, Canada, 2001.

Digital Library

[2]

2. S. Marsella and J. Gratch, "The Modeling coping behaviors in virtual humans: Don't worry, be happy," presented at Second International Joint Conference on Autonomous Agents and Multi-agent Systems, Melbourne, Australia, 2003.

Digital Library

[3]

3. J. Gratch and S. Marsella, "A domain independent framework for modeling emotion," J. Cognitive Sys. Res., vol. 5, pp. 269-306, 2004.

Digital Library

[4]

4. C. Conati, "Probabilistic assessment of user's emotions in educational games," J. Appl. Artif. Intelligence, special issue on "Merging Cognition and Affect in HCI", vol. 16, pp. 555-575, 2002.

[5]

5. C. Conati and H. MacLaren, "Evaluating a probabilistic model of student affect," presented at Seventh International Conference on Intelligent Tutoring Systems, Maceio, Brazil, 2004.

[6]

6. S. Marsella, W. L. Johnson, and C. LaBore, "Interactive pedagogical drama," presented at Fourth International Conference on Autonomous Agents, Montreal, Canada, 2000.

Digital Library

[7]

7. B. O. Rothbaum, L. F. Hodges, R. Alarcon, D. Ready, F. Shahar, K. Graap, J. Pair, P. Hebert, B. Wills, and D. Baltzell, "Virtual environment exposure therapy for PTSD vietnam veterans: A case study," J. Trauma Stress, vol. 12, pp. 263-272, 1999.

[8]

8. J. C. Lester, B. A. Stone, and G. D. Stelling, "Lifelike pedagogical agents for mixed-initiative problem solving in constructivist learning environments," User Model. User-Adapted Instruction, vol. 9, pp. 1- 44, 1999.

Digital Library

[9]

9. K. Ryokai, C. Vaucelle, and J. Cassell, "Virtual Peers as Partners in Storytelling and Literacy Learning," Journal of Computer Assisted Learning, vol. 19, no. 2, pp. 195-208, 2003.

[10]

10. E. Shaw, W. L. Johnson, and R. Ganeshan, "Pedagogical agents on the web," presented at Proceedings of the Third International Conference on Autonomous Agents, Seattle, WA, 1999.

Digital Library

[11]

11. E. André, T. Rist, S. V. Mulken, and M. Klesen, "The automated design of believable dialogues for animated presentation teams," in J. Cassell, J. Sullivan, S. Prevost, and E. Churchill, (eds.), Embodied Conversational Agents, MIT Press: Cambridge, MA, pp. 220-255, 2000.

Digital Library

[12]

12. J. Cassell, T. Bickmore, L. Campbell, H. Vilhjálmsson, and H. Yan, "Human conversation as a system framework: Designing embodied conversational agents," in J. Cassell, J. Sullivan, S. Prevost, and E. Churchill, (eds), Embodied Conversational Agents, MIT Press: Boston pp. 29-63, 2000.

Digital Library

[13]

13. B. G. Silverman, M. Johns, K. O'Brien, R. Weaver, and J. Cornwell, "Constructing Virtual Asymmetric Opponents from Data and Models in the Literature: Case of Crowd Rioting," 11th Conference on Computer-Generated Forces and Behavior Representation, Orlanda FL, pp. 97-105, 2002.

[14]

14. J. Gratch and S. Marsella, "Fight the way you train: The role and limits of emotions in training for combat," Brown J. World Affairs, vol. 10, no. 1, pp. 63-76, 2003.

[15]

15. S. Marsella, D. Pynadath, and S. Read, "PsychSim: Agent-based modeling of social interactions and influence," presented at International Conference on Cognitive Modeling, 2004.

[16]

16. M. Minsky, The Society of Mind, Simon and Schuster: New York 1986.

Digital Library

[17]

17. H. A. Simon, "Motivational and emotional controls of cognition," Psychological Rev., vol. 74, pp. 29- 39, 1967.

[18]

18. A. R. Damasio, Descartes' Error: Emotion, Reason, and the Human Brain, Avon Books: New York, 1994.

[19]

19. K. Oatley and P. N. Johnson-Laird, "Towards a Cognitive Theory of Emotions," Cognition and Emotion, vol. 1, no. 1, pp. 29-50, 1987.

[20]

20. A. Sloman and M. Croucher, "Why robots will have emotions," presented at International Joint Conference on Artificial Intelligence, Vancouver, Canada, 1981.

[21]

21. C. Lisetti and P. Gmytrasiewicz, "Can a rational agent afford to be affectless? A formal approach," Appl. Artif. Intelligence, vol. 16, pp. 577-609, 2002.

[22]

22. R. Frank, Passions with Reason: The Strategic Role of the Emotions, W. W. Norton; New York, NY, 1988.

[23]

23. A. R. Mele, Self-Deception Unmasked, Princeton University Press: Princeton, NJ, 2001.

[24]

24. W. Mao and J. Gratch, "Social judgment in multiagent interactions," presented at Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004.

Digital Library

[25]

25. J. Gratch, J. Rickel, E. André, J. Cassell, E. Petajan, and N. Badler, "Creating interactive virtual humans: Some assembly required," in IEEE Intelligent Syst., vol. July/August, pp. 54- 61, 2002.

Digital Library

[26]

26. J. Rickel, S. Marsella, J. Gratch, R. Hill, D. Traum, and W. Swartout, "Toward a new generation of virtual humans for interactive experiences," in IEEE Intelligent Syst., vol. July/August, pp. 32-38 2002.

Digital Library

[27]

27. S. Marsella, W. L. Johnson, and C. LaBore, "Interactive pedagogical drama for health interventions," presented at Conference on Artificial Intelligence in Education, Sydney, Australia, 2003.

[28]

28. M. Cavazza, F. Charles, and S. J. Mead, "Agents' interaction in virtual storytelling," presented at Third International Workshop on Intelligent Virtual Agents, 2001.

Digital Library

[29]

29. C. L. Lisetti and D. Schiano, "Facial expression recognition: Where human-computer interaction, artificial intelligence, and cognitive science intersect," Pragma Cognition, vol. 8, pp. 185-235, 2000.

[30]

30. R. W. Picard, Affective Computing, MIT Press: Cambridge, MA, 1997.

Digital Library

[31]

31. S. van Mulken, E. André, and J. Muller, "The persona effect: how substantial is it," presented at Human Computer Interaction Conference, Berlin, 1998.

Digital Library

[32]

32. W. Swartout, R. Hill, J. Gratch, W. L. Johnson, C. Kyriakakis, C. LaBore, R. Lindheim, S. Marsella, D. Miraglia, B. Moore, J. Morie, J. Rickel, M. Thiebaux, L. Tuch, R. Whitney, and J. Douglas, "Toward the holodeck: Integrating graphics, sound, character and story," presented at Fifth International Conference on Autonomous Agents, Montreal, Canada, 2001.

Digital Library

[33]

33. R. Lazarus, Emotion and Adaptation, Oxford University Press: NY, 1991.

[34]

34. J. Velásquez, "When robots weep: Emotional memories and decision-making.," presented at 15th National Conference on Artificial Intelligence, Madison, WI, 1998.

Digital Library

[35]

35. C. A. Smith and R. Lazarus, "Emotion and Adaptation," in L. A. Pervin, (ed.), Handbook of Personality: Theory and research, Guilford Press: NY, pp. 609-637, 1990.

[36]

36. E. Peacock and P. Wong, "The stress appraisal measure (SAM): A multidimensional approach to cognitive appraisal," Stress Medic., vol. 6, pp. 227-236, 1990.

[37]

37. J. Blythe, "Decision Theoretic Planning," in AI Magazine, vol. 20(2), pp. 37-54, 1999.

[38]

38. B. Grosz and S. Kraus, "Collaborative plans for complex group action," Artif. Intelligence, vol. 86, no. 2, pp. 269-357, 1996.

Digital Library

[39]

39. K. G. Shaver, The Attribution of Blame: Causality, Responsibility, and Blameworthiness. Springer-Verlag: NY, 1985.

[40]

40. A. Ortony, G. Clore, and A. Collins, The Cognitive Structure of Emotions, Cambridge University Press, Cambridge, 1988.

[41]

41. J. Gratch and S. Marsella, "Lessons from Emotion Psychology for the Design of Lifelike Characters," Applied Artif. Intelligence, vol. 19. nos. 3-4, pp. 215-233, 2005.

[42]

42. C. Pelachaud, V. Carofiglio, B. D. Carolis, F. d. Rosis, and I. Poggi, "First international joint conference on autonomous agents and multiagent systems," presented at Embodied Contextual Agent in Information Delivering Application, Bologna, Italy, 2002.

Digital Library

[43]

43. M. Klesen, "Using theatrical concepts for role-plays with educational agents," Appl. Artif. Intelligence Special Issue "Educational Agents - Beyond Virtual Tutors", vol. 19, nos. 3-4, pp. 413-431, 2005.

[44]

44. H. Nakanishi, S. Shimizu, and K. Isbister, "Sensitizing social agents for virtual training," Appl. Artif. Intelligence Special Issue "Educational Agents - Beyond Virtual Tutors", vol. 19, nos. 3-4, pp. 393-412, 2005.

[45]

45. A. Cowell and K. M. Stanney, "Embodiement and interaction guidelines for designing credible, trustworthy embodied conversational agents," presented at Intelligent Virtual Agents, Kloster Irsee, Germany, 2003.

[46]

46. J. C. Lester, S. G. Towns, C. B. Callaway, J. L. Voerman, and P. J. FitzGerald, "Deictic and emotive communication in animated pedagogical agents," in J. Cassell, S. Prevost, J. Sullivan, and E. Churchill, (eds.), Embodied Conversational Agents, MIT Press: Cambridge, pp. 123-154, 2000.

Digital Library

[47]

47. G. Biswas, D. Schwartz, K. Leelawong, N. Vye, and TAG-V, "Learning by teaching. A new agent paradigm for educational software," Appl. Artif. Intelligence special Issue "Educ. Agents - Beyond Virtual Tutors", vol. 19, 2005.

[48]

48. C. Elliott, "The affective reasoner: A process model of emotions in a multi-agent system," Ph.D Dissertation, Northwestern University Institute for the Learning Sciences, Northwestern, IL, vol. 32, 1992.

Digital Library

[49]

49. M. S. El Nasr, J. Yen, and T. Ioerger, "FLAME: Fuzzy Logic Adaptive Model of Emotions," Autonomous Agents and Multi-Agent Systems, vol. 3, pp. 219-257, 2000.

Digital Library

[50]

50. D. Moffat and N. Frijda, "Where there's a Will there's an agent," presented at Workshop on Agent Theories, Architectures and Languages, 1995.

Digital Library

[51]

51. J. L. Armony, D. Servan-Schreiber, J. D. Cohen, and J. E. LeDoux, "Computational modeling of emotion: Explorations through the anatomy and physiology of fear conditioning," Trends in Cognitive Sci., vol. 1, pp. 28-34, 1997.

[52]

52. D. Cañamero, "Modeling motivations and emotions as a basis for intelligent behavior," presented at International Conference on Autonomous Agents, Marina del Rey, CA, 1997.

Digital Library

[53]

53. R. C. Arkin, "Moving up the food chain: Motivation and Emotion in behavior-based robots," in J. Fellous and M. Arbib, (eds.), Who Needs Emotions: The Brain Meets the Robot, Oxford University Press, New York, 2005.

[54]

54. J. R. Busemeyer, J. T. Townsend, and J. C. Stout, "Motivational underpinnings of utility in decision making: Decision field theory analysis of deprivation and satiation," in S. Moore, (ed.), Emotional Cognition, John Benjamins: Amsterdam, 2002.

[55]

55. P. Gmytrasiewicz and C. Lisetti, "Using decision theory to formalize emotions for multi-agent systems," presented at Second ICMAS-2000 Workshop on Game Theoretic and Decision Theoretic Agents, Boston, 2000.

Digital Library

[56]

56. H. Prendinger, S. Mayer, J. Mori, and M. Ishizuka, "Persona effect revisited," presented at Intelligent Virtual Agents, Kloster Irsee, Germany, 2003.

[57]

57. N. C. Kramer, B. Tietz, and G. Bente, "Effects of embodied interface agents and their gestural activity," presented at Intelligent Virtual Agents, Kloster Irsee, Germany, 2003.

[58]

58. M. Scheutz and A. Sloman, "Affect and agent control: experiments with simple affective states," presented at IAT, 2001.

[59]

59. M. Perrez and M. Reicherts, Stress, Coping, and Health, Hogrefe and Huber Publishers: Seattle, WA, 1992.

Cited By

Somandepalli KSiy OJou B(2024)Relational Affect in Dyadic InteractionsExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3637206(1-9)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3637206
Zhang JHilpert BBroekens JJokinen J(2024)Simulating Emotions With an Integrated Computational Model of Appraisal and Reinforcement LearningProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641908(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641908
Benamara AMartin JPrigent EChaby LChetouani MZagdoun JVanderstichel HDacunha SRavenet BPelachaud CTaylor MFaliszewski PMascardi V(2022)COPALZ: A Computational Model of Pathological Appraisal Biases for an Interactive Virtual Alzheimer PatientProceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems10.5555/3535850.3535860(72-81)Online publication date: 9-May-2022
https://dl.acm.org/doi/10.5555/3535850.3535860
Show More Cited By

Index Terms

Evaluating a Computational Model of Emotion
1. Applied computing
  1. Law, social and behavioral sciences
    1. Psychology
2. Computing methodologies
  1. Artificial intelligence
    1. Distributed artificial intelligence
      1. Multi-agent systems
  2. Modeling and simulation
    1. Model development and analysis
      1. Model verification and validation
      2. Modeling methodologies

Recommendations

Modeling of emotion elicitation conditions for a cognitive-emotive architecture
Abstract
To cater to the need of embodying emotional behavior in an autonomous agent, there is a need for modeling computationally apt definitions of emotions. A number of emotion theories have been developed that provide an understanding of ...
Learning Human Emotion Patterns for Modeling Virtual Humans
TAAI '11: Proceedings of the 2011 International Conference on Technologies and Applications of Artificial Intelligence

Emotion modeling is a crucial part in modeling virtual humans. Although various emotion models have been proposed, most of them focus on designing specific appraisal rules. As there is no unified framework for emotional appraisal, the appraisal ...
An analytical system for user emotion extraction, mental state modeling, and rating
Highlights
- We estimate twelve emotions from emails - six positive and six negative.
- We ...
Abstract
Emotion is a crucial indicator of the mental state influenced by environmental cognition, health, and intention. Therefore, modeling emotional patterns from daily communications is useful and vital for behavioral studies. This paper ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Autonomous Agents and Multi-Agent Systems

Autonomous Agents and Multi-Agent Systems Volume 11, Issue 1

July 2005

99 pages

ISSN:1387-2532

Issue’s Table of Contents

Copyright © Copyright © 2005 Springer Science+Business Media Inc.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 July 2005

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

32
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Somandepalli KSiy OJou B(2024)Relational Affect in Dyadic InteractionsExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3637206(1-9)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3637206
Zhang JHilpert BBroekens JJokinen J(2024)Simulating Emotions With an Integrated Computational Model of Appraisal and Reinforcement LearningProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641908(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641908
Benamara AMartin JPrigent EChaby LChetouani MZagdoun JVanderstichel HDacunha SRavenet BPelachaud CTaylor MFaliszewski PMascardi V(2022)COPALZ: A Computational Model of Pathological Appraisal Biases for an Interactive Virtual Alzheimer PatientProceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems10.5555/3535850.3535860(72-81)Online publication date: 9-May-2022
https://dl.acm.org/doi/10.5555/3535850.3535860
Azad SMartens C(2021)Little Computer PeopleProceedings of the ACM on Human-Computer Interaction10.1145/34746725:CHI PLAY(1-30)Online publication date: 6-Oct-2021
https://dl.acm.org/doi/10.1145/3474672
Shvo MBuhmann JKapadia MPelachaud CMartin JBuschmeier HLucas GKopp S(2019)An Interdependent Model of Personality, Motivation, Emotion, and Mood for Intelligent Virtual AgentsProceedings of the 19th ACM International Conference on Intelligent Virtual Agents10.1145/3308532.3329474(65-72)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.1145/3308532.3329474
Gluz JJaques P(2017)A probabilistic formalization of the appraisal for the OCC event-based emotionsJournal of Artificial Intelligence Research10.5555/3176764.317677958:1(627-664)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.5555/3176764.3176779
Huang YYang JLiao PPan J(2017)Fusion of Facial Expressions and EEG for Multimodal Emotion RecognitionComputational Intelligence and Neuroscience10.1155/2017/21074512017Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1155/2017/2107451
Talanov MToschev A(2015)Appraisal, Coping and High Level Emotions Aspects of Computational Emotional ThinkingInternational Journal of Synthetic Emotions10.4018/IJSE.20150101026:1(24-39)Online publication date: 1-Jan-2015
https://dl.acm.org/doi/10.4018/IJSE.2015010102
Rodríguez LRamos F(2015)Computational models of emotions for autonomous agentsArtificial Intelligence Review10.1007/s10462-012-9380-943:3(437-465)Online publication date: 1-Mar-2015
https://dl.acm.org/doi/10.1007/s10462-012-9380-9
Talanov MToschev A(2014)Computational Emotional Thinking and Virtual NeurotransmittersInternational Journal of Synthetic Emotions10.4018/ijse.20140101015:1(1-8)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.4018/ijse.2014010101
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents