article

A domain-independent framework for modeling emotion

Authors:

Jonathan Gratch,

Stacy MarsellaAuthors Info & Claims

Cognitive Systems Research, Volume 5, Issue 4

Pages 269 - 306

https://doi.org/10.1016/j.cogsys.2004.02.002

Published: 01 December 2004 Publication History

Abstract

In this article, we show how psychological theories of emotion shed light on the interaction between emotion and cognition, and thus can inform the design of human-like autonomous agents that must convey these core aspects of human behavior. We lay out a general computational framework of appraisal and coping as a central organizing principle for such systems. We then discuss a detailed domain-independent model based on this framework, illustrating how it has been applied to the problem of generating behavior for a significant social training application. The model is useful not only for deriving emotional state, but also for informing a number of the behaviors that must be modeled by virtual humans such as facial expressions, dialogue management, planning, reacting, and social understanding. Thus, the work is of potential interest to models of strategic decision-making, action selection, facial animation, and social intelligence.

References

[1]

Agre, P., & Chapman, D. (1987). Pengi: An implementation of a theory of activity. Paper presented at the national conference on artificial intelligence

[2]

Ambros-Ingerson, J., & Steel, S. (1988). Integrating planning, execution and monitoring. Paper presented at the seventh national conference on artificial intelligence, St. Paul, MN

[3]

Rules of the mind. Erlbaum, Hillsdale, NJ.

[4]

The automated design of believable dialogues for animated presentation teams. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (Eds.), Embodied conversational agents, MIT Press, Cambridge, MA. pp. 220-255.

[5]

Emotion and personality. Columbia University Press, New York.

[6]

Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology. v70 i3. 614-636.

[7]

Bateman, J. A., & Paris, C. L. (1989). Phrasing a text in terms the user can understand. Paper presented at the 11th international joint conference on artificial intelligence, Detroit, MI

[8]

Broad agents. Sigart Bulletin. v2 i4. 38-40.

[9]

Decision theoretic planning. AI Magazine. v20 i2. 37-54.

[10]

Decision-theoretic planning: Structural assumptions and computational leverage. Journal of Artificial Intelligence Research. v11. 1-94.

[11]

What is intention?. In: Cohen, P., Morgan, J., Pollack, M. (Eds.), Intentions in communication, MIT Press, Cambridge, MA.

[12]

The importance of affective communication in social referencing: A commentary on Feinman. Merrill-Palmer Quarterly. v29. 83-87.

[13]

Assessing coping strategies: A theoretically based approach. Journal of Personality Psychology. v56 i2. 267-283.

[14]

Human conversation as a system framework: Designing embodied conversational agents. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (Eds.), Embodied conversational agents, MIT Press, Boston. pp. 29-63.

[15]

Cassell, J., Vilhjálmsson, H., & Bickmore, T. (2001). BEAT: The behavior expressive animation toolkit. Paper presented at the SIGGRAPH, Los Angeles, CA

[16]

Planning for conjunctive goals. Artificial Intelligence. v32. 333-377.

[17]

Clore, G., Schwartz, N., & Conway, M. (1994). Affect as information. In J. P. Forgas (Ed.), Handbook of affect and social cognition (pp. 121-144)

[18]

Feeling is believing: Some affective influences on belief. In: Frijda, N., Manstead, A.S.R., Bem, S. (Eds.), Emotions and beliefs: How feelings influence thoughts, Cambridge University Press, Paris. pp. 10-44.

[19]

Evolutionary psychology and the emotions. In: Lewis, M., Haviland-Jones, J. (Eds.), Handbook of emotion, Guilford Press, New York. pp. 91-115.

[20]

Personality and coping: A reconceptualization. In: Zeidner, M., Endler, N. (Eds.), Handbook of coping, Wiley, New York.

[21]

Descartes' error: Emotion reason and the human brain. 1994. Avon Books, New York.

[22]

de Kleer, J., & Brown, J.S., (1982). Foundations of envisioning. Paper presented at the national conference on artificial intelligence, Pittsburgh, PA

[23]

Generalizing the partial global planning algorithm. International Journal of Intelligent and Cooperative Information Systems. v1 i2. 319-346.

[24]

Universals and cultural differences in facial expressions of emotions. In: Cole, J. (Ed.), Nebraska symposium on motivation, University of Nebraska Press, Lincoln, Nebraska. pp. 207-283.

[25]

FLAME: Fuzzy logic adaptive model of emotions. Autonomous Agents and Multi-Agent Systems. v3 i3. 219-257.

[26]

Elliott, C., (1992). The affective reasoner: A process model of emotions in a multi-agent system (Ph.D. Dissertation No. 32). Northwestern, IL: Northwestern University Institute for the Learning Sciences

[27]

Appraisal processes in emotion. In: Davidson, R.J., Goldsmith, H.H., Scherer, K.R. (Eds.), Handbook of the affective sciences, Oxford University Press, New York. pp. 572-595.

[28]

STRIPS: A new approach to the application of theorem proving to problem solving. Artificial Intelligence. v2 i3-4. 189-208.

[29]

Fleischman, M., & Hovy, E. (2002). Emotional variation in speech-based natural language generation. Paper presented at the international natural language generation conference, Arden House, NY

[30]

Passions with reason: The strategic role of the emotions. W.W. Norton, New York.

[31]

Emotion cognitive structure and action tendency. Cognition and Emotion. v1. 115-143.

[32]

Appraisal: What is the dependent?. In: Scherer, K., Schorr, A., Johnstone, T. (Eds.), Appraisal processes in emotion, Oxford University Press, Oxford. pp. 141-156.

[33]

Gratch, J. (2000). E¿mile: Marshalling passions in training and education. Paper presented at the fourth international conference on intelligent agents, Barcelona, Spain

[34]

Socially situated planning. In: Dauterhahn, K., Bond, A.H., Cañamero, L., Edmonds, B. (Eds.), Socially intelligent agents - Creating relationships with computers and robots, Kluwer Academic Publishers, Norwell, MA. pp. 181-188.

[35]

Gratch, J., & Marsella, S., 2001. Tears and fears: Modeling emotions and emotional behaviors in synthetic agents. Paper presented at the fifth international conference on autonomous agents, Montreal, Canada

[36]

Fight the way you train: The role and limits of emotions in training for combat. Brown Journal of World Affairs. vX i1.

[37]

Gratch, J., & Marsella, S. (2004a). Evaluating a general model of emotional appraisal and coping. Paper presented at the AAAI symposium on architectures for modeling emotion: Cross-disciplinary foundations, Palo Alto, CA

[38]

Gratch, J., & Marsella, S. (2004b). Technical details of a domain independent framework for modeling emotion. Technical Report ICT-TR-04-2004. From www.ict.usc.edu/~gratch/EMA_Details.pdf

[39]

Creating interactive virtual humans: Some assembly required. IEEE Intelligent Systems. iJuly/August. 54-61.

[40]

Collaborative plans for complex group action. Artificial Intelligence. v86. 2

[41]

Hill, R., Chen, J., Gratch, J., Rosenbloom, P., & Tambe, M. (1997). Intelligent agents for the synthetic battlefield. Paper presented at the joint proceedings of the fourteenth national conference on artificial intelligence and the ninth conference on innovative applications of artificial intelligence (AAAI/IAAI97), Providence, RI

[42]

Pragmatics and natural language generation. Artificial Intelligence. v43 i2. 153-198.

[43]

Johnson, W. L., Narayanan, S., Whitney, R., Das, R., Bulut, M., & LaBore, C. (2002). Limited domain synthesis of expressive military speech for animated characters. Paper presented at the 7th international conference on spoken language processing, Denver, CO

[44]

Kirby, L., & Smith, C. (1996). Freaking, quitting, and staying engaged: Patterns of psychphysiological response to stress. Paper presented at the ninth conference of the international society for research on emotions, Toronto, Ontario

[45]

Emotion and adaptation. 1991. Oxford University Press, New York.

[46]

Relational meaning and discrete emotions. In: Scherer, K., Schorr, A., Johnstone, T. (Eds.), Appraisal processes in emotion, Oxford University Press, Oxford. pp. 37-67.

[47]

The emotional brain: The mysterious underpinnings of emotional life. Simon & Schuster, New York.

[48]

Beyond valence: Toward a model of emotion-specific influences on judgement and choice. Cognition and Emotion. v14. 473-493.

[49]

Lifelike pedagogical agents for mixed-initiative problem solving in constructivist learning environments. User Modeling and User-Adapted Instruction. v9 i1-2. 1-44.

[50]

Deictic and emotive communication in animated pedagogical agents. In: Cassell, J., Prevost, S., Sullivan, J., Churchill, E. (Eds.), Embodied conversational agents, MIT Press, Cambridge, MA. pp. 123-154.

[51]

Can a rational agent afford to be affectless? A formal approach. Applied Artificial Intelligence. v16. 577-609.

[52]

Mao, W., & Gratch, J. (2003). The social credit assignment problem. Paper presented at the international working conference in interactive virtual agents, Kloster Irsee, Germany

[53]

Marsella, S., & Gratch, J. (2001). Modeling the interplay of plans and emotions in multi-agent simulations. Paper presented at the cognitive science society, Edinburgh, Scotland

[54]

Marsella, S., & Gratch, J. (2002). A step toward irrationality: using emotion to change belief. Paper presented at the First International Joint Conference on Autonomous Agents and Multiagent Systems, Bologna, Italy

[55]

Marsella, S., & Gratch, J. (2003). Modeling coping behaviors in virtual humans: Don't worry, be happy. Paper presented at the Second International Joint Conference on Autonomous Agents and Multiagent Systems, Melbourne, Australia

[56]

Expressive behaviors for virtual worlds. In: Prendinger, H., Ishizuka, M. (Eds.), Life-like characters tools, affective functions and applications, Springer, Berlin.

[57]

Marsella, S., Johnson, W. L., & LaBore, C. (2000). Interactive pedagogical drama. Paper presented at the fourth international conference on autonomous agents, Montreal, Canada

[58]

Marsella, S., Johnson, W. L., & LaBore, C. (2003). Interactive pedagogical drama for health interventions. Paper presented at the artificial intelligence in education, Sydney, Australia

[59]

Self-deception unmasked. Princeton University Press, Princeton, NJ.

[60]

The society of mind. Simon and Schuster, New York.

[61]

Moffat, D., & Frijda, N. (1995). Where there's a Will there's an agent. Paper presented at the workshop on agent theories, architectures and languages

[62]

Neal Reilly, W. S. (1996). Believable social and emotional agents (Ph.D Thesis No. CMU-CS-96-138). Pittsburgh, PA: Carnegie Mellon University

[63]

Evaluation of environmental problems: A coherence model of cognition and emotion. Cognition and Emotion. v15. 521-551.

[64]

Unified theories of cognition. Harvard University Press, Cambridge, MA.

[65]

Cognitive theory of emotions. Cognition and Emotion. v1 i1.

[66]

The cognitive structure of emotions. Cambridge University Press, Cambridge, MA.

[67]

The stress appraisal measure (SAM): A multidimensional approach to cognitive appraisal. Stress Medicine. v6. 227-236.

[68]

Reasoning with cause and effect. AI Magazine. v23 i1. 95-112.

[69]

Associations among the Big Five emotional responses and coping with acute stress. Personality and Individual Differences. v32. 1215-1228.

[70]

Stress coping and health. Hogrefe and Huber Publishers, Seattle WA.

[71]

Emotional meaning and expression in performative faces. In: Paiva, A. (Ed.), Affective Interactions: Towards a New Generation of Computer Interfaces, Springer-Verlag, Berlin. pp. 182-195.

[72]

Plans as complex mental attitudes. In: Cohen, P., Morgan, J., Pollack, M. (Eds.), Intentions in communication, MIT Press, Cambridge, MA.

[73]

A logic for default reasoning. In: Ginsberg, M. (Ed.), Readings in nonmonotonic reasoning, Morgan Kaufmann, Los Altos, CA.

[74]

Animated agents for procedural training in virtual reality: Perception cognition and motor control. Applied Artificial Intelligence. v13. 343-382.

[75]

Toward a new generation of virtual humans for interactive experiences. IEEE Intelligent Systems. iJuly/August. 32-38.

[76]

Phenomenology, behaviors, and goals differentiate discrete emotions. Journal of Personality and Social Psychology. v67 i2. 206-221.

[77]

Virtual environment exposure therapy for PTSD Vietnam veterans: A case study. Journal of Traumatic Stress. 263-272.

[78]

Russell, S., & Wefald, E. (1989). On optimal game-tree search using rational meta-reasoning. Paper presented at the eleventh international joint conference on artificial intelligence, Detroit, MI

[79]

Virtual peers as partners in storytelling and literacy learning. Journal of Computer Assisted Learning. v19 i2. 195-208.

[80]

On the nature and function of emotion: A component process approach. In: Scherer, K.R., Ekman, P. (Eds.), Approaches to emotion, pp. 293-317.

[81]

. In: Scherer, K.R., Schorr, A., Johnstone, T. (Eds.), Appraisal processes in emotion, Oxford University Press, Oxford.

[82]

Searle, J. (2002, May 7). Quoted in a human touch for machines. Los Angeles Times, p. 1

[83]

The attribution of blame: Causality, responsibility, and blameworthiness. 1985. Springer, New York.

[84]

Shaw, E., Johnson, W. L., & Ganeshan, R. (1999). Pedagogical agents on the web. Paper presented at the proceedings of the third international conference on autonomous agents, Seattle, WA

[85]

Human behavior models for game-theoretic agents: Case of crowd tipping. Cogn. Sci. Q., Fall.

[86]

Motivational and emotional controls of cognition. Psychological Review. v74. 29-39.

[87]

Sloman, A., & Croucher, M. (1981). Why robots will have emotions. Paper presented at the international joint conference on artificial intelligence, Vancouver, Canada

[88]

Consequences require antecedents: Toward a process model of emotion elicitation. In: Forgas, J.P. (Ed.), Feeling and thinking: The role of affect in social cognition, Cambridge University Press, Cambridge, MA. pp. 83-106.

[89]

Towards delivering on the promise of appraisal theory. In: Scherer, K., Schorr, A., Johnstone, T. (Eds.), Appraisal processes in emotion, Oxford University Press, Oxford. pp. 121-138.

[90]

Emotion and adaptation. In: Pervin, (Ed.), Handbook of personality: Theory & research, Guilford Press, New York. pp. 609-637.

[91]

A componential approach to the meaning of facial expressions. In: Russell, J.A., Fernández-Dols, J.M. (Eds.), The psychology of facial expression, Cambridge University Press, Paris. pp. 229-254.

[92]

Coherence in thought and action. MIT Press, Cambridge, MA.

[93]

The illusion of life: Disney animation. Hyperion, New York.

[94]

Traum, D., & Rickel, J. (2002). Embodied agents for multi-party dialogue in immersive virtual worlds. Paper presented at the first international conference on autonomous agents and multi-agent systems, Bologna, Italy

[95]

Traum, D., Rickel, J., Gratch, J., & Marsella, S. (2003a). Negotiation over tasks in hybrid human-agent teams for simulation-based training. Paper presented at the second international conference on autonomous agents and multi-agent systems, Melbourne, Australia

[96]

Traum, D., Rickel, J., Gratch, J., & Marsella, S. (2003b). Negotiation over tasks in hybrid human-agent teams for simulation-based training. Paper presented at the international conference on autonomous agents and multiagent systems, Melbourne, Australia

[97]

The framing of decisions and the psychology of choice. Science. v211. 453-458.

[98]

An attributional theory of motivation and emotion. Springer, New York.

[99]

Feeling and thinking: Preferences need no inferences. American Psychologist. v35. 151-175.

Cited By

Stark L(2024)Animation and Artificial IntelligenceProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3658995(1663-1671)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3630106.3658995
Khan SDeng Z(2024)Agent-based crowd simulation: an in-depth survey of determining factors for heterogeneous behaviorThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-024-03503-240:7(4993-5004)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1007/s00371-024-03503-2
Yan TLin SWang JDeng FJiang ZChen GSu JZhang J(2023)AppraisalCloudPCTComputational Intelligence and Neuroscience10.1155/2023/59607642023Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1155/2023/5960764
Show More Cited By

A domain-independent framework for modeling emotion
1. Computing methodologies
  1. Artificial intelligence
    1. Knowledge representation and reasoning
    2. Philosophical/theoretical foundations of artificial intelligence
2. Human-centered computing

Recommendations

Modeling the Experience of Emotion

Affective computing has proven to be a viable field of research comprised of a large number of multidisciplinary researchers, resulting in work that is widely published. The majority of this work consists of emotion recognition technology, computational ...
A Framework for Automatic Human Emotion Classification Using Emotion Profiles

Automatic recognition of emotion is becoming an increasingly important component in the design process for affect-sensitive human-machine interaction (HMI) systems. Well-designed emotion recognition systems have the potential to augment HMI systems by ...
Vector based 3D Emotion Expression for Emotion Robot
ICMRE'19: Proceedings of the 5th International Conference on Mechatronics and Robotics Engineering

This paper suggests the novel 3D emotion express method based on the vector for the emotional robot. The emotion function such as face emotion, voice emotion, and gesture emotion can be expressed in several ways. To express fully emotion like the human ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Cognitive Systems Research

Cognitive Systems Research Volume 5, Issue 4

December, 2004

81 pages

ISSN:1389-0417

Issue’s Table of Contents

Copyright © Elsevier B.V. © 2004.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 December 2004

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

177
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Stark L(2024)Animation and Artificial IntelligenceProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3658995(1663-1671)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3630106.3658995
Khan SDeng Z(2024)Agent-based crowd simulation: an in-depth survey of determining factors for heterogeneous behaviorThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-024-03503-240:7(4993-5004)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1007/s00371-024-03503-2
Yan TLin SWang JDeng FJiang ZChen GSu JZhang J(2023)AppraisalCloudPCTComputational Intelligence and Neuroscience10.1155/2023/59607642023Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1155/2023/5960764
Antunes ACampos JGuimarães MDias JSantos PLugrin BLatoschik Mvon Mammen SKopp SPécune FPelachaud C(2023)Prompting for Socially Intelligent Agents with ChatGPTProceedings of the 23rd ACM International Conference on Intelligent Virtual Agents10.1145/3570945.3607303(1-9)Online publication date: 19-Sep-2023
https://dl.acm.org/doi/10.1145/3570945.3607303
Ghafurian MBudnarain NHoey J(2023)Improving Humanness of Virtual Agents and Users’ Cooperation Through EmotionsIEEE Transactions on Affective Computing10.1109/TAFFC.2021.309683114:2(1461-1471)Online publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1109/TAFFC.2021.3096831
Nallur V(2023)Anxiety Among Migrants - Questions for Agent SimulationAutonomous Agents and Multiagent Systems. Best and Visionary Papers10.1007/978-3-031-56255-6_8(141-150)Online publication date: 29-May-2023
https://dl.acm.org/doi/10.1007/978-3-031-56255-6_8
Traum D(2022)Socially Interactive Agent DialogueThe Handbook on Socially Interactive Agents10.1145/3563659.3563663(45-76)Online publication date: 27-Oct-2022
https://dl.acm.org/doi/10.1145/3563659.3563663
Mascarenhas SGuimarães MPrada RSantos PDias JPaiva A(2022)FAtiMA Toolkit: Toward an Accessible Tool for the Development of Socio-emotional AgentsACM Transactions on Interactive Intelligent Systems10.1145/351082212:1(1-30)Online publication date: 24-Mar-2022
https://dl.acm.org/doi/10.1145/3510822
Yongsatianchot NMarsella S(2022)A Computational Model of Coping and Decision Making in High-Stress, Uncertain Situations: An Application to Hurricane Evacuation DecisionsIEEE Transactions on Affective Computing10.1109/TAFFC.2022.317381214:3(2539-2556)Online publication date: 10-May-2022
https://dl.acm.org/doi/10.1109/TAFFC.2022.3173812
Samsonovich ALiu ZLiu T(2022)On the Possibility of Regulation of Human Emotions via Multimodal Social Interaction with an Embodied Agent Controlled by eBICA-Based Emotional Interaction ModelArtificial General Intelligence10.1007/978-3-031-19907-3_36(374-383)Online publication date: 19-Aug-2022
https://dl.acm.org/doi/10.1007/978-3-031-19907-3_36
Show More Cited By

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents