Article

Realistic emotional gaze and head behavior generation based on arousal and dominance factors

Authors:

Nadia Magnenat-ThalmannAuthors Info & Claims

MIG'10: Proceedings of the Third international conference on Motion in games

Pages 278 - 289

Published: 14 November 2010 Publication History

Abstract

Current state-of-the-art virtual characters fall far short of characters produced by skilled animators in terms of behavioral adequacy. This is due in large part to the lack of emotional expressivity in physical behaviors. Our approach is to develop emotionally expressive gaze and head movement models that are driven parametrically in real-time by the instantaneous mood of an embodied conversational agent (ECA). A user study was conducted to test the perceived emotional expressivity of the facial animation sequences generated by these models. The results showed that changes in gaze and head behavior combined can be used to express changes in arousal and/or dominance level of the ECA successfully.

References

[1]

Argyle, M.: Bodily Communication. Methuen, London (1998).

[2]

Busso, C., Deng, Z., Neumann, U., Narayanan, S.: Learning Expressive Human-Like Head Motion Sequences from Speech. In: Data-Driven 3D Facial Animations, pp. 113-131. Springer, New York (2007).

[3]

Dovidio, J.F., Ellyson, S.L.: Patterns of visual dominance behavior in humans. In: Power, Dominance, and Nonverbal Behavior, pp. 129-149. Springer, New York (1985).

[4]

Exline, R., Gray, D., Schuette, D.: Visual behavior in a dyad as affected by interview content and sex of respondant. Journal of Personality and Social Psychology 1, 201-209 (1965).

[5]

Field, T.: Infant gaze aversion and heart rate during face-to-face interactions. Infant Behaviour and Development 4, 307-315 (1981).

[6]

Fukayama, A., Ohno, T., Mukawa, N., Sawaki, M., Hagita, N.: Messages embedded in gaze of interface agents - impression management with agent's gaze. In: Proceedings of the ACM CHI 2002 Conference on Human Factors in Computing Systems Conference, pp. 41-48. ACM Press, Minnesota (2002).

Digital Library

[7]

Grimm, K., Kroschel, K.: Evaluation of natural emotions using self assessment manikins. In: Proceedings of the IEEEWorkshop on Automatic Speech Recognition and Understanding, pp. 381-385. IEEE Press, Mexico (2005).

[8]

Harris, C.S., Thackray, R.I., Shoenberger, R.W.: Blink rate as a function of induced muscular tension and manifest anxiety. Perceptual and Motor Skills 22, 155-160 (1966).

[9]

International Standards Office. ISO/IEC IS 14496-2 Information technology - Coding of audio-visual objects - Part 2: Visual. ISO, Geneva (1999).

[10]

Kovar, L., Gleicher, M., Pighin, F.: Motion graphs. In: Proceedings of ACM SIGGRAPH 2002, vol. 21, pp. 473-482 (2002).

Digital Library

[11]

Kasap, Z., Moussa, M.B., Chaudhuri, P., Magnenat-Thalmann, N.: Making Them Remember-Emotional Virtual Characters with Memory. IEEE Computer Graphics and Applications 29, 20-29 (2009).

Digital Library

[12]

Lance, B., Marsella, S.C.: Emotionally Expressive Head and Body Movement During Gaze Shifts. In: Pelachaud, C., Martin, J.C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 72-85. Springer, Heidelberg (2007).

Digital Library

[13]

Lee, S.P., Badler, J.B., Badler, N.I.: Eyes alive. ACM Transactions on Graphics 21, 637-644 (2002).

Digital Library

[14]

Mehrabian, A.: Analysis of the big-five personality factors in terms of the pad temperament model. Australian Journal of Psychology 48, 86-92 (1996).

[15]

Mignault, A., Chaudhuri, A.: The Many Faces of a Neutral Face: Head Tilt and Perception of Dominance and Emotion. Journal of Nonverbal Behavior 27, 111-132 (2003).

[16]

Paterson, H.M., Pollick, F.E., Sanford, A.J.: The Role of Velocity in Affect Discrimination. In: Proceedings of the Twenty-Third Annual Conference of the Cognitive Science Society, pp. 756-761. Lawrence Erlbaum Associates, London (2001).

[17]

Queiroz, R.B., Barros, L.M., Musse, S.R.: Providing expressive gaze to virtual animated characters in interactive applications. Computers in Entertainment (CIE) 6, 1-23 (2008).

Digital Library

Cited By

Thalmann NThalmann D(2015)Multimodal human-machine interaction including virtual humans or social robotsSIGGRAPH Asia 2015 Courses10.1145/2818143.2818176(1-210)Online publication date: 2-Nov-2015
https://dl.acm.org/doi/10.1145/2818143.2818176
Ruhland KPeters CAndrist SBadler JBadler NGleicher MMutlu BMcDonnell R(2015)A Review of Eye Gaze in Virtual Agents, Social Robotics and HCIComputer Graphics Forum10.1111/cgf.1260334:6(299-326)Online publication date: 1-Sep-2015
https://dl.acm.org/doi/10.1111/cgf.12603
Thalmann NThalmann DYumak Z(2014)Multimodal human-machine interaction including virtual humans or social robotsSIGGRAPH Asia 2014 Courses10.1145/2659467.2675052(1-103)Online publication date: 24-Nov-2014
https://dl.acm.org/doi/10.1145/2659467.2675052
Show More Cited By

Recommendations

Psychological responses to simulated displays of mismatched emotional expressions

Embodied agents are often designed with the ability to simulate human emotion. This paper investigates the psychological impact of simulated emotional expressions on computer users with a particular emphasis on how mismatched facial and audio ...
Emotional Chinese talking head system
ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces

Natural Human-Computer Interface requires integration of realistic audio and visual information for perception and display. In this paper, a lifelike talking head system is proposed. The system converts text to speech with synchronized animation of ...
Generation and visualization of emotional states in virtual characters
CASA'2008 Special Issue

This paper presents an affective model that determines the emotional state of a character according to the personality traits and the experienced emotions. We consider an emotional state as the layer between personality and emotion. The proposed ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

MIG'10: Proceedings of the Third international conference on Motion in games

November 2010

435 pages

ISBN:3642169570

Editors:
Ronan Boulic
Ecole Polytechnique Fédérale de Lausanne, VRLab, Lausanne, Switzerland
,
Yiorgos Chrysanthou
University of Cyprus, Dept. of Computer Science, Nicosia, Cyprus
,
Taku Komura
University of Edinburgh, School of Informatics, Edinburgh, UK

Sponsors

GATE: Game Research for Training and Entertainment

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 14 November 2010

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Thalmann NThalmann D(2015)Multimodal human-machine interaction including virtual humans or social robotsSIGGRAPH Asia 2015 Courses10.1145/2818143.2818176(1-210)Online publication date: 2-Nov-2015
https://dl.acm.org/doi/10.1145/2818143.2818176
Ruhland KPeters CAndrist SBadler JBadler NGleicher MMutlu BMcDonnell R(2015)A Review of Eye Gaze in Virtual Agents, Social Robotics and HCIComputer Graphics Forum10.1111/cgf.1260334:6(299-326)Online publication date: 1-Sep-2015
https://dl.acm.org/doi/10.1111/cgf.12603
Thalmann NThalmann DYumak Z(2014)Multimodal human-machine interaction including virtual humans or social robotsSIGGRAPH Asia 2014 Courses10.1145/2659467.2675052(1-103)Online publication date: 24-Nov-2014
https://dl.acm.org/doi/10.1145/2659467.2675052
Normoyle ABadler JFan TBadler NCassol VMusse SMcDonnell RSturtevant NZordan V(2013)Evaluating perceived trust from procedurally animated gazeProceedings of Motion on Games10.1145/2522628.2522630(141-148)Online publication date: 6-Nov-2013
https://dl.acm.org/doi/10.1145/2522628.2522630

View Options

View options

Media

Figures

Other

Tables

View Table of Contents