Abstract
Our objective is to develop a computational model to predict visual attention behavior for an embodied conversational agent. During interpersonal interaction, gaze provides signal feedback and directs conversation flow. Simultaneously, in a dynamic environment, gaze also directs attention to peripheral movements. An embodied conversational agent should therefore employ social gaze not only for interpersonal interaction but also to possess human attention attributes so that its eyes and facial expression portray and convey appropriate distraction and engagement behaviors.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Argyle, M., Cook, M.: Gaze and Mutual Gaze. Cambridge University Press, London (1976)
Badler, N., Chi, D., Chopra, S.: Virtual human animation based on movement observation and cognitive behavior models. In: Proc. Computer Animation, Geneva, Switzerland, pp. 128–137. IEEE Computer Society Press, Los Alamitos (1999)
Cassell, J., Thorisson, K.: The power of a nod and a glance: Envelope vs. emo-tional feedback in animated conversational agents. Applied Artificial Intelligence Journal 13(4-5), 519–538 (2000)
Cassell, J., Vilhjalmsson, H.: Fully embodied conversational avatars: Making communicative behaviors autonomous. Autonomous Agents and Multi-Agent Systems 2(1), 45–64 (1999)
Chopra-Khullar, S., Badler, N.: Where to look? Automating attending behaviors of virtual human characters. Autonomous Agents and Multi-agent Systems 4, 9–23 (2001)
Chopra-Khullar, S.: Where to look? Automating certain visual attending behaviors of human characters. Ph.D Dissertation, University of Pennsylvania (1999)
Colburn, A., Cohen, M., Drucker, S.: The role of eye gaze in avatar mediated conversational interfaces. MSR-TR-2000-81. Microsoft Research (2000)
Garau, M., Slater, M., Bee, S., Sasse, M.: The impact of eye gaze on communication using humaniod avatars. In: Proc. ACM SIGCHI, pp. 309–316 (2001)
Green, G.: Inattentional blindness and conspicuity (Retrieved November 10, 2004) (2004), http://www.visualexpert.com/Resources/inattentionalblindness.html
Gu, E.: Multiple Influences on Gaze and Attention Behavior for Embodied Agent, Doctoral Dissertation Proposal, Computer and Information Science Department, Univeristy of Pennysylavania (November 2005)
Gu, E., Stocker, C., Badler, N.: Do You See What Eyes See? Implementing Inattentional Blindness. In: Panayiotopoulos, T., Gratch, J., Aylett, R.S., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS (LNAI), vol. 3661, pp. 178–190. Springer, Heidelberg (2005)
Gu, E., Wang, J., Badler, N.: Generating sequence of eye fixations using decision-theoretic bottom-up attention model. In: 3rd International Workshop on Attention and Performance in Computational Vision, IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshop, San Diego, p. 92 (2005)
Itti, L.: Visual attention. In: Arbib, M.A. (ed.) The Handbook of Brain Theory and Neural Networks, pp. 1196–1201. MIT Press, Cambridge (2003)
Knapp, L., Hall, A.: The effects of eye behavior on human communication. In: Nonverbal communication in human interaction, 4th edn., ch. 10, pp. 369–380. Harcourt College Pub. (1996)
Kendon, A.: Some functions of gaze direction in social interaction. Acta Psychologica 32, 1–25 (1967)
Lee, S., Badler, J., Badler, N.: Eyes alive. ACM Transactions on Graphics 21(3), 637–644 (2002)
Mack, A., Rock, I.: Inattentional Blindness. MIT Press, Cambridge (1998)
Matsusaka, Y., Fujie, S., Kobayashi, T.: Modeling of conversational strategy for the robot participating in the group conversation. In: Proc. 7th European Conference on Speech Communication and Technology (Eurospeech 2001), Aalborg, Denmark, pp. 2173–2176 (2001)
Miller, E.: Turn-taking and relevance in conversation. For the course, Ways of Speaking, at the University of Pennsylvania (May 1999)
Most, S., Scholl, B., Clifford, E., Simons, D.: What you see is what you set: Sustained inattentional blindness and the capture of awareness. Psychological Review 112, 217–242 (2005)
Nakano, Y., Nishida, T.: Awareness of perceived world and conversational en-gagement by conversational agents. In: AISB Symposium: Conversational Informatics for Supporting Social Intelligence & Interaction, England (2005)
Novick, D., Hansen, B., Ward, K.: Coordinating turn-taking with gaze. In: Proc. of ICSLP 1996, Philadelphia, PA, pp. 1888–1891 (1996)
Peters, C.: Direction of attention perception for conversation initiation in virtual environments. In: Panayiotopoulos, T., Gratch, J., Aylett, R.S., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS (LNAI), vol. 3661, pp. 215–228. Springer, Heidelberg (2005)
Pelachaud, C., Peters, C., Mancini, M., Bevacqua, E., Poggi, I.: A model of attention and interest using gaze behavior. In: Panayiotopoulos, T., Gratch, J., Aylett, R.S., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS (LNAI), vol. 3661, pp. 229–240. Springer, Heidelberg (2005)
Slater, M., Pertaub, D., Steed, A.: Public Speaking in Virtual Reality: Facing and Audience of Avatars. IEEE Computer Graphics and Applications 19(2), 6–9 (1999)
Simons, D., Chabris, C.: Gorillas in our midst: Sustained inattentional blindness for dynamic events. Perception 28, 1059–1074 (1999)
Sidner, C., Lee, C., Lesh, N.: Engagement rules for human-robot collaborative interactions. In: Proc. IEEE International Conference on Systems, Man & Cybernetics (CSMC), vol. 4, pp. 3957–3962 (2003)
Vertegaal, R., Der Veer, G., Vons, H.: Effects of gaze on multiparty mediated communication. In: Proc. Graphics Interface, pp. 95–102. Morgan-Kaufmann Publishers, Montreal. Canadian Human-Computer Communications Society,Canada (2000)
Vertegaal, R., Slagter, R., Der Veer, G., Nijholt, A.: Eye gaze patterns in conversations: There is more to conversational ageents than meets the eyes. In: ACM CHI Conference on Human Factors in Computing Systems, pp. 301–308 (2001)
Wolfe, J.: Inattentional amnesia, in Fleeting Memories. In: Cognition of Brief Visual Stimuli, pp. 71–94. MIT Press, Cambridge (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gu, E., Badler, N.I. (2006). Visual Attention and Eye Gaze During Multiparty Conversations with Distractions. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds) Intelligent Virtual Agents. IVA 2006. Lecture Notes in Computer Science(), vol 4133. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11821830_16
Download citation
DOI: https://doi.org/10.1007/11821830_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-37593-7
Online ISBN: 978-3-540-37594-4
eBook Packages: Computer ScienceComputer Science (R0)