Cited By
View all- Wang IRuiz J(2021)Examining the Use of Nonverbal Communication in Virtual AgentsInternational Journal of Human–Computer Interaction10.1080/10447318.2021.1898851(1-26)Online publication date: 28-Mar-2021
Controllable models of gaze behavior for virtual agents and humanlike robots
Pages 333 - 336
Abstract
Embodied social agents, through their ability to afford embodied interaction using nonverbal human communicative cues, hold great promise in application areas such as education, training, rehabilitation, and collaborative work. Gaze cues are particularly important for achieving significant social and communicative goals. In this research, I explore how agents - both virtual agents and humanlike robots - might achieve such goals through the use of various gaze mechanisms. To this end, I am developing computational control models of gaze behavior that treat gaze as the output of a system with a number of multimodal inputs. These inputs can be characterized at different levels of interaction, from non-interactive (e.g., physical characteristics of the agent itself) to fully interactive (e.g., speech and gaze behavior of a human interlocutor). This research will result in a number of control models that each focus on a different gaze mechanism, combined into an open-source library of gaze behaviors that will be usable by both human-robot and human-virtual agent interaction designers. System-level evaluations in naturalistic settings will validate this gaze library for its ability to evoke positive social and cognitive responses in human users.
References
[1]
A. Abele. Functions of gaze in social interaction: Communication and monitoring. Journal of Nonverbal Behavior, 10(2):83--101, 1986.
[2]
S. Andrist, B. Mutlu, and M. Gleicher. Conversational gaze aversion for virtual agents. In Proc. of IVA 2013, pages 249--262, 2013.
[3]
S. Andrist, T. Pejsa, B. Mutlu, and M. Gleicher. Designing effective gaze mechanisms for virtual agents. In Proc. of CHI 2012, pages 705--714, 2012.
[4]
S. Andrist, T. Pejsa, B. Mutlu, and M. Gleicher. A head-eye coordination model for animating gaze shifts of virtual characters. In Proc. of ICMI 2012 (Gaze-In'12), pages 4:1--4:6, 2012.
[5]
M. Argyle and M. Cook. Gaze and mutual gaze. Cambridge University Press Cambridge, 1976.
[6]
C. Breazeal. Toward sociable robots. Robotics and Autonomous Systems, 42(3--4):167--175, 2003.
[7]
J. Cassell. Embodied conversational agents: representation and intelligence in user interfaces. AI magazine, 22(4):67--83, 2001.
[8]
J. Cassell, O. Torres, and S. Prevost. Turn taking vs. discourse structure: How best to model multimodal conversation. Machine conversations, pages 143--154, 1999.
[9]
M. Garau, M. Slater, S. Bee, and M. Sasse. The impact of eye gaze on communication using humanoid avatars. In Proc. of CHI 2001, pages 309--316, 2001.
[10]
A. M. Glenberg, J. L. Schroeder, and D. A. Robertson. Averting the gaze disengages the environment and facilitates remembering. Memory & Cognition, 26(4):651--658, 1998.
[11]
D. Heylen, I. Van Es, E. Van Dijk, A. Nijholt, J. van Kuppevelt, L. Dybkjaer, and N. Bernsen. Experimenting with the gaze of a conversational agent. In Proceedings of the International CLASS Workshop on Natural, Intelligent and Effective Interaction in Multimodal Dialogue Systems, pages 93--100, 2005.
[12]
A. Kendon. Some functions of gaze-direction in social interaction. Acta psychologica, 26(1):22--63, 1967.
[13]
S. A. Moubayed, J. Edlund, and J. Beskow. Taming mona lisa: Communicating gaze faithfully in 2d and 3d facial projections. ACM Transactions on Interactive Intelligent Systems, 1(2):11:1--11:25, 2012.
[14]
B. Mutlu, J. Forlizzi, and J. Hodgins. A storytelling robot: Modeling and evaluation of human-like gaze behavior. In Proc. of Humanoids 2006, pages 518--523, 2006.
Index Terms
- Controllable models of gaze behavior for virtual agents and humanlike robots
Recommendations
Conversational gaze aversion for humanlike robots
HRI '14: Proceedings of the 2014 ACM/IEEE international conference on Human-robot interactionGaze aversion-the intentional redirection away from the face of an interlocutor-is an important nonverbal cue that serves a number of conversational functions, including signaling cognitive effort, regulating a conversation's intimacy level, and ...
Designing effective gaze mechanisms for virtual agents
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsVirtual agents hold great promise in human-computer interaction with their ability to afford embodied interaction using nonverbal human communicative cues. Gaze cues are particularly important to achieve significant high-level outcomes such as improved ...
Conversational gaze mechanisms for humanlike robots
During conversations, speakers employ a number of verbal and nonverbal mechanisms to establish who participates in the conversation, when, and in what capacity. Gaze cues and mechanisms are particularly instrumental in establishing the participant roles ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
December 2013
630 pages
ISBN:9781450321297
DOI:10.1145/2522848
- General Chairs:
- Julien Epps,
- Fang Chen,
- Sharon Oviatt,
- Kenji Mase,
- Program Chairs:
- Andrew Sears,
- Kristiina Jokinen,
- Björn Schuller
Copyright © 2013 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 December 2013
Check for updates
Author Tags
Qualifiers
- Poster
Conference
ICMI '13
Sponsor:
ICMI '13: 2013 International Conference on Multimodal Interaction
December 9 - 13, 2013
Sydney, Australia
Acceptance Rates
ICMI '13 Paper Acceptance Rate 49 of 133 submissions, 37%;
Overall Acceptance Rate 453 of 1,080 submissions, 42%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 156Total Downloads
- Downloads (Last 12 months)7
- Downloads (Last 6 weeks)1
Reflects downloads up to 24 Nov 2024
Other Metrics
Citations
Cited By
View all- Wang IRuiz J(2021)Examining the Use of Nonverbal Communication in Virtual AgentsInternational Journal of Human–Computer Interaction10.1080/10447318.2021.1898851(1-26)Online publication date: 28-Mar-2021
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in