poster

A survey of social gaze

Authors:

Vasant Srinivasan,

Robin MurphyAuthors Info & Claims

HRI '11: Proceedings of the 6th international conference on Human-robot interaction

Pages 253 - 254

https://doi.org/10.1145/1957656.1957757

Published: 06 March 2011 Publication History

Abstract

Based on a synthesis of eight major studies using six robots involving social gaze in robotics, this research proposes a novel behavioral definition as a mapping G = E(C) from the perception of a social context C to a set of head, eye, and body patterns called gaze acts G that expresses the engagement E. This definition places social gaze within the behavior-based programming framework for robots and agents, providing a guide for principled future implementations. The research also identifies five social contexts, or functions, of social gaze (Establishing agency, Communicating social attention, Regulating the interaction process, Manifesting interaction content and Projecting mental state) along with six discrete gaze acts for social gaze functions (Fixation, Short glance, Aversion, Concurrence, Confusion, and Scan) that have been employed by various robots or in simulation for these contexts. The research contributes to a computational understanding of social gaze that bridges psychological, cognitive, and robotics communities.

References

[1]

R. C. Arkin. Behavior-Based Robotics. The MIT Press, May 1998.

Digital Library

[2]

C. Breazeal, C. D. Kidd, A. L. Thomaz, G. Hoffman, and M. Berlin. Effects of nonverbal communication on efficiency and robustness in human-robot teamwork. In in Proceedings of IROS, 2003.

[3]

J. Cassell, O. Torres, and S. Prevost. Turn taking vs. discourse structure: How best to model multimodal conversation. In In Machine Conversations. Kluwer, 1998.

[4]

N. J. Emery. The eyes have it: the neuroethology, function and evolution of social gaze. Neuroscience and Biobehavioral Reviews, 24(6):581--604, 2000.

[5]

B. N. Gu, E. Visual attention and eye gaze during multipartite conversations with distractions. In Intelligent Virtual Agents (IVA'06), Marina del Rey, CA, pages 411--416, 2006.

Digital Library

[6]

M. Imai, T. Kanda, T. Ono, H. Ishiguro, and K. Mase. Robot mediated round table: Analysis of the effect of robot's gaze. In Robot and Human Interactive Communication, 2002. Proceedings. 11th IEEE International Workshop on, pages 411--416, 2002.

[7]

M. Imai, T. Ono, and H. Ishiguro. Physical relation and expression: joint attention for human-robot interaction. In Robot and Human Interactive Communication, 2001. Proceedings. 10th IEEE International Workshop on, pages 512--517, 2001.

[8]

X. Mao, Z. Li, and Y. Xue. Emotional gaze behavior generation in human-agent interaction. In CHI '09: Proceedings of the 27th international conference extended abstracts on Human factors in computing systems, pages 3691--3696, New York, NY, USA, 2009. ACM.

Digital Library

[9]

B. Mutlu, J. Forlizzi, and J. Hodgins. A storytelling robot: Modeling and evaluation of human-like gaze behavior. In in Proc. International Conference on Humanoid Robots. IEEE, 2006.

[10]

B. Mutlu, T. Shiwa, T. K, H. Ishiguro, and N. Hagita. Footing in human-robot conversations: How robots might shape participant roles using gaze cues.

[11]

B. Mutlu, F. Yamaoka, T. Kanda, H. Ishiguro, and N. Hagita. Nonverbal leakage in robots: communication of intentions through seemingly unintentional behavior. In HRI '09: Proceedings of the 4th ACM/IEEE international conference on Human robot interaction, pages 69--76, New York, NY, USA, 2009. ACM.

Digital Library

[12]

C. L. Sidner, C. Lee, C. D. Kidd, N. Lesh, and C. Rich. Explorations in engagement for humans and robots. Artificial Intelligence, (166):10--1016, 2005.

Digital Library

[13]

M. Staudte and M. Crocker. The effect of robot gaze on processing robot utterances. In Proceedings of the 31th Annual Conference of the Cognitive Science Society. Amsterdam, Netherlands., 2009.

[14]

M. Staudte and M. W. Crocker. Visual attention in spoken human-robot interaction. In HRI '09: Proceedings of the 4th ACM/IEEE international conference on Human robot interaction, pages 77--84, New York, NY, USA, 2009. ACM.

Digital Library

[15]

J. Zwickel and H. Muller. Eye movements as a means to evaluate and improve robots. International Journal of Social Robotics, 1:357--366, 2009.

Cited By

Ren YClement J(2024)Augmenting Human Teams with Robots in Knowledge Work Settings: Insights from the LiteratureACM Transactions on Human-Robot Interaction10.1145/364988413:2(1-34)Online publication date: 14-Jun-2024
https://dl.acm.org/doi/10.1145/3649884
Aylett MClark LCowan BTorre I(2021)Building and Designing Expressive Speech SynthesisThe Handbook on Socially Interactive Agents10.1145/3477322.3477329(173-212)Online publication date: 10-Sep-2021
https://dl.acm.org/doi/10.1145/3477322.3477329
Lee WPark CJang SCho H(2020)Design of Effective Robotic Gaze-Based Social Cueing for Users in Task-Oriented Situations: How to Overcome In-Attentional Blindness?Applied Sciences10.3390/app1016541310:16(5413)Online publication date: 5-Aug-2020
https://doi.org/10.3390/app10165413
Show More Cited By

Index Terms

A survey of social gaze
1. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Robotics
2. Computing methodologies
  1. Artificial intelligence
    1. Control methods
      1. Robotic planning
    2. Planning and scheduling
      1. Robotic planning

Recommendations

Social eye gaze in human-robot interaction: a review

This article reviews the state of the art in social eye gaze for human-robot interaction (HRI). It establishes three categories of gaze research in HRI, defined by differences in goals and methods: a human-centered approach, which focuses on people's ...
A Gaze Controller for Coordinating Mutual Gaze During Conversational Turn-Taking in Human-Robot Interaction
HRI'15 Extended Abstracts: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts

This report proposes a method for modelling conversational mutual gaze from human interaction data in a way that allows the resulting gaze controller to be used in combination with any dialog manager that controls turn-taking. It also describes a set of ...
Explaining effects of eye gaze on mediated group conversations:: amount or synchronization?
CSCW '02: Proceedings of the 2002 ACM conference on Computer supported cooperative work

We present an experiment examining effects of gaze on speech during three-person conversations. Understanding such effects is crucial for the design of teleconferencing systems and Collaborative Virtual Environments (CVEs). Previous findings suggest ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '11: Proceedings of the 6th international conference on Human-robot interaction

March 2011

526 pages

ISBN:9781450305617

DOI:10.1145/1957656

General Chairs:
Aude Billard
EPFL, Switzerland
,
Peter Kahn
University of Washington, USA
,
Program Chairs:
Julie A. Adams
Vanderbilt University, USA
,
Greg Trafton
US Naval Research Laboratories, USA

Copyright © 2011 Authors.

Sponsors

In-Cooperation

RA: IEEE Robotics and Automation Society
Human Factors & Ergonomics Soc: Human Factors & Ergonomics Soc
The Association for the Advancement of Artificial Intelligence (AAAI)
IEEE Systems, Man and Cybernetics Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 March 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

HRI'11

Sponsor:

HRI'11: International Conference on Human-Robot Interaction

March 6 - 9, 2011

Lausanne, Switzerland

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
354
Total Downloads

Downloads (Last 12 months)38
Downloads (Last 6 weeks)1

Reflects downloads up to 24 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ren YClement J(2024)Augmenting Human Teams with Robots in Knowledge Work Settings: Insights from the LiteratureACM Transactions on Human-Robot Interaction10.1145/364988413:2(1-34)Online publication date: 14-Jun-2024
https://dl.acm.org/doi/10.1145/3649884
Aylett MClark LCowan BTorre I(2021)Building and Designing Expressive Speech SynthesisThe Handbook on Socially Interactive Agents10.1145/3477322.3477329(173-212)Online publication date: 10-Sep-2021
https://dl.acm.org/doi/10.1145/3477322.3477329
Lee WPark CJang SCho H(2020)Design of Effective Robotic Gaze-Based Social Cueing for Users in Task-Oriented Situations: How to Overcome In-Attentional Blindness?Applied Sciences10.3390/app1016541310:16(5413)Online publication date: 5-Aug-2020
https://doi.org/10.3390/app10165413
Fan LWang WZhu STang XHuang S(2019)Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoning2019 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV.2019.00582(5723-5732)Online publication date: Oct-2019
https://doi.org/10.1109/ICCV.2019.00582
Short EDeng EFeil-Seifer DMatarić M(2017)Understanding agency in interactions between children with autism and socially assistive robotsJournal of Human-Robot Interaction10.5898/JHRI.6.3.Short6:3(21-47)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.5898/JHRI.6.3.Short
Admoni HScassellati B(2017)Social eye gaze in human-robot interactionJournal of Human-Robot Interaction10.5898/JHRI.6.1.Admoni6:1(25-63)Online publication date: 26-May-2017
https://dl.acm.org/doi/10.5898/JHRI.6.1.Admoni
Broadbent E(2017)Interactions With Robots: The Truths We Reveal About OurselvesAnnual Review of Psychology10.1146/annurev-psych-010416-04395868:1(627-652)Online publication date: 3-Jan-2017
https://doi.org/10.1146/annurev-psych-010416-043958
Fischer KJensen LSuvei SBodenhagen L(2016)Between legibility and contact: The role of gaze in robot approach2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)10.1109/ROMAN.2016.7745186(646-651)Online publication date: Aug-2016
https://doi.org/10.1109/ROMAN.2016.7745186
Cruz BAhn BHyung HLee D(2016)Developing an Interactive Gaze Algorithm for Android RobotsSocial Robotics10.1007/978-3-319-47437-3_43(441-448)Online publication date: 7-Oct-2016
https://doi.org/10.1007/978-3-319-47437-3_43
Ruhland KPeters CAndrist SBadler JBadler NGleicher MMutlu BMcDonnell R(2015)A Review of Eye Gaze in Virtual Agents, Social Robotics and HCIComputer Graphics Forum10.1111/cgf.1260334:6(299-326)Online publication date: 1-Sep-2015
https://dl.acm.org/doi/10.1111/cgf.12603
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents