abstract

Vision-based attention estimation and selection for social robot to perform natural interaction in the open world

Authors:

Jun Li,

Haizhou LiAuthors Info & Claims

HRI '12: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction

Pages 183 - 184

https://doi.org/10.1145/2157689.2157746

Published: 05 March 2012 Publication History

Get Access

Abstract

In this paper, a novel vision system is proposed to estimate attention of people from rich visual clues for social robot to perform natural interactions with multiple participants in public environments. The vision detection and recognition modules include multi-person detection and tracking, upper-body pose recognition, face and gaze detection, lip motion analysis for speaking recognition, and facial expression recognition. A computational approach is proposed to generate a quantitative estimation of human attention. The vision system is implemented on a robotic receptionist "EVE" and encouraging results have been obtained.

Supplementary Material

JPG File (lbr139.jpg)

Download
28.73 KB

WMV File (lbr139.wmv)

Download
7.00 MB

References

[1]

X. Feng, M. Pietikäinen, and A. Hadid. Facial expression recognition with local binary patterns and linear programming. In 7th International Conference on Pattern Recognition and Image Analysis: New Information Technologies (PRIA-7), 2004.

Google Scholar

[2]

L. Li, K. E. Hoe, S. Yan, and X. Yu. Ml-fusion based multi-model human detection and tracking for robust human-robot interfaces. In IEEE Workshop on Applications of Computer Vision (WACV), 2009.

Crossref

Google Scholar

[3]

L. Li, K. E. Hoe, X. Yu, L. Dong, and X. Chu. Human upper body pose recognition using adaboost template for natural human robot interaction. In Seventh Canadian Conference on Computer and Robot Vision (CRV), 2010.

Digital Library

Google Scholar

[4]

X. Yu, W. Han, L. Li, J. Y. Shi, and G. Wang. An eye detection and localization system for natural human and robot interaction without face detection. In 12th Conference Towards Autonomous Robotic Systems (TAROS), 2011.

Digital Library

Google Scholar

Cited By

View all

Guo XWu YMiao JChen Y(2023)LiteGaze: Neural architecture search for efficient gaze estimationPLOS ONE10.1371/journal.pone.028481418:5(e0284814)Online publication date: 1-May-2023
https://doi.org/10.1371/journal.pone.0284814
Abdelrahman AHempel TKhalifa AAl-Hamadi ADinges L(2023)L2CS-Net : Fine-Grained Gaze Estimation in Unconstrained Environments2023 8th International Conference on Frontiers of Signal Processing (ICFSP)10.1109/ICFSP59764.2023.10372944(98-102)Online publication date: 23-Oct-2023
https://doi.org/10.1109/ICFSP59764.2023.10372944
Mahzoon HOkazaki MYoshikawa YIshiguro H(2021)Effect of the projection of robot’s talk information on the perception of communicating humanAdvanced Robotics10.1080/01691864.2021.1964597(1-14)Online publication date: 23-Aug-2021
https://doi.org/10.1080/01691864.2021.1964597
Show More Cited By

Index Terms

Vision-based attention estimation and selection for social robot to perform natural interaction in the open world
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Tracking
      2. Computer vision tasks
        Scene understanding

Recommendations

Attention-based addressee selection for service and social robots to interact with multiple persons
WASA '12: Proceedings of the Workshop at SIGGRAPH Asia

For robots to perform interaction with multiple persons, they have to be able to identify the addressees to interact with. We classify the methods of addressee detection and selection into two categories, namely, passive and active approaches. For ...
Designing social greetings in human robot interaction
DIS '14: Proceedings of the 2014 conference on Designing interactive systems

We designed and operationalized a greetings model for human robot interaction as a state machine, derived from a subset of social behaviors as detailed by Kendon's observations of greetings and augmented by Hall's proxemics theory. Our premise is that ...
Multi-party interaction with a virtual character and a human-like robot
VRST '13: Proceedings of the 19th ACM Symposium on Virtual Reality Software and Technology

Research on interactive virtual characters and social robots focuses mainly on one-to-one interactions and multi-party interactions concept are rather less explored. As we are developing these characters to be helpful to us in our daily lives as guides, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

HRI '12: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction

March 2012

518 pages

ISBN:9781450310635

DOI:10.1145/2157689

General Chairs:
Holly Yanco
University of Massachusetts Lowell, USA
,
Aaron Steinfeld
Carnegie Mellon University, USA
,
Program Chairs:
Vanessa Evers
University of Amsterdam, The Netherlands
,
Odest Chadwicke Jenkins
Brown University, USA

In-Cooperation

IEEE-RAS: Robotics and Automation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 March 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Abstract

Conference

HRI'12

Sponsor:

HRI'12: International Conference on Human-Robot Interaction

March 5 - 8, 2012

Massachusetts, Boston, USA

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
229
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Guo XWu YMiao JChen Y(2023)LiteGaze: Neural architecture search for efficient gaze estimationPLOS ONE10.1371/journal.pone.028481418:5(e0284814)Online publication date: 1-May-2023
https://doi.org/10.1371/journal.pone.0284814
Abdelrahman AHempel TKhalifa AAl-Hamadi ADinges L(2023)L2CS-Net : Fine-Grained Gaze Estimation in Unconstrained Environments2023 8th International Conference on Frontiers of Signal Processing (ICFSP)10.1109/ICFSP59764.2023.10372944(98-102)Online publication date: 23-Oct-2023
https://doi.org/10.1109/ICFSP59764.2023.10372944
Mahzoon HOkazaki MYoshikawa YIshiguro H(2021)Effect of the projection of robot’s talk information on the perception of communicating humanAdvanced Robotics10.1080/01691864.2021.1964597(1-14)Online publication date: 23-Aug-2021
https://doi.org/10.1080/01691864.2021.1964597
Sun MZhao ZMa XMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)Sensing and Handling Engagement Dynamics in Human-Robot Interaction Involving Peripheral Computing DevicesProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025469(556-567)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025469
Xu QLi LWang GMackay WBrewster SBødker S(2013)Designing engagement-aware agents for multiparty conversationsProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2470654.2481308(2233-2242)Online publication date: 27-Apr-2013
https://dl.acm.org/doi/10.1145/2470654.2481308
Li YTee KGe SLi H(2013)Building Companionship through Human-Robot CollaborationProceedings of the 5th International Conference on Social Robotics - Volume 823910.1007/978-3-319-02675-6_1(1-7)Online publication date: 27-Oct-2013
https://dl.acm.org/doi/10.1007/978-3-319-02675-6_1
Chua YTee KYan RLi LHuang ZManocha DWinslett M(2012)Towards more engaging telepresence by face trackingProceedings of the Workshop at SIGGRAPH Asia10.1145/2425296.2425320(137-141)Online publication date: 26-Nov-2012
https://dl.acm.org/doi/10.1145/2425296.2425320
Li LXu QTan YManocha DWinslett M(2012)Attention-based addressee selection for service and social robots to interact with multiple personsProceedings of the Workshop at SIGGRAPH Asia10.1145/2425296.2425319(131-136)Online publication date: 26-Nov-2012
https://dl.acm.org/doi/10.1145/2425296.2425319

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Attention-based addressee selection for service and social robots to interact with multiple persons

Designing social greetings in human robot interaction

Multi-party interaction with a virtual character and a human-like robot