abstract

Towards Real-time Probabilistic Evaluation of Situation Awareness from Human Gaze in Human-Robot Interaction

Authors:

Rosemarie VelikAuthors Info & Claims

HRI '17: Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction

Pages 247 - 248

https://doi.org/10.1145/3029798.3038322

Published: 06 March 2017 Publication History

Get Access

Abstract

Human attention processes play a major role for optimization in human-robot interaction (HRI). This work describes a novel methodology to measure situation awareness in real-time from gaze interaction with scene objects of interest using eye tracking glasses and 3D gaze analysis. A probabilistic framework of uncertainty considers coping with measurement errors in eye and position tracking. Comprehensive experiments on HRI were conducted with tasks including handover in a lab based prototypical manufacturing environment. The methodology is proven to predict a standard measure of situation awareness (SAGAT) in real-time and will open new opportunities for human factors based performance optimization in HRI applications.

References

[1]

L. Tiberio, A. Cesta, and M. O. Belardinelli, "Psychophysiological methods to evaluate user's response in human robot interaction: a review and feasibility study", Robotics, 2(2):92--121, 2013.

Crossref

Google Scholar

[2]

A. Steinfeld, T. Fong, D. Kaber, M. Lewis, J. Scholtz, A. Schultz, and M. Goodrich, "Common metrics for human-robot interaction", Proc. ACM SIGCHI/SIGART Human-robot interaction, 2006.

Digital Library

Google Scholar

[3]

C.-M. Huang, and B. Mutlu. "Anticipatory robot control for efficient human-robot collaboration", Proc. ACM/IEEE HRI 2016, 2016.

Digital Library

Google Scholar

[4]

M. R. Endsley, "Toward a theory of situation awareness in dynamic systems," Human Factors, vol. 37, no. 1, pp. 32--64, 1995.

Crossref

Google Scholar

[5]

K. Santner, G. Fritz, L. Paletta, and H. Mayer, "Visual recovery of saliency maps from human attention in 3D environments", Proc. Intl. Conf. on Robotics & Automation (ICRA), pp. 4297--4303, 2013.

Crossref

Google Scholar

[6]

M. R. Endsley, "Direct measurement of situation awareness: Validity and use of SAGAT," in Situation Awareness Analysis and Measurement, M. R. Endsley, and D. J. Garland, Eds., 2000.

Google Scholar

[7]

R. M. Taylor, "Situational awareness rating technique (SART): The development of a tool for aircrew systems design", in Situational Awareness in Aerospace Operations, 1990, pp. 3/1--3/17.

Google Scholar

[8]

K. Moore, and L. Gugerty, "Development of a novel measure of situation awareness: The case for eye movement analysis," Human Factors & Ergon. Soc. Ann. Meeting, vol. 54:19, 2010.

Google Scholar

[9]

W.J. Horrey, C.D. Wickens, and K.P. Consalus, "Modeling drivers' visual attention allocation while interacting with in-vehicle technologies", J. Experimental Psychology: Applied, 2006.

Crossref

Google Scholar

Cited By

View all

Dong WFang WQiu HBao H(2024)Impact of Situation Awareness Variations on Multimodal Physiological Responses in High-Speed Train DrivingBrain Sciences10.3390/brainsci1411115614:11(1156)Online publication date: 20-Nov-2024
https://doi.org/10.3390/brainsci14111156
Aderinto FBhagat Smith JGiolando MBaskaran PAdams JGrollman DBroadbent EJu WSoh HWilliams T(2024)Improving Human-Robot Team Transparency with Eye-tracking based Situation Awareness AssessmentCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640647(177-181)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610978.3640647
Camblor BDaney DJoseph LSalotti J(2024)Attention Sharing Handling Through Projection Capability Within Human–Robot CollaborationInternational Journal of Social Robotics10.1007/s12369-024-01101-9Online publication date: 16-Feb-2024
https://doi.org/10.1007/s12369-024-01101-9
Show More Cited By

Index Terms

Towards Real-time Probabilistic Evaluation of Situation Awareness from Human Gaze in Human-Robot Interaction
1. Computing methodologies
  1. Artificial intelligence
    1. Knowledge representation and reasoning
      1. Cognitive robotics
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Estimation of situation awareness score and performance using eye and head gaze for human-robot collaboration
ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

Human attention processes play a major role in the optimization of human-robot collaboration (HRC) [Huang et al. 2015]. We describe a novel methodology to measure and predict situation awareness from eye and head gaze features in real-time. The ...
Self-improving situation awareness for human–robot-collaboration using intelligent Digital Twin
Abstract
The situation awareness, especially for collaborative robots, plays a crucial role when humans and machines work together in a human-centered, dynamic environment. Only when the humans understands how well the robot is aware of its environment can ...
Ontology-based situation awareness

The notions of ''situation'' and ''situation awareness'' have been formulated by many authors in various contexts. In this paper, we present a formalization of situations that is compatible with the interpretation of situation awareness in terms of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

HRI '17: Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction

March 2017

462 pages

ISBN:9781450348850

DOI:10.1145/3029798

General Chairs:
Bilge Mutlu
University of Wisconsin-Madison, USA
,
Manfred Tscheligi
University of Salzburg, Austria
,
Program Chairs:
Astrid Weiss
Vienna University of Technology, Austria
,
James E. Young
University of Manitoba, Canada

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 March 2017

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

Austrian Ministry for Transport Innovation and Technology (BMVIT)

Conference

HRI '17

Sponsor:

SIGAI
SIGCHI
IEEE-RAS

HRI '17: ACM/IEEE International Conference on Human-Robot Interaction

March 6 - 9, 2017

Vienna, Austria

Acceptance Rates

HRI '17 Paper Acceptance Rate 51 of 211 submissions, 24%;

Overall Acceptance Rate 192 of 519 submissions, 37%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
501
Total Downloads

Downloads (Last 12 months)33
Downloads (Last 6 weeks)8

Reflects downloads up to 26 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Dong WFang WQiu HBao H(2024)Impact of Situation Awareness Variations on Multimodal Physiological Responses in High-Speed Train DrivingBrain Sciences10.3390/brainsci1411115614:11(1156)Online publication date: 20-Nov-2024
https://doi.org/10.3390/brainsci14111156
Aderinto FBhagat Smith JGiolando MBaskaran PAdams JGrollman DBroadbent EJu WSoh HWilliams T(2024)Improving Human-Robot Team Transparency with Eye-tracking based Situation Awareness AssessmentCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640647(177-181)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610978.3640647
Camblor BDaney DJoseph LSalotti J(2024)Attention Sharing Handling Through Projection Capability Within Human–Robot CollaborationInternational Journal of Social Robotics10.1007/s12369-024-01101-9Online publication date: 16-Feb-2024
https://doi.org/10.1007/s12369-024-01101-9
Abonyi JNagy LRuppert TAbonyi JNagy LRuppert T(2024)Introduction to the Industrial Application of Semantic TechnologiesOntology-Based Development of Industry 4.0 and 5.0 Solutions for Smart Manufacturing and Production10.1007/978-3-031-47444-6_2(23-65)Online publication date: 1-Jan-2024
https://doi.org/10.1007/978-3-031-47444-6_2
Kintz JBuchner SAnderson AClark T(2023)Predicting Operator Cognitive States for Supervisory Human-Autonomy Teaming2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC53992.2023.10394254(5146-5153)Online publication date: 1-Oct-2023
https://doi.org/10.1109/SMC53992.2023.10394254
Cheng LBelopolsky AHindriks K(2023)Boundary Conditions for Human Gaze Estimation on A Social Robot using State-of-the-Art Models2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309348(1486-1493)Online publication date: 28-Aug-2023
https://doi.org/10.1109/RO-MAN57019.2023.10309348
Kang YZhou XChen WLi X(2023)Investigating the relationship between eye movements and the situation awareness of forklift operators for accident preventionInternational Journal of Occupational Safety and Ergonomics10.1080/10803548.2022.215711329:4(1477-1485)Online publication date: 6-Jan-2023
https://doi.org/10.1080/10803548.2022.2157113
Aschenbrenner DColloseus C(2023)Human in Command in ManufacturingAdvances in Production Management Systems. Production Management Systems for Responsible Manufacturing, Service, and Logistics Futures10.1007/978-3-031-43662-8_40(559-572)Online publication date: 14-Sep-2023
https://doi.org/10.1007/978-3-031-43662-8_40
Lin TKrishnan ALi Z(2022)Intuitive, Efficient and Ergonomic Tele-Nursing Robot Interfaces: Design Evaluation and EvolutionACM Transactions on Human-Robot Interaction10.1145/352610811:3(1-41)Online publication date: 13-Jul-2022
https://dl.acm.org/doi/10.1145/3526108
Jiang GChen HWang CXue P(2022)Transformer Network Intelligent Flight Situation Awareness Assessment Based on Pilot Visual Gaze and Operation Behavior DataInternational Journal of Pattern Recognition and Artificial Intelligence10.1142/S021800142259015736:05Online publication date: 6-May-2022
https://doi.org/10.1142/S0218001422590157
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Estimation of situation awareness score and performance using eye and head gaze for human-robot collaboration

Self-improving situation awareness for human–robot-collaboration using intelligent Digital Twin

Ontology-based situation awareness