research-article

Attentional orienting in virtual reality using endogenous and exogenous cues in auditory and visual modalities

Authors:

Christophe Hurter,

Vsevolod PeysakhovichAuthors Info & Claims

ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

Article No.: 86, Pages 1 - 8

https://doi.org/10.1145/3317959.3321490

Published: 25 June 2019 Publication History

Abstract

The virtual reality (VR) has nowadays numerous applications in training, education, and rehabilitation. To efficiently present the immersive 3D stimuli, we need to understand how spatial attention is oriented in VR. The efficiency of different cues can be compared using the Posner paradigm. In this study, we designed an ecological environment where participants were presented with a modified version of the Posner cueing paradigm. Twenty subjects equipped with an eye-tracking system and VR HMD performed a sandwich preparation task. They were asked to assemble the ingredients which could be either endogenously and exogenously cued in both auditory and visual modalities. The results showed that all valid cues made participants react faster. While directional arrow (visual endogenous) and 3D sound (auditory exogenous) oriented attention globally to the entire cued hemifield, the vocal instruction (auditory endogenous) and object highlighting (visual exogenous) allowed more local orientation, in a specific region of space. No differences in gaze shift initiation nor time to fixate the target were found suggesting the covert orienting.

References

[1]

Edward Awh, Katherine M Armstrong, and Tirin Moore. 2006. Visual and oculomotor selection: links, causes and implications for spatial attention. Trends in cognitive sciences 10, 3 (2006), 124--130.

[2]

Ehsan Azimi, Alexander Winkler, Emerson Tucker, Long Qian, Jayfus Doswell, Nassir Navab, and Peter Kazanzides. 2018. Can mixed-reality improve the training of medical procedures?. In 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 4065--4068.

[3]

Andrea Berger, Avishai Henik, and Robert Rafal. 2005. Competition between endogenous and exogenous orienting of visual attention. Journal of Experimental Psychology: General 134, 2 (2005), 207.

[4]

Hans-Jürgen Bucher and Peter Schumacher. 2006. The relevance of attention for selecting news content. An eye-tracking study on attention patterns in the reception of print and online media. Communications 31, 3 (2006), 347--368.

[5]

Fabio Buttussi and Luca Chittaro. 2018. Effects of different types of virtual reality display on presence and learning in a safety training scenario. IEEE transactions on visualization and computer graphics 24, 2 (2018), 1063--1076.

[6]

Ana B Chica, Elisa Martín-Arévalo, Fabiano Botta, and Juan Lupiánez. 2014. The Spatial Orienting paradigm: how to design and interpret spatial attention experiments. Neuroscience & Biobehavioral Reviews 40 (2014), 35--51.

[7]

Heiner Deubel and Werner X Schneider. 2003. Delayed saccades, but not delayed manual aiming movements, require visual attention shifts. Annals of the New York Academy of Sciences 1004, 1 (2003), 289--296.

[8]

Albert Hoang Duc, Paul Bays, and Masud Husain. 2008. Eye movements as a probe of attention. In Progress in brain research. Vol. 171. Elsevier, 403--411.

[9]

Andrew T Duchowski. 2007. Eye tracking methodology. Theory and practice 328 (2007), 614.

Digital Library

[10]

Robert Egly, Jon Driver, and Robert D Rafal. 1994a. Shifting visual attention between objects and locations: evidence from normal and parietal lesion subjects. Journal of Experimental Psychology: General 123, 2 (1994), 161.

[11]

Robert Egly, Robert Rafal, Jon Driver, and Yves Starrveveld. 1994b. Covert orienting in the split brain reveals hemispheric specialization for object-based attention. Psychological Science 5, 6 (1994), 380--383.

[12]

Charles W Eriksen and James E Hoffman. 1973. The extent of processing of noise elements during selective encoding from visual displays. Perception & Psychophysics 14, 1 (1973), 155--160.

[13]

John M Findlay and Iain D Gilchrist. 1998. Eye guidance and visual search. In Eye guidance in reading and scene perception. Elsevier, 295--312.

[14]

Todd C Handy, Amishi P Jha, and George R Mangun. 1999. Promoting novelty in vision: Inhibition of return modulates perceptual-level processing. Psychological Science 10, 2 (1999), 157--161.

[15]

Harold L Hawkins, Steven A Hillyard, Steven J Luck, Mustapha Mouloua, Cathryn J Downing, and Donald P Woodward. 1990. Visual attention modulates signal detectability. Journal of Experimental Psychology: Human Perception and Performance 16, 4 (1990), 802.

[16]

Charlotte Hoareau. 2016. Elaboration et éevaluation de recommandations ergonomiques pour le guidage de l'apprenant en EVAH: application d l'apprentissage de procéedure dans le domaine biomédical. Ph.D. Dissertation. Brest.

[17]

James E Hoffman and Baskaran Subramaniam. 1995. The role of visual attention in saccadic eye movements. Perception & psychophysics 57, 6 (1995), 787--795.

[18]

Susan Jang, Jonathan M Vitale, Robert W Jyung, and John B Black. 2017. Direct manipulation is better than passive viewing for learning anatomy in a three-dimensional virtual reality environment. Computers & Education 106 (2017), 150--165.

[19]

Chi-Hung Juan, Stephanie M Shorter-Jacobi, and Jeffrey D Schall. 2004. Dissociation of spatial attention and saccade preparation. Proceedings of the National Academy of Sciences 101, 43 (2004), 15541--15544.

[20]

Eileen Kowler, Eric Anderson, Barbara Dosher, and Erik Blaser. 1995. The role of attention in the programming of saccades. Vision research 35, 13 (1995), 1897--1916.

[21]

Yen-Chen Lin, Yung-Ju Chang, Hou-Ning Hu, Hsien-Tzu Cheng, Chi-Wen Huang, and Min Sun. 2017. Tell me where to look: Investigating ways for assisting focus in 360 video. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 2535--2545.

Digital Library

[22]

Francesco Maringelli, John McCarthy, Anthony Steed, Mel Slater, and Carlo Umilta. 2001. Shifting visuo-spatial attention in a virtual three-dimensional space. Cognitive Brain Research 10, 3 (2001), 317--322.

[23]

Sebastiaan Mathôt, Clayton Hickey, and Jan Theeuwes. 2010. From reorienting of attention to biased competition: Evidence from hemifield effects. Attention, Perception, & Psychophysics 72, 3 (2010), 651--657.

[24]

Cathleen M Moore, Steven Yantis, and Barry Vaughan. 1998. Object-based visual selection: Evidence from perceptual completion. Psychological science 9, 2 (1998), 104--110.

[25]

Michael C Mozer and Shaun P Vecera. 2005. Space-and object-based attention. In Neurobiology of attention. Elsevier, 130--134.

[26]

Bettina Olk, Alina Dinu, David J Zielinski, and Regis Kopper. 2018. Measuring visual search and distraction in immersive virtual reality. Royal Society open science 5, 5 (2018), 172331.

[27]

Takashi J Ozaki, Seiji Ogawa, and Tsunehiro Takeda. 2009. Dissociable neural correlates of reorienting within versus across visual hemifields. Neuroreport 20, 5 (2009), 497--501.

[28]

Matthew S Peterson, Arthur F Kramer, and David E Irwin. 2004. Covert shifts of attention precede involuntary eye movements. Perception & psychophysics 66, 3 (2004), 398--405.

[29]

Michael I Posner. 1980. Orienting of attention. Quarterly journal of experimental psychology 32, 1 (1980), 3--25.

[30]

Patricia A Reuter-Lorenz, Maxwell Drain, and Corinne Hardy-Morais. 1996. Object-centered attentional biases in the intact brain. Journal of Cognitive Neuroscience 8, 6 (1996), 540--550.

Digital Library

[31]

Giacomo Rizzolatti, Lucia Riggio, Isabella Dascola, and Carlo Umiltá. 1987. Reorienting attention across the horizontal and vertical meridians: evidence in favor of a premotor theory of attention. Neuropsychologia 25, 1 (1987), 31--40.

[32]

Alia Sheikh, Andy Brown, Zillah Watson, and Michael Evans. 2016. Directing attention in 360-degree video. (2016).

[33]

Daniel T Smith and Thomas Schenk. 2012. The premotor theory of attention: time to move on? Neuropsychologia 50, 6 (2012), 1104--1114.

[34]

Carlo Umiltà, Lucia Riggio, Isabella Dascola, and Giacomo Rizzolatti. 1991. Differential effects of central and peripheral cues on the reorienting of spatial attention. European Journal ofCognitive Psychology 3, 2 (1991), 247--267.

[35]

Deepak Vembar, Nikhil Iyengar, Andrew T Duchowski, Kevin Clark, Jason Hewitt, and Keith Pauls. 2004. Effect of visual cues on human performance in navigating through a virtual maze. In EGVE. 53--60.

Digital Library

[36]

Sabine Webel, Uli Bockholt, Timo Engelke, Nirit Gavish, Manuel Olbrich, and Carsten Preusche. 2013. An augmented reality training platform for assembly and maintenance skills. Robotics and Autonomous Systems 61, 4 (2013), 398--403.

Digital Library

Cited By

Ullal ATauseef MWatkins AJuckett LMaxwell CTate JMion LSarkar N(2024)An Iterative Participatory Design Approach to Develop Collaborative Augmented Reality Activities for Older Adults in Long-Term Care FacilitiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642595(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642595
Jeong SKim JLee J(2024)The Differential Effects of Multisensory Attentional Cues on Task Performance in VR Depending on the Level of Cognitive Load and Cognitive CapacityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337212630:5(2703-2712)Online publication date: May-2024
https://doi.org/10.1109/TVCG.2024.3372126
Wu RChen H(2023)The Effect of Visual and Auditory Modality Mismatching between Distraction and Warning on Pedestrian Street Crossing Behavior2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00121(1045-1054)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00121
Show More Cited By

Index Terms

Attentional orienting in virtual reality using endogenous and exogenous cues in auditory and visual modalities
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
    2. Interaction paradigms
      1. Virtual reality

Recommendations

Attentional orienting in real and virtual 360-degree environments: applications to aeronautics
ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

We investigate the mechanisms of attentional orienting in a 360-degree virtual environments. Through the use of Posner's paradigm, we study the effects of different attentional guidance techniques designed to improve information processing. The most ...
Eye-tracking and Virtual Reality in 360-degrees: exploring two ways to assess attentional orienting in rear space
ETRA '20 Adjunct: ACM Symposium on Eye Tracking Research and Applications

The Posner cueing task is a classic experimental paradigm in cognitive science for measuring visual attention orienting abilities. Recently, it was suggested that this paradigm can be adapted in virtual reality (e.g. in an immersive and ecological ...
The Frontal Cortex and Exogenous Attentional Orienting

Normal functioning of the attentional orienting system is critical for effective behavior and is predicated on a balanced interaction between goal-directed (endogenous) processes and stimulus-driven (exogenous) processes. Although both systems have been ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

June 2019

623 pages

ISBN:9781450367097

DOI:10.1145/3314111

Conference Chairs:
Krzysztof Krejtz
SWPS University, Poland
,
Bonita Sharif
University of Nebraska-Lincoln

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ETRA '19

Sponsor:

ETRA '19: 2019 Symposium on Eye Tracking Research and Applications

June 25 - 28, 2019

Colorado, Denver

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
643
Total Downloads

Downloads (Last 12 months)106
Downloads (Last 6 weeks)19

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ullal ATauseef MWatkins AJuckett LMaxwell CTate JMion LSarkar N(2024)An Iterative Participatory Design Approach to Develop Collaborative Augmented Reality Activities for Older Adults in Long-Term Care FacilitiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642595(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642595
Jeong SKim JLee J(2024)The Differential Effects of Multisensory Attentional Cues on Task Performance in VR Depending on the Level of Cognitive Load and Cognitive CapacityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337212630:5(2703-2712)Online publication date: May-2024
https://doi.org/10.1109/TVCG.2024.3372126
Wu RChen H(2023)The Effect of Visual and Auditory Modality Mismatching between Distraction and Warning on Pedestrian Street Crossing Behavior2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00121(1045-1054)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00121
Soret RCharras PHurter CPeysakhovich V(2022)Attentional Orienting in Front and Rear Spaces in a Virtual Reality Discrimination TaskVision10.3390/vision60100036:1(3)Online publication date: 6-Jan-2022
https://doi.org/10.3390/vision6010003
Pjesivac IWojdynski BBinford MKim JHerndon K(2021)Using Directional Cues in Immersive Journalism: The Impact on Information Processing, Narrative Transportation, Presence, News Attitudes, and CredibilityDigital Journalism10.1080/21670811.2021.189747311:6(982-1004)Online publication date: 29-Jul-2021
https://doi.org/10.1080/21670811.2021.1897473
Soret RCharras PKhazar IHurter CPeysakhovich V(2020)Eye-tracking and Virtual Reality in 360-degrees: exploring two ways to assess attentional orienting in rear spaceACM Symposium on Eye Tracking Research and Applications10.1145/3379157.3391418(1-7)Online publication date: 2-Jun-2020
https://dl.acm.org/doi/10.1145/3379157.3391418
Soret RHurter CPeysakhovich VKrejtz KSharif B(2019)Attentional orienting in real and virtual 360-degree environmentsProceedings of the 11th ACM Symposium on Eye Tracking Research & Applications10.1145/3314111.3322871(1-3)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3314111.3322871

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents