research-article

EyeSee360: designing a visualization technique for out-of-view objects in head-mounted augmented reality

Authors:

Uwe Gruenefeld,

Abdallah El Ali,

Susanne BollAuthors Info & Claims

SUI '17: Proceedings of the 5th Symposium on Spatial User Interaction

Pages 109 - 118

https://doi.org/10.1145/3131277.3132175

Published: 16 October 2017 Publication History

Abstract

Head-mounted displays allow user to augment reality or dive into a virtual one. However, these 3D spaces often come with problems due to objects that may be out of view. Visualizing these out-of-view objects is useful under certain scenarios, such as situation monitoring during ship docking. To address this, we designed a lo-fi prototype of our EyeSee360 system, and based on user feedback, subsequently implemented EyeSee360. We evaluate our technique against well-known 2D off-screen object visualization techniques (Arrow, Halo, Wedge) adapted for head-mounted Augmented Reality, and found that EyeSee360 results in lowest error for direction estimation of out-of-view objects. Based on our findings, we outline the limitations of our approach and discuss the usefulness of our developed lo-fi prototyping tool.

References

[1]

Patrick Baudisch and Ruth Rosenholtz. 2003. Halo: A Technique for Visualizing Off-screen Objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 481--488.

Digital Library

[2]

Frank Biocca, Arthur Tang, Charles Owen, and Fan Xiao. 2006. Attention Funnel: Omnidirectional 3D Cursor for Mobile Augmented Reality Platforms. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06). ACM, New York, NY, USA, 1115--1122.

Digital Library

[3]

John Brooke and others. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4--7.

[4]

Stefano Burigat and Luca Chittaro. 2007. Navigation in 3D virtual environments: Effects of user experience and location-pointing navigation aids. International Journal of Human-Computer Studies 65, 11 (2007), 945--958.

Digital Library

[5]

Stefano Burigat, Luca Chittaro, and Silvia Gabrielli. 2006. Visualizing Locations of Off-screen Objects on Mobile Devices: A Comparative Evaluation of Three Approaches. In Proceedings of the 8th Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '06). ACM, New York, NY, USA, 239--246.

Digital Library

[6]

Andy Cockburn, Amy Karlson, and Benjamin B. Bederson. 2009. A Review of Overview+Detail, Zooming, and Focus+Context Interfaces. ACM Comput. Surv. 41, 1, Article 2 (Jan. 2009), 31 pages.

Digital Library

[7]

Marco de Sá and Elizabeth Churchill. 2012. Mobile Augmented Reality: Exploring Design and Prototyping Techniques. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '12). ACM, New York, NY, USA, 221--230.

Digital Library

[8]

Uwe Gruenefeld, Abdallah El Ali, Wilko Heuten, and Susanne Boll. 2017. Visualizing Out-of-view Objects in Head-mounted Augmented Reality. In Proceedings of the 19th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '17). ACM, New York, NY, USA.

Digital Library

[9]

Sean Gustafson, Patrick Baudisch, Carl Gutwin, and Pourang Irani. 2008. Wedge: Clutter-free Visualization of Off-screen Locations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 787--796.

Digital Library

[10]

Sean G. Gustafson and Pourang P. Irani. 2007. Comparing Visualizations for Tracking Off-screen Moving Targets. In CHI '07 Extended Abstracts on Human Factors in Computing Systems (CHI EA '07). ACM, New York, NY, USA, 2399--2404.

Digital Library

[11]

C.L. Hardin. 2000. Red and yellow, green and blue, warm and cool: explaining colour appearance. Journal of Consciousness Studies 7, 8--9 (2000), 113--122. http://www.ingentaconnect.com/content/imp/jcs/2000/00000007/F0020008/1046

[12]

Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Advances in Psychology 52 (1988), 139 -- 183. ) 62386-9

[13]

Niels Henze, Benjamin Poppinga, and Susanne Boll. 2010. Experiments in the Wild: Public Evaluation of Off-screen Visualizations in the Android Market. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (NordiCHI '10). ACM, New York, NY, USA, 675--678.

Digital Library

[14]

Hyungeun Jo, Sungjae Hwang, Hyunwoo Park, and Jung-hee Ryu. 2011. Around-plot: Focus+ context interface for off-screen objects in 3D environments. Computers & Graphics 35, 4 (2011), 841--853.

Digital Library

[15]

James Kalat. 2015. Biological psychology. Nelson Education.

[16]

Adam M. Larson and Lester C. Loschky. 2009. The contributions of central versus peripheral vision to scene gist recognition. Journal of Vision 9, 10 (2009), 6. arXiv:/data/journals/jov/932854/jov-9-10-6.pdf

[17]

Felix Lauber, Claudius Böttcher, and Andreas Butz. 2014. PapAR: Paper Prototyping for Augmented Reality. In Adjunct Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '14). ACM, New York, NY, USA, 1--6.

Digital Library

[18]

Ji-Yong Lee, Joung-Huem Kwon, Sang-Hun Nam, Joong-Jae Lee, and Bum-Jae You. 2016. Coexistent Space: Collaborative Interaction in Shared 3D Space. In Proceedings of the 2016 Symposium on Spatial User Interaction (SUI '16). ACM, New York, NY, USA, 175--175.

Digital Library

[19]

Kris Luyten, Donald Degraen, Gustavo Rovelo Ruiz, Sven Coppers, and Davy Vanacken. 2016. Hidden in Plain Sight: An Exploration of a Visual Language for Near-Eye Out-of-Focus Displays in the Peripheral View. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 487--497.

Digital Library

[20]

Marie-Christin Ostendorp, Jan Charles Lenk, and Andreas LÃijdtke. 2015. Smart Glasses to Support Maritime Pilots in Harbor Maneuvers. Procedia Manufacturing 3 (2015), 2840 -- 2847.

[21]

Benjamin I. Outram, Yun Suen Pai, Kevin Fan, Kouta Minamizawa, and Kai Kunze. 2016. AnyOrbit: Fluid 6DOF Spatial Navigation of Virtual Environments Using Orbital Motion. In Proceedings of the 2016 Symposium on Spatial User Interaction (SUI '16). ACM, New York, NY, USA, 199--199.

Digital Library

[22]

James F Parker Jr and Vita R West. 1973. Bioastronautics Data Book: NASA SP-3006. NASA Special Publication 3006 (1973).

[23]

Martin Pielot, Oliver Krull, and Susanne Boll. 2010. Where is My Team: Supporting Situation Awareness with Tactile Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 1705--1714.

Digital Library

[24]

David Rudi, Ioannis Giannopoulos, Peter Kiefer, Christian Peier, and Martin Raubal. 2016. Interacting with Maps on Optical Head-Mounted Displays. In Proceedings of the 2016 Symposium on Spatial User Interaction (SUI '16). ACM, New York, NY, USA, 3--12.

Digital Library

[25]

Manojit Sarkar and Marc H Brown. 1994. Graphical fisheye views. Commun. ACM 37, 12 (1994), 73--83.

Digital Library

[26]

Torben Schinke, Niels Henze, and Susanne Boll. 2010. Visualization of Off-screen Objects in Mobile Augmented Reality. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '10). ACM, New York, NY, USA, 313--316.

Digital Library

[27]

Teresa Siu and Valeria Herskovic. 2013. SidebARs: Improving Awareness of Off-screen Elements in Mobile Augmented Reality. In Proceedings of the 2013 Chilean Conference on Human - Computer Interaction (ChileCHI '13). ACM, New York, NY, USA, 36--41.

Digital Library

[28]

Richard Stoakley, Matthew J. Conway, and Randy Pausch. 1995. Virtual Reality on a WIM: Interactive Worlds in Miniature. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '95). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 265--272.

Digital Library

[29]

Hans Strasburger, Ingo Rentschler, and Martin Jüttner. 2011. Peripheral vision and pattern recognition: A review. Journal of vision 11, 5 (2011), 13--13.

[30]

Mengu Sukan, Carmine Elvezio, Ohan Oda, Steven Feiner, and Barbara Tversky. 2014. ParaFrustum: Visualization Techniques for Guiding a User to a Constrained Set of Viewing Positions and Orientations. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 331--340.

Digital Library

[31]

Marcus Tonnis and Gudrun Klinker. 2006. Effective Control of a Car Driver's Attention for Visual and Acoustic Guidance Towards the Direction of Imminent Dangers. In Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR '06). IEEE Computer Society, Washington, DC, USA, 13--22.

Digital Library

[32]

Matthias Trapp, Lars Schneider, Christine Lehmann, Norman Holz, and Jürgen Döllner. 2011. Strategies for visualising 3D points-of-interest on mobile devices. Journal of Location Based Services 5, 2 (2011), 79--99.

Digital Library

[33]

Polle T. Zellweger, Jock D. Mackinlay, Lance Good, Mark Stefik, and Patrick Baudisch. 2003. City Lights: Contextual Views in Minimal Space. In CHI '03 Extended Abstracts on Human Factors in Computing Systems (CHI EA '03). ACM, New York, NY, USA, 838--839.

Digital Library

Cited By

Qin YSu JQin HTian Y(2024)Exploring the Role of Video Playback Visual Cues in Object Retrieval TasksSensors10.3390/s2410314724:10(3147)Online publication date: 15-May-2024
https://doi.org/10.3390/s24103147
Yangfu RZhiqiang LSonghai Z(2024)Survey of visualization methods for multiscene visual cue information in immersive environmentsJournal of Image and Graphics10.11834/jig.22114729:1(1-21)Online publication date: 2024
https://doi.org/10.11834/jig.221147
Kergaßner SDoerr NWieland MFuchs MSedlmair M(2024)HiveFive360: Extending the VR Gaze Guidance Technique HiveFive to Highlight Out-Of-FOV TargetsProceedings of Mensch und Computer 202410.1145/3670653.3670662(11-20)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670662
Show More Cited By

Index Terms

EyeSee360: designing a visualization technique for out-of-view objects in head-mounted augmented reality
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies
    2. Interaction paradigms
      1. Mixed / augmented reality
  2. Visualization
    1. Visualization application domains
      1. Information visualization

Recommendations

Visualizing out-of-view objects in head-mounted augmented reality
MobileHCI '17: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services

Various off-screen visualization techniques that point to off-screen objects have been developed for small screen devices. A similar problem arises with head-mounted Augmented Reality (AR) with respect to the human field-of-view, where objects may be ...
Beyond Halo and Wedge: visualizing out-of-view objects on head-mounted virtual and augmented reality devices
MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services

Head-mounted devices (HMDs) for Virtual and Augmented Reality (VR/AR) enable us to alter our visual perception of the world. However, current devices suffer from a limited field of view (FOV), which becomes problematic when users need to locate out of ...
FlyingARrow: Pointing Towards Out-of-View Objects on Augmented Reality Devices
PerDis '18: Proceedings of the 7th ACM International Symposium on Pervasive Displays

Augmented Reality (AR) devices empower users to enrich their surroundings by pinning digital content onto real world objects. However, current AR devices suffer from having small fields of view, making the process of locating spatially distributed ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SUI '17: Proceedings of the 5th Symposium on Spatial User Interaction

October 2017

167 pages

ISBN:9781450354868

DOI:10.1145/3131277

General Chair:
Adalberto L. Simeone
KU Leuven, Belgium
,
Program Chairs:
Kyle Johnsen
University of Georgia
,
Rob Teather
Carleton University, Canada
,
Christian Sandor
Nara Institute of Science and Technology (NAIST), Japan

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SUI '17

Sponsor:

SIGCHI

SUI '17: Symposium on Spatial User Interaction

October 16 - 17, 2017

Brighton, United Kingdom

Acceptance Rates

Overall Acceptance Rate 86 of 279 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

67
Total Citations
View Citations
985
Total Downloads

Downloads (Last 12 months)113
Downloads (Last 6 weeks)20

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Qin YSu JQin HTian Y(2024)Exploring the Role of Video Playback Visual Cues in Object Retrieval TasksSensors10.3390/s2410314724:10(3147)Online publication date: 15-May-2024
https://doi.org/10.3390/s24103147
Yangfu RZhiqiang LSonghai Z(2024)Survey of visualization methods for multiscene visual cue information in immersive environmentsJournal of Image and Graphics10.11834/jig.22114729:1(1-21)Online publication date: 2024
https://doi.org/10.11834/jig.221147
Kergaßner SDoerr NWieland MFuchs MSedlmair M(2024)HiveFive360: Extending the VR Gaze Guidance Technique HiveFive to Highlight Out-Of-FOV TargetsProceedings of Mensch und Computer 202410.1145/3670653.3670662(11-20)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670662
Woodworth JKhokhar ARahman YKulshreshth ABorst C(2024)Attention Guidance In The Wild: An Experiment Testing Visual Guidance Cues for VR Field Trips at High Schools2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00035(173-179)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00035
Torres ÁMolina JGarcía AGonzález P(2024)Prototyping of Augmented Reality interfaces for air traffic alert and their evaluation using a Virtual Reality aircraft-proximity simulator2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00101(817-826)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00101
Reddy ABandaru PYaswanth GKoni Jiavana F(2024)The Impact of Variable Focal Lengths in Head Mounted Display2024 International Conference on Recent Advances in Electrical, Electronics, Ubiquitous Communication, and Computational Intelligence (RAEEUCCI)10.1109/RAEEUCCI61380.2024.10547764(1-7)Online publication date: 17-Apr-2024
https://doi.org/10.1109/RAEEUCCI61380.2024.10547764
Kiral IDemirkesen S(2024)Evaluating the impact of different hard hats on the peripheral vision of construction workersInternational Journal of Occupational Safety and Ergonomics10.1080/10803548.2024.231651530:2(436-449)Online publication date: 25-Feb-2024
https://doi.org/10.1080/10803548.2024.2316515
Woodworth JBorst C(2024)Visual cues in VR for guiding attention vs. restoring attention after a short distractionComputers and Graphics10.1016/j.cag.2023.12.008118:C(194-209)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.cag.2023.12.008
Cho HKomar MLindlbauer D(2023)RealityReplayProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108887:3(1-25)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610888
Wecker DYigitbas E(2023)Minimizing Eye Movements and Distractions in Head-Mounted Augmented Reality through Eye-Gaze AdaptivenessProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614524(1-12)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614524
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents