abstract

Public Access

Gaze-directed Immersive Visualization of Scientific Ensembles

Authors:

Aidong LuAuthors Info & Claims

ISS '16 Companion: Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces

Pages 77 - 82

https://doi.org/10.1145/3009939.3009952

Published: 06 November 2016 Publication History

Abstract

The latest advances in head-mounted displays (HMDs) for augmented reality (AR) and mixed reality (MR) have produced commercialized devices that are gradually accepted by the public. These HMDs are generally equipped with head tracking, which provides an excellent input to explore immersive visualization and interaction techniques for various AR/MR applications. This paper explores the head tracking function on the latest Microsoft HoloLens -- where gaze is defined as the ray starting at the head location and points forward. We present a gaze-directed visualization approach to study ensembles of 2D oil spill simulations in mixed reality. Our approach allows users to place an ensemble as an image stack in a real environment and explore the ensemble with gaze tracking. The prototype system demonstrates the challenges and promising effects of gaze-based interaction in the state-of-the-art mixed reality.

References

[1]

Amer Al-Rahayfeh and Miad Faezipour. 2013. Eye Tracking and Head Movement Detection: A State-of-Art Survey. IEEE Journal of Translational Engineering in Health and Medicine 1 (2013).

[2]

Fabian Beck, Tanja Blascheck, Thomas Ertl, and Daniel Weiskopf. 2015. Exploring Word-Sized Graphics for Visualizing Eye Tracking Data within Transcribed Experiment Recordings. In ETVIS2015.

[3]

T. Blascheck, K. Kurzhals, M. Raschke, M. Burch, D. Weiskopf, and T. Ertl. 2014. State-of-the-Art of Visualization for Eye Tracking Data. In EuroVis - STARs, R. Borgo, R. Maciejewski, and I. Viola (Eds.). The Eurographics Association.

[4]

B. Brinkman. 2012. Willing to be fooled: Security and autoamputation in augmented reality. In 2012 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH). 89--90.

[5]

T. Chandler, M. Cordeil, T. Czauderna, T. Dwyer, J. Glowacki, C. Goncu, M. Klapperstueck, K. Klein, K. Marriott, F. Schreiber, and E. Wilson. 2015. Immersive Analytics. In Big Data Visual Analytics (BDVA), 2015. 1--8.

[6]

Henry Chen, Austin S Lee, Mark Swift, and John C Tang. 2015. 3D Collaboration Method over HoloLens™ and Skype™ End Points. In Proceedings of the 3rd International Workshop on Immersive Media Experiences. ACM, 27--30.

Digital Library

[7]

Adrian James Chung, Fani Deligianni, Xiao-Peng Hu, and Guang-Zhong Yang. 2004. Visual Feature Extraction via Eye Tracking for Saliency Driven 2D/3D Registration. In Proceedings of the 2004 Symposium on Eye Tracking Research & Applications (ETRA '04). 49--54.

Digital Library

[8]

J.C. Dietrich, C.J. Trahan, and etc. 2012. Surface trajectories of oil transport along the Northern Coastline of the Gulf of Mexico. Continental Shelf Research 41 (2012), 17--47.

[9]

S. Hillaire, A. Lecuyer, T. Regia-Corte, R. Cozot, J. Royan, and G. Breton. 2012. Design and Application of Real-Time Visual Attention Model for the Exploration of 3D Virtual Environments. IEEE Transactions on Visualization and Computer Graphics 18, 3 (2012), 356--368.

Digital Library

[10]

M. Hlawatsch, M. Burch, F. Beck, J. Freire, C. Silva, and D. Weiskopf. 2015. Visualizing the Evolution of Module Workflows. In 2015 19th International Conference on Information Visualisation. 40--49.

Digital Library

[11]

Youngmin Kim, Amitabh Varshney, David W. Jacobs, and François Guimbretière. 2010. Mesh Saliency and Human Eye Fixations. ACM Trans. Appl. Percept. 7, 2 (2010), 12:1--12:13.

Digital Library

[12]

A. Kotranza, D. Scott Lind, C. M. Pugh, and B. Lok. 2009. Real-time in-situ visual feedback of task performance in mixed environments for learning joint psychomotor-cognitive tasks. In Mixed and Augmented Reality, 2009. ISMAR 2009. 8th IEEE International Symposium on. 125--134.

Digital Library

[13]

Chang Ha Lee, Amitabh Varshney, and David W. Jacobs. 2005. Mesh Saliency. ACM Trans. Graph. 24, 3 (2005), 659--666.

Digital Library

[14]

S. Lee, G. J. Kim, and S. Choi. 2009. Real-Time Tracking of Visually Attended Objects in Virtual Environments and Its Application to LOD. IEEE Transactions on Visualization and Computer Graphics 15, 1 (2009), 6--19.

Digital Library

[15]

Aidong Lu, Ross Maciejewski, and David S. Ebert. 2010. Volume Composition and Evaluation Using Eye-tracking Data. ACM Trans. Appl. Percept. 7, 1 (2010), 4:1--4:20.

Digital Library

[16]

J.F. Mackworth and N.H. Mackworth. 1958. Eye fixations recorded on changing visual scenes by the television eye-marker. Journal of the Optical Society of America 48, 7 (1958), 439--444.

[17]

Thies Pfeiffer and Patrick Renner. 2014. EyeSee3D: A Low-cost Approach for Analyzing Mobile 3D Eye Tracking Data Using Computer Vision and Augmented Reality Technology. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '14). 195--202.

Digital Library

[18]

Dariusz Zapala and Bibianna Balaj. 2012. Eye Tracking and Head Tracking -- The two approaches in assistive technologies. (2012), 2406--2415.

Cited By

Fonnet APrie Y(2021)Survey of Immersive AnalyticsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2019.292903327:3(2101-2122)Online publication date: 1-Mar-2021
https://doi.org/10.1109/TVCG.2019.2929033
Nguyen HKetchell SEngelke UThomas BSouza P(2017)[POSTER] HoloBee: Augmented Reality Based Bee Drift Analysis2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)10.1109/ISMAR-Adjunct.2017.38(87-92)Online publication date: Oct-2017
https://doi.org/10.1109/ISMAR-Adjunct.2017.38
Nguyen HKetchell SEngelke UThomas Bde Souza P(2017)Augmented Reality Based Bee Drift Analysis: A User Study2017 International Symposium on Big Data Visual Analytics (BDVA)10.1109/BDVA.2017.8114581(1-8)Online publication date: Nov-2017
https://doi.org/10.1109/BDVA.2017.8114581

Index Terms

Gaze-directed Immersive Visualization of Scientific Ensembles

Recommendations

A geoscience perspective on immersive 3D gridded data visualization

We describe visualization software, Visualizer, that was developed specifically for interactive, visual exploration in immersive virtual reality (VR) environments. Visualizer uses carefully optimized algorithms and data structures to support the high ...
Evaluation of Navigation Operations in Immersive Microscopic Visualization
VRST '19: Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology

In this study, we evaluated the quantitative effectiveness of navigation operation in a virtual reality (VR) volumetric viewer, in order to confirm the effectiveness of VR in life sciences. The analytical work for biological data is a promising ...
Cross-Platform Immersive Visualization and Navigation with Augmented Reality
VINCI '21: Proceedings of the 14th International Symposium on Visual Information Communication and Interaction

Navigation and situation awareness are amongst the most important aspects of collaborative analysis in 3D environments. This paper investigates the latest technology of mixed reality to improve the team navigation through effective real-time ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ISS '16 Companion: Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces

November 2016

136 pages

ISBN:9781450345309

DOI:10.1145/3009939

General Chairs:
Mark Hancock
University of Waterloo, Canada
,
Nicolai Marquardt
University College London, UK
,
Program Chairs:
Johannes Schöning
Hasselt University, Belgium
,
Melanie Tory
Tableau Research, USA

Copyright © 2016 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2016

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

National Science Foundation

Conference

ISS '16

Sponsor:

SIGCHI

ISS '16: 2016 ACM International Conference on Interactive Surfaces and Spaces

November 6 - 9, 2016

Ontario, Niagara Falls, Canada

Acceptance Rates

Overall Acceptance Rate 147 of 533 submissions, 28%

Upcoming Conference

ISS '24

Sponsor:
sigchi

Conference on Interactive Surfaces and Spaces

October 27 - 30, 2024

Vancouver , BC , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
471
Total Downloads

Downloads (Last 12 months)74
Downloads (Last 6 weeks)14

Reflects downloads up to 01 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Fonnet APrie Y(2021)Survey of Immersive AnalyticsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2019.292903327:3(2101-2122)Online publication date: 1-Mar-2021
https://doi.org/10.1109/TVCG.2019.2929033
Nguyen HKetchell SEngelke UThomas BSouza P(2017)[POSTER] HoloBee: Augmented Reality Based Bee Drift Analysis2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)10.1109/ISMAR-Adjunct.2017.38(87-92)Online publication date: Oct-2017
https://doi.org/10.1109/ISMAR-Adjunct.2017.38
Nguyen HKetchell SEngelke UThomas Bde Souza P(2017)Augmented Reality Based Bee Drift Analysis: A User Study2017 International Symposium on Big Data Visual Analytics (BDVA)10.1109/BDVA.2017.8114581(1-8)Online publication date: Nov-2017
https://doi.org/10.1109/BDVA.2017.8114581

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents