research-article

Space-time volume visualization of gaze and stimulus

Authors:

Valentin Bruder,

Daniel Weiskopf,

Thomas ErtlAuthors Info & Claims

ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

Article No.: 12, Pages 1 - 9

https://doi.org/10.1145/3314111.3319812

Published: 25 June 2019 Publication History

Abstract

We present a method for the spatio-temporal analysis of gaze data from multiple participants in the context of a video stimulus. For such data, an overview of the recorded patterns is important to identify common viewing behavior (such as attentional synchrony) and outliers. We adopt the approach of space-time cube visualization, which extends the spatial dimensions of the stimulus by time as the third dimension. Previous work mainly handled eye tracking data in the space-time cube as point cloud, providing no information about the stimulus context. This paper presents a novel visualization technique that combines gaze data, a dynamic stimulus, and optical flow with volume rendering to derive an overview of the data with contextual information. With specifically designed transfer functions, we emphasize different data aspects, making the visualization suitable for explorative analysis and for illustrative support of statistical findings alike.

Supplementary Material

ZIP File (a12-bruder.zip)

Supplemental files.

Download
2.07 MB

References

[1]

Johanna Beyer, Markus Hadwiger, and Hanspeter Pfister. 2015. State-of-the-Art in GPU-Based Large-Scale Volume Visualization. Computer Graphics Forum 34, 8 (2015), 13--37.

Digital Library

[2]

Tanja Blascheck, Kuno Kurzhals, Michael Raschke, Michael Burch, Daniel Weiskopf, and Thomas Ertl. 2017. Visualization of Eye Tracking Data: A Taxonomy and Survey. Computer Graphics Forum 36, 8 (2017), 260--284.

[3]

R. Borgo, M. Chen, B. Daubney, E. Grundy, G. Heidemann, B. Höferlin, M. Höferlin, H. Leitte, D. Weiskopf, and X. Xie. 2012. State of the Art Report on Video-Based Graphics and Video Visualization. Computer Graphics Forum 31, 8 (2012), 2450--2477.

Digital Library

[4]

Thomas Brox, Andrés Bruhn, Nils Papenberg, and Joachim Weickert. 2004. High Accuracy Optical Flow Estimation Based on a Theory for Warping. In Proceedings of the European Conference on Computer Vision (ECCV). 25--36.

[5]

Valentin Bruder, Steffen Frey, and Thomas Ertl. 2017. Prediction-Based Load Balancing and Resolution Tuning for Interactive Volume Raycasting. Visual Informatics 1, 2 (2017), 106--117.

[6]

Valentin Bruder, Marcel Hlawatsch, Steffen Frey, Michael Burch, Daniel Weiskopf, and Thomas Ertl. 2018. Volume-Based Large Dynamic Graph Analytics. In Proceedings of the 22nd International Conference Information Visualisation (IV). 210--219.

[7]

Min Chen, Ralf Botchen, Rudy Hashim, Daniel Weiskopf, Thomas Ertl, and Ian Thornton. 2006. Visual Signatures in Video Visualization. IEEE Transactions on Visualization and Computer Graphics 12, 5 (2006), 1093--1100.

Digital Library

[8]

Robert A. Drebin, Loren Carpenter, and Pat Hanrahan. 1988. Volume Rendering. SIGGRAPH Computer Graphics 22, 4 (1988), 65--74.

Digital Library

[9]

Klaus Engel, Markus Hadwiger, Joe M. Kniss, Christof Rezk-Salama, and Daniel Weiskopf. 2006. Real-Time Volume Graphics. A. K. Peters, Ltd., Natick, MA.

Digital Library

[10]

Steffen Frey. 2018. Spatio-Temporal Contours from Deep Volume Raycasting. Computer Graphics Forum 37, 3 (2018), 513--524.

[11]

Steffen Frey and Thomas Ertl. 2017a. Flow-Based Temporal Selection for Interactive Volume Visualization. Computer Graphics Forum 36, 8 (2017), 153--165.

[12]

Steffen Frey and Thomas Ertl. 2017b. Progressive Direct Volume-to-Volume Transformation. IEEE Transactions on Visualization and Computer Graphics 23, 1 (2017), 921--930.

Digital Library

[13]

Steffen Frey, Filip Sadlo, and Thomas Ertl. 2012. Visualization of Temporal Similarity in Field Data. IEEE Transactions on Visualization and Computer Graphics 18, 12 (2012), 2023--2032.

Digital Library

[14]

Peter Gatalsky, Natalia Andrienko, and Gennady Andrienko. 2004. Interactive Analysis of Event Data Using Space-Time Cube. In Proceedings of the Eighth International Conference on Information Visualisation (IV). 145--152.

Digital Library

[15]

Torsten Hägerstraand. 1970. What About People in Regional Science? Papers in Regional Science 24, 1 (1970), 7--24.

[16]

Martin Hilpoltsteiner. 2005. Recreating Movement - Tools for Analyzing Film Sequences. Diplomarbeit. University of Applied Sciences, Wuerzburg, Germany.

[17]

James T. Kajiya and Brian P. von Herzen. 1984. Ray Tracing Volume Densities. SIGGRAPH Computer Graphics 18, 3 (1984), 165--174.

Digital Library

[18]

Maurice Koch, Kuno Kurzhals, and Daniel Weiskopf. 2018. Image-Based Scanpath Comparison with Slit-Scan Visualization. In Proceedings of the ACM Symposium on Eye Tracking Research and Applications (ETRA). 55:1--55:5.

Digital Library

[19]

Menno-Jan Kraak and Irma Kveladze. 2017. Narrative of the Annotated Space-Time Cube - Revisiting a Historical Event. Journal of Maps 13, 1 (2017), 56--61.

[20]

Kuno Kurzhals, Cyrill Fabian Bopp, Jochen Bässler, Felix Ebinger, and Daniel Weiskopf. 2014a. Benchmark Data for Evaluating Visualization and Analysis Techniques for Eye Tracking for Video Stimuli. In Proceedings of the Workshop Beyond Time and Errors: Novel Evaluation Methods for Visualization (BELIV). 54--60.

Digital Library

[21]

Kuno Kurzhals, Florian Heimerl, and Daniel Weiskopf. 2014b. ISeeCube: Visual Analysis of Gaze Data for Video. In Proceedings of the Symposium on Eye-Tracking Research and Applications (ETRA). 43--50.

Digital Library

[22]

Kuno Kurzhals and Daniel Weiskopf. 2013. Space-Time Visual Analytics of Eye-Tracking Data for Dynamic Stimuli. IEEE Transactions on Visualization and Computer Graphics 19, 12 (2013), 2129--2138.

Digital Library

[23]

Kuno Kurzhals and Daniel Weiskopf. 2016. Visualizing Eye Tracking Data with Gaze-Guided Slit-Scans. In Proceedings of the IEEE Second Workshop on Eye Tracking and Visualization (ETVIS). 45--49.

[24]

Xia Li, Arzu Çöltekin, and Menno-Jan Kraak. 2010. Visual Exploration of Eye Movement Data Using the Space-Time-Cube. In Proceedings of the 6th International Conference on Geographic Information Science. 295--309.

Digital Library

[25]

Parag K. Mital, Tim J. Smith, Robin L. Hill, and John M. Henderson. 2011. Clustering of Gaze during Dynamic Scene Viewing Is Predicted by Motion. Cognitive Computation 3, 1 (2011), 5--24.

[26]

Prithiviraj K. Muthumanickam, Katerina Vrotsou, Aida Nordman, Jimmy Johansson, and Matthew Cooper. 2019. Identification of Temporally Varying Areas of Interest in Long-Duration Eye-Tracking Data Sets. IEEE Transactions on Visualization and Computer Graphics 25, 1 (2019), 87--97.

Digital Library

[27]

Cuong Nguyen, Yuzhen Niu, and Feng Liu. 2012. Video Summagator: An Interface for Video Summarization and Navigation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 647--650.

Digital Library

[28]

Stefan Roettger, Stefan Guthe, Daniel Weiskopf, Thomas Ertl, and Wolfgang Strasser. 2003. Smart Hardware-accelerated Volume Rendering. In Proceedings of the 2003 Joint Eurographics/IEEE TCVG Symposium on Visualisation (VISSYM). 231--238.

Digital Library

[29]

Mario Romero, Jay Summet, John Stasko, and Gregory Abowd. 2008. Viz-A-Vis: Toward Visualizing Video through Computer Vision. IEEE Transactions on Visualization and Computer Graphics 14, 6 (2008), 1261--1268.

Digital Library

[30]

Bernard W. Silverman. 1986. Density Estimation for Statistics and Data Analysis. Chapman and Hall, New York.

[31]

Simon Stegmaier, Magnus Strengert, Thomas Klein, and Thomas Ertl. 2005. A Simple and Flexible Volume Rendering Framework for Graphics-Hardware-Based Raycasting. In In Proceedings of the Fourth International Workshop on Volume Graphics. 187--241.

Digital Library

[32]

Jonathan Woodring and Han-Wei Shen. 2003. Chronovolumes: a Direct Rendering Technique for Visualizing Time-varying Data. In Proceedings of the 2003 Eurographics/IEEE TCVG Workshop on Volume Graphics. 27--34.

Digital Library

Cited By

Pathmanathan NÖney SBecher MSedlmair MWeiskopf DKurzhals K(2023)Been There, Seen That: Visualization of Movement and 3D Eye Tracking Data from Real‐World EnvironmentsComputer Graphics Forum10.1111/cgf.1483842:3(385-396)Online publication date: 27-Jun-2023
https://doi.org/10.1111/cgf.14838
Yang ZXie YLi MHuang G(2023)GazeGraphVisAdvanced Engineering Informatics10.1016/j.aei.2023.10211157:COnline publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1016/j.aei.2023.102111
Weiskopf D(2020)Vis4Vis: Visualization for (Empirical) Visualization ResearchFoundations of Data Visualization10.1007/978-3-030-34444-3_10(209-224)Online publication date: 12-Aug-2020
https://doi.org/10.1007/978-3-030-34444-3_10

Index Terms

Space-time volume visualization of gaze and stimulus
1. Human-centered computing
  1. Visualization
    1. Visualization techniques

Recommendations

ISeeCube: visual analysis of gaze data for video
ETRA '14: Proceedings of the Symposium on Eye Tracking Research and Applications

We introduce a new design for the visual analysis of eye tracking data recorded from dynamic stimuli such as video. ISeeCube includes multiple coordinated views to support different aspects of various analysis tasks. It combines methods for the ...
Beyond gaze: preliminary analysis of pupil dilation and blink rates in an fMRI study of program comprehension
EMIP '18: Proceedings of the Workshop on Eye Movements in Programming

Researchers have been employing psycho-physiological measures to better understand program comprehension, for example simultaneous fMRI and eye tracking to validate top-down comprehension models. In this paper, we argue that there is additional value in ...
Space-Time Visual Analytics of Eye-Tracking Data for Dynamic Stimuli

We introduce a visual analytics method to analyze eye movement data recorded for dynamic stimuli such as video or animated graphics. The focus lies on the analysis of data of several viewers to identify trends in the general viewing behavior, including ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

June 2019

623 pages

ISBN:9781450367097

DOI:10.1145/3314111

Conference Chairs:
Krzysztof Krejtz
SWPS University, Poland
,
Bonita Sharif
University of Nebraska-Lincoln

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Deutsche Forschungsgemeinschaft

Conference

ETRA '19

Sponsor:

ETRA '19: 2019 Symposium on Eye Tracking Research and Applications

June 25 - 28, 2019

Colorado, Denver

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

ETRA '25

Sponsor:
sigchi
sigchi

2025 Symposium on Eye Tracking Research and Applications

May 26 - 29, 2025

Tokyo , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
332
Total Downloads

Downloads (Last 12 months)39
Downloads (Last 6 weeks)3

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Pathmanathan NÖney SBecher MSedlmair MWeiskopf DKurzhals K(2023)Been There, Seen That: Visualization of Movement and 3D Eye Tracking Data from Real‐World EnvironmentsComputer Graphics Forum10.1111/cgf.1483842:3(385-396)Online publication date: 27-Jun-2023
https://doi.org/10.1111/cgf.14838
Yang ZXie YLi MHuang G(2023)GazeGraphVisAdvanced Engineering Informatics10.1016/j.aei.2023.10211157:COnline publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1016/j.aei.2023.102111
Weiskopf D(2020)Vis4Vis: Visualization for (Empirical) Visualization ResearchFoundations of Data Visualization10.1007/978-3-030-34444-3_10(209-224)Online publication date: 12-Aug-2020
https://doi.org/10.1007/978-3-030-34444-3_10

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten