research-article

Realistic heatmap visualization for interactive analysis of 3D gaze data

Authors:

Michael Maurus,

Jan Hendrik Hammer,

Jürgen BeyererAuthors Info & Claims

ETRA '14: Proceedings of the Symposium on Eye Tracking Research and Applications

Pages 295 - 298

https://doi.org/10.1145/2578153.2578204

Published: 26 March 2014 Publication History

Get Access

Abstract

In this paper, a novel approach for real-time heatmap generation and visualization of 3D gaze data is presented. By projecting the gaze into the scene and considering occlusions from the observer's view, to our knowledge, for the first time a correct visualization of the actual scene perception in 3D environments is provided. Based on a graphics-centric approach utilizing the graphics pipeline, shaders and several optimization techniques, heatmap rendering is fast enough for an interactive online and offline gaze analysis of thousands of gaze samples.

References

[1]

Campbell, M., Moran, A., and Kenny, I. 2013. Characteristics of expertise in able and disabled elite golfers: the role of vision and technique. In British Association of Sport and Exercise Sciences Annual Conference, British Association of Sport and Exercise Sciences. http://hdl.handle.net/10344/3372 (last accessed 2014-01-30).

Google Scholar

[2]

Duchowski, A. T., Price, M. M., Meyer, M., and Orero, P. 2012. Aggregate gaze visualization with real-time heatmaps. In Proceedings of the Symposium on Eye Tracking Research and Applications, ACM, New York, NY, USA, ETRA '12, 13--20.

Digital Library

Google Scholar

[3]

Guestrin, E., and Eizenman, E. 2006. General theory of remote gaze estimation using the pupil center and corneal reflections. Biomedical Engineering, IEEE Transactions on 53, 6, 1124--1133.

Crossref

Google Scholar

[4]

Hammer, J. H., Maurus, M., and Beyerer, J. 2013. Real-time 3D gaze analysis in mobile applications. In Proceedings of the 2013 Conference on Eye Tracking South Africa, ACM, New York, NY, USA, ETSA '13, 75--78.

Digital Library

Google Scholar

[5]

Harwood, T., Jones, M., and Carreras, A. 2013. Shedding light on retail environments. In Proceedings of the 2013 Conference on Eye Tracking South Africa, ACM, New York, NY, USA, ETSA '13, 2--7.

Digital Library

Google Scholar

[6]

Holmqvist, K., Nystrm, M., Andersson, R., Dewhurst, R., Halszka, J., and van de Weijer, J. 2011. Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford University Press, Oxford {u.a.}.

Google Scholar

[7]

Paletta, L., Santner, K., Fritz, G., Mayer, H., and Schrammel, J. 2013. 3d attention: measurement of visual saliency using eye tracking glasses. In CHI '13 Extended Abstracts on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI EA '13, 199--204.

Digital Library

Google Scholar

[8]

Pfeiffer, T. 2012. 3D Attention Volumes for usability studies in virtual reality. In Proceedings of the 2012 IEEE Virtual Reality, IEEE Computer Society, Washington, DC, USA, VR '12, 117--118.

Digital Library

Google Scholar

[9]

Pfeiffer, T. 2012. Measuring and visualizing attention in space with 3d attention volumes. In Proceedings of the Symposium on Eye Tracking Research and Applications, ACM, New York, NY, USA, ETRA '12, 29--36.

Digital Library

Google Scholar

[10]

Stellmach, S., Nacke, L., and Dachselt, R. 2010. Advanced gaze visualizations for three-dimensional virtual environments. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, ACM, New York, NY, USA, ETRA '10, 109--112.

Digital Library

Google Scholar

[11]

Toyama, T., Kieninger, T., Shafait, F., and Dengel, A. 2012. Gaze guided object recognition using a head-mounted eye tracker. In Proceedings of the Symposium on Eye Tracking Research and Applications, ACM, New York, NY, USA, ETRA '12, 91--98.

Digital Library

Google Scholar

[12]

Williams, L. 1978. Casting curved shadows on curved surfaces. In Proceedings of the 5th annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, SIGGRAPH '78, 270--274.

Digital Library

Google Scholar

Cited By

View all

Javerliat CVillenave SRaimbaud PLavoué G(2024)PLUME: Record, Replay, Analyze and Share User Behavior in 6DoF XR ExperiencesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337210730:5(2087-2097)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372107
Ban SLee YKim KKim JYeo W(2022)Advances in Materials, Sensors, and Integrated Systems for Monitoring Eye MovementsBiosensors10.3390/bios1211103912:11(1039)Online publication date: 17-Nov-2022
https://doi.org/10.3390/bios12111039
Sundstedt VGarro V(2022)A Systematic Review of Visualization Techniques and Analysis Tools for Eye-Tracking in 3D EnvironmentsFrontiers in Neuroergonomics10.3389/fnrgo.2022.9100193Online publication date: 13-Jul-2022
https://doi.org/10.3389/fnrgo.2022.910019
Show More Cited By

Index Terms

Realistic heatmap visualization for interactive analysis of 3D gaze data
1. Computing methodologies
  1. Computer graphics

Recommendations

Intermediate shadow maps for interactive many-light rendering

We present an efficient method for computing shadows for many light sources (e.g., 1024). Our work is based on the observation that conventional shadow mapping becomes redundant as the number of lights increases. First, we sample the scene with a ...
Scalable interactive volume rendering using off-the-shelf components
PVG '01: Proceedings of the IEEE 2001 symposium on parallel and large-data visualization and graphics

This paper describes an application of a second generation implementation of the Sepia architecture (Sepia-2) to interactive volumetric visualization of large rectilinear scalar fields. By employing pipelined associative blending operators in a sort-...
Soft irregular shadow mapping: fast, high-quality, and robust soft shadows
I3D '09: Proceedings of the 2009 symposium on Interactive 3D graphics and games

We introduce a straightforward, robust, and efficient algorithm for rendering high-quality soft shadows in dynamic scenes. Each frame, points in the scene visible from the eye are inserted into a spatial acceleration structure. Shadow umbrae are ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ETRA '14: Proceedings of the Symposium on Eye Tracking Research and Applications

March 2014

394 pages

ISBN:9781450327510

DOI:10.1145/2578153

Conference Chairs:
Pernilla Qvarfordt
FX Palo Alto Laboratory
,
Dan Witzner Hansen
IT University, Denmark

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 March 2014

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ETRA '14

Sponsor:

ETRA '14: Eye Tracking Research and Applications

March 26 - 28, 2014

Florida, Safety Harbor

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
908
Total Downloads

Downloads (Last 12 months)55
Downloads (Last 6 weeks)7

Reflects downloads up to 29 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Javerliat CVillenave SRaimbaud PLavoué G(2024)PLUME: Record, Replay, Analyze and Share User Behavior in 6DoF XR ExperiencesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337210730:5(2087-2097)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372107
Ban SLee YKim KKim JYeo W(2022)Advances in Materials, Sensors, and Integrated Systems for Monitoring Eye MovementsBiosensors10.3390/bios1211103912:11(1039)Online publication date: 17-Nov-2022
https://doi.org/10.3390/bios12111039
Sundstedt VGarro V(2022)A Systematic Review of Visualization Techniques and Analysis Tools for Eye-Tracking in 3D EnvironmentsFrontiers in Neuroergonomics10.3389/fnrgo.2022.9100193Online publication date: 13-Jul-2022
https://doi.org/10.3389/fnrgo.2022.910019
Gil‐Lopez CGuixeres JMarín‐Morales JAlcañiz M(2022)Use of XR's Technologies for Consumer Behavior AnalysisRoadmapping Extended Reality10.1002/9781119865810.ch12(283-308)Online publication date: 21-Jul-2022
https://doi.org/10.1002/9781119865810.ch12
Han E(2021)Integrating Mobile Eye-Tracking and VSLAM for Recording Spatial Gaze in Works of Art and ArchitectureTechnology|Architecture + Design10.1080/24751448.2021.19670585:2(177-187)Online publication date: 3-Nov-2021
https://doi.org/10.1080/24751448.2021.1967058
Chittaro LSerafini M(2021)Visualization of User’s Behavior in Indoor Virtual Environments Through Interactive HeatmapsHuman-Computer Interaction – INTERACT 202110.1007/978-3-030-85613-7_38(600-609)Online publication date: 30-Aug-2021
https://dl.acm.org/doi/10.1007/978-3-030-85613-7_38
Jogeshwar A(2020)Analysis and visualization tool for motion and gazeACM Symposium on Eye Tracking Research and Applications10.1145/3379157.3391996(1-3)Online publication date: 2-Jun-2020
https://dl.acm.org/doi/10.1145/3379157.3391996
Burova AMäkelä JHakulinen JKeskinen THeinonen HSiltanen STurunen MBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Utilizing VR and Gaze Tracking to Develop AR Solutions for Industrial MaintenanceProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376405(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376405
Rahman YAsish SFisher NBruce EKulshreshth ABorst C(2020)Exploring Eye Gaze Visualization Techniques for Identifying Distracted Students in Educational VR2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR46266.2020.00009(868-877)Online publication date: Mar-2020
https://doi.org/10.1109/VR46266.2020.00009
Matsumoto RTakemura K(2019)Semantic 3D gaze mapping for estimating focused objectsProceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3338286.3344396(1-6)Online publication date: 1-Oct-2019
https://dl.acm.org/doi/10.1145/3338286.3344396
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Intermediate shadow maps for interactive many-light rendering

Scalable interactive volume rendering using off-the-shelf components

Soft irregular shadow mapping: fast, high-quality, and robust soft shadows