research-article

Open access

Foveated instant preview for progressive rendering

Authors:

Matias Koskela,

Pekka Jääskeläinen,

Joonas Multanen,

Jarmo TakalaAuthors Info & Claims

SA '17: SIGGRAPH Asia 2017 Technical Briefs

Article No.: 10, Pages 1 - 4

https://doi.org/10.1145/3145749.3149423

Published: 27 November 2017 Publication History

Abstract

Progressive rendering, for example Monte Carlo rendering of 360° content for virtual reality headsets, is a time-consuming task. If the 3D artist notices an error while previewing the rendering, he or she must return to editing mode, do the required changes, and restart rendering. Restart is required because the rendering system cannot know which pixels are affected by the change. We propose the use of eye-tracking-based optimization to significantly speed up previewing the artist's points of interest. Moreover, we derive an optimized version of the visual acuity model, which follows the original model more accurately than previous work. The proposed optimization was tested with a comprehensive user study. The participants felt that preview with the proposed method converged instantly, and the recorded split times show that the preview is 10 times faster than conventional preview. In addition, the system does not have measurable drawbacks on computational performance.

Supplementary Material

MP4 File (a10-koskela.mp4)

Download
94.68 MB

References

[1]

AMD. 2017. RadeonRays SDK. Online. (2017). Available: https://github.com/GPUOpen-LibrariesAndSDKs/RadeonRays_SDK, Referenced: 24th of May 2017.

[2]

Luc Devroye. 1986. Non-Uniform Random Variate Generation. Springer.

[3]

Andrew Duchowski, David Bate, Paris Stringfellow, Kaveri Thakur, Brian Melloy, and Anand Gramopadhye. 2009. On Spatiochromatic Visual Sensitivity and Peripheral Color LOD Management. ACM Transactions on Applied Perception 6, 2 (2009).

Digital Library

[4]

Brian Guenter, Mark Finch, Steven Drucker, Desney Tan, and John Snyder. 2012. Foveated 3D Graphics. ACM Transactions on Graphics 31, 6 (2012).

Digital Library

[5]

Matias Koskela, Timo Viitanen, Pekka Jääskeläinen, and Jarmo Takala. 2016. Foveated Path Tracing. In Proceedings of the International Symposium on Visual Computing.

[6]

The community of LuxRender. 2013. LuxRender Documentation: Refine Brush. Available: http://www.luxrender.net/wiki/Refine_Brush, Referenced: 26th of May 2017.

[7]

Andrew MacQuarrie and Anthony Steed. 2017. Cinematic Virtual Reality: Evaluating the Effect of Display Type on the Viewing Experience for Panoramic Video. In Proceedings of the IEEE Virtual Reality.

[8]

Hunter Murphy, Andrew Duchowski, and Richard Tyrrell. 2009. Hybrid Image/Model-Based Gaze-Contingent Rendering. ACM Transactions on Applied Perception 5, 4 (2009).

Digital Library

[9]

Matt Pharr and Greg Humphreys. 2010. Physically Based Rendering: From Theory to Implementation (2nd ed.). Morgan Kaufmann.

Digital Library

[10]

Pixar. 2017. RenderMan 20 Documentation: Rendering Efficiently. Available: https://renderman.pixar.com/resources/RenderMan_20/tutorialRenderingEfficiently. html, Referenced: 26th of May 2017.

[11]

Daniel Pohl, Xucong Zhang, and Andreas Bulling. 2016. Combining Eye Tracking with Optimizations for Lens Astigmatism in Modern Wide-Angle HMDs. In Proceedings of the Virtual Reality.

[12]

Martin Reddy. 2001. Perceptually Optimized 3D Graphics. IEEE computer Graphics and Applications 21, 5 (2001).

Digital Library

[13]

Thorsten Roth, Martin Weier, Jens Maiero, André Hinkenjann, and Yongmin Li. 2015. Guided High-Quality Rendering. In Proceedings of the International Symposium on Visual Computing.

[14]

Takashi Shibata. 2002. Head mounted display. Displays 23, 1--2 (2002).

[15]

Michael Stengel, Steve Grogorick, Martin Eisemann, and Marcus Magnor. 2016. Adaptive Image-Space Sampling for Gaze-Contingent Real-time Rendering. Computer Graphics Forum 35, 4 (2016).

Digital Library

[16]

Karthik Vaidyanathan, Marco Salvi, Robert Toth, Tim Foley, Tomas Akenine-Möller, Jim Nilsson, Jacob Munkberg, Jon Hasselgren, Masamichi Sugihara, Petrik Clarberg, et al. 2014. Coarse Pixel Shading. In Proceedings of High Performance Graphics.

Digital Library

[17]

Martin Weier, Thorsten Roth, Ernst Kruijff, André Hinkenjann, Arsène Pérard-Gayot, Philipp Slusallek, and Yongmin Li. 2016. Foveated Real-Time Ray Tracing for Head-Mounted Displays. 35, 7 (2016).

Digital Library

[18]

Martin Weier, Michael Stengel, Thorsten Roth, Piotr Didyk, Elmar Eisemann, Martin Eisemann, Steve Grogorick, André Hinkenjann, Ernst Kruijff, Marcus Magnor, Karol Myszkowski, and Philipp Slusallek. 2017. Perception-driven Accelerated Rendering. Computer Graphics Forum 36, 2 (2017).

Digital Library

[19]

Eric Weisstein. 2002. Lambert W-function. Online. (2002). Available: http://mathworld.wolfram.com/LambertW-Function.html, Referenced: 1st of June 2017.

Cited By

Shi XWang LWu JKe WLam C(2023)Locomotion-aware Foveated Rendering2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00062(471-481)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00062
Wang LShi XLiu Y(2023)Foveated rendering: A state-of-the-art surveyComputational Visual Media10.1007/s41095-022-0306-49:2(195-228)Online publication date: 3-Jan-2023
https://doi.org/10.1007/s41095-022-0306-4

Index Terms

Foveated instant preview for progressive rendering
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
    2. Rendering
      1. Ray tracing

Recommendations

Foveated Depth-of-Field Filtering in Head-Mounted Displays

In recent years, a variety of methods have been introduced to exploit the decrease in visual acuity of peripheral vision, known as foveated rendering. As more and more computationally involved shading is requested and display resolutions increase, ...
Towards foveated rendering for gaze-tracked virtual reality

Foveated rendering synthesizes images with progressively less detail outside the eye fixation region, potentially unlocking significant speedups for wide field-of-view displays, such as head mounted displays, where target framerate and resolution is ...
Kernel Foveated Rendering

Foveated rendering coupled with eye-tracking has the potential to dramatically accelerate interactive 3D graphics with minimal loss of perceptual detail. In this paper, we parameterize foveated rendering by embedding polynomial kernel functions in the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SA '17: SIGGRAPH Asia 2017 Technical Briefs

November 2017

108 pages

ISBN:9781450354066

DOI:10.1145/3145749

Conference Chairs:
Diego Gutierrez
University of Zaragoza, Spain
,
Hui Huang
Shenzhen University, China

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 November 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SA '17

Sponsor:

SIGGRAPH

SA '17: SIGGRAPH Asia 2017

November 27 - 30, 2017

Bangkok, Thailand

Acceptance Rates

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
438
Total Downloads

Downloads (Last 12 months)100
Downloads (Last 6 weeks)15

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Shi XWang LWu JKe WLam C(2023)Locomotion-aware Foveated Rendering2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00062(471-481)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00062
Wang LShi XLiu Y(2023)Foveated rendering: A state-of-the-art surveyComputational Visual Media10.1007/s41095-022-0306-49:2(195-228)Online publication date: 3-Jan-2023
https://doi.org/10.1007/s41095-022-0306-4

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten