Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Real-time Subsurface Control Variates: Temporally Stable Adaptive Sampling

Published: 28 April 2021 Publication History

Abstract

Real-time adaptive sampling is a new technique recently proposed for efficient importance sampling in realtime Monte Carlo sampling in subsurface scattering. It adaptively places samples based on variance tracking to help escape the uncanny valley of subsurface rendering. However, the occasional performance drop due to temporal lighting dynamics (e.g., guns or lights turning on and off) could hinder adoption in games or other applications where smooth high frame rate is preferred. In this paper we propose a novel usage of Control Variates (CV) in the sample domain instead of shading domain to maintain a consistent low pass time. Our algorithm seamlessly reduces to diffuse with zero scattering samples for sub-pixel scattering. We propose a novel joint-optimization algorithm for sample count and CV coefficient estimation. The main enabler is our novel time-variant covariance updating method that helps remove the effect of recent temporal dynamics from variance tracking. Since bandwidth is critical in real-time rendering, a solution without adding any extra textures is also provided.

Supplementary Material

xie (xie.zip)
Supplemental movie, appendix, image and software files for, Real-time Subsurface Control Variates: Temporally Stable Adaptive Sampling

References

[1]
Carol Alexander. 1999. Risk Management and Analysis. Volume 1: Measuring and Modelling Financial Risk.
[2]
Brent Burley. 2015. Extending the Disney BRDF to a BSDF with integrated subsurface scattering. In SIGGRAPH Course: Physically Based Shading in Theory and Practice. ACM, New York, NY, 19 pages.
[3]
Per H. Christensen and Brent Burley. 2015. Approximate Reflectance Profiles for Efficient Subsurface Scattering. Technical Report. Pixar.
[4]
Holger Dammertz, Johannes Hanika, Alexander Keller, and Hendrik Lensch. 2010. A hierarchical automatic stopping condition for Monte Carlo global illumination. In Eurographics WSCG 2010: Full Paper Proceedings. Václav Skala-UNION Agency, 159--164.
[5]
Eugene d'Eon and David Luebke. 2007. Advanced techniques for realistic real-time skin rendering. GPU Gems 3, 3 (2007), 293--347.
[6]
Shaohua Fan, Stephen Chenney, Bo Hu, Kam-Wah Tsui, and Yu-chi Lai. 2006. Optimizing control variate estimators for rendering. Computer Graphics Forum 25, 3 (2006), 351--357.
[7]
Tony Finch. 2009. Incremental calculation of weighted mean and variance. University of Cambridge 4, 11--5 (2009), 41--42.
[8]
Evgenii Golubev. 2018. Efficient screen-space subsurface scattering using Burley's normalized diffusion in real-time. In SIGGRAPH 2018 Courses: Advances in Real-Time Rendering.
[9]
Till Guldimann, Peter Zangari, Jacques Longerstaey, John Matero, and Scott Howard. 1995. RiskMetrics Technical Document. Technical Report. Morgan Guaranty Trust Company.
[10]
Timothy C Hesterberg and Barry L Nelson. 1998. Control variates for probability and quantile estimation. Management Science 44, 9 (1998), 1295--1312.
[11]
Henrik Wann Jensen, Stephen R Marschner, Marc Levoy, and Pat Hanrahan. 2001. A practical model for subsurface light transport. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques. ACM, New York, NY, 511--518.
[12]
Jorge Jimenez, Veronica Sundstedt, and Diego Gutierrez. 2009. Screen-space perceptual rendering of human skin. ACM Transactions on Applied Perception (TAP) 6, 4 (2009), 23.
[13]
Jorge Jimenez, Károly Zsolnai, Adrian Jarabo, Christian Freude, Thomas Auzinger, Xian-Chun Wu, Javier von der Pahlen, Michael Wimmer, and Diego Gutierrez. 2015. Separable Subsurface Scattering. Computer Graphics Forum 34, 6 (Sept. 2015), 188--197.
[14]
David Kirk and James Arvo. 1991. Unbiased sampling techniques for image synthesis. ACM SIGGRAPH Computer Graphics 25, 4 (1991), 153--156.
[15]
Ivo Kondapaneni, Petr Vévoda, Pascal Grittmann, Tomáš Skřivan, Philipp Slusallek, and Jaroslav Křivánek. 2019. Optimal multiple importance sampling. ACM Transactions on Graphics (TOG) 38, 4 (2019), 1--14.
[16]
Stephen S Lavenberg, Thomas L Moeller, and Peter D Welch. 1982. Statistical results on control variables with application to queueing network simulation. Operations Research 30, 1 (1982), 182--202.
[17]
Bochang Moon, Nathan Carr, and Sung-Eui Yoon. 2014. Adaptive rendering based on weighted local regression. ACM Transactions on Graphics (TOG) 33, 5 (2014), 1--14.
[18]
Thomas Müller, Fabrice Rousselle, Alexander Keller, and Jan Novák. 2020. Neural Control Variates. ACM Trans. Graph. 39, 6, Article 243 (Dec. 2020), 19 pages. https://doi.org/10.1145/3414685.3417804
[19]
Barry L Nelson. 1990. Control variate remedies. Operations Research 38, 6 (1990), 974--992.
[20]
Jan Novák, Andrew Selle, and Wojciech Jarosz. 2014. Residual ratio tracking for estimating attenuation in participating media. ACM Trans. Graph. 33, 6 (2014), 179--1.
[21]
Eric Penner and George Borshukov. 2011. Pre-integrated skin shading. GPU Pro 2 (2011), 41--55.
[22]
Matt Pharr, Wenzel Jakob, and Greg Humphreys. 2016. Physically based rendering: From theory to implementation. Morgan Kaufmann, Cambridge, MA.
[23]
Brian D Ripley. 2009. Stochastic simulation. Vol. 316. John Wiley & Sons, New Jersey.
[24]
Fabrice Rousselle, Wojciech Jarosz, and Jan Novák. 2016. Image-space control variates for rendering. ACM Transactions on Graphics (TOG) 35, 6 (2016), 1--12.
[25]
László Szécsi, Mateu Sbert, and László Szirmay-Kalos. 2004. Combined correlated and importance sampling in direct light source computation and environment mapping. Computer Graphics Forum 23, 3 (2004), 585--593.
[26]
Ruey S Tsay. 2005. Analysis of financial time series. Vol. 543. John Wiley & Sons, New Jersey.
[27]
Greg Welch, Gary Bishop, et al. 1995. An introduction to the Kalman filter.
[28]
BP Welford. 1962. Note on a method for calculating corrected sums of squares and products. Technometrics 4, 3 (1962), 419--420.
[29]
Tiantian Xie, Marc Olano, Brian Karis, and Krzysztof Narkowicz. 2020. Real-time subsurface scattering with single pass variance-guided adaptive importance sampling. Proceedings of the ACM on Computer Graphics and Interactive Techniques 3, 1 (2020), 1--21.

Cited By

View all
  • (2023)Recursive Control Variates for Inverse RenderingACM Transactions on Graphics10.1145/359213942:4(1-13)Online publication date: 26-Jul-2023

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Computer Graphics and Interactive Techniques
Proceedings of the ACM on Computer Graphics and Interactive Techniques  Volume 4, Issue 1
April 2021
274 pages
EISSN:2577-6193
DOI:10.1145/3463840
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 April 2021
Published in PACMCGIT Volume 4, Issue 1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Real-time adaptive sampling
  2. control variates
  3. subsurface scattering

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)26
  • Downloads (Last 6 weeks)3
Reflects downloads up to 26 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Recursive Control Variates for Inverse RenderingACM Transactions on Graphics10.1145/359213942:4(1-13)Online publication date: 26-Jul-2023

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media