article

Direct-to-indirect transfer for cinematic relighting

Authors:

Fabio Pellacini,

Kavita BalaAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 25, Issue 3

Pages 1089 - 1097

https://doi.org/10.1145/1141911.1141998

Published: 01 July 2006 Publication History

Abstract

This paper presents an interactive GPU-based system for cinematic relighting with multiple-bounce indirect illumination from a fixed view-point. We use a deep frame-buffer containing a set of view samples, whose indirect illumination is recomputed from the direct illumination on a large set of gather samples, distributed around the scene. This direct-to-indirect transfer is a linear transform which is particularly large, given the size of the view and gather sets. This makes it hard to precompute, store and multiply with. We address this problem by representing the transform as a set of sparse matrices encoded in wavelet space. A hierarchical construction is used to impose a wavelet basis on the unstructured gather cloud, and an image-based approach is used to map the sparse matrix computations to the GPU. We precompute the transfer matrices using a hierarchical algorithm and a variation of photon mapping in less than three hours on one processor. We achieve high-quality indirect illumination at 10-20 frames per second for complex scenes with over 2 million polygons, with diffuse and glossy materials, and arbitrary direct lighting models (expressed using shaders). We compute per-pixel indirect illumination without the need of irradiance caching or other subsampling techniques.

Supplementary Material

JPG File (p1089-hasan-high.jpg)

Download
15.45 KB

JPG File (p1089-hasan-low.jpg)

Download
13.72 KB

High Resolution (p1089-hasan-high.mov)

Download
116.71 MB

Low Resolution (p1089-hasan-low.mov)

Download
26.45 MB

References

[1]

Annen, T., Kautz, J., Durand, F., and Seidel, H.-P. 2004. Spherical harmonic gradients for mid-range illumination. In Rendering Techniques 2004 Eurographics Symposium on Rendering, 331--336.]]

[2]

Arikan, O., Forsyth, D. A., and O'Brien, J. F. 2005. Fast and detailed approximate global illumination by irradiance decomposition. In Proceedings of ACM SIGGRAPH 2005, 1108--1114.]]

Digital Library

[3]

Bala, K., Dorsey, J., and Teller, S. 1999. Interactive ray-traced scene editing using ray segment trees. In 10th Eurographics Workshop on Rendering, 39--52.]]

[4]

Bala, K., Dorsey, J., and Teller, S. 1999. Radiance interpolants for accelerated bounded-error ray tracing. ACM Transactions on Graphics 18, 3, 213--256.]]

Digital Library

[5]

Bala, K., Walter, B., and Greenberg, D. 2003. Combining edges and points for interactive high-quality rendering. In Proceedings of ACM SIGGRAPH 2003, 631--640.]]

Digital Library

[6]

Barzel, R. 1997. Lighting controls for computer cinematography. Journal of Graphics Tools 2, 1, 1--20.]]

Digital Library

[7]

Bolz, J., Farmer, I., Grinspun, E., and Schröder, P. 2003. Sparse matrix solvers on the gpu: conjugate gradients and multigrid. Proceedings of ACM SIGGRAPH 2003, 917--924.]]

Digital Library

[8]

Briére, N., and Poulin, P. 1996. Hierarchical view-dependent structures for interactive scene manipulation. In Proceedings of ACM SIGGRAPH 96, 83--90.]]

Digital Library

[9]

Dayal, A., Woolley, C., Watson, B., and Luebke, D. 2005. Adaptive frameless rendering. In Proceedings of Eurographics Symposium on Rendering.]]

[10]

Dmitriev, K., Brabec, S., Myszkowski, K., and Seidel, H.-P. 2002. Interactive Global Illumination Using Selective Photon Tracing. In 13th Eurographics Workshop on Rendering, 25--36.]]

Digital Library

[11]

Drettakis, G., and Sillion, F. 1997. Interactive Update of Global Illumination Using A Line-Space Hierarchy. In Proceedings of ACM SIGGRAPH 97, 57--64.]]

Digital Library

[12]

Gautron, P., Krivanek, J., Bouatouch, K., and Pattanaik, S. 2005. Radiance cache splatting: A gpu-friendly global illumination algorithm. In Proceedings of Eurographics Symposium on Rendering.]]

[13]

Gershbein, R., and Hanrahan, P. M. 2000. A fast relighting engine for interactive cinematic lighting design. In Proceedings of ACM SIGGRAPH 2000, 353--358.]]

Digital Library

[14]

Gortler, S. J., Schröder, P., Cohen, M. F., and Hanrahan, P. 1993. Wavelet radiosity. In Proceedings of ACM SIGGRAPH 93, 221--230.]]

Digital Library

[15]

Hanrahan, P., Salzman, D., and Aupperle, L. 1991. A rapid hierarchical radiosity algorithm. Proceedings of ACM SIGGRAPH 91, 197--206.]]

Digital Library

[16]

Jensen, H. W. 1996. Global illumination using photon maps. In Proceedings of the Eurographics workshop on Rendering techniques '96, 21--30.]]

[17]

Kautz, J., Sloan, P.-P., and Snyder, J. 2002. Fast, arbitrary brdf shading for low-frequency lighting using spherical harmonics. In EGRW '02: Proceedings of the 13th Eurographics workshop on Rendering, 291--296.]]

Digital Library

[18]

Kristensen, A. W., Akenine-Möller, T., and Jensen, H. W. 2005. Precomputed local radiance transfer for real-time lighting design. Proceedings of ACM SIGGRAPH 2005, 1208--1215.]]

Digital Library

[19]

Liu, X., Sloan, P.-P. J., Shum, H.-Y., and Snyder, J. 2004. All-frequency precomputed radiance transfer for glossy objects. In Proceedings of Eurographics Symposium on Rendering, 337--344.]]

[20]

Ng, R., Ramamoorthi, R., and Hanrahan, P. 2003. All-frequency shadows using non-linear wavelet lighting approximation. Proceedings of ACM SIGGRAPH 2003, 376--381.]]

Digital Library

[21]

Ng, R., Ramamoorthi, R., and Hanrahan, P. 2004. Triple product wavelet integrals for all-frequency relighting. Proceedings of ACM SIGGRAPH 2004, 477--487.]]

Digital Library

[22]

Pellacini, F., Vidim&ccirc;e?, K., Lefohn, A., Mohr, A., Leone, M., and Warren, J. 2005. Lpics: a hybrid hardware-accelerated relighting engine for computer cinematography. Proceedings of ACM SIGGRAPH 2005, 464--470.]]

Digital Library

[23]

Saito, T., and Takahashi, T. 1990. Comprehensible rendering of 3-d shapes. In Proceedings of ACM SIGGRAPH 90, 197--206.]]

Digital Library

[24]

Saito, T., and Takahashi, T. 1990. Comprehensible rendering of 3-d shapes. In Proceedings of ACM SIGGRAPH 90, 197--206.]]

Digital Library

[25]

Séquin, C. H., and Smyrl, E. K. 1989. Parameterized ray tracing. In Proceedings of ACM SIGGRAPH 89, 307--314.]]

Digital Library

[26]

Sloan, P.-P., Kautz, J., and Snyder, J. 2002. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. In Proceedings of ACM SIGGRAPH 2002, 527--536.]]

Digital Library

[27]

Smits, B. E., Arvo, J. R., and Salesin, D. H. 1992. An importance-driven radiosity algorithm. In Proceedings of ACM SIGGRAPH 92, 273--282.]]

Digital Library

[28]

Tabellion, E., and Lamorlette, A. 2004. An approximate global illumination system for computer generated films. Proceedings of ACM SIGGRAPH 2005, 469--476.]]

Digital Library

[29]

Tole, P., Pellacini, F., Walter, B., and Greenberg, D. P. 2002. Interactive global illumination in dynamic scenes. Proceedings of ACM SIGGRAPH 2002, 537--546.]]

Digital Library

[30]

Wald, I., Kollig, T., Benthin, C., Keller, A., and Slusallek, P. 2002. Interactive Global Illumination. In 13th Eurographics Workshop on Rendering, 15--24.]]

Digital Library

[31]

Walter, B., Drettakis, G., and Parker, S. 1999. Interactive rendering using the Render Cache. In 10th Eurographics Workshop on Rendering, 19--30.]]

[32]

Walter, B., Drettakis, G., and Greenberg, D. 2002. Enhancing and optimizing the Render Cache. In 13th Eurographics Workshop on Rendering, 37--42.]]

Digital Library

[33]

Walter, B., Fernandez, S., Arbree, A., Bala, K., Donikian, M., and Greenberg, D. P. 2005. Lightcuts: A scalable approach to illumination. In Proceedings of ACM SIGGRAPH 2005, 1098--1107.]]

Digital Library

[34]

Wang, R., Tran, J., and Luebke, D. P. 2004. All-frequency relighting of non-diffuse objects using separable brdf approximation. In Proceedings of Eurographics Symposium on Rendering, 345--354.]]

[35]

Wang, R., Tran, J., and Luebke, D. 2005. All-frequency interactive relighting of translucent objects with single and multiple scattering. Proceedings of ACM SIGGRAPH 2005, 1202--1207.]]

Digital Library

[36]

Ward, G., and Simmons, M. 1999. The holodeck ray cache: an interactive rendering system for global illumination in nondiffuse environments. ACM Transactions on Graphics 18, 4, 361--368.]]

Digital Library

[37]

Ward, G. J., Rubinistein, F. M., and Clear, R. D. 1988. A ray tracing solution for diffuse interreflection. In Proceedings of ACM SIGGRAPH 88, 85--92.]]

Digital Library

Cited By

Raghavan NXiao YLin KSun TBi SXu ZLi TRamamoorthi R(2023)Neural Free‐Viewpoint Relighting for Glossy Indirect IlluminationComputer Graphics Forum10.1111/cgf.1488542:4Online publication date: 26-Jul-2023
https://doi.org/10.1111/cgf.14885
Xin HZheng SXu KYan L(2022)Lightweight Bilateral Convolutional Neural Networks for Interactive Single-Bounce Diffuse Indirect IlluminationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.302312928:4(1824-1834)Online publication date: 1-Apr-2022
https://doi.org/10.1109/TVCG.2020.3023129
Hermosilla PMaisch SRitschel TRopinski T(2019)Deep‐learning the Latent Space of Light TransportComputer Graphics Forum10.1111/cgf.1378338:4(207-217)Online publication date: 30-Jul-2019
https://doi.org/10.1111/cgf.13783
Show More Cited By

Index Terms

Direct-to-indirect transfer for cinematic relighting
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
      1. Texturing

Recommendations

Direct-to-indirect transfer for cinematic relighting
SIGGRAPH '06: ACM SIGGRAPH 2006 Papers

This paper presents an interactive GPU-based system for cinematic relighting with multiple-bounce indirect illumination from a fixed view-point. We use a deep frame-buffer containing a set of view samples, whose indirect illumination is recomputed from ...
Interactive relighting with dynamic BRDFs

We present a technique for interactive relighting in which source radiance, viewing direction, and BRDFs can all be changed on the fly. In handling dynamic BRDFs, our method efficiently accounts for the effects of BRDF modification on the reflectance ...
Interactive relighting with dynamic BRDFs
SIGGRAPH '07: ACM SIGGRAPH 2007 papers

We present a technique for interactive relighting in which source radiance, viewing direction, and BRDFs can all be changed on the fly. In handling dynamic BRDFs, our method efficiently accounts for the effects of BRDF modification on the reflectance ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 25, Issue 3

July 2006

742 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1141911

Issue’s Table of Contents

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2006

Published in TOG Volume 25, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

96
Total Citations
View Citations
1,418
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Raghavan NXiao YLin KSun TBi SXu ZLi TRamamoorthi R(2023)Neural Free‐Viewpoint Relighting for Glossy Indirect IlluminationComputer Graphics Forum10.1111/cgf.1488542:4Online publication date: 26-Jul-2023
https://doi.org/10.1111/cgf.14885
Xin HZheng SXu KYan L(2022)Lightweight Bilateral Convolutional Neural Networks for Interactive Single-Bounce Diffuse Indirect IlluminationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.302312928:4(1824-1834)Online publication date: 1-Apr-2022
https://doi.org/10.1109/TVCG.2020.3023129
Hermosilla PMaisch SRitschel TRopinski T(2019)Deep‐learning the Latent Space of Light TransportComputer Graphics Forum10.1111/cgf.1378338:4(207-217)Online publication date: 30-Jul-2019
https://doi.org/10.1111/cgf.13783
Zhang GKong F(2019)Depth Learning Method of Many Light Rendering based on Matrix Row and Column Sampling2019 6th International Conference on Systems and Informatics (ICSAI)10.1109/ICSAI48974.2019.9010518(849-854)Online publication date: Nov-2019
https://doi.org/10.1109/ICSAI48974.2019.9010518
Miyagawa IKinebuchi T(2017)[Paper] Compressive Inverse Light Transport for Radiometric Compensation in Projection-based DisplaysITE Transactions on Media Technology and Applications10.3169/mta.5.965:3(96-109)Online publication date: 2017
https://doi.org/10.3169/mta.5.96
Silvennoinen ALehtinen J(2017)Real-time global illumination by precomputed local reconstruction from sparse radiance probesACM Transactions on Graphics10.1145/3130800.313085236:6(1-13)Online publication date: 20-Nov-2017
https://dl.acm.org/doi/10.1145/3130800.3130852
Blumer ANovák JHabel RNowrouzezahrai DJarosz W(2016)Reduced Aggregate Scattering Operators for Path TracingComputer Graphics Forum10.5555/3151666.315171335:7(461-473)Online publication date: 1-Oct-2016
https://dl.acm.org/doi/10.5555/3151666.3151713
Günther TRohmer KRössl CGrosch TTheisel HGomes APurgathofer WJorge JLin M(2016)Stylized causticsProceedings of the 37th Annual Conference of the European Association for Computer Graphics10.5555/3058909.3058941(243-252)Online publication date: 9-May-2016
https://dl.acm.org/doi/10.5555/3058909.3058941
MIYAGAWA ITANIGUCHI Y(2016)Dense Light Transport for Relighting Computation Using Orthogonal Illumination Based on Walsh-Hadamard MatrixIEICE Transactions on Information and Systems10.1587/transinf.2015CYP0002E99.D:4(1038-1051)Online publication date: 2016
https://doi.org/10.1587/transinf.2015CYP0002
Göbel AGoldberg LRicherby D(2016)Counting Homomorphisms to Square-Free Graphs, Modulo 2ACM Transactions on Computation Theory10.1145/28984418:3(1-29)Online publication date: 25-May-2016
https://dl.acm.org/doi/10.1145/2898441
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents