article

All-frequency relighting of glossy objects

Authors:

David LuebkeAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 25, Issue 2

Pages 293 - 318

https://doi.org/10.1145/1138450.1138456

Published: 01 April 2006 Publication History

Abstract

We present a technique for interactive rendering of glossy objects in complex and dynamic lighting environments that captures interreflections and all-frequency shadows. Our system is based on precomputed radiance transfer and separable BRDF approximation. We factor glossy BRDFs using a separable decomposition and keep only a few low-order approximation terms, each consisting of a purely view-dependent and a purely light-dependent component. In the precomputation step, for every vertex, we sample its visibility and compute a direct illumination transport vector corresponding to each BRDF term. We use modern graphics hardware to accelerate this step and further compress the data using a nonlinear wavelet approximation. The direct illumination pass is followed by one or more interreflection passes, each of which gathers compressed transport vectors from the previous pass to produce global illumination transport vectors. To render at run time, we dynamically sample the lighting to produce a light vector, also represented in a wavelet basis. We compute the inner product of the light vector with the precomputed transport vectors, and the results are further combined with the BRDF view-dependent components to produce vertex colors. We describe acceleration of the rendering algorithm using programmable graphics hardware and discuss the limitations and trade-offs imposed by the hardware.

References

[1]

Agrawala, M., Ramamoorthi, R., Heirich, A., and Moll, L. 2000. Efficient image-based methods for rendering soft shadows. In Proceedings of SIGGRAPH. 375--384.

Digital Library

[2]

Ashikhmin, M. and Shirley, P. 2000. An anisotropic phong BRDF model. J. Graph. Tools 5, 2, 25--32.

Digital Library

[3]

Ashikhmin, M. and Shirley, P. 2002. Steerable illumination textures. ACM Trans. Graph. 21, 1, 1--19.

Digital Library

[4]

Blinn, J. and Newell, M. 1976. Texture and reflection in computer generated images. Comm. ACM 19, 10, 542--547.

Digital Library

[5]

Bolz, J., Farmer, I., Grinspun, E., and Schröder, P. 2003. Sparse matrix solvers on the GPU: Conjugate gradients and multigrid. ACM Trans. Graph. 22, 3, 917--924.

Digital Library

[6]

Cabral, B., Max, N., and Springmeyer, R. 1987. Bidirectional reflection functions from surface bump maps. In Proceedings of SIGGRAPH. 273--281.

Digital Library

[7]

Chen, W.-C., Bouguet, J.-Y., Chu, M., and Grzeszczuk, R. 2002. Light field mapping: Efficient representation and hardware rendering of surface light fields. In ACM Trans. Graph. 21, 447--456.

Digital Library

[8]

Cohen, M. and Wallace, J. 1993. Radiosity and Realistic Image Synthesis. Academic Press.

Digital Library

[9]

Debevec, P., Hawkins, T., Tchou, C., Duiker, H.-P., Sarokin, W., and Sagar, M. 2000. Acquiring the reflectance field of a human face. In Proceedings of SIGGRAPH. 145--156.

Digital Library

[10]

DeYoung, J. and Fournier, A. 1997. Properties of tabulated bidirectional reflectance distribution functions. In Proceedings of Graphics Interface. 47--55.

Digital Library

[11]

Dorsey, J., Sillion, F. X., and Greenberg, D. 1991. Design and simulation of opera lighting and projection effects. In Proceedings of SIGGRAPH. 41--50.

Digital Library

[12]

Fournier, A. 1995. Separating reflection functions for linear radiosity. In Proceedings of the 6th Eurographics Rendering Workshop. 383--392.

[13]

Gortler, S., Grzeszczuk, R., Szeliski, R., and Cohen, M. F. 1996. The lumigraph. In Proceedings of SIGGRAPH. 43--54.

Digital Library

[14]

Greene, N. 1986. Environment mapping and other applications of world projections. IEEE Comput. Graph. Appl. 6, 11, 21--29.

Digital Library

[15]

Heidrich, W., Daubert, K., Kautz, J., and Seidel, H.-P. July 2000. Illuminating micro geometry based on precomputed visibility. In Proceedings of SIGGRAPH. 455--464.

Digital Library

[16]

Jensen, H. 1996. Global illumination using photon maps. In Proceedings of the 7th Eurographics Rendering Workshop. 21--30.

Digital Library

[17]

Kajiya, J. 1986. The rendering equation. In Proceedings of SIGGRAPH. 143--150.

Digital Library

[18]

Kautz, J. and McCool, M. 1999. Interactive rendering with arbitrary BRDFs using separable approximations. In Proceedings of the 10th Eurographics Rendering Workshop. 281--292.

Digital Library

[19]

Kautz, J. and McCool, M. 2000. Approximation of glossy reflection with prefiltered environment maps. In Proceedings of Graphics Interface. 119--126.

[20]

Kautz, J., Sloan, P.-P., and Snyder, J. 2002. Fast, arbitrary BRDF shading for low-frequency lighting using spherical harmonics. In Proceedings of the 13th Eurographics Rendering Workshop. 291--296.

Digital Library

[21]

Krüger, J. and Westermann, R. 2003. Linear algebra operators for GPU implementation of numerical algorithms. ACM Trans. Graph. 22, 3, 908--916.

Digital Library

[22]

Lafortune, E., Foo, S.-C., Torrance, K., and Greenberg, D. 1997. Non-linear approximation of reflectance functions. In Proceedings of SIGGRAPH. Vol. 31, 117--126.

Digital Library

[23]

Lawrence, J., Rusinkiewicz, S., and Ramamoorthi, R. 2004. Efficient BRDF importance sampling using a factored representation. ACM Trans. Graph. 23, 3, 496--505.

Digital Library

[24]

Lee, D. and Seung, H. 1999. Learning the parts of objects by non-negative matrix factorization. Nature 401, 6755, 788--791.

[25]

Lehtinen, J. and Kautz, J. 2003. Matrix radiance transfer. In ACM Symposium on Interactive 3D graphics. 59--64.

Digital Library

[26]

Levoy, M. and Hanrahan, P. 1996. Light field rendering. In Proceedings of SIGGRAPH. 31--42.

Digital Library

[27]

Liu, X., Sloan, P.-P., Shum, H.-Y., and Snyder, J. 2004. All-frequency precomputed radiance transfer for glossy objects. In Proceedings of the 15th Eurographics Symposium on Rendering. 337--344.

Digital Library

[28]

Malzbender, T., Gelb, D., and Wolters, H. 2001. Polynomial texture maps. In Proceedings of SIGGRAPH. 519--528.

Digital Library

[29]

McCool, M., Ang, J., and Ahmad, A. 2001. Homomorphic factorization of BRDFs for high-performance rendering. In Proceedings of SIGGRAPH. 171--178.

Digital Library

[30]

Ng, R., Ramamoorthi, R., and Hanrahan, P. 2003. All-frequency shadows using nonlinear wavelet lighting approximation. ACM Trans. Graph. 22, 3, 376--381.

Digital Library

[31]

Ng, R., Ramamoorthi, R., and Hanrahan, P. 2004. Triple product wavelet integrals for all-frequency relighting. ACM Trans. Graph. 23, 3, 477--487.

Digital Library

[32]

Peers, P. and Dutré, P. 2003. Wavelet environment matting. In Proceedings of the 14th Eurographics Symposium on Rendering. 157--166.

Digital Library

[33]

Ramamoorthi, R. and Hanrahan, P. 2001. An efficient representation for irradiance environment maps. In Proceedings of SIGGRAPH. 497--500.

Digital Library

[34]

Ramamoorthi, R. and Hanrahan, P. 2002. Frequency space environment map rendering. In ACM Trans. Graph. 21, 517--526.

Digital Library

[35]

Rusinkiewicz, S. 1998. A new change of variables for efficient BRDF representation. In Proceedings of the 9th Eurographics Rendering Workshop. 11--22.

[36]

Sillion, F., Arvo, J., Westin, S., and Greenberg, D. 1991. A global illumination solution for general reflectance distributions. In Proceedings of SIGGRAPH. 187--196.

Digital Library

[37]

Sloan, P.-P., Hall, J., Hart, J., and Snyder, J. 2003. Clustered principal components for precomputed radiance transfer. ACM Trans. Graph. 23, 3, 382--391.

Digital Library

[38]

Sloan, P.-P., Kautz, J., and Snyder, J. 2002. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. In ACM Trans. Graph. 21, 527--536.

Digital Library

[39]

Soler, C. and Sillion, F. X. 1998. Fast calculation of soft shadow textures using convolution. In Proceedings of SIGGRAPH. 321--332.

Digital Library

[40]

Suykens, F., vom Berge, K., Lagae, A., and Dutré, P. 2003. Interactive rendering with bidirectional texture functions. Eurographics Computer Graphics Forum 22, 3.

[41]

Veach, E. 1997. Robust monte carlo methods for light transport simulation. Ph.D. thesis, Department of Computer Science, Stanford University.

Digital Library

[42]

Wang, R., Tran, J., and Luebke, D. 2004. All-frequency relighting of non-diffuse objects using separable BRDF approximation. In Proceedings of the 15th Eurographics Symposium on Rendering. 345--354.

Digital Library

[43]

Westin, S., Arvo, J., and Torrance, K. 1992. Predicting reflectance functions from complex surfaces. In Proceedings of SIGGRAPH. 255--264.

Digital Library

[44]

Wood, D., Azuma, D., Aldinger, K., Curless, B., Duchamp, T., Salesin, D., and Stuetzle, W. 2000. Surface light fields for 3D photography. In Proceedings of SIGGRAPH. 287--296.

Digital Library

[45]

Zongker, D., Werner, D., Curless, B., and Salesin, D. 1999. Environment matting and compositing. In Proceedings of SIGGRAPH. 205--214.

Digital Library

Cited By

Xing YPan GChen XWu JWang LWang B(2024)Real-time all-frequency global illumination with radiance cachingComputational Visual Media10.1007/s41095-023-0367-z10:5(923-936)Online publication date: 21-Sep-2024
https://doi.org/10.1007/s41095-023-0367-z
Raghavan NXiao YLin KSun TBi SXu ZLi TRamamoorthi R(2023)Neural Free‐Viewpoint Relighting for Glossy Indirect IlluminationComputer Graphics Forum10.1111/cgf.1488542:4Online publication date: 26-Jul-2023
https://doi.org/10.1111/cgf.14885
Gao DMu HXu K(2023)Neural Global Illumination: Interactive Indirect Illumination Prediction Under Dynamic Area LightsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320996329:12(5325-5341)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1109/TVCG.2022.3209963
Show More Cited By

Index Terms

All-frequency relighting of glossy objects
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics

Recommendations

Interactive relighting with dynamic BRDFs
SIGGRAPH '07: ACM SIGGRAPH 2007 papers

We present a technique for interactive relighting in which source radiance, viewing direction, and BRDFs can all be changed on the fly. In handling dynamic BRDFs, our method efficiently accounts for the effects of BRDF modification on the reflectance ...
All-frequency interactive relighting of translucent objects with single and multiple scattering
SIGGRAPH '05: ACM SIGGRAPH 2005 Papers

We present a technique, based on precomputed light transport, for interactive rendering of translucent objects under all-frequency environment maps. We consider the complete BSSRDF model proposed by Jensen et al. [2001]. which includes both single and ...
All-frequency interactive relighting of translucent objects with single and multiple scattering

We present a technique, based on precomputed light transport, for interactive rendering of translucent objects under all-frequency environment maps. We consider the complete BSSRDF model proposed by Jensen et al. [2001]. which includes both single and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 25, Issue 2

April 2006

288 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1138450

Issue’s Table of Contents

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 April 2006

Published in TOG Volume 25, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

59
Total Citations
View Citations
729
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)2

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xing YPan GChen XWu JWang LWang B(2024)Real-time all-frequency global illumination with radiance cachingComputational Visual Media10.1007/s41095-023-0367-z10:5(923-936)Online publication date: 21-Sep-2024
https://doi.org/10.1007/s41095-023-0367-z
Raghavan NXiao YLin KSun TBi SXu ZLi TRamamoorthi R(2023)Neural Free‐Viewpoint Relighting for Glossy Indirect IlluminationComputer Graphics Forum10.1111/cgf.1488542:4Online publication date: 26-Jul-2023
https://doi.org/10.1111/cgf.14885
Gao DMu HXu K(2023)Neural Global Illumination: Interactive Indirect Illumination Prediction Under Dynamic Area LightsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320996329:12(5325-5341)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1109/TVCG.2022.3209963
Leung HWang ZHo TLeung CWong E(2021)All Frequency Direct Illumination Using Visibility Correspondence Generated With Spherical Voronoi DiagramsIEEE Access10.1109/ACCESS.2021.30846119(81296-81313)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3084611
Marin ARossi SSottana M(2020)Dynamic Resource Allocation in Fork-Join QueuesACM Transactions on Modeling and Performance Evaluation of Computing Systems10.1145/33723765:1(1-28)Online publication date: 4-Feb-2020
https://dl.acm.org/doi/10.1145/3372376
Salamati MSoudjani SMajumdar R(2020)A Lyapunov Approach for Time-Bounded Reachability of CTMCs and CTMDPsACM Transactions on Modeling and Performance Evaluation of Computing Systems10.1145/33719235:1(1-29)Online publication date: 4-Feb-2020
https://dl.acm.org/doi/10.1145/3371923
Khungurn PWu RNoeckel JMarschner SBala K(2017)Fast rendering of fabric micro-appearance models under directional and spherical gaussian lightsACM Transactions on Graphics10.1145/3130800.313082936:6(1-15)Online publication date: 20-Nov-2017
https://dl.acm.org/doi/10.1145/3130800.3130829
Tze-Yiu Ho Yi Xiao Rui-Bin Feng Chi-Sing Leung Tien-Tsin Wong (2015)All-Frequency Direct Illumination with Vectorized VisibilityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2015.240739821:8(945-958)Online publication date: 29-Jun-2015
https://dl.acm.org/doi/10.1109/TVCG.2015.2407398
Chung HTeuscher CPande P(2014)Design and Evaluation of Technology-Agnostic Heterogeneous Networks-on-ChipACM Journal on Emerging Technologies in Computing Systems10.1145/256766610:3(1-27)Online publication date: 6-May-2014
https://dl.acm.org/doi/10.1145/2567666
Kamal MAfzali-Kusha ASafari SPedram M(2014)Impact of Process Variations on Speedup and Maximum Achievable Frequency of Extensible ProcessorsACM Journal on Emerging Technologies in Computing Systems10.1145/256766510:3(1-25)Online publication date: 6-May-2014
https://dl.acm.org/doi/10.1145/2567665
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents