Article

Frequency domain normal map filtering

Authors:

Ravi Ramamoorthi,

Eitan GrinspunAuthors Info & Claims

SIGGRAPH '07: ACM SIGGRAPH 2007 papers

Pages 28 - es

https://doi.org/10.1145/1275808.1276412

Published: 29 July 2007 Publication History

Abstract

Filtering is critical for representing detail, such as color textures or normal maps, across a variety of scales. While MIP-mapping texture maps is commonplace, accurate normal map filtering remains a challenging problem because of nonlinearities in shading---we cannot simply average nearby surface normals. In this paper, we show analytically that normal map filtering can be formalized as a spherical convolution of the normal distribution function (NDF) and the BRDF, for a large class of common BRDFs such as Lambertian, microfacet and factored measurements. This theoretical result explains many previous filtering techniques as special cases, and leads to a generalization to a broader class of measured and analytic BRDFs. Our practical algorithms leverage a significant body of work that has studied lighting-BRDF convolution. We show how spherical harmonics can be used to filter the NDF for Lambertian and low-frequency specular BRDFs, while spherical von Mises-Fisher distributions can be used for high-frequency materials.

Supplementary Material

JPG File (pps028.jpg)

Download
13.04 KB

MP4 File (pps028.mp4)

Download
58.33 MB

References

[1]

Banerjee, A., Dhillon, I., Ghosh, J., and Sra, S. 2005. Clustering on the unit hypersphere using von Mises-Fisher distributions. Journal of Machine Learning Research 6, 1345--1382.

Digital Library

[2]

Basri, R., and Jacobs, D. 2001. Lambertian reflectance and linear subspaces. In International Conference on Computer Vision, 383--390.

[3]

Becker, B., and Max, N. 1993. Smooth transitions between bump rendering algorithms. In SIGGRAPH 93, 183--190.

Digital Library

[4]

Blinn, J. 1978. Simulation of wrinkled surfaces. In SIGGRAPH 78, 286--292.

Digital Library

[5]

Claustres, L., Barthe, L., and Paulin, M. 2007. Wavelet Encoding of BRDFs for Real-Time Rendering. In Graphics Interface 07.

Digital Library

[6]

Cohen, J., Olano, M., and Manocha, D. 1998. Appearance preserving simplification. In SIGGRAPH 98, 115--122.

Digital Library

[7]

Dempster, A., Laird, N., and Rubin, D. 1977. Maximum-likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B 39, 1--38.

[8]

Fisher, R. 1953. Dispersion on a sphere. Proceedings of the Royal Society of London, Series A 217, 295--305.

[9]

Fournier, A. 1992. Normal distribution functions and multiple surfaces. In Graphics Interface Workshop on Local Illumination, 45--52.

[10]

Hara, K., Nishino, K., and Ikeuchi, K. 2005. Multiple light sources and reflectance property estimation based on a mixture of spherical distributions. In ICCV '05: Proceedings of the Tenth IEEE International Conference on Computer Vision, 1627--1634.

Digital Library

[11]

Heckbert, P. 1989. Fundamentals of texture mapping and image warping. Master's thesis, UC Berkeley UCB/CSD 89/516.

Digital Library

[12]

Hochbaum, D., and Shmoys, D. 1985. A best possible heuristic for the k-center problem. Mathematics of Operations Research.

[13]

Horn, B. K. P. 1984. Extended gaussian images. Proceedings of the IEEE 72, 1671--1686.

[14]

Kajiya, J. 1985. Anisotropic reflection models. In SIGGRAPH 85, 15--21.

Digital Library

[15]

Lalonde, P., and Fournier, A. 1997. A wavelet representation of reflectance functions. IEEE TVCG 3, 4, 329--336.

Digital Library

[16]

Lawrence, J., BenArtzi, A., Decoro, C., Matusik, W., Pfister, H., Ramamoorthi, R., and Rusinkiewicz, S. 2006. Inverse shade trees for non-parametric material representation and editing. ACM Transactions on Graphics (SIGGRAPH 2006) 25, 3, 735--745.

Digital Library

[17]

Matusik, W., Pfister, H., Brand, M., and McMillan, L. 2003. A data-driven reflectance model. ACM Transactions on Graphics (SIGGRAPH 03 proceedings) 22, 3, 759--769.

Digital Library

[18]

Ng, R., Ramamoorthi, R., and Hanrahan, P. 2004. Triple product wavelet integrals for all-frequency relighting. ACM Transactions on Graphics (SIGGRAPH 2004) 23, 3, 475--485.

Digital Library

[19]

Olano, M., and North, M. 1997. Normal distribution mapping. Tech. Rep. 97-041 http://www.cs.unc.edu/~olano/papers/ndm/ndm.pdf, UNC.

[20]

Ramamoorthi, R., and Hanrahan, P. 2001. A signal-processing framework for inverse rendering. In SIGGRAPH 01, 117--128.

Digital Library

[21]

Schilling, A. 1997. Toward real-time photorealistic rendering: Challenges and solutions. In SIGGRAPH/Eurographics Workshop on Graphics Hardware, 7--16.

Digital Library

[22]

Sloan, P., Kautz, J., and Snyder, J. 2002. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. ACM Transactions on Graphics (SIGGRAPH 02 proceedings) 21, 3, 527--536.

Digital Library

[23]

Sloan, P., Luna, B., and Snyder, J. 2005. Local, deformable precomputed radiance transfer. ACM Transactions on Graphics (SIGGRAPH 05 proceedings) 24, 3, 1216--1224.

Digital Library

[24]

Strehl, A., Ghosh, J., and Mooney, R. 2000. Impact of similarity measures on web-page clustering. In Proc Natl Conf on Artificial Intelligence: Workshop of AI for Web Search (AAAI 2000), 58--64.

[25]

Sun, B., Sunkavalli, K., Ramamoorthi, R., Belhumeur, P., and Nayar, S. 2007. Time-Varying BRDFs. IEEE Transactions on Visualization and Computer Graphics 13, 3, 595--609.

Digital Library

[26]

Tan, P., Lin, S., Quan, L., Guo, B., and Shum, H. 2005. Multiresolution reflectance filtering. In EuroGraphics Symposium on Rendering 2005, 111--116.

[27]

Toksvig, M. 2005. Mipmapping normal maps. Journal of Graphics Tools 10, 3, 65--71.

[28]

Tsai, Y., and Shih, Z. 2006. All-frequency precomputed radiance transfer using spherical radial basis functions and clustered tensor approximation. ACM Transactions on Graphics (SIGGRAPH 2006) 25, 3, 967--976.

Digital Library

[29]

Williams, L. 1983. Pyramidal parametrics. In SIGGRAPH 83, 1--11.

Digital Library

Cited By

Lu GGuo JKellnhofer PEisemann E(2024)Sheared Polygonal Texture FilteringProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670952(1-7)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670952
Ranjan AYi KChang JTuzel O(2023)FaceLit: Neural 3D Relightable Faces2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00833(8619-8628)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00833
Tan HZhu JXu YMeng XWang LYan L(2022)Real‐Time Microstructure Rendering with MIP‐Mapped Normal Map SamplesComputer Graphics Forum10.1111/cgf.1444841:1(495-506)Online publication date: Feb-2022
https://doi.org/10.1111/cgf.14448
Show More Cited By

Index Terms

Frequency domain normal map filtering
1. Computing methodologies

Recommendations

Frequency domain normal map filtering

Filtering is critical for representing detail, such as color textures or normal maps, across a variety of scales. While MIP-mapping texture maps is commonplace, accurate normal map filtering remains a challenging problem because of nonlinearities in ...
Real-Time Geometric Glint Anti-Aliasing with Normal Map Filtering

Real-time geometric specular anti-aliasing is required when using a low number of pixel samples and high-frequency specular lobes. Several methods have been proposed for mono-lobe bidirectional reflection distribution functions (BRDFs), but none for ...
Frequency space environment map rendering

We present a new method for real-time rendering of objects with complex isotropic BRDFs under distant natural illumination, as specified by an environment map. Our approach is based on spherical frequency space analysis and includes three main ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '07: ACM SIGGRAPH 2007 papers

August 2007

1019 pages

ISBN:9781450378369

DOI:10.1145/1275808

Conference Chair:
Marc Levoy

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SIGGRAPH07

Sponsor:

SIGGRAPH

SIGGRAPH07: Special Interest Group on Computer Graphics and Interactive Techniques Conference

August 5 - 9, 2007

California, San Diego

Acceptance Rates

SIGGRAPH '07 Paper Acceptance Rate 108 of 455 submissions, 24%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
1,654
Total Downloads

Downloads (Last 12 months)45
Downloads (Last 6 weeks)7

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lu GGuo JKellnhofer PEisemann E(2024)Sheared Polygonal Texture FilteringProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670952(1-7)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670952
Ranjan AYi KChang JTuzel O(2023)FaceLit: Neural 3D Relightable Faces2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00833(8619-8628)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00833
Tan HZhu JXu YMeng XWang LYan L(2022)Real‐Time Microstructure Rendering with MIP‐Mapped Normal Map SamplesComputer Graphics Forum10.1111/cgf.1444841:1(495-506)Online publication date: Feb-2022
https://doi.org/10.1111/cgf.14448
Zhu JZhao SXu YMeng XWang LYan L(2022)Recent advances in glinty appearance renderingComputational Visual Media10.1007/s41095-022-0280-x8:4(535-552)Online publication date: 16-Jun-2022
https://doi.org/10.1007/s41095-022-0280-x
Atanasov AWilkie AKoylazov VKřivánek J(2021)A Multiscale Microfacet Model Based on Inverse Bin MappingComputer Graphics Forum10.1111/cgf.14261840:2(103-113)Online publication date: 4-Jun-2021
https://doi.org/10.1111/cgf.142618
Crassin CMcGuire MFatahalian KLefohn A(2016)Aggregate G-Buffer Anti-Aliasing -Extended Version-IEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2016.258607322:10(2215-2228)Online publication date: 1-Oct-2016
https://doi.org/10.1109/TVCG.2016.2586073
Guo JPan J(2016)Real-time rendering of refracting transmissive objects with multi-scale rough surfacesThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-015-1141-832:12(1579-1592)Online publication date: 1-Dec-2016
https://dl.acm.org/doi/10.1007/s00371-015-1141-8
Crassin CMcGuire MFatahalian KLefohn AKeyser JSander PSubr KWei L(2015)Aggregate G-buffer anti-aliasingProceedings of the 19th Symposium on Interactive 3D Graphics and Games10.1145/2699276.2699285(109-119)Online publication date: 27-Feb-2015
https://dl.acm.org/doi/10.1145/2699276.2699285
Simion AAsavei VPistirica SPoncea O(2015)Practical GPU and Voxel-Based Indirect Illumination for Real Time Computer Games2015 20th International Conference on Control Systems and Computer Science10.1109/CSCS.2015.47(379-384)Online publication date: May-2015
https://doi.org/10.1109/CSCS.2015.47
Kimball JDuchaineau MKuester F(2013)Interactive visualization of large scale atomistic and cosmological particle simulations2013 IEEE Aerospace Conference10.1109/AERO.2013.6497419(1-9)Online publication date: Mar-2013
https://doi.org/10.1109/AERO.2013.6497419
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents