Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Manifold bootstrapping for SVBRDF capture

Published: 26 July 2010 Publication History

Abstract

Manifold bootstrapping is a new method for data-driven modeling of real-world, spatially-varying reflectance, based on the idea that reflectance over a given material sample forms a low-dimensional manifold. It provides a high-resolution result in both the spatial and angular domains by decomposing reflectance measurement into two lower-dimensional phases. The first acquires representatives of high angular dimension but sampled sparsely over the surface, while the second acquires keys of low angular dimension but sampled densely over the surface.
We develop a hand-held, high-speed BRDF capturing device for phase one measurements. A condenser-based optical setup collects a dense hemisphere of rays emanating from a single point on the target sample as it is manually scanned over it, yielding 10 BRDF point measurements per second. Lighting directions from 6 LEDs are applied at each measurement; these are amplified to a full 4D BRDF using the general (NDF-tabulated) microfacet model. The second phase captures N=20-200 images of the entire sample from a fixed view and lit by a varying area source. We show that the resulting N-dimensional keys capture much of the distance information in the original BRDF space, so that they effectively discriminate among representatives, though they lack sufficient angular detail to reconstruct the SVBRDF by themselves. At each surface position, a local linear combination of a small number of neighboring representatives is computed to match each key, yielding a high-resolution SVBRDF. A quick capture session (10-20 minutes) on simple devices yields results showing sharp and anisotropic specularity and rich spatial detail.

Supplementary Material

JPG File (tp005-10.jpg)
Supplemental material. (098.zip)
MP4 File (tp005-10.mp4)

References

[1]
Alldrin, N., Zickler, T. E., and Kriegman, D. 2008. Photometric stereo with non-parametric and spatially-varying reflectance. In CVPR, 1--8.
[2]
Ashikhmin, M., Premoze, S., and Shirley, P. 2000. A microfacet-based BRDF generator. In Siggraph 2000, Computer Graphics Proceedings, ACM Press / ACM SIGGRAPH / Addison Wesley Longman, 65--74.
[3]
Cook, R. L., and Torrance, K. E. 1982. A reflectance model for computer graphics. ACM Trans. Graph. 1, 1, 7--24.
[4]
Dana, K. J., Nayar, S. K., van Ginneken, B., and Koenderink, J. J. 1999. Reflectance and texture of real-world surfaces. ACM Transactions on Graphics 18, 1, 1--34.
[5]
Dana, K. J. 2001. BRDF/BTF measurement device. In Proceedings of eighth IEEE international conference on computer vision (ICCV), vol. 2, 460--466.
[6]
Debevec, P. E., and Malik, J. 1997. Recovering high dynamic range radiance maps from photographs. In ACM SIGGRAPH, 369--378.
[7]
Debevec, P., Hawkins, T., Tchou, C., Duiker, H.-P., Sarokin, W., and Sagar, M. 2000. Acquiring the reflectance field of a human face. In Proc. SIGGRAPH 2000, 145--156.
[8]
Debevec, P., Tchou, C., Gardner, A., Hawkins, T., Poullis, C., Stumpfel, J., Jones, A., Yun, N., Einarsson, P., Lundgren, T., Fajardo, M., and Martinez, P. 2004. Estimating surface reflectance properties of a complex scene under captured natural illumination. Technical report ICT-TR-06, University of Southern California Institute for Creative Technologies Graphics Laboratory.
[9]
Gardner, A., Tchou, C., Hawkins, T., and Debevec, P. 2003. Linear light source reflectometry. ACM Trans. Graph. 22, 3, 749--758.
[10]
Garg, G., Talvala, E.-V., Levoy, M., and Lensch, H. P. A. 2006. Symmetric photography: exploiting data-sparseness in reflectance fields. In Eurographics Workshop/ Symposium on Rendering, Eurographics Association, Nicosia, Cyprus, 251--262.
[11]
Goldman, D. B., Curless, B., Hertzmann, A., and Seitz, S. M. 2005. Shape and spatially-varying BRDFs from photometric stereo. In ICCV, I: 341--348.
[12]
Han, J. Y., and Perlin, K. 2003. Measuring bidirectional texture reflectance with a kaleidoscope. ACM Trans. Graph. 22, 3, 741--748.
[13]
Lawrence, J., Ben-Artzi, A., DeCoro, C., Matusik, W., Pfister, H., Ramamoorthi, R., and Rusinkiewicz, S. 2006. Inverse shade trees for non-parametric material representation and editing. ACM Transactions on Graphics (Proc. SIGGRAPH) 25, 3 (July).
[14]
Lensch, H. P. A., Kautz, J., Goesele, M., Heidrich, W., and Seidel, H.-P. 2003. Image-based reconstruction of spatial appearance and geometric detail. ACM Transaction on Graphics 22, 2 (Apr.), 234--257.
[15]
Lu, R., Koenderink, J. J., and Kappers, A. M. L. 1998. Optical properties bidirectional reflectance distribution functions of velvet. Applied Optics 37, 25 (Sept.), 5974--5984.
[16]
Marschner, S., Westin, S., Lafortune, E., Torrance, K., and Greenberg, D. 1999. Image-based BRDF measurement including human skin. In 10th Eurographics Rendering Workshop.
[17]
Matusik, W., Pfister, H., Brand, M., and McMillan, L. 2003. A data-driven reflectance model. ACM Trans. Graph. 22, 3, 759--769.
[18]
Matusik, W., Pfister, H., Brand, M., and McMillan, L. 2003. Efficient isotropic BRDF measurement. In EGRW '03: Proceedings of the 14th Eurographics Workshop on Rendering, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 241--247.
[19]
McAllister, D. K., Lastra, A. A., and Heidrich, W. 2002. Efficient rendering of spatial bi-directional reflectance distribution functions. In Proceedings of the 17th Eurographics/SIGGRAPH Workshop on Graphics Hardware (EGGH-02), ACM Press, New York, S. N. Spencer, Ed., 79--88.
[20]
Moshe, B.-E., Wang, J., Bennett, W., Li, X., and Ma, L. 2008. An LED-only BRDF measurement device. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, 1--8.
[21]
Mount, D., and Arya, S. 1997. Ann: A library for approximate nearest neighbor searching. In CGC 2nd Annual Fall Workshop on Computational Geometry.
[22]
Mukaigawa, Y., sumino, K., and yagi, Y. 2007. High-speed measurement of BRDF using an ellipsoidal mirror and a projector. In Proc. of Asian Conference on Computer Vision (ACCV2007), LNCS-4844, 246--257.
[23]
Muller, G., Meseth, J., Sattler, M., Sarlette, R., and Klein, R. 2005. Acquisition, synthesis, and rendering of bidirectional texture functions. Computer Graphics Forum 24, 1, 83--109.
[24]
Ngan, A., Durand, F., and Matusik, W. 2005. Experimental analysis of BRDF models. Eurographics Symposium on Rendering 2005, 117C226.
[25]
Nicodemus, F. E., Richmond, J. C., Hsia, J. J., Ginsberg, I. W., and Limperis, T. 1977. Geometric considerations and nomenclature for reflectance. Monograph 161, National Bureau of Standards (US).
[26]
Roweis, S. T., and Saul, L. K. 2000. Nonlinear dimensionality reduction by locally linear embedding. In Science, 2323--2326.
[27]
Schuster, W. 2001. Harmonische interpolation. In Math. Semesterber, Springer-Verlag, 1--27.
[28]
Shirley, P., and Chiu, K. 1997. A low distortion map between disk and square. J. Graph. Tools 2, 3, 45--52.
[29]
Wang, J., Zhao, S., Tong, X., Snyder, J., and Guo, B. 2008. Modeling anisotropic surface reflectance with example-based microfacet synthesis. In SIGGRAPH '08: ACM SIGGRAPH 2008 papers, ACM, New York, NY, USA, 1--9.
[30]
Wang, J., Dong, Y., Tong, X., Lin, Z., and Guo, B. 2009. Kernel nyström method for light transport. ACM Trans. Graph. 28, 3, 29:1--29:10.
[31]
Weistroffer, R. P., Walcott, K. R., Humphreys, G., and Lawrence, J. 2007. Efficient basis decomposition for scattered reflectance data. In EGSR07: Proceedings of the Eurographics Symposium on Rendering.
[32]
Weyrich, T. 2006. Acquisition of human faces using a measurement-based skin reflectance model. PhD thesis, Department of Computer Science, ETH Zurich.
[33]
Zhang, Z. 2000. A flexible new technique for camera calibration. In Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 22, 1330--1334.
[34]
Zickler, T., Enrique, S., Ramamoorthi, R., and Belhumeur, P. 2005. Reflectance sharing: image-based rendering from a sparse set of images. In Eurographics Symposium on Rendering, Eurographics Association, Konstanz, Germany, K. Bala and P. Dutré, Eds., 253--264.

Cited By

View all
  • (2024)Single‐Image SVBRDF Estimation with Learned Gradient DescentComputer Graphics Forum10.1111/cgf.1501843:2Online publication date: 23-Apr-2024
  • (2024)Efficient Reflectance Capture With a Deep Gated Mixture-of-ExpertsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.326187230:7(4246-4256)Online publication date: Jul-2024
  • (2024)DiffMat: Latent diffusion models for image-guided material generationVisual Informatics10.1016/j.visinf.2023.12.0018:1(6-14)Online publication date: Mar-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 29, Issue 4
July 2010
942 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/1778765
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 July 2010
Published in TOG Volume 29, Issue 4

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)0
Reflects downloads up to 21 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Single‐Image SVBRDF Estimation with Learned Gradient DescentComputer Graphics Forum10.1111/cgf.1501843:2Online publication date: 23-Apr-2024
  • (2024)Efficient Reflectance Capture With a Deep Gated Mixture-of-ExpertsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.326187230:7(4246-4256)Online publication date: Jul-2024
  • (2024)DiffMat: Latent diffusion models for image-guided material generationVisual Informatics10.1016/j.visinf.2023.12.0018:1(6-14)Online publication date: Mar-2024
  • (2023)OpenSVBRDF: A Database of Measured Spatially-Varying ReflectanceACM Transactions on Graphics10.1145/361835842:6(1-14)Online publication date: 5-Dec-2023
  • (2023)DeepBasis: Hand-Held Single-Image SVBRDF Capture via Two-Level Basis Material ModelSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618239(1-11)Online publication date: 10-Dec-2023
  • (2023)Towards Material Digitization with a Dual-scale Optical SystemACM Transactions on Graphics10.1145/359214742:4(1-13)Online publication date: 26-Jul-2023
  • (2023)Multi-View Photometric Stereo Revisited2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV56688.2023.00314(3125-3134)Online publication date: Jan-2023
  • (2023)Neural Photometry-Guided Visual Attribute TransferIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.313308129:3(1818-1830)Online publication date: 1-Mar-2023
  • (2023)Neural Reflectance Capture in the View-Illumination DomainIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.311737029:2(1450-1462)Online publication date: 1-Feb-2023
  • (2023)A Compact BRDF Scanner with Multi-conjugate Optics2023 IEEE International Conference on Computational Photography (ICCP)10.1109/ICCP56744.2023.10233818(1-11)Online publication date: 28-Jul-2023
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media