research-article

Pocket reflectometry

Authors:

Baining GuoAuthors Info & Claims

SIGGRAPH '11: ACM SIGGRAPH 2011 papers

Article No.: 45, Pages 1 - 10

https://doi.org/10.1145/1964921.1964940

Published: 25 July 2011 Publication History

Abstract

We present a simple, fast solution for reflectance acquisition using tools that fit into a pocket. Our method captures video of a flat target surface from a fixed video camera lit by a hand-held, moving, linear light source. After processing, we obtain an SVBRDF.

We introduce a BRDF chart, analogous to a color "checker" chart, which arranges a set of known-BRDF reference tiles over a small card. A sequence of light responses from the chart tiles as well as from points on the target is captured and matched to reconstruct the target's appearance.

We develop a new algorithm for BRDF reconstruction which works directly on these LDR responses, without knowing the light or camera position, or acquiring HDR lighting. It compensates for spatial variation caused by the local (finite distance) camera and light position by warping responses over time to align them to a specular reference. After alignment, we find an optimal linear combination of the Lambertian and purely specular reference responses to match each target point's response. The same weights are then applied to the corresponding (known) reference BRDFs to reconstruct the target point's BRDF. We extend the basic algorithm to also recover varying surface normals by adding two spherical caps for diffuse and specular references to the BRDF chart.

We demonstrate convincing results obtained after less than 30 seconds of data capture, using commercial mobile phone cameras in a casual environment.

Supplementary Material

Supplemental material. (a45-ren.zip)

Download
54.84 MB

MP4 File (tp027_11.mp4)

Download
15.12 MB

References

[1]

Alldrin, N., Zickler, T. E., and Kriegman, D. 2008. Photometric stereo with non-parametric and spatially-varying reflectance. In Conf. on Comp. Vision and Pattern Recognition (CVPR), 1--8.

[2]

An, X., and Pellacini, F. 2008. Appprop: all-pairs appearance-space edit propagation. ACM Transactions on Graphics 27, 40:1--40:9.

Digital Library

[3]

Ashikhmin, M., Premoze, S., and Shirley, P. 2000. A microfacet-based BRDF generator. In Siggraph 2000, Computer Graphics Proceedings, ACM Press/ACM SIGGRAPH/Addison Wesley Longman, 65--74.

Digital Library

[4]

Chen, T., Goesele, M., and Seidel, H.-P. 2006. Mesostructure from specularity. In Proceedings of Computer Vision and Pattern Recognition (CVPR), CVPR '06, 1825--1832.

Digital Library

[5]

Cook, R. L., and Torrance, K. E. 1982. A reflectance model for computer graphics. ACM Trans. Graph. 1, 1, 7--24.

Digital Library

[6]

Dana, K. J., Nayar, S. K., van Ginneken, B., and Koenderink, J. J. 1999. Reflectance and texture of real-world surfaces. ACM Transactions on Graphics 18, 1, 1--34.

Digital Library

[7]

Dana, K. J. 2001. BRDF/BTF measurement device. In Proceedings of eighth IEEE international conference on computer vision (ICCV), vol. 2, 460--466.

[8]

Debevec, P., Hawkins, T., Tchou, C., Duiker, H.-P., Sarokin, W., and Sagar, M. 2000. Acquiring the reflectance field of a human face. In Proc. SIGGRAPH 2000, 145--156.

Digital Library

[9]

Dong, Y., Wang, J., Tong, X., Snyder, J., Lan, Y., BenEzra, M., and Guo, B. 2010. Manifold bootstrapping for SVBRDF capture. ACM Trans. Graph. 29, 4, 98:1--98:10.

Digital Library

[10]

Gardner, A., Tchou, C., Hawkins, T., and Debevec, P. 2003. Linear light source reflectometry. ACM Trans. Graph. 22, 3, 749--758.

Digital Library

[11]

Garg, G., Talvala, E.-V., Levoy, M., and Lensch, H. P. A. 2006. Symmetric photography: exploiting data-sparseness in reflectance fields. In Eurographics Workshop/Symposium on Rendering, Eurographics Association, Nicosia, Cyprus, 251--262.

Digital Library

[12]

Ghosh, A., Achutha, S., Heidrich, W., and O'Toole, M. 2007. BRDF acquisition with basis illumination. Computer Vision, IEEE International Conference on, 1--8.

[13]

Ghosh, A., Chen, T., Peers, P., Wilson, C. A., and Debevec, P. E. 2009. Estimating specular roughness and anisotropy from second order spherical gradient illumination. Computer Graphics Forum 28, 4, 1161--1170.

Digital Library

[14]

Ghosh, A., Chen, T., Peers, P., Wilson, C. A., and Debevec, P. 2010. Circularly polarized spherical illumination reflectometry. ACM Trans. Graph. 29 (December), 162:1--162:12.

Digital Library

[15]

Goldman, D. B., Curless, B., Hertzmann, A., and Seitz, S. M. 2005. Shape and spatially-varying BRDFs from photometric stereo. In International Conference on Computer Vision, I: 341--348.

Digital Library

[16]

Han, J. Y., and Perlin, K. 2003. Measuring bidirectional texture reflectance with a kaleidoscope. ACM Trans. Graph. 22, 3, 741--748.

Digital Library

[17]

Hertzmann, A., and Seitz, S. M. 2003. Shape and materials by example: A photometric stereo approach. In IN PROC. IEEE CONF. COMPUTER VISION AND PATTERN RECOGNITION, 533--540.

Digital Library

[18]

Holroyd, M., Lawrence, J., Humphreys, G., and Zickler, T. 2008. A photometric approach for estimating normals and tangents. ACM Transactions on Graphics 27, 5, 1--9.

Digital Library

[19]

Holroyd, M., Lawrence, J., and Zickler, T. 2010. A coaxial optical scanner for synchronous acquisition of 3d geometry and surface reflectance. ACM Trans. Graph. 29 (July), 99:1--99:12.

Digital Library

[20]

Lawrence, J., Ben-Artzi, A., DeCoro, C., Matusik, W., Pfister, H., Ramamoorthi, R., and Rusinkiewicz, S. 2006. Inverse shade trees for non-parametric material representation and editing. ACM Transactions on Graphics (Proc. SIGGRAPH) 25, 3 (July).

Digital Library

[21]

Lawson, C., and Hanson, R. 1974. Solving least squares problems. Prentice-Hall Chapter 23, 161.

[22]

Lensch, H. P. A., Kautz, J., Goesele, M., Heidrich, W., and Seidel, H.-P. 2003. Image-based reconstruction of spatial appearance and geometric detail. ACM Transaction on Graphics 22, 2 (Apr.), 234--257.

Digital Library

[23]

Lu, R., Koenderink, J. J., and Kappers, A. M. L. 1998. Optical properties (bidirectional reflectance distribution functions) of velvet. Applied Optics 37, 25 (Sept.), 5974--5984.

[24]

Ma, W.-C., Hawkins, T., Peers, P., Chabert, C. F., Weiss, M., and Debevec, P. 2007. Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination. Rendering Techniques, 183--194.

Digital Library

[25]

Marschner, S., Westin, S., Lafortune, E., Torrance, K., and Greenberg, D. 1999. Image-based BRDF measurement including human skin. In 10th Eurographics Rendering Workshop.

Digital Library

[26]

Matusik, W., Pfister, H., Brand, M., and McMillan, L. 2003. Efficient isotropic BRDF measurement. In EGRW '03: Proceedings of the 14th Eurographics workshop on Rendering, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 241--247.

Digital Library

[27]

Matusik, W., Ajdin, B., Gu, J., Lawrence, J., Lensch, H. P., Pellacini, F., and Rusinkiewicz, S. 2009. Printing spatially-varying reflectance. ACM Trans. Graphics (Proc. SIGGRAPH Asia) 28, 5 (Dec.).

Digital Library

[28]

McAllister, D. K., Lastra, A. A., and Heidrich, W. 2002. Efficient rendering of spatial bi-directional reflectance distribution functions. In Proceedings of the 17th Eurographics/SIGGRAPH workshop on graphics hardware (EGGH-02), ACM Press, New York, S. N. Spencer, Ed., 79--88.

Digital Library

[29]

Moshe, B.-E., Wang, J., Bennett, W., Li, X., and Ma, L. 2008. An LED-only BRDF measurement device. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, 1--8.

[30]

Mukaigawa, Y., sumino, K., and yagi, Y. 2007. High-speed measurement of BRDF using an ellipsoidal mirror and a projector. In Computer Vision and Pattern Recognition, 2007. CVPR '07. IEEE Conference on, 1--8.

[31]

Muller, G., Meseth, J., Sattler, M., Sarlette, R., and Klein, R. 2005. Acquisition, synthesis, and rendering of bidirectional texture functions. Computer Graphics Forum 24, 1, 83--109.

[32]

Murrsy-Coleman, J. F., A. S. 1990. The automated measurement of BRDFs and their application to luminaire modeling. Journal of the Illuminating Engineering Sociery, Winter.

[33]

Ngan, A., Durand, F., and Matusik, W. 2005. Experimental analysis of BRDF models. Eurographics Symposium on Rendering 2005.

Digital Library

[34]

Ramamoorthi, R., and Hanrahan, P. 2001. A signal-processing framework for inverse rendering. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, SIGGRAPH '01, 117--128.

Digital Library

[35]

Romeiro, F., and Zickler, T. 2010. Blind reflectometry. In Proceedings of the 11th European conference on Computer vision: Part I, Springer-Verlag, Berlin, Heidelberg, ECCV'10, 45--58.

Digital Library

[36]

Romeiro, F., Vasilyev, Y., and Zickler, T. 2008. Passive reflectometry. In Proceedings of the 10th European Conference on Computer Vision: Part IV, Springer-Verlag, Berlin, Heidelberg, 859--872.

Digital Library

[37]

Sakoe, H., and Chiba, S. 1978. Dynamic programming algorithm optimization for spoken word recognition. IEEE Transactions on Acoustics, Speech, and Signal Processing 26, 43--49.

[38]

Treuille, A., Hertzmann, A., and Seitz, S. M. 2004. Example-based stereo with general BRDFs. In European Conference on Computer Vision, 457--469.

[39]

Wang, J., Zhao, S., Tong, X., Snyder, J., and Guo, B. 2008. Modeling anisotropic surface reflectance with example-based microfacet synthesis. In SIGGRAPH '08: ACM SIGGRAPH 2008 papers, ACM, New York, NY, USA, 1--9.

Digital Library

[40]

Wang, J., Ren, P., Gong, M., Snyder, J., and Guo, B. 2009. All-frequency rendering of dynamic, spatially-varying reflectance. ACM Transactions on Graphics 28, 5, 133:1--133:10.

Digital Library

[41]

Ward, G. J. 1992. Measuring and modeling anisotropic reflection. In SIGGRAPH '92: Proceedings of the 19th annual conference on Computer graphics and interactive techniques, ACM Press, New York, NY, USA, 265--272.

Digital Library

[42]

Weyrich, T. 2006. Acquisition of human faces using a measurement-based skin reflectance model. In PhD thesis, Department of Computer Science, ETH Zrich, vol. 16741.

[43]

Xu, K., Jia, Y.-T., Fu, H., Hu, S.-M., and Tai, C.-L. 2008. Spherical piecewise constant basis functions for all-frequency precomputed radiance transfer. IEEE Transactions on Visualization and Computer Graphics 14, 2, 454--467.

Digital Library

[44]

Xu, K., Li, Y., Ju, T., Hu, S.-M., and Liu, T.-Q. 2009. Efficient affinity-based edit propagation using k-d tree. ACM Transactions on Graphics 28, 5, 118:1--118:6.

Digital Library

[45]

Zhang, Z. 2000. A flexible new technique for camera calibration. In Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 22, 1330--1334.

Digital Library

[46]

Zickler, T., Enrique, S., Ramamoorthi, R., and Belhumeur, P. 2005. Reflectance sharing: image-based rendering from a sparse set of images. In Eurographics Symposium on Rendering, Eurographics Association, Konstanz, Germany, K. Bala and P. Dutré, Eds., 253--264.

Cited By

Lu FChen XSato ISato Y(2018)SymPS: BRDF Symmetry Guided Photometric Stereo for Shape and Light Source EstimationIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2017.265552540:1(221-234)Online publication date: 1-Jan-2018
https://doi.org/10.1109/TPAMI.2017.2655525
Thanikachalam NBaboulaz LFirmenich DSusstrunk SVetterli M(2017)Handheld Reflectance Acquisition of PaintingsIEEE Transactions on Computational Imaging10.1109/TCI.2017.27491823:4(580-591)Online publication date: Dec-2017
https://doi.org/10.1109/TCI.2017.2749182
Hartl AArth CGrubert JSchmalstieg D(2016)Efficient Verification of Holograms Using Mobile Augmented RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2015.249861222:7(1843-1851)Online publication date: 1-Jul-2016
https://doi.org/10.1109/TVCG.2015.2498612
Show More Cited By

Index Terms

Pocket reflectometry
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
      1. Texturing

Recommendations

Pocket reflectometry

We present a simple, fast solution for reflectance acquisition using tools that fit into a pocket. Our method captures video of a flat target surface from a fixed video camera lit by a hand-held, moving, linear light source. After processing, we obtain ...
Linear light source reflectometry

This paper presents a technique for estimating the spatially-varying reflectance properties of a surface based on its appearance during a single pass of a linear light source. By using a linear light rather than a point light source as the illuminant, ...
Linear light source reflectometry
SIGGRAPH '03: ACM SIGGRAPH 2003 Papers

This paper presents a technique for estimating the spatially-varying reflectance properties of a surface based on its appearance during a single pass of a linear light source. By using a linear light rather than a point light source as the illuminant, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '11: ACM SIGGRAPH 2011 papers

August 2011

869 pages

ISBN:9781450309431

DOI:10.1145/1964921

Editor:
Hugues Hoppe

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 July 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGGRAPH '11

Sponsor:

SIGGRAPH

SIGGRAPH '11: Special Interest Group on Computer Graphics and Interactive Techniques Conference

August 7 - 11, 2011

British Columbia, Vancouver, Canada

Acceptance Rates

SIGGRAPH '11 Paper Acceptance Rate 82 of 432 submissions, 19%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
1,186
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lu FChen XSato ISato Y(2018)SymPS: BRDF Symmetry Guided Photometric Stereo for Shape and Light Source EstimationIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2017.265552540:1(221-234)Online publication date: 1-Jan-2018
https://doi.org/10.1109/TPAMI.2017.2655525
Thanikachalam NBaboulaz LFirmenich DSusstrunk SVetterli M(2017)Handheld Reflectance Acquisition of PaintingsIEEE Transactions on Computational Imaging10.1109/TCI.2017.27491823:4(580-591)Online publication date: Dec-2017
https://doi.org/10.1109/TCI.2017.2749182
Hartl AArth CGrubert JSchmalstieg D(2016)Efficient Verification of Holograms Using Mobile Augmented RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2015.249861222:7(1843-1851)Online publication date: 1-Jul-2016
https://doi.org/10.1109/TVCG.2015.2498612
Feng Lu Matsushita YSato IOkabe TSato Y(2015)From Intensity Profile to Surface Normal: Photometric Stereo for Unknown Light Sources and Isotropic ReflectancesIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2015.238984137:10(1999-2012)Online publication date: 1-Oct-2015
https://dl.acm.org/doi/10.1109/TPAMI.2015.2389841
Bielza CLarrañaga P(2014)Discrete Bayesian Network ClassifiersACM Computing Surveys10.1145/257686847:1(1-43)Online publication date: 14-Jul-2014
https://dl.acm.org/doi/10.1145/2576868
Filip JVávra R(2014)Template-Based Sampling of Anisotropic BRDFsComputer Graphics Forum10.1111/cgf.1247733:7(91-99)Online publication date: 1-Oct-2014
https://dl.acm.org/doi/10.1111/cgf.12477
Georgoulis SProesmans MGool L(2014)Tackling Shapes and BRDFs Head-OnProceedings of the 2014 2nd International Conference on 3D Vision - Volume 0110.1109/3DV.2014.81(267-274)Online publication date: 8-Dec-2014
https://dl.acm.org/doi/10.1109/3DV.2014.81
Titzer B(2013)Harmonizing classes, functions, tuples, and type parameters in virgil iiiACM SIGPLAN Notices10.1145/2499370.249196248:6(85-94)Online publication date: 16-Jun-2013
https://dl.acm.org/doi/10.1145/2499370.2491962
Johnson NOh TZaks AAugust D(2013)Fast condensation of the program dependence graphACM SIGPLAN Notices10.1145/2499370.249196048:6(39-50)Online publication date: 16-Jun-2013
https://dl.acm.org/doi/10.1145/2499370.2491960
Isradisaikul CMyers A(2013)Reconciling exhaustive pattern matching with objectsACM SIGPLAN Notices10.1145/2499370.246219448:6(343-354)Online publication date: 16-Jun-2013
https://dl.acm.org/doi/10.1145/2499370.2462194
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents