Article

Shape and materials by example: a photometric stereo approach

Authors:

Aaron Hertzmann,

Steven M. SeitzAuthors Info & Claims

CVPR'03: Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition

Pages 533 - 540

Published: 18 June 2003 Publication History

Abstract

This paper presents a technique for computing the geometry of objects with general reflectance properties from images. For surfaces with varying material properties, a full segmentation into different material types is also computed. It is assumed that the camera viewpoint is fixed, but the illumination varies over the input sequence. It is also assumed that one or more example objects with similar materials and known geometry are imaged under the same illumination conditions. Unlike most previous work in shape reconstruction, this technique can handle objects with arbitrary and spatially-varying BRDFs. Furthermore, the approach works for arbitrary distant and unknown lighting environments. Finally, almost no calibration is needed, making the approach exceptionally simple to apply.

References

[1]

S. Arya, D. M. Mount, N. S. Netanyahu, R. Silverman, and A. Y. Wu. An Optimal Algorithm for Approximate Nearest Neighbor Searching in Fixed Dimensions. Journal of the ACM, 45(6):891-923, 1998.

[2]

R. Basri and D. Jacobs. Photometric stereo with general, unknown lighting. In Proc. CVPR, pages 374-381, 2001.

[3]

K. J. Dana, S. K. Nayar, B. van Ginneken, and J. J. Koenderink. Reflectance and texture of real-world surfaces. In Proc. CVPR., pages 151-157, 1997.

[4]

B. K. P. Horn. Robot Vision. McGraw-Hill, New York, NY, 1986.

[5]

K. Ikeuchi. Determining surface orientations of specular surfaces by using the photometric stereo method. IEEE PAMI, 3(6):661-669, 1981.

[6]

H. P. Lensch, J. Kautz, M. Goesele, W. Heidrich, and H.-P. Seidel. Image-Based Reconstruction of Spatial Appearance and Geometric Detail. Trans. on Graphics, 22(2), Apr. 2003.

[7]

S. Magda, T. Zickler, D. Kriegman, and P. Belhumeur. Beyond Lambert: Reconstructing Surfaces with Arbitrary BRDFs. In Proc. ICCV 2001, pages 391-398, 2001.

[8]

S. K. Nayar, K. Ikeuchi, and T. Kanade. Determining shape and reflectance of hybrid surfaces by photometric sampling. IEEE Trans. on Robotics and Automation, 6(4):418-431, 1990.

[9]

R. Ramamoorthi and P. Hanrahan. Frequency Space Environment Map Rendering. Trans. on Graphics, 21(3):517- 526, July 2002. (Proceedings of SIGGRAPH 2002).

[10]

W. M. Silver. Determining shape and reflectance using multiple images. Master's thesis, MIT, Cambridge, MA, 1980.

[11]

D. Terzopoulos. The computation of visible-surface representations. PAMI, 10(4):417-438, 1988.

[12]

L. B. Wolff, S. A. Shafer, and G. E. Healey, editors. Physicsbased vision: Principles and Practice, Shape Recovery. Jones and Bartlett, Boston, MA, 1992.

[13]

D. N. Wood, D. I. Azuma, W. Aldinger, B. Curless, T. Duchamp, D. H. Salesin, and W. Stuetzle. Surface Light Fields for 3D Photography. In Proc. SIGGRAPH, pages 287- 296, 2000.

[14]

R. J. Woodham. Photometric method for determining surface orientation from multiple images. Optical Engineering, 19(1):139-144, 1980.

[15]

T. Zickler, P. N. Belhumeur, and D. J. Kriegman. Helmholtz Stereopsis: Exploiting Reciprocity for Surface Reconstruction. In Proc. of ECCV, volume 3, pages 869-884, 2002.

Cited By

Xu ZNielsen JYu JJensen HRamamoorthi R(2016)Minimal BRDF sampling for two-shot near-field reflectance acquisitionACM Transactions on Graphics10.1145/2980179.298239635:6(1-12)Online publication date: 5-Dec-2016
https://dl.acm.org/doi/10.1145/2980179.2982396
Xia RDong YPeers PTong X(2016)Recovering shape and spatially-varying surface reflectance under unknown illuminationACM Transactions on Graphics10.1145/2980179.298024835:6(1-12)Online publication date: 5-Dec-2016
https://dl.acm.org/doi/10.1145/2980179.2980248
Sun YJian MZhang XDong JShen LChen B(2016)Reconstruction of normal and albedo of convex Lambertian objects by solving ambiguity matrices using SVD and optimization methodNeurocomputing10.1016/j.neucom.2016.03.064207:C(95-104)Online publication date: 26-Sep-2016
https://dl.acm.org/doi/10.1016/j.neucom.2016.03.064
Show More Cited By

Shape and materials by example: a photometric stereo approach
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Image and video acquisition
  2. Computer graphics
2. Networks
  1. Network protocols

Recommendations

Simulating painted appearance of BTF materials

Bidirectional texture function (BTF) provides a realistic representation for real-world materials; however, the representation does not allow users to append additional rendering effects to the BTF data in a simple and effective way. In this paper, we ...
Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs

This paper presents a technique for computing the geometry of objects with general reflectance properties from images. For surfaces with varying material properties, a full segmentation into different material types is also computed. It is assumed that ...
Rendering translucent materials using photon diffusion
EGSR'07: Proceedings of the 18th Eurographics conference on Rendering Techniques

We present a new algorithm for rendering translucent materials that combines photon tracing with diffusion. This combination makes it possible to efficiently render highly scattering translucent materials while accounting for internal blockers, complex ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

CVPR'03: Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition

June 2003

865 pages

ISBN:0769519008

Sponsors

TCPAMI: IEEE Computer Society Technical Committee on Pattern Analysis and Machine Intelligence (TCPAMI)

Publisher

IEEE Computer Society

United States

Publication History

Published: 18 June 2003

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

30
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xu ZNielsen JYu JJensen HRamamoorthi R(2016)Minimal BRDF sampling for two-shot near-field reflectance acquisitionACM Transactions on Graphics10.1145/2980179.298239635:6(1-12)Online publication date: 5-Dec-2016
https://dl.acm.org/doi/10.1145/2980179.2982396
Xia RDong YPeers PTong X(2016)Recovering shape and spatially-varying surface reflectance under unknown illuminationACM Transactions on Graphics10.1145/2980179.298024835:6(1-12)Online publication date: 5-Dec-2016
https://dl.acm.org/doi/10.1145/2980179.2980248
Sun YJian MZhang XDong JShen LChen B(2016)Reconstruction of normal and albedo of convex Lambertian objects by solving ambiguity matrices using SVD and optimization methodNeurocomputing10.1016/j.neucom.2016.03.064207:C(95-104)Online publication date: 26-Sep-2016
https://dl.acm.org/doi/10.1016/j.neucom.2016.03.064
Nielsen JJensen HRamamoorthi R(2015)On optimal, minimal BRDF sampling for reflectance acquisitionACM Transactions on Graphics10.1145/2816795.281808534:6(1-11)Online publication date: 2-Nov-2015
https://dl.acm.org/doi/10.1145/2816795.2818085
Wu HZhou K(2015)AppFusionComputer Graphics Forum10.1111/cgf.1260034:6(289-298)Online publication date: 1-Sep-2015
https://dl.acm.org/doi/10.1111/cgf.12600
Dong YChen GPeers PZhang JTong X(2014)Appearance-from-motionACM Transactions on Graphics10.1145/2661229.266128333:6(1-12)Online publication date: 19-Nov-2014
https://dl.acm.org/doi/10.1145/2661229.2661283
Gomes LRegina Pereira Bellon OSilva L(2014)3D reconstruction methods for digital preservation of cultural heritagePattern Recognition Letters10.1016/j.patrec.2014.03.02350:C(3-14)Online publication date: 1-Dec-2014
https://dl.acm.org/doi/10.1016/j.patrec.2014.03.023
Palma GCallieri MDellepiane MScopigno R(2012)A Statistical Method for SVBRDF Approximation from Video Sequences in General Lighting ConditionsComputer Graphics Forum10.1111/j.1467-8659.2012.03145.x31:4(1491-1500)Online publication date: 1-Jun-2012
https://dl.acm.org/doi/10.1111/j.1467-8659.2012.03145.x
Ren PWang JSnyder JTong XGuo B(2011)Pocket reflectometryACM SIGGRAPH 2011 papers10.1145/1964921.1964940(1-10)Online publication date: 7-Aug-2011
https://dl.acm.org/doi/10.1145/1964921.1964940
Herbort SWöhler C(2011)An introduction to image-based 3D surface reconstruction and a survey of photometric stereo methods3D Research10.1007/3DRes.03(2011)42:3(1-17)Online publication date: 1-Sep-2011
https://dl.acm.org/doi/10.1007/3DRes.03%282011%294
Show More Cited By

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents