article

Efficiently combining positions and normals for precise 3D geometry

Authors:

Szymon Rusinkiewicz,

Ravi RamamoorthiAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 24, Issue 3

Pages 536 - 543

https://doi.org/10.1145/1073204.1073226

Published: 01 July 2005 Publication History

Abstract

Range scanning, manual 3D editing, and other modeling approaches can provide information about the geometry of surfaces in the form of either 3D positions (e.g., triangle meshes or range images) or orientations (normal maps or bump maps). We present an algorithm that combines these two kinds of estimates to produce a new surface that approximates both. Our formulation is linear, allowing it to operate efficiently on complex meshes commonly used in graphics. It also treats high-and low-frequency components separately, allowing it to optimally combine outputs from data sources such as stereo triangulation and photometric stereo, which have different error-vs.-frequency characteristics. We demonstrate the ability of our technique to both recover high-frequency details and avoid low-frequency bias, producing surfaces that are more widely applicable than position or orientation data alone.

Supplementary Material

MP4 File (pps017.mp4)

Download
31.58 MB

References

[1]

Banerjee, S., Sastry, P., and Venkatesh, Y. 1992. Surface reconstruction from disparate shading: An integration of shape-from-shading and stereopsis. In IAPR, volume 1, pages 141--144.

[2]

Bernardini, F., Martin, I., Mittleman, J., Rushmeier, H., and Taubin, G. 2002. Building a digital model of michelangelo's florentine pietà. IEEE Computer Graphics and Applications, 22(1):59--67.

Digital Library

[3]

Besl, P. J. 1989. Active Optical Range Imaging Sensors, pages 1--63.

Digital Library

[4]

Besl, P. J. and Mckay, N. D. 1992. A method for registration of 3-d shapes. PAMI, 14(2):239--256.

Digital Library

[5]

Bouguet, J.-Y. 2004. Camera Calibration Toolbox for Matlab. URL http://www.vision.caltech.edu/bouguetj/calib_doc.

[6]

Chen, C.-Y., Klette, R., and Chen, C.-F. 2003. Shape from photometric-stereo and contours. In N. Petkov and M. Westenberg, editors, CAIP, Springer-Verlag, pages 377--384.

[7]

Cryer, J. E., Tsai, P.-S., and Shah, M. 1995. Integration of shape from shading and stereo. Pattern Recognition, 28(7): 1033--1043.

[8]

Curless, B. 1997. New Methods For Surface Reconstruction From Range Images. PhD thesis, Stanford University.

Digital Library

[9]

Curless, B. and Levoy, M. 1996. A volumetric method for building complex models from range images. In SIGGRAPH, ACM Press, pages 303--312.

Digital Library

[10]

Davis, J., Nehab, D., Ramamoorthi, R., and Rusinkiewicz, S. 2005. Spacetime stereo: A unifying framework for depth from triangulation. PAMI, 27(2):296--302.

Digital Library

[11]

Epstein, R., Yuille, A. L., and Belhumeur, P. N. 1996. Learning object representations from lighting variations. In ECCV, pages 179--199.

Digital Library

[12]

Fua, P. and Leclerc, Y. G. 1994. Using 3-dimensional meshes to combine image-based and geometry-based constraints. In J.-O. Eklundh, editor, ECCV, volume 2, Springer-Verlag, pages 281--291.

Digital Library

[13]

Georghiades. A. 2003. Incorporating the torrance and sparrow model of reflectance in uncalibrated photometric stereo. In ICCV, volume 2, pages 816--823.

Digital Library

[14]

Horn, B. K. P. 1970. Shape from Shading: A Method for Obtaining the Shape of a Smooth Opaque Object from One View. PhD thesis, Massachusetts Institute of Technology.

[15]

Ikeuchi, K. 1983. Constructing a depth map from images. A. I Memo AIM-744, Artificial Intelligence Laboratory, MIT.

[16]

Ikeuchi, K. 1987. Determining a depth map using a dual photometric stereo. IJRR, 6(1):15--31.

Digital Library

[17]

Lange, H. 1999. Advances in the cooperation of shape from shading and stereo vision. In 3DIM, pages 46--58.

Digital Library

[18]

Lensch, H. P. A., Kautz, J., Goesele, M., Heidrich, W., and Seidel, H.-P. 2003. Image-based reconstruction of spatial appearance and geometric detail. ACM Trans. Graph., 22(2): 234--257.

Digital Library

[19]

Miller, G. 1994. Efficient algorithms for local and global accessibility shading. In SIGGRAPH, pages 319--326.

Digital Library

[20]

Mostafa, M., Yamany, S., and Farag, A. 1999. Integrating shape from shading and range data using neural networks. In CVPR, volume 2, IEEE Computer Society, pages 15--20.

[21]

Paige, C. C. and Saunders, M. A. 1982. LSQR: An algorithm for sparse linear equations and sparse least squares. TOMS, 8(1): 43--71.

Digital Library

[22]

Poussart, D. and Laurendeau, D. 1989. 3-D Sensing for Industrial Computer Vision, pages 122--159.

Digital Library

[23]

Pulli, K. 1999. Multiview registration for large datasets. In 3DIM, pages 160--168.

Digital Library

[24]

Rushmeier, H. and Bernardini, F. 1999. Computing consistent normals and colors from photometric data. In 3DIM, pages 99--108.

Digital Library

[25]

Tagare, H. D. and Defigueiredo, R. J. P. 1991. A theory of photometric stereo for a class of diffuse non-lambertian surfaces. PAMI, 13(2):133--152.

Digital Library

[26]

Terzopoulos, D. 1988. The computation of visible-surface representations. PAMI, 10(4):417--438.

Digital Library

[27]

Woodham, R. J. 1980. Photometric method for determining surface orientation from multiple images. Optical Engineering, 19 (1):139--144.

[28]

Zhang, L., Curless, B., and Seitz, S. M. 2003. Spacetime stereo: Shape recovery for dynamic scenes. In CVPR, pages 367--374.

Cited By

Shi JLi YZhang ZLi TZhou J(2024)Adaptive Weighted Data Fusion for Line Structured Light and Photometric Stereo Measurement SystemSensors10.3390/s2413418724:13(4187)Online publication date: 27-Jun-2024
https://doi.org/10.3390/s24134187
Bridgeman LRainer GGhosh A(2024)High-Quality Facial Geometry from Sparse Heterogeneous Devices under Active IlluminationProceedings of 21st ACM SIGGRAPH Conference on Visual Media Production10.1145/3697294.3697296(1-10)Online publication date: 18-Nov-2024
https://dl.acm.org/doi/10.1145/3697294.3697296
Logothetis FBudvytis ICipolla R(2024)A Neural Height-Map Approach for the Binocular Photometric Stereo Problem2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00159(1557-1566)Online publication date: 3-Jan-2024
https://doi.org/10.1109/WACV57701.2024.00159
Show More Cited By

Index Terms

Efficiently combining positions and normals for precise 3D geometry

Recommendations

Efficiently combining positions and normals for precise 3D geometry
SIGGRAPH '05: ACM SIGGRAPH 2005 Papers

Range scanning, manual 3D editing, and other modeling approaches can provide information about the geometry of surfaces in the form of either 3D positions (e.g., triangle meshes or range images) or orientations (normal maps or bump maps). We present an ...
Estimating specular normals from spherical Stokes reflectance fields
SIGGRAPH '12: ACM SIGGRAPH 2012 Posters

Despite being at the focal point of intense research in both computer graphics as well as in computer vision, accurately reproducing the shape and appearance of real-world scenes remains a challenging problem, especially under uncontrolled conditions. ...
Simultaneous acquisition of polarimetric SVBRDF and normals

Capturing appearance often requires dense sampling in light-view space, which is often achieved in specialized, expensive hardware setups. With the aim of realizing a compact acquisition setup without multiple angular samples of light and view, we ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 24, Issue 3

July 2005

826 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1073204

Issue’s Table of Contents

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2005

Published in TOG Volume 24, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

287
Total Citations
View Citations
2,620
Total Downloads

Downloads (Last 12 months)83
Downloads (Last 6 weeks)15

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Shi JLi YZhang ZLi TZhou J(2024)Adaptive Weighted Data Fusion for Line Structured Light and Photometric Stereo Measurement SystemSensors10.3390/s2413418724:13(4187)Online publication date: 27-Jun-2024
https://doi.org/10.3390/s24134187
Bridgeman LRainer GGhosh A(2024)High-Quality Facial Geometry from Sparse Heterogeneous Devices under Active IlluminationProceedings of 21st ACM SIGGRAPH Conference on Visual Media Production10.1145/3697294.3697296(1-10)Online publication date: 18-Nov-2024
https://dl.acm.org/doi/10.1145/3697294.3697296
Logothetis FBudvytis ICipolla R(2024)A Neural Height-Map Approach for the Binocular Photometric Stereo Problem2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00159(1557-1566)Online publication date: 3-Jan-2024
https://doi.org/10.1109/WACV57701.2024.00159
Brument BBruneau RQuéau YMélou JLauze FDurou JCalvet L(2024)RNb-NeuS: Reflectance and Normal-Based Multi-View 3D Reconstruction2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00500(5230-5239)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.00500
Zhu JWang HHogg DKelly T(2024)Learning to sculpt neural cityscapesThe Visual Computer10.1007/s00371-024-03528-7Online publication date: 12-Jul-2024
https://doi.org/10.1007/s00371-024-03528-7
Wang WPan WDai CDazeley RWei LRolfe BLu X(2024)Segmentation-driven feature-preserving mesh denoisingThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-03161-w40:9(6201-6217)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1007/s00371-023-03161-w
Xiong ZDu DWu YDong JKang DBao LHan X(2024)PIFu for the Real World: A Self-supervised Framework to Reconstruct Dressed Human from Single-View ImagesComputational Visual Media10.1007/978-981-97-2095-8_1(3-23)Online publication date: 10-Apr-2024
https://dl.acm.org/doi/10.1007/978-981-97-2095-8_1
Miyashita LSueishi TTabata SHayakawa TIshikawa M(2023)Dynamic Projection Mapping Technologies Pioneered by High-speed Vision高速ビジョンが開くダイナミックプロジェクションマッピング技術IEICE Communications Society Magazine10.1587/bplus.16.27516:4(275-284)Online publication date: 2023
https://doi.org/10.1587/bplus.16.275
Chen HLi ZWei MWang J(2023)Geometric and Learning-Based Mesh Denoising: A Comprehensive SurveyACM Transactions on Multimedia Computing, Communications, and Applications10.1145/362509820:3(1-28)Online publication date: 10-Nov-2023
https://dl.acm.org/doi/10.1145/3625098
Heep MZell E(2023)ShadowPatch: Shadow Based Segmentation for Reliable Depth Discontinuities in Photometric StereoComputer Graphics Forum10.1111/cgf.1470741:7(635-646)Online publication date: 20-Mar-2023
https://doi.org/10.1111/cgf.14707
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents