Nothing Special   »   [go: up one dir, main page]

skip to main content
10.5555/2383847.2383873acmconferencesArticle/Chapter ViewAbstractPublication PagesegConference Proceedingsconference-collections
Article

Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination

Published: 25 June 2007 Publication History

Abstract

We estimate surface normal maps of an object from either its diffuse or specular reflectance using four spherical gradient illumination patterns. In contrast to traditional photometric stereo, the spherical patterns allow normals to be estimated simultaneously from any number of viewpoints. We present two polarized lighting techniques that allow the diffuse and specular normal maps of an object to be measured independently. For scattering materials, we show that the specular normal maps yield the best record of detailed surface shape while the diffuse normals deviate from the true surface normal due to subsurface scattering, and that this effect is dependent on wavelength. We show several applications of this acquisition technique. First, we capture normal maps of a facial performance simultaneously from several viewing positions using time-multiplexed illumination. Second, we show that highresolution normal maps based on the specular component can be used with structured light 3D scanning to quickly acquire high-resolution facial surface geometry using off-the-shelf digital still cameras. Finally, we present a realtime shading model that uses independently estimated normal maps for the specular and diffuse color channels to reproduce some of the perceptually important effects of subsurface scattering.

References

[1]
BABA M., MUKUNOKI M., ASADA N.: Estimating roughness parameters of an object s surface from real images. In SIGGRAPH 2004 Posters Proceedings.
[2]
BARSKY S., PETROU M.: The 4-source photometric stereo technique for three-dimensional surfaces in the presence of highlights and shadows. IEEE Trans. Pattern Anal. Machine Intell. 25, 10 (2003), 1239-1252.
[3]
CHEN T., GOESELE M., SEIDEL H.-P.: Mesostructure from specularity. In CVPR '06: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 1825-1832.
[4]
CHEN T., LENSCH H. P. A., FUCHS C., SEIDEL H.-P.: Polarization and phase-shifting for 3D scanning of translucent objects. In CVPR '07: Proceedings of the 2007 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.
[5]
CHUANG Y.-Y., ZONGKER D. E., HINDORFF J., CURLESS B., SALESIN D. H., SZELISKI R.: Environment matting extensions: Towards higher accuracy and real-time capture. In Proceedings of SIGGRAPH 2000, pp. 121-130.
[6]
DEBEVEC P., HAWKINS T., TCHOU C., DUIKER H.-P., SAROKIN W., SAGAR M.: Acquiring the reflectance field of a human face. In Proceedings of SIGGRAPH 2000, pp. 145-156.
[7]
FLEISHMAN S., DRORI I., COHEN-OR D.: Bilateral mesh denoising. In Proceedings of SIGGRAPH 2003, pp. 950- 953.
[8]
GARDNER A., TCHOU C., HAWKINS T., DEBEVEC P.: Linear light source reflectometry. In Proceedings of SIGGRAPH 2003, pp. 335-342.
[9]
HALSTEAD M., BARSKY B. A., KLEIN S., MANDELL R.: Reconstructing curved surfaces from specular reflection patterns using spline surface fitting of normals. In Proceedings of SIGGRAPH 96, pp. 335-342.
[10]
IKEUCHI K.: Determining surface orientation of specular surfaces by using the photometric stereo method. IEEE Trans. Pattern Anal. Machine Intell. 3, 6 (1981), 661-669.
[11]
JENSEN H. W., BUHLER J.: A rapid hierarchical rendering technique for translucent materials. ACM Transactions on Graphics 21, 3 (2002), 576-581.
[12]
LANDIS H.: Production-ready global illumination. Course Notes for SIGGRAPH 2002 Course 16, RenderMan in Production, 2002.
[13]
LENSCH H. P. A., KAUTZ J., GOESELE M., HEIDRICH W., SEIDEL H.-P.: Image-based reconstruction of spatial appearance and geometric detail. ACM Transactions on Graphics 22, 2 (2003), 234-257.
[14]
MERSCH S.: Polarized lighting for machine vision applications. In Proceedings of RI/SME Third Annual Applied Machine Vision Conference (1984), pp. 40-54.
[15]
MALZBENDER T., GELB D., WOLTERS H.: Polynomial texture maps. In Proceedings of SIGGRAPH 2001, pp. 519-528.
[16]
MATUSIK W., PFISTER H., BRAND M., MCMILLAN L.: A data-driven reflectance model. ACM Transactions on Graphics 22, 3 (2003), 759-769.
[17]
MARSCHNER S. R., WESTIN S. H., LAFORTUNE E. P. F., TORRANCE K. E., GREENBERG D. P.: Image-based BRDF measurement including human skin. Eurographics Rendering Workshop 1999.
[18]
MALLICK S. P., ZICKLER T. E., KRIEGMAN D. J., BELHUMEUR P. N.: Beyond Lambert: Reconstructing specular surfaces using color. In CVPR '05: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2.
[19]
NAYAR S., FANG X., BOULT T.: Separation of reflection components using color and polarization. International Journal of Computer Vision 21, 3 (1997), 163-186.
[20]
NAYAR S. K., IKEUCHI K., KANADE T.: Determining shape and reflectance of hybrid surfaces by photometric sampling. IEEE Journal of Robotics and Automation 6, 4 (1990), 418-431.
[21]
NAYAR S. K., IKEUCHI K., KANADE T.: Shape from interreflections. International Journal of Computer Vision 6, 3 (1991), 173-195.
[22]
NEHAB D., RUSINKIEWICZ S., DAVIS J., RAMAMOORTHI R.: Efficiently combining positions and normals for precise 3d geometry. ACM Transactions on Graphics 24, 3 (2005), 536-543.
[23]
PEERS P., HAWKINS T., DEBEVEC P.: A reflective light stage. ICT Technical Report ICT-TR-04.2006 (December 2006).
[24]
RAMAMOORTHI R., HANRAHAN P.: Frequency space environment map rendering. ACM Transactions on Graphics 21, 3 (July 2002), 517-526.
[25]
SCHLÜNS K.: Photometric stereo for non-lambertian surfaces using color information. In CAIP '93: Proceedings of the 5th International Conference on Computer Analysis of Images and Patterns (1993), pp. 444-451.
[26]
SATO Y., WHEELER M. D., IKEUCHI K.: Object shape and reflectance modeling from observation. In Proceedings of SIGGRAPH 1997, pp. 379-388.
[27]
TARINI M., LENSCH H. P. A., GOESELE M., SEIDEL H.-P.: 3D acquisition of mirroring objects using striped patterns. Graphical Models 67, 4 (2005), 233-259.
[28]
WENGER A., GARDNER A., TCHOU C., UNGER J., HAWKINS T., DEBEVEC P.: Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Transactions on Graphics 24, 3 (2005), 756-764.
[29]
WEYRICH T., MATUSIK W., PFISTER H., BICKEL B., DONNER C., TU C., MCANDLESS J., LEE J., NGAN A., JENSEN H. W., GROSS M.: Analysis of human faces using a measurement-based skin reflectance model. ACM Transactions on Graphics 25, 3 (2006), 1013-1024.
[30]
WOLFF L.: Using polarization to separate reflection components. In In CVPR '89: Proceedings of the 1989 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 363-369.
[31]
WOLFF L.: Material classification and separation of reflection components using polarization radiometric information. In DARPA89 (1989), pp. 232-244.
[32]
WOODHAM R. J.: Photometric method for determining surface orientation from multiple images. Optical Engineering 19, 1 (1980), 139-144.
[33]
ZICKLER T., ENRIQUE S., RAMAMOORTHI R., BELHUMEUR P.: Reflectance sharing: Image-based rendering from a sparse set of images. In Proceedings of Eurographics Symposium on Rendering 2005, pp. 253-264.
[34]
ZONGKER D. E., WERNER D. M., CURLESS B., SALESIN D. H.: Environment matting and compositing. In Proceedings of SIGGRAPH 1999, pp. 205-214.

Cited By

View all
  • (2024)High-Quality Facial Geometry from Sparse Heterogeneous Devices under Active IlluminationProceedings of 21st ACM SIGGRAPH Conference on Visual Media Production10.1145/3697294.3697296(1-10)Online publication date: 18-Nov-2024
  • (2023)Towards Material Digitization with a Dual-scale Optical SystemACM Transactions on Graphics10.1145/359214742:4(1-13)Online publication date: 26-Jul-2023
  • (2022)NeARportation: A Remote Real-time Neural Rendering FrameworkProceedings of the 28th ACM Symposium on Virtual Reality Software and Technology10.1145/3562939.3565616(1-5)Online publication date: 29-Nov-2022
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
EGSR'07: Proceedings of the 18th Eurographics conference on Rendering Techniques
June 2007
370 pages
ISBN:9783905673524

Sponsors

Publisher

Eurographics Association

Goslar, Germany

Publication History

Published: 25 June 2007

Check for updates

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)14
  • Downloads (Last 6 weeks)1
Reflects downloads up to 13 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)High-Quality Facial Geometry from Sparse Heterogeneous Devices under Active IlluminationProceedings of 21st ACM SIGGRAPH Conference on Visual Media Production10.1145/3697294.3697296(1-10)Online publication date: 18-Nov-2024
  • (2023)Towards Material Digitization with a Dual-scale Optical SystemACM Transactions on Graphics10.1145/359214742:4(1-13)Online publication date: 26-Jul-2023
  • (2022)NeARportation: A Remote Real-time Neural Rendering FrameworkProceedings of the 28th ACM Symposium on Virtual Reality Software and Technology10.1145/3562939.3565616(1-5)Online publication date: 29-Nov-2022
  • (2022)Authentic volumetric avatars from a phone scanACM Transactions on Graphics10.1145/3528223.353014341:4(1-19)Online publication date: 22-Jul-2022
  • (2022)Sparse ellipsometryACM Transactions on Graphics10.1145/3528223.353007541:4(1-14)Online publication date: 22-Jul-2022
  • (2022)Real-Time Relighting of Human Faces with a Low-Cost SetupProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/35226265:1(1-19)Online publication date: 4-May-2022
  • (2021)Polarimetric spatio-temporal light transport probingACM Transactions on Graphics10.1145/3478513.348051740:6(1-18)Online publication date: 10-Dec-2021
  • (2021)Total relightingACM Transactions on Graphics10.1145/3450626.345987240:4(1-21)Online publication date: 19-Jul-2021
  • (2020)Dynamic facial asset and rig generation from a single scanACM Transactions on Graphics10.1145/3414685.341781739:6(1-18)Online publication date: 27-Nov-2020
  • (2020)Deep relightable texturesACM Transactions on Graphics10.1145/3414685.341781439:6(1-21)Online publication date: 27-Nov-2020
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media