research-article

Shield fields: modeling and capturing 3D occluders

Authors:

Douglas Lanman,

Gabriel TaubinAuthors Info & Claims

SIGGRAPH Asia '08: ACM SIGGRAPH Asia 2008 papers

Article No.: 131, Pages 1 - 10

https://doi.org/10.1145/1457515.1409084

Published: 01 December 2008 Publication History

Abstract

We describe a unified representation of occluders in light transport and photography using shield fields: the 4D attenuation function which acts on any light field incident on an occluder. Our key theoretical result is that shield fields can be used to decouple the effects of occluders and incident illumination. We first describe the properties of shield fields in the frequency-domain and briefly analyze the "forward" problem of efficiently computing cast shadows. Afterwards, we apply the shield field signal-processing framework to make several new observations regarding the "inverse" problem of reconstructing 3D occluders from cast shadows -- extending previous work on shape-from-silhouette and visual hull methods. From this analysis we develop the first single-camera, single-shot approach to capture visual hulls without requiring moving or programmable illumination. We analyze several competing camera designs, ultimately leading to the development of a new large-format, mask-based light field camera that exploits optimal tiled-broadband codes for light-efficient shield field capture. We conclude by presenting a detailed experimental analysis of shield field capture and 3D occluder reconstruction.

Supplementary Material

MOV File (a131-lanman-mp4_hi.mov)

Download
347.03 MB

References

[1]

Accorsia, R., Gasparini, F., and Lanza, R. C. 2001. Optimal coded aperture patterns for improved SNR in nuclear medicine imaging. Nuclear Instruments and Methods in Physics Research A 474, 3, 273--284.

[2]

Adelson, T., and Wang, J. 1992. Single lens stereo with a plenoptic camera. IEEE TPAMI 14, 2, 99--106.

Digital Library

[3]

BowHaus, Inc., 2007. BowHaus LVT specs and resolutions. http://www.bowhaus.com/services/lvtspecs.php4.

[4]

Chai, J.-X., Tong, X., Chan, S.-C., and Shum, H.-Y. 2000. Plenoptic sampling. In SIGGRAPH, 307--318.

Digital Library

[5]

Debevec, P., Hawkins, T., Tchou, C., Duiker, H.-P., Sarokin, W., and Sagar, M. 2000. Acquiring the reflectance field of a human face. In SIGGRAPH, 145--156.

Digital Library

[6]

Durand, F., Holzschuch, N., Soler, C., Chan, E., and Sillion, F. X. 2005. A frequency analysis of light transport. ACM Trans. Graph. 24, 3, 1115--1126.

Digital Library

[7]

Farid, H. 1997. Range Estimation by Optical Differentiation. PhD thesis, University of Pennsylvania.

Digital Library

[8]

Fenimore, E., and Cannon, T. 1978. Coded aperture imaging with uniformly redundant arrays. Appl. Optics 17, 3, 337--347.

[9]

Georgiev, T., Zheng, K. C., Curless, B., Salesin, D., Na-yar, S., and Intwala, C. 2006. Spatio-angular resolution tradeoffs in integral photography. In EGSR, 263--272.

Digital Library

[10]

Goodman, J. W. 1996. Introduction to Fourier Optics.

[11]

Gortler, S. J., Grzeszczuk, R., Szeliski, R., and Cohen, M. F. 1996. The lumigraph. In SIGGRAPH, 43--54.

Digital Library

[12]

Gross, M., Würmlin, S., Naef, M., Lamboray, E., Spagno, C., Kunz, A., Koller-Meier, E., Svoboda, T., Gool, L. V., Lang, S., Strehlke, K., Moere, A. V., and Staadt, O. 2003. blue-c: a spatially immersive display and 3d video portal for telepresence. ACM Trans. Graph. 22, 3, 819--827.

Digital Library

[13]

Isaksen, A., McMillan, L., and Gortler, S. J. 2000. Dynamically reparameterized light fields. In SIGGRAPH, 297--306.

Digital Library

[14]

Ives, H. E. 1928. Camera for making parallax panoramagrams. J. Opt. Soc. of America 17, 435--439.

[15]

Levin, A., Fergus, R., Durand, F., and Freeman, W. T. 2007. Image and depth from a conventional camera with a coded aperture. ACM Trans. Graph. 26, 3, 70.

Digital Library

[16]

Levoy, M., and Hanrahan, P. 1996. Light field rendering. In SIGGRAPH, 31--42.

Digital Library

[17]

Lippmann, G. 1908. Epreuves reversible donnant la sensation du relief. Journal of Physics 7, 4, 821--825.

[18]

Matusik, W., Buehler, C., and McMillan, L. 2001. Polyhedral visual hulls for real-time rendering. In EGSR, 115--126.

Digital Library

[19]

Nayar, S. K., Krishnan, G., Grossberg, M. D., and Raskar, R. 2006. Fast separation of direct and global components of a scene using high frequency illumination. ACM Trans. Graph. 25, 3, 935--944.

Digital Library

[20]

Ng, R., Levoy, M., Brédif, M., Duval, G., Horowitz, M., and Hanrahan, P. 2005. Light field photography with a hand-held plenoptic camera. Tech. rep., Stanford University.

[21]

Ng, R. 2005. Fourier slice photography. ACM Trans. Graph. 24, 735--744.

Digital Library

[22]

Ramamoorthi, R., Koudelka, M., and Belhumeur, P. 2005. A fourier theory for cast shadows. IEEE TPAMI 27, 2, 288--295.

Digital Library

[23]

Ramamoorthi, R., Mahajan, D., and Belhumeur, P. 2007. A first-order analysis of lighting, shading, and shadows. ACM Trans. Graph. 26, 1, 2.

Digital Library

[24]

Raskar, R., Agrawal, A., and Tumblin, J. 2006. Coded exposure photography: motion deblurring using fluttered shutter. ACM Trans. Graph. 25, 3, 795--804.

Digital Library

[25]

Savarese, S., Rushmeier, H., Bernardini, F., and Per-ona, P. 2001. Shadow carving. In ICCV, 190--197.

[26]

Soler, C., and Sillion, F. X. 1998. Fast calculation of soft shadow textures using convolution. In SIGGRAPH, 321--332.

Digital Library

[27]

Talvala, E.-V., Adams, A., Horowitz, M., and Levoy, M. 2007. Veiling glare in high dynamic range imaging. ACM Trans. Graph. 26, 3, 37.

Digital Library

[28]

Thornber, K., and Jacobs, D. 2001. Cast shadows and linear subspaces. Tech. rep. TR-2001-100, NEC.

[29]

Veeraraghavan, A., Raskar, R., Agrawal, A., Mohan, A., and Tumblin, J. 2007. Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing. ACM Trans. Graph. 26, 3, 69.

Digital Library

[30]

Vlasic, D., Pfister, H., Molinov, S., Grzeszczuk, R., and Matusik, W. 2003. Opacity light fields: Interactive rendering of surface light fields with view-dependent opacity. In Symposium on Interactive 3D Graphics (i3D), 65--74.

Digital Library

[31]

Wilburn, B., Joshi, N., Vaish, V., Talvala, E.-V., An-tunez, E., Barth, A., Adams, A., Horowitz, M., and Levoy, M. 2005. High performance imaging using large camera arrays. ACM Trans. Graph. 24, 3, 765--776.

Digital Library

[32]

Wood, D., Azuma, D., Aldinger, K., Curless, B., Duchamp, T., Salesin, D., and Stuetzle, W. 2000. Surface light fields for 3d photography. In SIGGRAPH, 287--296.

Digital Library

[33]

Yamazaki, S., Narasimhan, S. G., Baker, S., and Kanade, T. 2007. Coplanar shadowgrams for acquiring visual hulls of intricate objects. In ICCV, 1--8.

[34]

Zhou, K., Hu, Y., Lin, S., Guo, B., and Shum, H.-Y. 2005. Precomputed shadow fields for dynamic scenes. ACM Trans. Graph. 24, 3, 1196--1201.

Digital Library

[35]

Zwicker, M., Matusik, W., Durand, F., and Pfister, H. 2006. Antialiasing for automultiscopic displays. In EGSR, 1--10.

Digital Library

Cited By

Zhou SZhu TShi KLi YZheng WYong J(2021)Review of light field technologiesVisual Computing for Industry, Biomedicine, and Art10.1186/s42492-021-00096-84:1Online publication date: 3-Dec-2021
https://doi.org/10.1186/s42492-021-00096-8
Swedish THenley CRaskar R(2021)Objects as Cameras: Estimating High-Frequency Illumination from Shadows2021 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV48922.2021.00259(2573-2582)Online publication date: Oct-2021
https://doi.org/10.1109/ICCV48922.2021.00259
Mildenhall BSrinivasan POrtiz-Cayon RKalantari NRamamoorthi RNg RKar A(2019)Local light field fusionACM Transactions on Graphics10.1145/3306346.332298038:4(1-14)Online publication date: 12-Jul-2019
https://dl.acm.org/doi/10.1145/3306346.3322980
Show More Cited By

Index Terms

Shield fields: modeling and capturing 3D occluders
1. Applied computing
  1. Document management and text processing
    1. Document capture
      1. Document scanning
      2. Graphics recognition and interpretation
2. Computing methodologies
  1. Computer graphics
    1. Image manipulation

Recommendations

Shield fields: modeling and capturing 3D occluders

We describe a unified representation of occluders in light transport and photography using shield fields: the 4D attenuation function which acts on any light field incident on an occluder. Our key theoretical result is that shield fields can be used to ...
Phasor Imaging: A Generalization of Correlation-Based Time-of-Flight Imaging

In correlation-based time-of-flight (C-ToF) imaging systems, light sources with temporally varying intensities illuminate the scene. Due to global illumination, the temporally varying radiance received at the sensor is a combination of light received ...
Glare aware photography: 4D ray sampling for reducing glare effects of camera lenses

Glare arises due to multiple scattering of light inside the camera's body and lens optics and reduces image contrast. While previous approaches have analyzed glare in 2D image space, we show that glare is inherently a 4D ray-space phenomenon. By ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH Asia '08: ACM SIGGRAPH Asia 2008 papers

December 2008

581 pages

ISBN:9781450318310

DOI:10.1145/1457515

Editor:
John C. Hart
University of Illinois at Urbana-Champaign, Urbana, IL

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGGRAPH '08

Sponsor:

SIGGRAPH

SIGGRAPH '08: Special Interest Group on Computer Graphics and Interactive Techniques Conference

December 10 - 13, 2008

Singapore

Acceptance Rates

SIGGRAPH Asia '08 Paper Acceptance Rate 59 of 320 submissions, 18%;

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
735
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhou SZhu TShi KLi YZheng WYong J(2021)Review of light field technologiesVisual Computing for Industry, Biomedicine, and Art10.1186/s42492-021-00096-84:1Online publication date: 3-Dec-2021
https://doi.org/10.1186/s42492-021-00096-8
Swedish THenley CRaskar R(2021)Objects as Cameras: Estimating High-Frequency Illumination from Shadows2021 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV48922.2021.00259(2573-2582)Online publication date: Oct-2021
https://doi.org/10.1109/ICCV48922.2021.00259
Mildenhall BSrinivasan POrtiz-Cayon RKalantari NRamamoorthi RNg RKar A(2019)Local light field fusionACM Transactions on Graphics10.1145/3306346.332298038:4(1-14)Online publication date: 12-Jul-2019
https://dl.acm.org/doi/10.1145/3306346.3322980
Mitra KCossairt OVeeraraghavan A(2014)A Framework for Analysis of Computational Imaging Systems: Role of Signal Prior, Sensor Noise and MultiplexingIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2014.231311836:10(1909-1921)Online publication date: Oct-2014
https://doi.org/10.1109/TPAMI.2014.2313118
Kim JLanman DMukaigawa YRaskar R(2010)Descattering Transmission via Angular FilteringComputer Vision – ECCV 201010.1007/978-3-642-15549-9_7(86-99)Online publication date: 2010
https://doi.org/10.1007/978-3-642-15549-9_7
Cuypers TFrancken YTaelman JBekaert P(2009)Shadow multiplexing for real-time silhouette extraction2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops10.1109/CVPRW.2009.5204341(61-68)Online publication date: Jun-2009
https://doi.org/10.1109/CVPRW.2009.5204341

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents