research-article

Highlighted depth-of-field photography: Shining light on focus

Authors:

Roarke Horstmeyer,

Ramesh RaskarAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 30, Issue 3

Article No.: 24, Pages 1 - 9

https://doi.org/10.1145/1966394.1966403

Published: 19 May 2011 Publication History

Abstract

We present a photographic method to enhance intensity differences between objects at varying distances from the focal plane. By combining a unique capture procedure with simple image processing techniques, the detected brightness of an object is decreased proportional to its degree of defocus. A camera-projector system casts distinct grid patterns onto a scene to generate a spatial distribution of point reflections. These point reflections relay a relative measure of defocus that is utilized in postprocessing to generate a highlighted DOF photograph. Trade-offs between three different projector-processing pairs are analyzed, and a model is developed to help describe a new intensity-dependent depth of field that is controlled by the pattern of illumination. Results are presented for a primary single snapshot design as well as a scanning method and a comparison method. As an application, automatic matting results are presented.

Supplementary Material

Kim (kim.zip)

Supplemental movie and image files for, Highlighted depth-of-field photography: Shining light on focus

Download
27.30 MB

MP4 File (tp100_11.mp4)

Download
16.82 MB

References

[1]

Bae, S. and Durand, F. 2007. Defocus magnification. Comput. Graph. Forum 26, 3.

[2]

Born, M. and Wolf, E. 1970. Principles of Optics. Pergamon Press.

[3]

Davis, J., Nehab, D., Ramamoothi, R., and Rusinkiewicz, S. 2005. Spacetime stereo: A unifying framework for depth from triangulation. IEEE Trans. Patt. Anal. Mach. Intell. 27, 2.

Digital Library

[4]

Eisner, M., Lindlein, N., and Schwider, J. 1998. Confocal microscopy with a refractive microlens-pinhole array. Optics Lett. 23, 10.

[5]

Hasinoff, S. and Kutulakos, K. 2006. Confocal stereo. In Proceedings of the 9th European Conference on Computer Vision (ECCV), 259--268.

Digital Library

[6]

Heintzmann, R., Hanley, Q. S., Arndt-jovin, D., and Jovin, T. M. 2001. A dual path programmable array microscope (pam):simultaneous acquisition of conjugate and non-conjugate images. J. Microscopy 204, 119--137.

[7]

Joshi, N., Matusik, W., and Avidan, S. 2006. Natural video matting using camera arrays. In Proceedings of the International Conference on Computer Graphics and Interactive Techniques. ACM SIGGRAPH. 779--786.

Digital Library

[8]

Kim, J., Lanman, D., Mukaigawa, Y., and Raskar, R. 2010. Descattering transmission via angular filtering. In Proceedings of the European Conference on Computer Vision (ECCV'10). Lecture Notes in Computer Science, vol. 6311. Springer, 86--99.

Digital Library

[9]

Lai, S., Fu, C., and Chang, S. 1992. A generalized depth estimation algorithm with a single image. IEEE Trans. Patt. Anal. Mach. Intell. 14, 4, 405--411.

Digital Library

[10]

LeMoigne, J. and Waxman, A. 1988. Structured light patterns for robot mobility. IEEE J. Robot. Autom. 4, 5, 541--548.

[11]

Levoy, M., Chen, B., Vaish, V., Horowitz, M., McDowall, I., and Bolas, M. 2004. Synthetic aperture confocal imaging. In Proceedings of the Conference on Computer Graphics and Interactive Techniques. ACM SIGGRAPH.

Digital Library

[12]

Levoy, M., Ng, R., Adams, A., Footer, M., and Horowitz, M. 2006. Light field microscopy. ACM Trans. Graph. 22, 2.

Digital Library

[13]

Levoy, M., Zhang, Z., and McDowall, I. 2009. Recording and controlling the 4d light field in a microscope. J. Microscopy 235.

[14]

Maas, H. 1992. Robust automatic surface reconstruction with structured light. Int. Arch. Photogram. Remote Sens. 29, B5.

[15]

Mitic, J., Anhut, T., Serov, A., and Lasser, T. 2003. Real-Time optically sectioned wide-field microscopy employing structured light illumination and a cmos detector. Proc. SPIE 4964.

[16]

Moreno-Noguer, F., Belhumeur, P. N., and Nayar, S. K. 2007. Active refocusing of images and videos. In Proceedings of the Conference on Computer Graphics and Interaction Techniques ACM SIGGRAPH 2007.

Digital Library

[17]

Mouaddabi, E., Batile, J., and Salvi, J. 1997. Recent progress in structured light in order to solve the correspondence problem in stereovision. In Proceedings of the IEEE International Conference on Robotics and Automation. (ICRA).

[18]

Nayar, S., Krichnan, G., Grossberg, M., and Raskar, R. 2006. Fast separation of direct and global components of a scene using high frequency illumination. ACM Trans. Graph. 25, 3, 935--943.

Digital Library

[19]

Ng, R., Levoy, M., Bredif, M., Duval, M., Horowitz, G., and Hanrahan, P. 2004. Light field photography with a hand-held plenoptic camera. Tech. rep, Stanford University.

[20]

Salvi, J., Pages, J., and Batlle, J. 2004. Pattern codification strategies in structured light systems. Patt. Recogn. 37, 827--849.

[21]

Schechner, Y., Kiryati, N., and Basri, R. 2000. Separation of transparent layers using focus. Int. J. Comput. Vis. 39, 1, 25--39.

Digital Library

[22]

Shrikhande, N. and Stockman, G. 1989. Surface orientation from a projection grid. IEEE Trans. Pattern Anal. Mach. Intell. 11, 6, 650--655.

Digital Library

[23]

Sun, J., Kang, S. B., and Shum, H. Y. 2006. Flash matting. In Proceedings of the International Conference on Computer Graphics and Interactive Techniques. ACM SIGGRAPH. 361--366.

Digital Library

[24]

Tiziani, H. and Uhde, H. 1994. Three-Dimensional analysis by a microlens-array confocal arrangement. Appl. Optics 33, 567--572.

[25]

Wang, Y., Mitiche, A., and Aggarwal, J. 1987. Computation of surface orientation and structure of objects using grid coding. IEEE Trans. Pattern Anal. Mach. Intell. 9, 129--137.

Digital Library

[26]

Watanabe, M. and Nayar, S. 1998. Rational filters for passive depth from defocus. Int. J. Comput. Vis. 27, 3, 203--225.

Digital Library

[27]

Will, P. and Pennington, K. 1971. Grid coding: A preprocessing technique for robot and machine vision. Artif. Intell. 2, 319--329.

[28]

Wilson, T., Juskaitis, R., Neil, M., and Kozubek, M. 1996. Confocal microscopy by aperture correlation. Optics Lett. 21, 3.

[29]

Zhang, L. and Nayar, S. 2006. Projection defocus analysis for scene capture and image display. ACM Trans. Graph. 25, 3, 907--915.

Digital Library

Cited By

Cao DRoetzer PBernard F(2023)Unsupervised Learning of Robust Spectral Shape MatchingACM Transactions on Graphics10.1145/359210742:4(1-15)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1145/3592107
Xu GHou QZhang LCheng MMagalhães Jdel Bimbo ASatoh SSebe NAlameda-Pineda XJin QOria VToni L(2022)FMNet: Frequency-Aware Modulation Network for SDR-to-HDR TranslationProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3548016(6425-6435)Online publication date: 10-Oct-2022
https://dl.acm.org/doi/10.1145/3503161.3548016
Walton DAnjos RFriston SSwapp DAkşit KSteed ARitschel T(2021)Beyond blurACM Transactions on Graphics10.1145/3450626.345994340:4(1-14)Online publication date: 23-Jul-2021
https://dl.acm.org/doi/10.1145/3450626.3459943
Show More Cited By

Index Terms

Highlighted depth-of-field photography: Shining light on focus
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
  2. Computer graphics
    1. Image manipulation
    2. Rendering

Recommendations

Computational Schlieren Photography with Light Field Probes

We introduce a new approach to capturing refraction in transparent media, which we call light field background oriented Schlieren photography. By optically coding the locations and directions of light rays emerging from a light field probe, we can ...
Real-time depth of field using multi-layer filtering
i3D '15: Proceedings of the 19th Symposium on Interactive 3D Graphics and Games

We present a novel technique for rendering depth of field that addresses difficult overlap cases, such as close, but out-of-focus, geometry in the near-field. Such scene configurations are not managed well by state-of-the-art post-processing approaches ...
Depth-of-Field Rendering with Saliency-Based Bilateral Filtering
CADGRAPHICS '13: Proceedings of the 2013 International Conference on Computer-Aided Design and Computer Graphics

Depth of Field (DoF) is an indispensable feature of photo realistic rendering and photography retouching. In this paper, we propose an image-based rendering technique which can simulate the depth-of-field effect. The proposed technique can render the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 30, Issue 3

May 2011

127 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1966394

Issue’s Table of Contents

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 May 2011

Accepted: 01 March 2011

Revised: 01 January 2011

Received: 01 August 2010

Published in TOG Volume 30, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
1,187
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)1

Reflects downloads up to 30 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cao DRoetzer PBernard F(2023)Unsupervised Learning of Robust Spectral Shape MatchingACM Transactions on Graphics10.1145/359210742:4(1-15)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1145/3592107
Xu GHou QZhang LCheng MMagalhães Jdel Bimbo ASatoh SSebe NAlameda-Pineda XJin QOria VToni L(2022)FMNet: Frequency-Aware Modulation Network for SDR-to-HDR TranslationProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3548016(6425-6435)Online publication date: 10-Oct-2022
https://dl.acm.org/doi/10.1145/3503161.3548016
Walton DAnjos RFriston SSwapp DAkşit KSteed ARitschel T(2021)Beyond blurACM Transactions on Graphics10.1145/3450626.345994340:4(1-14)Online publication date: 23-Jul-2021
https://dl.acm.org/doi/10.1145/3450626.3459943
Zhou BFranco JBogo FTekin BBoyer E(2020)Reconstructing Human Body Mesh from Point Clouds by Adversarial GP NetworkComputer Vision – ACCV 202010.1007/978-3-030-69525-5_8(123-139)Online publication date: 30-Nov-2020
https://dl.acm.org/doi/10.1007/978-3-030-69525-5_8
Haynes BMazumdar AAlaghi ABalazinska MCeze LCheung A(2018)LightDBProceedings of the VLDB Endowment10.14778/3231751.323176811:10(1192-1205)Online publication date: 1-Jun-2018
https://dl.acm.org/doi/10.14778/3231751.3231768
Wang XZhou BWang ZZou DChen XZhao Q(2018)Efficiently consistent affinity propagation for 3D shapes co-segmentationThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-018-1538-234:6-8(997-1008)Online publication date: 1-Jun-2018
https://dl.acm.org/doi/10.1007/s00371-018-1538-2
Koschier DBender JThuerey N(2017)Robust eXtended finite elements for complex cutting of deformablesACM Transactions on Graphics10.1145/3072959.307366636:4(1-13)Online publication date: 20-Jul-2017
https://dl.acm.org/doi/10.1145/3072959.3073666
Cosmo LRodolí EAlbarelli AMémoli FCremers D(2017)Consistent Partial Matching of Shape Collections via Sparse ModelingComputer Graphics Forum10.1111/cgf.1279636:1(209-221)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1111/cgf.12796
Xu KKim VHuang QKalogerakis E(2017)Data-Driven Shape Analysis and ProcessingComputer Graphics Forum10.1111/cgf.1279036:1(101-132)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1111/cgf.12790
Murmann LDavis AKautz JDurand F(2016)Computational bounce flash for indoor portraitsACM Transactions on Graphics10.1145/2980179.298021935:6(1-9)Online publication date: 5-Dec-2016
https://dl.acm.org/doi/10.1145/2980179.2980219
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents