article

Synthetic aperture confocal imaging

Authors:

Mark BolasAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 23, Issue 3

Pages 825 - 834

https://doi.org/10.1145/1015706.1015806

Published: 01 August 2004 Publication History

Abstract

Confocal microscopy is a family of imaging techniques that employ focused patterned illumination and synchronized imaging to create cross-sectional views of 3D biological specimens. In this paper, we adapt confocal imaging to large-scale scenes by replacing the optical apertures used in microscopy with arrays of real or virtual video projectors and cameras. Our prototype implementation uses a video projector, a camera, and an array of mirrors. Using this implementation, we explore confocal imaging of partially occluded environments, such as foliage, and weakly scattering environments, such as murky water. We demonstrate the ability to selectively image any plane in a partially occluded environment, and to see further through murky water than is otherwise possible. By thresholding the confocal images, we extract mattes that can be used to selectively illuminate any plane in the scene.

Supplementary Material

MOV File (pps074.mov)

Download
11.92 KB

References

[1]

CHAI, J.-X., TONG, X., CHAN, S.-C. SHUM, H.-Y. "Plenoptic Sampling." Proc. SIGGRAPH 2000.

Digital Library

[2]

CHAM, T.-J., REHG, J. M., SUKTHANKAR, R., SUKTHANKAR, G., "Shadow Elimination and Occluder Light Suppression for Multi-Projector Displays," Proc. PROCAMS 2003.

[3]

CHUANG, Y.-Y., CURLESS, B., SALESIN, D. H., SZELISKI, R., "A Bayesian Approach to Digital Matting," Proc. CVPR 2001.

[4]

COORG, S., TELLER, S., "Extracting Textured Vertical Facades from Controlled Close-Range Imagery," Proc. CVPR 1999.

[5]

CORLE, T. R., KINO, G. S., Confocal Scanning Optical Microscopy and Related Imaging Systems, Academic Press, 1996.

[6]

DEBEVEC, P., "Image-Based Lighting." IEEE Computer Graphics and Applications, Vol. 22, No. 2, March/April, 2002.

Digital Library

[7]

HAN, J. Y., PERLIN, K., "Measuring Bidirectional Texture Reflectance With a Kaleidoscope," Proc. SIGGRAPH 2003.

Digital Library

[8]

HARWIT, M., SLOANE, N. J. A., "Hadamard Transform Optics," Academic Press, 1979.

[9]

ISAKSEN, A., MCMILLAN, L., GORTLER, S. J., "Dynamically Reparameterized Light Fields," Proc. SIGGRAPH 2000.

Digital Library

[10]

JAFFE, J. S., "Computer Modeling and the Design of Optimal Underwater Imaging Systems," J. Oceanic Eng., Vol. 15, No. 2, 1990.

[11]

JAFFE, J. S., MCLEAN, J., STRAND, M. P., MOORE, K. D., "Underwater Optical Imaging: Status and Prospects," Oceanography. Vol. 14, No. 3, 2001, pp. 66--76.

[12]

LEVOY, M., HANRAHAN, P., "Light Field Rendering," Proc. SIGGRAPH 1996.

Digital Library

[13]

MALZBENDER, T., GELB, D., WOLTERS, H., "Polynomial Texture Maps," Proc. SIGGRAPH 2001.

Digital Library

[14]

MASSELUS, V., PEERS, P., DUTRE, P., WILLEMS, Y. D., "Relighting with 4D incident light fields," Proc. SIGGRAPH 2003.

Digital Library

[15]

MIDDLETON, W., Vision Through the Atmosphere, University of Toronto Press, 1952.

[16]

MOBLEY, C., Light and Water: Radiative Transfer in Natural Waters, Academic Press, 1994.

[17]

OKASHI, T., Three-Dimensional Imaging Techniques, Academic Press, 1976.

[18]

RUSINKIEWICZ, S., HALL-HOLT, O., LEVOY, M., "Real-Time 3D Model Acquisition," Proc. SIGGRAPH 2002.

Digital Library

[19]

SCHECHNER, Y. Y., KARPEL, N., "Clear Underwater Vision," Proc. CVPR 2004.

[20]

SCHECHNER, Y., NAYAR., S., BELHUMEUR, P., "A Theory of Multiplexed Illumination." Proc. ICCV 2003.

Digital Library

[21]

SMITH, A., BLINN, J., "Blue Screen Matting," Proc. SIGGRAPH 1996.

Digital Library

[22]

VAISH, V., WILBURN, B., JOSHI, N., LEVOY, M., "Using Plane + Parallax for Calibrating Dense Camera Arrays." Proc. CVPR 2004.

[23]

WILBURN, B., SMULSKI, M., LEE, K., HOROWITZ, M. A., "The Light Field Video Camera," Proc. SPIE Electronic Imaging 2002.

[24]

WILSON, T., JUSKAITIS, R., NEIL, M., KOZUBEK, M., "Confocal Microscopy by Aperture Correlation," Optics Letters, 21(3), 1996.

[25]

ZAND, J., "Coded aperture imaging in high energy astronomy," NASA Laboratory for High Energy Astrophysics (LHEA) at NASA's GSFC, 1996. URL: http://theawww.gsfc.nasa.gov/docs/cai/.

Cited By

Guindy MKara P(2024)Lessons Learned from Implementing Light Field Camera Animation: Implications, Limitations, Potentials, and Future Research EffortsMultimodal Technologies and Interaction10.3390/mti80800688:8(68)Online publication date: 1-Aug-2024
https://doi.org/10.3390/mti8080068
Kusuyama HKageyama YIwai DSato K(2024)A Multi-aperture Coaxial Projector Balancing Shadow Suppression and DeblurringIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345617030:11(7031-7041)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456170
Jha MBhandari A(2024)CBLA: Color-Balanced Locally Adjustable Underwater Image EnhancementIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2024.339685073(1-11)Online publication date: 2024
https://doi.org/10.1109/TIM.2024.3396850
Show More Cited By

Index Terms

Synthetic aperture confocal imaging
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        Epipolar geometry

Recommendations

Synthetic aperture confocal imaging
SIGGRAPH '04: ACM SIGGRAPH 2004 Papers

Confocal microscopy is a family of imaging techniques that employ focused patterned illumination and synchronized imaging to create cross-sectional views of 3D biological specimens. In this paper, we adapt confocal imaging to large-scale scenes by ...
Short-lag spatial coherence combined with eigenspace-based minimum variance beamformer for synthetic aperture ultrasound imaging

Recently, short-lag spatial coherence (SLSC) imaging has been widely studied to improve image contrast and contrast-to-noise ratio (CNR) in ultrasound imaging. Nevertheless, SLSC is unable to provide a good imaging resolution. Eigenspace-based minimum ...
Template-driven segmentation of confocal microscopy images

High quality 3D visualization of anatomic structures is necessary for many applications. The anatomic structures first need to be segmented. A variety of segmentation algorithms have been developed for this purpose. For confocal microscopy images, the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 23, Issue 3

August 2004

684 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1015706

Editor:
John C. Hart

Issue’s Table of Contents

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2004

Published in TOG Volume 23, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

124
Total Citations
View Citations
2,513
Total Downloads

Downloads (Last 12 months)84
Downloads (Last 6 weeks)11

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Guindy MKara P(2024)Lessons Learned from Implementing Light Field Camera Animation: Implications, Limitations, Potentials, and Future Research EffortsMultimodal Technologies and Interaction10.3390/mti80800688:8(68)Online publication date: 1-Aug-2024
https://doi.org/10.3390/mti8080068
Kusuyama HKageyama YIwai DSato K(2024)A Multi-aperture Coaxial Projector Balancing Shadow Suppression and DeblurringIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345617030:11(7031-7041)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456170
Jha MBhandari A(2024)CBLA: Color-Balanced Locally Adjustable Underwater Image EnhancementIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2024.339685073(1-11)Online publication date: 2024
https://doi.org/10.1109/TIM.2024.3396850
Pu XWang XShi LMa YWei CGao XGao J(2023)Computational imaging and occluded objects perception method based on polarization camera arrayOptics Express10.1364/OE.49517731:15(24633)Online publication date: 11-Jul-2023
https://doi.org/10.1364/OE.495177
Huang ZYang Yang YZhang XMiao YTang QLiu X(2023)Light field camera decoding based on two-plane ray modelInternational Conference on Optical and Photonic Engineering (icOPEN 2022)10.1117/12.2667012(76)Online publication date: 27-Jan-2023
https://doi.org/10.1117/12.2667012
Hiratani KIwai DKageyama YPunpongsanon PHiraki TSato K(2023)Shadowless Projection Mapping using Retrotransmissive OpticsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324710429:5(2280-2290)Online publication date: 22-Feb-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3247104
Kumar AKamal ASingh JGupta B(2023)Ultra Low Energy Charge Trapping MOSFET With Neuro-Inspired Learning CapabilitiesIEEE Transactions on Nanotechnology10.1109/TNANO.2023.328398722(266-272)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1109/TNANO.2023.3283987
Bon BLe Pendu MGuillemot C(2023)Unrolled Fourier Disparity Layer Optimization for Scene Reconstruction from Few-Shots Focal StacksICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP49357.2023.10095720(1-5)Online publication date: 4-Jun-2023
https://doi.org/10.1109/ICASSP49357.2023.10095720
Guo XZhao CCheng YXu MYuan Z(2023)Adaptive Light Field Contrast Enhancement using Efficient Feature Extraction2023 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)10.1109/BMSB58369.2023.10211548(1-4)Online publication date: 14-Jun-2023
https://doi.org/10.1109/BMSB58369.2023.10211548
Bon BLe Pendu MGuillemot C(2023)Joint Fourier Disparity Layers Unrolling With Learned View Synthesis for Light Field Reconstruction From Few-Shots Focal StacksIEEE Access10.1109/ACCESS.2023.332932811(123350-123360)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3329328
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents