Abstract
Since 1960s, aperture patterns have been studied extensively and a variety of coded apertures have been proposed for various applications, including extended depth of field, defocus deblurring, depth from defocus, light field acquisition, etc. Researches have shown that optimal aperture patterns can be quite different due to different applications, imaging conditions, or scene contents. In addition, many coded aperture techniques require aperture patterns to be temporally changed during capturing. As a result, it is often necessary to have a programmable aperture camera whose aperture pattern can be dynamically changed as needed in order to capture more useful information.
In this paper, we propose a programmable aperture camera using a Liquid Crystal on Silicon (LCoS) device. This design affords a high brightness contrast and high resolution aperture with a relatively low light loss, and enables one change the pattern at a reasonably high frame rate. We build a prototype camera and evaluate its features and drawbacks comprehensively by experiments. We also demonstrate two coded aperture applications in light field acquisition and defocus deblurring.
Chapter PDF
Similar content being viewed by others
Keywords
- Liquid Crystal Display
- Polarize Beam Splitter
- High Dynamic Range Imaging
- Defocused Image
- Lens Aberration
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Veeraraghavan, A., Raskar, R., Agrawal, A., Mohan, A., Tumblin, J.: Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing. ACM Trans. Graphics (2007)
Zhou, C., Nayar, S.: What are good apertures for defocus deblurring? In: International Conference of Computational Photography, San Francisco, U.S (2009)
Levin, A., Fergus, R., Durand, F., Freeman, W.: Image and depth from a conventional camera with a coded aperture. Proc. ACM SIGGRAPH 26, 70 (2007)
Zhou, C., Lin, S., Nayar, S.: Coded Aperture Pairs for Depth from Defocus. In: Proc. International Conference on Computer Vision, Kyoto, Japan (2009)
Liang, C.K., Lin, T.H., Wong, B.Y., Liu, C., Chen, H.: Programmable aperture photography: Multiplexed light field acquisition. ACM Trans. Graphics 27 (2008)
Raskar, R., Agrawal, A., Tumblin, J.: Coded exposure photography: motion deblurring using fluttered shutter. ACM Trans. Graphics, 795–804 (2006)
Gottesman, S., Fenimore, E.: New family of binary arrays for coded aperture imaging. Applied Optics, 4344–4352 (1989)
Zomet, A., Nayar, S.: Lensless Imaging with a Controllable Aperture. In: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, p. 346. IEEE Computer Society, Los Alamitos (2006)
Bando, Y., Chen, B., Nishita, T.: Extracting depth and matte using a color-filtered aperture. ACM Trans. Graphics 27 (2008)
Hasinoff, S., Kutulakos, K., Durand, F., Freeman, W.: Time-constrained photography. In: Proc. International Conference on Computer Vision, pp. 1–8 (2009)
Caroli, E., Stephen, J., Cocco, G., Natalucci, L., Spizzichino, A.: Coded aperture imaging in X-and gamma-ray astronomy. Space Science Reviews, 349–403 (1987)
Welford, W.: Use of annular apertures to increase focal depth. Journal of the Optical Society of America A, 749–753 (1960)
Mino, M., Okano, Y.: Improvement in the OTF of a defocused optical system through the use of shaded apertures. Applied Optics, 2219–2225 (1971)
Varamit, C., Indebetouw, G.: Imaging properties of defocused partitioned pupils. Journal of the Optical Society of America A, 799–802 (1985)
Ojeda-Castafieda, J., Andres, P., Diaz, A.: Annular apodizers for low sensitivity to defocus and to spherical aberration. Optics Letters, 487–489 (1986)
Zomet, A., Nayar, S.: Lensless imaging with a controllable aperture. In: Proc. Computer Vision and Pattern Recognition, pp. 339–346 (2006)
Aggarwal, M., Ahuja, N.: Split Aperture Imaging for High Dynamic Range. International Journal of Computer Vision 58, 7–17 (2004)
Green, P., Sun, W., Matusik, W., Durand, F.: Multi-aperture photography. Proc. ACM SIGGRAPH 26 (2007)
Wikipedia: Liquid crystal on silicon, http://en.wikipedia.org/wiki/Liquid_crystal_on_silicon
Mannami, H., Sagawa, R., Mukaigawa, Y., Echigo, T., Yagi, Y.: High dynamic range camera using reflective liquid crystal. In: Proc. International Conference on Computer Vision, pp. 14–20 (2007)
Nayar, S.K., Branzoi, V., Boult, T.: Programmable imaging: Towards a flexible camera. International Journal of Computer Vision 70, 7–22 (2006)
Nagahara, H., Kuthirummal, S., Zhou, C., Nayar, S.: Flexible depth of field photography. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol. 5305, pp. 60–73. Springer, Heidelberg (2008)
Levoy, M., Hanrahan, P.: Light field rendering. In: Proc. ACM SIGGRAPH, pp. 31–42 (1996)
Schechner, Y., Nayar, S., Belhumeur, P.: A theory of multiplexed illumination. In: Proc. International Conference on Computer Vision, vol. 2, pp. 808–815 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
1 Electronic Supplementary Material
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nagahara, H., Zhou, C., Watanabe, T., Ishiguro, H., Nayar, S.K. (2010). Programmable Aperture Camera Using LCoS. In: Daniilidis, K., Maragos, P., Paragios, N. (eds) Computer Vision – ECCV 2010. ECCV 2010. Lecture Notes in Computer Science, vol 6316. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15567-3_25
Download citation
DOI: https://doi.org/10.1007/978-3-642-15567-3_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15566-6
Online ISBN: 978-3-642-15567-3
eBook Packages: Computer ScienceComputer Science (R0)