Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article
Open access

Multisource Holography

Published: 05 December 2023 Publication History

Abstract

Holographic displays promise several benefits including high quality 3D imagery, accurate accommodation cues, and compact form-factors. However, holography relies on coherent illumination which can create undesirable speckle noise in the final image. Although smooth phase holograms can be speckle-free, their non-uniform eyebox makes them impractical, and speckle mitigation with partially coherent sources also reduces resolution. Averaging sequential frames for speckle reduction requires high speed modulators and consumes temporal bandwidth that may be needed elsewhere in the system.
In this work, we propose multisource holography, a novel architecture that uses an array of sources to suppress speckle in a single frame without sacrificing resolution. By using two spatial light modulators, arranged sequentially, each source in the array can be controlled almost independently to create a version of the target content with different speckle. Speckle is then suppressed when the contributions from the multiple sources are averaged at the image plane. We introduce an algorithm to calculate multisource holograms, analyze the design space, and demonstrate up to a 10 dB increase in peak signal-to-noise ratio compared to an equivalent single source system. Finally, we validate the concept with a benchtop experimental prototype by producing both 2D images and focal stacks with natural defocus cues.

Supplementary Material

ZIP File (papers_606s4-file4.zip)
supplemental
MP4 File (papers_606s4-file3.mp4)
supplemental

References

[1]
Boris Apter, Uzi Efron, and Eldad Bahat-Treidel. 2004. On the fringing-field effect in liquid-crystal beam-steering devices. Applied Optics 43, 1 (2004), 11--19.
[2]
Seung-Hwan Baek, Ethan Tseng, Andrew Maimone, Nathan Matsuda, Grace Kuo, Qiang Fu, Wolfgang Heidrich, Douglas Lanman, and Felix Heide. 2021. Neural Etendue Expander for Ultra-Wide-Angle High-Fidelity Holographic Display. arXiv (2021).
[3]
Kiseung Bang, Changwon Jang, and Byoungho Lee. 2019. Compact noise-filtering volume gratings for holographic displays. Optics Letters 44, 9 (2019), 2133--2136.
[4]
Praneeth Chakravarthula, Seung-Hwan Baek, Ethan Tseng, Andrew Maimone, Grace Kuo, Florian Schiffers, Nathan Matsuda, Oliver Cossairt, Douglas Lanman, and Felix Heide. 2022. Pupil-aware holography. arXiv (2022).
[5]
Praneeth Chakravarthula, Yifan Peng, Joel Kollin, Henry Fuchs, and Felix Heide. 2019. Wirtinger holography for near-eye displays. ACM Transactions on Graphics (TOG) 38, 6 (2019), 213.
[6]
Praneeth Chakravarthula, Ethan Tseng, Tarun Srivastava, Henry Fuchs, and Felix Heide. 2020. Learned hardware-in-the-loop phase retrieval for holographic near-eye displays. ACM Transactions on Graphics 39, 6 (2020).
[7]
Suyeon Choi, Manu Gopakumar, Yifan Peng, Jonghyun Kim, Matthew O'Toole, and Gordon Wetzstein. 2022. Time-multiplexed neural holography: A flexible framework for holographic near-eye displays with fast heavily-quantized spatial light modulators. In ACM SIGGRAPH 2022 Conference Proceedings. 1--9.
[8]
Suyeon Choi, Manu Gopakumar, Yifan Peng, Jonghyun Kim, and Gordon Wetzstein. 2021a. Neural 3D Holography: Learning Accurate Wave Propagation Models for 3D Holographic Virtual and Augmented Reality Displays. ACM Transactions on Graphics 40, 6 (2021).
[9]
Suyeon Choi, Jonghyun Kim, Yifan Peng, and Gordon Wetzstein. 2021b. Optimizing image quality for holographic near-eye displays with Michelson holography. Optica 8, 2 (2021), 143--146.
[10]
Eduardo Cuervo, Krishna Chintalapudi, and Manikanta Kotaru. 2018. Creating the perfect illusion: What will it take to create life-like virtual reality headsets?. In Proceedings of the 19th International Workshop on Mobile Computing Systems & Applications. 7--12.
[11]
Vincent R Curtis, Nicholas W Caira, Jiayi Xu, Asha Gowda Sata, and Nicolas C Pégard. 2021. DCGH: Dynamic computer generated holography for speckle-free, high fidelity 3D displays. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). IEEE, 1--9.
[12]
Yuanbo Deng and Daping Chu. 2017. Coherence properties of different light sources and their effect on the image sharpness and speckle of holographic displays. Scientific Reports 7, 1 (2017), 5893.
[13]
Jean Duchon. 1977. Splines minimizing rotation-invariant semi-norms in Sobolev spaces. In Constructive Theory of Functions of Several Variables: Proceedings of a Conference Held at Oberwolfach April 25--May 1, 1976. Springer, 85--100.
[14]
James R Fienup. 1982. Phase retrieval algorithms: a comparison. Applied Optics 21, 15 (1982), 2758--2769.
[15]
Isaac Freund, Michael Rosenbluh, and Shechao Feng. 1988. Memory effects in propagation of optical waves through disordered media. Physical Review Letters 61, 20 (1988), 2328.
[16]
A Georgiou, J Christmas, N Collings, J Moore, and WA Crossland. 2008. Aspects of hologram calculation for video frames. Journal of Optics A: Pure and Applied Optics 10, 3 (2008), 035302.
[17]
Ioannis Gkioulekas, Anat Levin, Frédo Durand, and Todd Zickler. 2015. Micron-scale light transport decomposition using interferometry. ACM Transactions on Graphics (ToG) 34, 4 (2015), 1--14.
[18]
Joseph W Goodman. 2005. Introduction to Fourier optics. Roberts and Company publishers.
[19]
Joseph W Goodman. 2007. Speckle phenomena in optics: theory and applications. Roberts and Company Publishers.
[20]
Manu Gopakumar, Jonghyun Kim, Suyeon Choi, Yifan Peng, and Gordon Wetzstein. 2021. Unfiltered holography: Optimizing high diffraction orders without optical filtering for compact holographic displays. Optics Letters 46, 23 (2021), 5822--5825.
[21]
John F Heanue, Matthew C Bashaw, and Lambertus Hesselink. 1994. Volume holographic storage and retrieval of digital data. Science 265, 5173 (1994), 749--752.
[22]
David M Hoffman, Ahna R Girshick, Kurt Akeley, and Martin S Banks. 2008. Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. Journal of Vision 8, 3 (2008), 33--33.
[23]
Youngjin Jo, Dongheon Yoo, Dukho Lee, Minkwan Kim, and Byoungho Lee. 2022. Multiillumination 3D holographic display using a binary mask. Optics Letters 47, 10 (2022), 2482--2485.
[24]
Koray Kavaklı, Yuta Itoh, Hakan Urey, and Kaan Akşit. 2023. Realistic defocus blur for multiplane computer-generated holography. In 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR). IEEE, 418--426.
[25]
Koray Kavaklı, Hakan Urey, and Kaan Akşit. 2022. Learned holographic light transport. Applied Optics 61, 5 (2022), B50--B55.
[26]
Dongyeon Kim, Seung-Woo Nam, Byounghyo Lee, Jong-Mo Seo, and Byoungho Lee. 2022b. Accommodative holography: Improving accommodation response for perceptually realistic holographic displays. ACM Transactions on Graphics (TOG) 41, 4 (2022), 1--15.
[27]
Jonghyun Kim, Manu Gopakumar, Suyeon Choi, Yifan Peng, Ward Lopes, and Gordon Wetzstein. 2022a. Holographic glasses for virtual reality. In ACM SIGGRAPH 2022 Conference Proceedings. 1--9.
[28]
Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv (2014).
[29]
Alankar Kotwal, Anat Levin, and Ioannis Gkioulekas. 2020. Interferometric transmission probing with coded mutual intensity. ACM Transactions on Graphics (TOG) 39, 4 (2020), 74--1.
[30]
Alankar Kotwal, Anat Levin, and Ioannis Gkioulekas. 2023. Swept-angle synthetic wavelength interferometry. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 8233--8243.
[31]
Tomasz Kozacki, Maksymilian Chlipala, Juan Martinez-Carranza, Rafał Kukołowicz, and Moncy Sajeev Idicula. 2022. LED near-eye holographic display with a large non-paraxial hologram generation. Optics Express 30, 24 (2022), 43551--43565.
[32]
Grace Kuo, Laura Waller, Ren Ng, and Andrew Maimone. 2020. High resolution étendue expansion for holographic displays. ACM Transactions on Graphics (TOG) 39, 4 (2020), 66.
[33]
Byounghyo Lee, Dongyeon Kim, Seungjae Lee, Chun Chen, and Byoungho Lee. 2022. High-contrast, speckle-free, true 3D holography via binary CGH optimization. Scientific Reports 12, 1 (2022), 2811.
[34]
Byounghyo Lee, Dongheon Yoo, Jinsoo Jeong, Seungjae Lee, Dukho Lee, and Byoungho Lee. 2020b. Wide-angle speckleless DMD holographic display using structured illumination with temporal multiplexing. Optics Letters 45, 8 (2020), 2148--2151.
[35]
Dukho Lee, Changwon Jang, Kiseung Bang, Seokil Moon, Gang Li, and Byoungho Lee. 2019. Speckle reduction for holographic display using optical path difference and random phase generator. IEEE Transactions on Industrial Informatics 15, 11 (2019), 6170--6178.
[36]
Seungjae Lee, Dongyeon Kim, Seung-Woo Nam, Byounghyo Lee, Jaebum Cho, and Byoungho Lee. 2020a. Light source optimization for partially coherent holographic displays with consideration of speckle contrast, resolution, and depth of field. Scientific Reports 10, 1 (2020), 18832.
[37]
Andrew Maimone, Andreas Georgiou, and Joel S Kollin. 2017. Holographic near-eye displays for virtual and augmented reality. ACM Transactions on Graphics (TOG) 36, 4 (2017), 85.
[38]
Kyoji Matsushima and Tomoyoshi Shimobaba. 2009. Band-limited angular spectrum method for numerical simulation of free-space propagation in far and near fields. Optics Express 17, 22 (2009), 19662--19673.
[39]
Eunkyong Moon, Myeongjae Kim, Jinyoung Roh, Hwi Kim, and Joonku Hahn. 2014. Holographic head-mounted display with RGB light emitting diode light source. Optics Express 22, 6 (2014), 6526--6534.
[40]
Simon Moser, Monika Ritsch-Marte, and Gregor Thalhammer. 2019. Model-based compensation of pixel crosstalk in liquid crystal spatial light modulators. Optics Express 27, 18 (2019), 25046--25063.
[41]
Nitish Padmanaban, Yifan Peng, and Gordon Wetzstein. 2019. Holographic near-eye displays based on overlap-add stereograms. ACM Transactions on Graphics (TOG) 38, 6 (2019), 1--13.
[42]
Jae-Hyeung Park and Byoungho Lee. 2022. Holographic techniques for augmented reality and virtual reality near-eye displays. Light: Advanced Manufacturing 3, 1 (2022), 137--150.
[43]
Yifan Peng, Suyeon Choi, Jonghyun Kim, and Gordon Wetzstein. 2021. Speckle-free holography with partially coherent light sources and camera-in-the-loop calibration. Science Advances 7, 46 (2021), eabg5040.
[44]
Yifan Peng, Suyeon Choi, Nitish Padmanaban, and Gordon Wetzstein. 2020. Neural holography with camera-in-the-loop training. ACM Transactions on Graphics (TOG) 39, 6 (2020), 1--14.
[45]
Yifan Peng, Xiong Dun, Qilin Sun, and Wolfgang Heidrich. 2017. Mix-and-match holography. ACM Trans. Graph. 36, 6 (2017), 191--1.
[46]
Martin Persson, David Engström, and Mattias Goksör. 2012. Reducing the effect of pixel crosstalk in phase only spatial light modulators. Optics Express 20, 20 (2012), 22334--22343.
[47]
Nikolay Primerov, Jean Dahdah, Stefan Gloor, Nicolai Matuschek, Tim von Niederhäusern, Antonino Castiglia, Marco Malinverni, Christian Mounir, Marco Rossetti, Marcus Duelk, et al. 2019. P-203: Late-News Poster: Integrated Full-Color RGB Superluminescent LED Module for Micro-Displays. In SID Symposium Digest of Technical Papers, Vol. 50. Wiley Online Library, 1731--1734.
[48]
Edgar Riba, Dmytro Mishkin, Daniel Ponsa, Ethan Rublee, and Gary Bradski. 2020. Kornia: An open source differentiable computer vision library for Pytorch. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 3674--3683.
[49]
W.O. Saxton and R.W. Gerchberg. 1972. Gerchberg---Saxton algorithm: Experimental realisation and modification for the problem of formation of multimode laser beams. Optik 35, 2 (1972), 237--246.
[50]
Liang Shi, Beichen Li, Changil Kim, Petr Kellnhofer, and Wojciech Matusik. 2021. Towards real-time photorealistic 3D holography with deep neural networks. Nature 591, 7849 (2021), 234--239.
[51]
Di Wang, Nan-Nan Li, Chao Liu, and Qiong-Hua Wang. 2019. Holographic display method to suppress speckle noise based on effective utilization of two spatial light modulators. Optics Express 27, 8 (2019), 11617--11625.
[52]
Gordon Wetzstein, Douglas R Lanman, Matthew Waggener Hirsch, and Ramesh Raskar. 2012. Tensor displays: Compressive light field synthesis using multilayer displays with directional backlighting. (2012).
[53]
Daeho Yang, Wontaek Seo, Hyeonseung Yu, Sun Il Kim, Bongsu Shin, Chang-Kun Lee, Seokil Moon, Jungkwuen An, Jong-Young Hong, Geeyoung Sung, et al. 2022. Diffraction-engineered holography: Beyond the depth representation limit of holographic displays. Nature Communications 13, 1 (2022), 6012.
[54]
Genzhi Ye, Sundeep Jolly, V Michael Bove Jr, Qionghai Dai, Ramesh Raskar, and Gordon Wetzstein. 2014. Toward BxDF display using multilayer diffraction. ACM Transactions on Graphics (TOG) 33, 6 (2014), 1--14.
[55]
Dongheon Yoo, Youngjin Jo, Seung-Woo Nam, Chun Chen, and Byoungho Lee. 2021. Optimization of computer-generated holograms featuring phase randomness control. Optics Letters 46, 19 (2021), 4769--4772.
[56]
Zijie Zhao, Junyi Duan, and Juan Liu. 2022. Speckle reduction in holographic display with partially spatial coherent illumination. Optics Communications 507 (2022), 127604.

Cited By

View all

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 42, Issue 6
December 2023
1565 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/3632123
Issue’s Table of Contents
This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 December 2023
Published in TOG Volume 42, Issue 6

Check for updates

Author Tags

  1. display
  2. holography
  3. speckle

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 610
    Total Downloads
  • Downloads (Last 12 months)610
  • Downloads (Last 6 weeks)70
Reflects downloads up to 04 Oct 2024

Other Metrics

Citations

Cited By

View all

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media