article

Recovering high dynamic range by Multi-Exposure Retinex

Authors:

Masaki SuwaAuthors Info & Claims

Journal of Visual Communication and Image Representation, Volume 20, Issue 8

Pages 521 - 531

https://doi.org/10.1016/j.jvcir.2009.07.006

Published: 01 November 2009 Publication History

Abstract

The matter of generating high dynamic range (HDR) image from a number of differently exposed pictures arises to satisfy the needs of high-quality imaging and industrial applications. A number of HDR image generation algorithms have been proposed in the past. However, the HDR radiance map recovered by these classical methods cannot completely exclude the noisy pixels in the input images and thus are unable to produce the optimal result with highest possible SNR. In this paper we are going to introduce a new HDR generation algorithm based on the Multi-Exposure Retinex model deduced in this paper for HDR image composition. The luminance component L and the reflectance R are synthesized independently before being combined together. A novel R image composition method is introduced to help the composed result image reach the highest possible SNR. The method is tested on grey-level images in this paper, but it can be easily extended to the color-image version.

References

[1]

Debevec, P.E. and Malik, J., Recovering high dynamic range radiance maps from photographs. Proc. SIGGRAPH. v97. 369-378.

[2]

Mitsunaga, T. and Nayar, S.K., Radiometric self calibration. Proc. CVPR. v2. 374-380.

[3]

S. Mann, Comparametric imaging: estimating both the unknown response and the unknown set of exposures in a plurality of differently exposed images, in: Proc. CVPR, IEEE Computer Society, 2001.

[4]

S. Mann, R. Picard, Being 'undigital' with digital cameras: extending dynamic range by combining differently exposed pictures, in: Proc. IS&T, 46th Annual Conference, 1996, pp. 422-428.

[5]

Donoho, M.A. and Johnstone, I.M., Ideal spatial adaptation via wavelet shrinkage. Biometrika. v81. 425-455.

[6]

Reinhard, E., Ward, G., Pattanaik, S. and Debevec, P., High Dynamic Range Imaging: Acquisition, Display and Image-based Lighting. 2005. Morgan Kaufman Publishers, San Francisco.

[7]

Land, E. and McCann, J., Lightness and the retinex theory. J. Opt. Soc. Am. v61. 1-11.

[8]

Perez, P., Gangnet, M. and Blake, A., Poisson image editing. Siggraph'03. 313-318.

[9]

Finlayson, G., Hordley, S. and Drew, M., Removing shadows from images. ECCV. 823-836.

[10]

Socolinsky, D. and Wolff, L., A new visualization paradigm for multispectral imagery and data fusion. CVPR 99. v1. 319-324.

[11]

R. Raskar, A. Ilie, J. Yu, Image fission for context enhancement and video surrealism, NPAR'04, 2004.

[12]

Fattal, R., Lischinski, D. and Werman, M., Gradient domain high dynamic range compression. ACM Trans. Graphics (TOG). v21 i3. 249-256.

[13]

Land, E., Recent advances in the Retinex theory and some implications for cortical computations: color vision and the natural image. Proc. Nat. Acad. Sci. USA. v80. 5163-5169.

[14]

Stockham Jr., T.G., Image processing in the context of a visual model. Proc. IEEE. v60 i7. 828-842.

[15]

Faugeras, O.D., Digital image color processing within the framework of a human visual system. IEEE Trans. ASSP. v27. 380-393.

[16]

Land, E., An alternative technique for the computation of the designator in the Retinex theory of color vision. Proc. Nat. Acad. Sci. USA. v83. 3078-3080.

[17]

Jobson, D.J., Rahman, Z. and Woodell, G.A., Properties and performance of the center/surround Retinex. IEEE Trans. Image Proc. v6. 451-462.

[18]

Jobson, D.J., Rahman, Z. and Woodell, G.A., A multiscale Retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans. Image Proc. v6 i7. 965-976.

[19]

Horn, B.K.P., Determining lightness from an image. Comput. Graphics Image Proc. v3. 277-299.

[20]

Blake, A., Boundary conditions of lightness computation in Mondrian world. Comput. Vision Graphics Image Proc. v32. 314-327.

[21]

Terzopoulos, D., Image analysis using multigrid relaxation methods. IEEE Trans. PAMI. v8. 129-139.

[22]

B.V. Funt, M.S. Drew, M. Brockington, Recovering shading from color images, in: Proc. ECCV'92, 1992, pp. 124-132.

[23]

J. Frankle, J. McCann, Method and apparatus for lightness imaging, US Patent no. 4,384,336, 1983.

[24]

J. McCann, Lessons learned from Mondrians applied to real images and color gamuts, in: Proc. IS&T/SID 7th Color Imaging Conference, 1999, pp. 1-8.

[25]

B.V. Funt, F. Ciurea, J. McCann, Retinex in Matlab, in: Proc. IS&T/SID 8th Color Imaging Conference, 2000, pp. 112-121.

[26]

Kimmel, R., Elad, M., Shaked, D., Keshet(Kresch), R. and Sobel, I., A variational framework for Retinex. Int. J. Comput. Vision. v52. 7-23.

[27]

Elad, M., Retinex by two bilateral filters. Lecture Notes Comput. Sci. v3459. 217-229.

[28]

Ashikhmin, M., A tone mapping algorithm for high contrast images. Eurograph Workshop Rendering. 1-11.

[29]

Meylan, L. and Susstrunk, S., High dynamic range image rendering with a Retinex-based adaptive filter. IEEE Trans. Image Proc. v15 i9. 2820-2830.

[30]

F. Shen, Y. Zhao, Y. Wu, M. Suwa, M. Kimachi, Improved retinex with denoising by bilateral filtering, Meeting on Image Recognition and Understanding, IS 2-21, 2007.

[31]

Akyuz, A. and Reinhard, E., Noise reduction in high dynamic range imaging. J. Visual Commun. Image Represent. v18. 366-376.

Digital Library

[32]

Y. Xiao, Y. Zhao, J. Liu, Y. Wu, M. Suwa, M. Kimachi, A simplified variational framework of Retinex for feature extraction, Meeting on Image Recognition and Understanding, IS 3-57, 2006.

[33]

Bolz, J., Farmer, I., Grinpsun, E. and Schoroder, P., Sparse matrix solvers on the GPU: conjugate gradients and multigrid. ACM Trans. Graphics.

Cited By

Peng PJing ZPan HLiu YSong B(2024)CurveMEFNeurocomputing10.1016/j.neucom.2024.127915596:COnline publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1016/j.neucom.2024.127915
Tripathi SGupta BTiwari M(2020)An alternative approach to preserve naturalness with non-uniform illumination estimation for images enhancement using normalized -Norm based on RetinexMultidimensional Systems and Signal Processing10.1007/s11045-020-00700-931:3(1091-1112)Online publication date: 22-Jan-2020
https://dl.acm.org/doi/10.1007/s11045-020-00700-9
Chen YHsia CLu CHsieh W(2019)Multiple exposure fusion based on sharpness-controllable fuzzy feedbackJournal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology10.3233/JIFS-16988636:2(1121-1132)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.3233/JIFS-169886
Show More Cited By

Recovering high dynamic range by Multi-Exposure Retinex
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
  2. Computer graphics

Recommendations

High Dynamic Range Imaging
CSNT '13: Proceedings of the 2013 International Conference on Communication Systems and Network Technologies

While real scenes produce a wide range of brightness variations, current cameras use low dynamic range image detector that typically provide 256 levels of brightness data at each pixel. We propose methods to create High Dynamic Range images, the method ...
A contrast enhancement method using dynamic range separate histogram equalization

In this paper, a contrast enhancement method using dynamic range separate histogram equalization (DRSHE) is proposed. Histogram equalization (HE) method is widely used for contrast enhancement. However, HE is not suitable for consumer electronic ...
High Dynamic Range Imaging for Dynamic Scenes
CSNT '14: Proceedings of the 2014 Fourth International Conference on Communication Systems and Network Technologies

Although the currently available digital cameras typically provide 256 levels of brightness data at each pixel, a real world scenes contains a very wide range of brightness variations. High Dynamic Range (HDR) images contain wider range of brightness ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Journal of Visual Communication and Image Representation

Journal of Visual Communication and Image Representation Volume 20, Issue 8

November, 2009

112 pages

ISSN:1047-3203

Issue’s Table of Contents

Copyright © Elsevier Inc. © 2009.

Publisher

Academic Press, Inc.

United States

Publication History

Published: 01 November 2009

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Peng PJing ZPan HLiu YSong B(2024)CurveMEFNeurocomputing10.1016/j.neucom.2024.127915596:COnline publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1016/j.neucom.2024.127915
Tripathi SGupta BTiwari M(2020)An alternative approach to preserve naturalness with non-uniform illumination estimation for images enhancement using normalized -Norm based on RetinexMultidimensional Systems and Signal Processing10.1007/s11045-020-00700-931:3(1091-1112)Online publication date: 22-Jan-2020
https://dl.acm.org/doi/10.1007/s11045-020-00700-9
Chen YHsia CLu CHsieh W(2019)Multiple exposure fusion based on sharpness-controllable fuzzy feedbackJournal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology10.3233/JIFS-16988636:2(1121-1132)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.3233/JIFS-169886
Celebi ADuvar RUrhan O(2015)Fuzzy fusion based high dynamic range imaging using adaptive histogram separationIEEE Transactions on Consumer Electronics10.1109/TCE.2015.706411961:1(119-127)Online publication date: 19-Mar-2015
https://dl.acm.org/doi/10.1109/TCE.2015.7064119
Gu BLi WWong JZhu MWang M(2012)Gradient field multi-exposure images fusion for high dynamic range image visualizationJournal of Visual Communication and Image Representation10.1016/j.jvcir.2012.02.00923:4(604-610)Online publication date: 1-May-2012
https://dl.acm.org/doi/10.1016/j.jvcir.2012.02.009

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents