Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Beyond Brightening Low-light Images

Published: 01 April 2021 Publication History

Abstract

Images captured under low-light conditions often suffer from (partially) poor visibility. Besides unsatisfactory lightings, multiple types of degradation, such as noise and color distortion due to the limited quality of cameras, hide in the dark. In other words, solely turning up the brightness of dark regions will inevitably amplify pollution. Thus, low-light image enhancement should not only brighten dark regions, but also remove hidden artifacts. To achieve the goal, this work builds a simple yet effective network, which, inspired by Retinex theory, decomposes images into two components. Following a divide-and-conquer principle, one component (illumination) is responsible for light adjustment, while the other (reflectance) for degradation removal. In such a way, the original space is decoupled into two smaller subspaces, expecting for better regularization/learning. It is worth noticing that our network is trained with paired images shot under different exposure conditions, instead of using any ground-truth reflectance and illumination information. Extensive experiments are conducted to demonstrate the efficacy of our design and its superiority over the state-of-the-art alternatives, especially in terms of the robustness against severe visual defects and the flexibility in adjusting light levels. Our code is made publicly available at https://github.com/zhangyhuaee/KinD_plus.

References

[1]
Abdullah-Al-Wadud M, Kabir MH, Dewan MA, and Chae O A dynamic histogram equalization for image contrast enhancement IEEE TCE 2007 53 2 593-600
[2]
Agostinelli, F., Anderson, M.R., & Lee, H. (2013). Adaptive multicolumn deep neural networks with application to robust image denoising. in: NeurIPS, pp. 1493–1501.
[3]
Bradley RA and Terry ME Rank analysis of incomplete block designs: I,. the method of paired comparisons Biometrika 1952 39 324
[4]
Bychkovsky, V., Paris, S., Chan, E., & Durand, F. (2011). Learning photographic global tonal adjustment with a database of input / output image pairs. in: CVPR, pp. 97–104.
[5]
Cai B, Xu X, Jia K, Qing C, and Tao D DehazeNet: An end-to-end system for single image haze removal IEEE TIP 2016 25 11 5187-5198
[6]
Cai J, Gu S, and Zhang L Learning a deep single image contrast enhancer from multi-exposure images IEEE TIP 2018 27 4 2049-2062
[7]
Chen, C., Chen, Q., Xu, J., & Koltun, V. (2018). Learning to see in the dark. in: CVPR, pp. 3291–3300.
[8]
Chen Y and Pock T Trainable nonlinear reaction diffusion: A flexible framework for fast and effective image restoration IEEE TPAMI 2017 39 6 1256-1272
[9]
Chen, Y., Wang, Y., Kao, M., & Chuang, Y. (2018). Deep photo enhancer: Unpaired learning for image enhancement from photographs with GANs. in: CVPR, pp. 6306–6314.
[10]
Cheng HD and Shi XJ A simple and effective histogram equalization approach to image enhancement Digital Signal Processing 2004 14 2 158-170
[11]
Dabov K, Foi A, Katkovnik V, and Egiazarian K Image denoising by sparse 3-D transform-domain collaborative filtering IEEE TIP 2007 16 8 2080-2095
[12]
Dong C, Chen CL, He K, and Tang X Image super-resolution using deep convolutional networks IEEE TPAMI 2016 38 2 295-307
[13]
Dong, C., Deng, Y., Loy, C.C., & Tang, X. (2015). Compression artifacts reduction by a deep convolutional network. in: ICCV, pp. 576–584.
[14]
Dong, X., Pang, Y., & Wen, J. (2011). Fast efficient algorithm for enhancement of low lighting video. in: ICME, pp. 1–6.
[15]
Fu, X., Zeng, D., Huang, Y., Zhang, X., & Ding, X. (2016). A weighted variational model for simultaneous reflectance and illumination estimation. in: CVPR, pp. 2782–2790.
[16]
Fu X, Zeng D, Yue H, Liao Y, Ding X, and Paisley J A fusion-based enhancing method for weakly illuminated images Signal Processing 2016 129 82-96
[17]
Gu, S., Zhang, L., Zuo, W., & Feng, X. (2014). Weighted nuclear norm minimization with application to image denoising. in: CVPR, pp. 2862–2869.
[18]
Guo X, Li Y, and Ling H LIME: Low-light image enhancement via illumination map estimation IEEE TIP 2017 26 2 982-993
[19]
Huang S, Cheng F, and Chiu Y Efficient contrast enhancement using adaptive gamma correction with weighting distribution IEEE TIP 2013 22 3 1032-1041
[20]
Ignatov, A., Kobyshev, N., Timofte, R., Vanhoey, K., & Van Gool, L. (2018). WESPE: Weakly supervised photo enhancer for digital cameras. in: CVPRW, pp. 691–700.
[21]
Jobson DJ, Rahman Z, and Woodell GA Properties and performance of a center/surround Retinex IEEE TIP 1997 6 3 451-462
[22]
Jobson DJ, Rahman Z, and Woodell GA A multiscale Retinex for bridging the gap between color images and the human observation of scenes IEEE TIP 2002 6 7 965-976
[23]
Land EH The Retinex theory of color vision Scientific American 1977 237 6 108-128
[24]
Lee C, Lee C, and Kim CS Contrast enhancement based on layered difference representation of 2D histograms IEEE TIP 2013 22 12 5372-5384
[25]
Li, B., Peng, X., Wang, Z., Xu, J., & Feng, D. (2017). AOD-Net: All-in-one dehazing network. in: ICCV, pp. 4780–4788.
[26]
Li M, Liu J, Yang W, Sun X, and Guo Z Structure-revealing low-light image enhancement via robust Retinex model IEEE TIP 2018 27 6 2828-2841
[27]
Lore KG, Akintayo A, and Sarkar S LLNet: A deep autoencoder approach to natural low-light image enhancement Pattern Recognition 2017 61 650-662
[28]
Ma K, Zeng K, and Wang Z Perceptual quality assessment for multi-exposure image fusion IEEE TIP 2015 24 11 3345-3356
[29]
Mateescu, V., & Bajic, I. V. (2016). Visual attention retargeting. IEEE Multimedia, 23(1),
[30]
Mechrez R, Shechtman E, and Zelnik-Manor L Saliency driven image manipulation WACV 2018 30 189-202
[31]
Mittal A, Soundararajan R, and Bovik A Making a completely blind image quality analyzer IEEE SPL 2013 20 3 209-212
[32]
Pisano E, Zong S, Hemminger B, Deluca M, Johnston R, Muller K, Braeuning M, and Pizer S Contrast limited adaptive histogram equalization image processing to improve the detection of simulated spiculations in dense mammograms Journal of Digital Imaging 1998 11 4 193-200
[33]
Rahman S, Rahman MM, Abdullah-Al-Wadud M, Al-Quaderi GD, and Shoyaib M An adaptive gamma correction for image enhancement Eurasip Journal on Image & Video Processing 2016 2016 1 35
[34]
Ronneberger, O., Fischer, P., & Brox, T. (2015). U-Net: Convolutional networks for biomedical image segmentation. in: MICCAI, pp. 234–241.
[35]
Sharma G, Wu W, and Dalal EN The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations Color Research and Application 2005 30 1 21-30
[36]
Shen, L., Yue, Z., Feng, F., Chen, Q., Liu, S., & Ma, J. (2017). MSR-Net:low-light image enhancement using deep convolutional network. arXiv: 1711.02488.
[37]
Stevens S On the psychophysical law Psychological Review 1957 64 3 153-181
[38]
Turgay C and Tardi T Contextual and variational contrast enhancement IEEE TIP 2011 20 12 3431-3441
[39]
Wang, R., Zhang, Q., Fu, C.W., Shen, X., Zheng, W.S., & Jia, J. (2019). Underexposed photo enhancement using deep illumination estimation. in: CVPR, pp. 6849–6857.
[40]
Wang S, Zheng J, Hu H, and Li B Naturalness preserved enhancement algorithm for non-uniform illumination images IEEE TIP 2013 22 9 3538-3548
[41]
Wang, W., Chen, W., Yang, W., & Liu, J. (2018). GLADNet: Low-light enhancement network with global awareness. in: FG.
[42]
Wang ZG, Liang ZH, and Liu C A real-time image processor with combining dynamic contrast ratio enhancement and inverse gamma correction for PDP Displays 2009 30 133-139
[43]
Wei, C., Wang, W., Yang, W., & Liu, J. (2018). Deep Retinex decomposition for low-light enhancement. in: BMVC.
[44]
Xie, J., Xu, L., & Chen, E. (2012). Image denoising and inpainting with deep neural networks. in: NeurIPS, pp. 341–349.
[45]
Xie, J., Xu, L., Chen, E., Xie, J., & Xu, L. (2012). Image denoising and inpainting with deep neural networks. in: NeurIPS, pp. 341–349.
[46]
Ying, Z., Ge, L., & Gao, W. (2017). A bio-inspired multi-exposure fusion framework for low-light image enhancement. arXiv: 1711.00591.
[47]
Ying, Z., Ge, L., Ren, Y., Wang, R., & Wang, W. (2018). A new low-light image enhancement algorithm using camera response model. in: ICCVW, pp. 3015–3022.
[48]
Zhang K, Zuo W, Chen Y, Meng D, and Zhang L Beyond a gaussian denoiser: Residual learning of deep CNN for image denoising IEEE TIP 2016 26 7 3142-3155
[49]
Zhang K, Zuo W, and Zhang L FFDNet: Toward a fast and flexible solution for CNN-based image denoising IEEE TIP 2018 27 9 4608-4622
[50]
Zhang, L., Dai, J., Lu, H., He, Y., & Wang, G. (2018). A bi-directional message passing model for salient object detection. in: CVPR, pp. 1741–1750.
[51]
Zhang, X., Lu, Y., Liu, J., & Dong, B. (2018). Dynamically unfolding recurrent restorer: A moving endpoint control method for image restoration. in: ICLR.
[52]
Zhang, Y., Zhang, J., & Guo, X. (2019). Kindling the darkness: A practical low-light image enhancer. in: ACM MM, pp. 1632–1640.

Cited By

View all
  • (2025)Wakeup-Darkness: When Multimodal Meets Unsupervised Low-Light Image EnhancementACM Transactions on Multimedia Computing, Communications, and Applications10.1145/371192921:3(1-25)Online publication date: 15-Jan-2025
  • (2025)Noise Self-Regression: A New Learning Paradigm to Enhance Low-Light Images Without Task-Related DataIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.348736147:2(1073-1088)Online publication date: 1-Feb-2025
  • (2025)Illumination Map Estimation via Sparse Bright Channel for Enhancing Under-Exposed ImagesIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2024.349503426:1(1344-1350)Online publication date: 1-Jan-2025
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image International Journal of Computer Vision
International Journal of Computer Vision  Volume 129, Issue 4
Apr 2021
535 pages

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 April 2021
Accepted: 13 November 2020
Received: 17 April 2020

Author Tags

  1. Low-light image enhancement
  2. Image decomposition
  3. Image restoration
  4. Light manipulation

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Wakeup-Darkness: When Multimodal Meets Unsupervised Low-Light Image EnhancementACM Transactions on Multimedia Computing, Communications, and Applications10.1145/371192921:3(1-25)Online publication date: 15-Jan-2025
  • (2025)Noise Self-Regression: A New Learning Paradigm to Enhance Low-Light Images Without Task-Related DataIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.348736147:2(1073-1088)Online publication date: 1-Feb-2025
  • (2025)Illumination Map Estimation via Sparse Bright Channel for Enhancing Under-Exposed ImagesIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2024.349503426:1(1344-1350)Online publication date: 1-Jan-2025
  • (2025)Residual Quotient Learning for Zero-Reference Low-Light Image EnhancementIEEE Transactions on Image Processing10.1109/TIP.2024.351999734(365-378)Online publication date: 1-Jan-2025
  • (2025)Nighttime Person Re-Identification via Collaborative Enhancement Network With Multi-Domain LearningIEEE Transactions on Information Forensics and Security10.1109/TIFS.2025.352733520(1305-1319)Online publication date: 1-Jan-2025
  • (2025)A Semantic-Aware Detail Adaptive Network for Image EnhancementIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2024.348319135:2(1787-1800)Online publication date: 1-Feb-2025
  • (2025)Extracting Noise and Darkness: Low-Light Image Enhancement via Dual Prior GuidanceIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2024.348093035:2(1700-1714)Online publication date: 1-Feb-2025
  • (2025)For Overall Nighttime Visibility: Integrate Irregular Glow Removal With Glow-Aware EnhancementIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2024.346567035:1(823-837)Online publication date: 1-Jan-2025
  • (2025)Seed Optimization With Frozen Generator for Superior Zero-Shot Low-Light Image EnhancementIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2024.345476335:1(561-576)Online publication date: 1-Jan-2025
  • (2025)RMANetSignal Processing10.1016/j.sigpro.2024.109689227:COnline publication date: 1-Feb-2025
  • Show More Cited By

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media