Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3641584.3641635acmotherconferencesArticle/Chapter ViewAbstractPublication PagesaiprConference Proceedingsconference-collections
research-article

A deep bilateral learning based GAN for non-homogeneous dehazing

Published: 14 June 2024 Publication History

Abstract

Affected by haze, images often face color distortion, resolution reduction and other image quality degradation problems. The existing dehazing methods based on convolutional neural network(CNN) often perform well on large-scale synthetic datasets, but lack robustness in the processing of real haze images. This is because haze images in reality are often non-homogeneous. Due to the fact that the haze texture faced by the real haze processing is more complex, it is easier to destroy the texture details. Meanwhile, the paired training images are difficult to collect, and the small-scale data set is easy to lead to overfitting. To address these challenges, we propose a dehazing approach based on ensemble learning, DB-GAN, which uses Res2Net pre-trained by ImageNet as the encoder in the knowledge adaptation branch to improve the generalization ability of the network and avoid overfitting. In the data fitting branch, deep bilateral learning is used to learn the structure of the features from the full-resolution and low-resolution inputs, respectively, to better learn the color features and boundary features. We then map the different features by a fusion tail. Finally, we demonstrate the effectiveness of our approach through extensive experimental results.

References

[1]
Liu, J., Wu, H., Xie, Y., Qu, Y., & Ma, L. 2020. Trident Dehazing Network. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 430-431.
[2]
Qin, X., Wang, Z., Bai, Y., Xie, X., & Jia, H. 2020. FFA-Net: Feature Fusion Attention Network for Single Image Dehazing. Proceedings of the AAAI Conference on Artificial Intelligence, 34(07), 11908-11915. https://doi.org/10.1609/aaai.v34i07.6865.
[3]
Wu, H., Liu, J., Xie, Y., Qu, Y., & Ma, L. 2020. Knowledge Transfer Dehazing Network for NonHomogeneous Dehazing. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 478-479.
[4]
Zhou, Z., Shi, Z., Guo, M., Feng, Y., & Zhao, M. 2020. Cggan: a context guided generative adversarial network for single image dehazing.
[5]
Middleton, W. 1957. Vision through the atmosphere. Springer Berlin Heidelberg, 1-2.
[6]
He, K., Jian, S., & Tang, X. 2011. Single image haze removal using dark channel prior. IEEE Transactions on Pattern Analysis & Machine Intelligence, 33(12), 2341-2353.
[7]
Stipetić V, Lončarić S. 2022. Variational Formulation of Dark Channel Prior for Single Image Dehazing. Journal of Mathematical Imaging and Vision,64(8): 845-854.
[8]
Van N, Vien A G, Lee C. 2022. Real-time image and video dehazing based on multiscale guided filtering. Multimedia Tools and Applications, 81(25): 36567-36584.
[9]
Ren W Q, Liu S, Zhang H, Single image dehazing via multi-scale convolutional neural networks. Proceedings of European Conference on Computer Vision(ECCV). Amsterdam:Springer, 2016: 154-169.
[10]
LI B, Peng X, Wang Z, 2017. Aod-net: all-inone dehazing network. Proceedings of the IEEE International Conference on Computer Vision, 4770-4778.
[11]
Engin D, Genc A, Kemal Ekenel H. 2018. Cycledehaze: enhanced cyclegan for single image dehazing. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 825-833.
[12]
Chen D, He M, Fan Q, 2019. Gated context aggregation network for image dehazing and deraining. 2019 IEEE Winter Conference on Applications of Computer Vision(WACV). IEEE, 1375-1383.
[13]
Wu H, Qu Y, Lin S, 2021. Contrastive learning for compact single image dehazing. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 10551-10560.
[14]
Tran L A, Moon S, Park D C. 2022. A novel encoder-decoder network with guided transmission map for single image dehazing. arXiv Pre-print arXiv: 2202.04757.
[15]
Xiao B, Zhang Z, Chen X, 2022. Single UHD image dehazing via interpretable pyramid network. arXiv Preprint arXiv: 2202.08589.
[16]
Gao S., Cheng M., Zhao K., Zhang X., Yang M. 2021. Res2Net: A New Multi-Scale Backbone Architecture, in IEEE Transactions on Pattern Analysis and Machine Intelligence, 43(2): 652-662.
[17]
T. G. Dietterich 2002. Ensemble learning. The handbook of brain theory and neural networks, 2:110–125.
[18]
Gharbi, M., Chen, J., Barron, J. T., Hasinoff, S. W., Durand, F. 2017. Deep bilateral learning for real-time image enhancement. Acm Transactions on Graphics, 36(4), 118.
[19]
Zhou Z., Shi, Z., Guo, M., Feng, Y., Zhao, M. 2020. Cggan: a context guided generative adversarial network for single image dehazing.
[20]
Ancuti, C. O., Ancuti, C., Timofte, R., & Vleeschouwer, C. D. 2018. O-HAZE: A Dehazing Benchmark with Real Hazy and Haze-Free Outdoor Images. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE, 754-762.
[21]
Ancuti, C. O., Ancuti, C., Sbert, M., & Timofte, R. 2019. Dense haze: a benchmark for image dehazing with dense-haze and haze-free images. ICIP 2019: 1014-1018
[22]
Ancuti, C. O., Ancuti, C., & Timofte, R. 2020. Nh-haze: an image dehazing benchmark with non-homogeneous hazy and haze-free images. IEEE, 1798-1805.
[23]
Ancuti, C. O., Ancuti, C., & Timofte, R. 2021. NTIRE 2021 NonHomogeneous Dehazing Challenge Report. Computer Vision and Pattern Recognition. IEEE Computer Society, 627-646.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
AIPR '23: Proceedings of the 2023 6th International Conference on Artificial Intelligence and Pattern Recognition
September 2023
1540 pages
ISBN:9798400707674
DOI:10.1145/3641584
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 June 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Deep bilateral learning
  2. Ensemble learning
  3. Image dehazing
  4. ImageNet pre-training
  5. Non-homogeneous haze

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

AIPR 2023

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 9
    Total Downloads
  • Downloads (Last 12 months)9
  • Downloads (Last 6 weeks)2
Reflects downloads up to 21 Nov 2024

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media