Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

DCNet: dual-cascade network for single image dehazing

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Image dehazing is a challenging ill-posed problem in the field of computer vision. Existing learning-methods usually use a single convolutional neural network (CNN) model to solve it, which lacks details recovery mechanism and leads to poor performance. In this paper, we propose an end-to-end Dual-cascade Network for image dehazing, which obtains the haze-free image in a coarse-to-fine manner. Specifically, the overall model consists of two sub-networks: Net-U and Net-D. The Net-U employs an encoder–decoder architecture to restore a coarse dehazing result, which leverages residual channel attention block for distilling hierarchical features, and transmits the contextual information into next stage. To preserve the spatial details of latent image, our Net-D adopts a constant-size CNN structure, and captures the texture-rich features by utilizing residual multi-scale spatial block. Moreover, we apply an effective selective fusion module to integrate these derived features from Net-U and Net-D. Experimental comparisons show that our method obtains comparable or even better results than existing state-of-the-art methods in terms of quantitative evaluation and visual performance. The code will be made publicly available on GitHub.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Punitha V, Mala C (2021) Traffic classification in server farm using supervised learning techniques. Neural Comput Appl 33(3):1279–1296

    Article  Google Scholar 

  2. Perez-Borrero I, Marin-Santos D, Vasallo-Vazquez MJ, Gegundez-Arias ME (2021) A new deep-learning strawberry instance segmentation methodology based on a fully convolutional neural network. Neural Comput Appl 33:1–13

    Article  Google Scholar 

  3. Mukilan P, Semunigus W (2021) Human object detection: an enhanced black widow optimization algorithm with deep convolution neural network. Neural Comput Appl 33:15831–15842

    Article  Google Scholar 

  4. Fattal R (2014) Dehazing using color-lines. Acm Trans Graph 34:1–14

    Article  Google Scholar 

  5. Fattal R (2008) Single image dehazing. Acm Trans Graph 27(3):1–9

    Article  Google Scholar 

  6. Li B, Gou Y, Gu S, Liu JZ, Peng X (2021) You only look yourself: unsupervised and untrained single image dehazing neural network. Int J Comput Vis 11:1–14

    Google Scholar 

  7. Zhao S et al (2021) RefineDNet: a weakly supervised refinement framework for single image dehazing. IEEE Trans Image Process 30:3391–3404

    Article  Google Scholar 

  8. McCartney EJ (1976) Optics of the atmosphere: scattering by molecules and particles. nyjw

  9. Narasimhan SG, Nayar SK (2000) Chromatic framework for vision in bad weather. In: IEEE computer society conference on computer vision and pattern recognition

  10. Narasimhan SG, Nayar SK (2002) Vision and the atmosphere. Int J Comput Vis 48(3):233–254

    Article  MATH  Google Scholar 

  11. He K, Sun J, Fellow IEEE, Tang X (2011) Single image haze removal using dark channel prior. IEEE Trans Pattern Anal Mach Intell 33(12):2341–2353

    Article  Google Scholar 

  12. Berman D, Treibitz T, Avidan S (2016) Non-local image dehazing. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR)

  13. Cai B, Xu X, Jia K, Qing C, Tao D (2016) Dehazenet: an end-to-end system for single image haze removal. IEEE Trans Image Process 25(11):5187–5198

    Article  MathSciNet  MATH  Google Scholar 

  14. Ren W, Ma L, Zhang J, Pan J, Cao X, Liu W, Yang MH (2018) Gated fusion network for single image dehazing. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 3253–3261

  15. Zhang H, Patel VM (2018) Densely connected pyramid dehazing network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 3194–3203

  16. Qu Y, Chen Y, Huang J, Xie Y (2019) Enhanced pix2pix dehazing network. In: 2019 IEEE/CVF conference on computer vision and pattern recognition (CVPR)

  17. Chen D, He M, Fan Q, Liao J, Zhang L, Hou D, Yuan L, Hua G (2019) Gated context aggregation network for image dehazing and deraining. In: 2019 IEEE winter conference on applications of computer vision (WACV). IEEE, pp 1375–1383

  18. Li L, Dong Y, Ren W, Pan J, Gao C, Sang N, Yang MH (2020) Semi-supervised image dehazing. IEEE Trans Image Process 29:2766–2779

    Article  MATH  Google Scholar 

  19. Xie B, Guo F, Cai Z (2010) Improved single image dehazing using dark channel prior and multi-scale retinex. In: International conference on intelligent system design and engineering application

  20. Xu H, Guo J, Liu Q, Ye L (2012) Fast image dehazing using improved dark channel prior. IEEE, pp 663–667

  21. Zhu Q, Mai J, Shao L (2015) A fast single image haze removal algorithm using color attenuation prior. IEEE Trans Image Process 24(11):3522–3533

    Article  MathSciNet  MATH  Google Scholar 

  22. Abdulkareem KH et al (2021) A new standardisation and selection framework for real-time image dehazing algorithms from multi-foggy scenes based on fuzzy Delphi and hybrid multi-criteria decision analysis methods. Neural Comput Appl 33(4):1029–1054

  23. Zhu Z, Wei H, Hu G, Li Y, Mazur N (2020) A novel fast single image dehazing algorithm based on artificial multiexposure image fusion. IEEE Trans Instrum Meas 99:1–1

    Article  Google Scholar 

  24. Zheng M, Qi G, Zhu Z, Li Y, Liu Y (2020) Image dehazing by an artificial image fusion method based on adaptive structure decomposition. IEEE Sens J 99:1–1

    Google Scholar 

  25. Zhao D et al (2019) Multi-scale optimal fusion model for single image dehazing. Signal Process: Image Commun 74:253–265

  26. Ren W, Liu S, Zhang H et al (2016) Single image dehazing via multi-scale convolutional neural networks[C]. In: European conference on computer vision. Springer, Cham, pp. 154–169

  27. Li B, Peng X, Wang Z, Xu J, Dan F (2017) Aod-net: all-in-one dehazing network. In: 2017 IEEE international conference on computer vision (ICCV)

  28. Qin X, Wang Z, Bai Y et al (2020) FFA-Net: feature fusion attention network for single image dehazing[C]. Proceedings AAAI Conf Artif Intell 34(07):11908–11915

  29. Zhao D, Xu L, Ma L, Li J, Yan Y (2020) Pyramid global context network for image dehazing. IEEE Trans Circuits Syst Video Technol 99:1–1

    Google Scholar 

  30. Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial networks. Adv Neural Inf Process Syst 3:2672–2680

    Google Scholar 

  31. Engin D, Gen A, Ekenel HK (2018) Cycle-dehaze: enhanced cyclegan for single image dehazing. IEEE

  32. Yang X, Xu Z, Luo J (2018) Towards perceptual image dehazing by physics-based disentanglement and adversarial training. In: Proceedings of the AAAI conference on artificial intelligence, vol 32

  33. Dong Y, Liu Y, Zhang H, Chen S, Qiao Y (2020) Fd-gan: generative adversarial networks with fusion-discriminator for single image dehazing. Proc AAAI Conf Artif Intell 34(7):10729–10736

    Google Scholar 

  34. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  35. Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 234–241

  36. Targ S, Almeida D, Lyman K (2016) Resnet in resnet: generalizing residual architectures[J]. arXiv:1603.08029

  37. Hu J, Shen L, Albanie S, Sun G, Wu E (2017) Squeeze-and-excitation networks. IEEE Trans Pattern Anal Mach Intell (99)

  38. Yu F, Koltun V (2016) Multi-scale context aggregation by dilated convolutions. In: ICLR

  39. Johnson J, Alahi A, Fei-Fei L (2016) Perceptual losses for real-time style transfer and super-resolution. Springer, Cham

    Book  Google Scholar 

  40. Li B et al (2018) Benchmarking single-image dehazing and beyond. IEEE Trans Image Process 28(1):492–505

  41. Zhang Y, Li D, Sharma G (2018) Hazerd: an outdoor scene dataset and benchmark for single image dehazing. In: 2017 IEEE international conference on image processing (ICIP)

  42. Ancuti C, Ancuti CO, Timofte R et al (2018) I-HAZE: a dehazing benchmark with real hazy and haze-free indoor images[C]. In: International Conference on Advanced Concepts for Intelligent Vision Systems. Springer, Cham, pp. 620–631

  43. Ancuti CO, Ancuti C, Timofte R, Vleeschouwer CD (2018) O-haze: a dehazing benchmark with real hazy and haze-free outdoor images. In: 2018 IEEE/CVF conference on computer vision and pattern recognition workshops (CVPRW)

  44. Huynh-Thu Q, Ghanbari M (2008) Scope of validity of psnr in image/video quality assessment. Electron Lett 44(13):800–801

    Article  Google Scholar 

  45. Wang Z et al (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

  46. Liu X, Ma Y, Shi Z, Chen J (2019) Griddehazenet: attention-based multi-scale network for image dehazing. In: Proceedings of the IEEE international conference on computer vision, pp 7314–7323

  47. Shao Y, Li L, Ren W, Gao C, Sang N (2020) Domain adaptation for image dehazing. In: 2020 IEEE/CVF conference on computer vision and pattern recognition (CVPR)

  48. Wang L, Huang P, Zhang X, Xu J (2021) Haze concentration adaptive network for image dehazing. Neurocomputing 439(6):75–85

    Article  Google Scholar 

  49. Yu C, Wang J, Peng C, Gao C, Yu G, Sang N (2018) Bisenet: bilateral segmentation network for real-time semantic segmentation. In: European conference on computer vision

  50. Redmon J, Farhadi A (2018) Yolov3: an incremental improvement. arXiv:1804.02767

Download references

Acknowledgements

This work was supported by the Beijing Key Laboratory of Precision Photoelectric Measuring Instrument and Technology, the National Natural Science Foundation of China (Grant No. 6130119), the National Natural Science Foundation of China (Grant No. 61475018) and the Winter Olympics Key Project Technology Fund (2018YFF0300804))

Author information

Authors and Affiliations

  1. Beijing Key Laboratory for Precision Optoelectronic Measurement Instrument and Technology, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, China

    Weichao Yi, Liquan Dong, Ming Liu, Yuejin Zhao, Mei Hui & Lingqin Kong

  2. Yangtze Delta Region Academy of Beijing Institute of Technology, Jiaxing, 314019, China

    Liquan Dong, Ming Liu, Yuejin Zhao & Lingqin Kong

Authors
  1. Weichao Yi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Liquan Dong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ming Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yuejin Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mei Hui
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Lingqin Kong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Liquan Dong or Ming Liu.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yi, W., Dong, L., Liu, M. et al. DCNet: dual-cascade network for single image dehazing. Neural Comput & Applic 34, 16771–16783 (2022). https://doi.org/10.1007/s00521-022-07319-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-07319-w

Keywords

Search

Navigation