Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

CyclicNet: an alternately updated network for semantic segmentation

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In recent years, with the continuous breakthrough in deep learning, convolutional neural networks (CNNs) have shown great potential for semantic segmentation. CNNs achieve better results by deepening or widening the network, but they increase the utilization rate of computing resources and even have the phenomenon of the vanishing gradient. A new convolutional neural network architecture with alternately updated clique (CliqueNet) can get a deeper network and improves the utilization of network features. In order to maximize the transmission of semantic information, this paper introduces the clique block of CliqueNet and proposes a new fully convolutional network based on the encoder-decoder structure, which calls the CyclicNet, an alternately updated network for semantic segmentation. Besides, the long skip connections and short skip connections are added in the network to avoid the vanishing gradient. The experiment was conducted on the CamVid and Cityscapes. Comparing it with the current advanced architectures shows that CyclicNet can maximize information flow and achieve the most superior results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Badrinarayanan V, Kendall A, Cipolla R (2017) SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell

  2. Chen LC, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2018) DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans Pattern Anal Mach Intell

  3. Chen C, Wei J, Peng C, Zhang W, Qin H (2020) Improved saliency detection in RGB-d images using Two-Phase depth estimation and selective deep fusion. IEEE Trans Image Process 29:4296–4307

    Article  Google Scholar 

  4. Csurka G, Perronnin F (2011) An efficient approach to semantic segmentation. Int J Comput Vis 2011 95(2):198–212

    Article  MathSciNet  Google Scholar 

  5. Ding H, Jiang X, Shuai B, Liu AQ, Wang G (2020) Semantic segmentation with context encoding and Multi-Path decoding. IEEE Trans Image Process 29(8):3520–3533

    Article  Google Scholar 

  6. Drozdzal M, Vorontsov E, Chartrand G, Kadoury S, Pal C (2016) The importance of skip connections in biomedical image segmentation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)

  7. Fan DP, Cheng MM, Liu JJ, Gao SH, Hou Q, Borji A (2018) Salient objects in clutter: Bringing salient object detection to the foreground. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), 11219 LNCS(61620106008), pp 196–212

  8. Fan DP, Wang W, Cheng MM, Shen J (2019) Shifting more attention to video salient object detection. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, 2019-June, pp 8546–8556

  9. Fu K, Zhao Q, Yu-Hua Gu I, Yang J (2019) Deepside: a general deep framework for salient object detection. Neurocomputing 356:69–82

    Article  Google Scholar 

  10. Hassaballah M, Awad AI (2020) Deep learning in computer vision: principles and applications. CRC Press, Boca Raton, p 2020

    Book  Google Scholar 

  11. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition

  12. He K, Zhang X, Ren S, Sun J (2016) Identity mappings in deep residual networks. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)

  13. Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings - 30th IEEE conference on computer vision and pattern recognition. CVPR, p 2017

  14. Krizhevsky A, Sutskever I, Hinton GE (2017), ImageNet classification with deep convolutional neural networks. Commun ACM

  15. Li X, Chen S, Hu X, Yang J (2019) Understanding the disharmony between dropout and batch normalization by variance shift. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, 2019-June, pp 2677–2685

  16. Li H, Xiong P, Fan H, Sun J (2019) DFANet: Deep feature aggregation for real-time semantic segmentation. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition

  17. Lin G, Milan A, Shen C, Reid I (2017) Refinenet: Multi-path refinement networks for high-resolution semantic segmentation. In: Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017

  18. Liu P, Yu H, Cang S (2019) Adaptive neural network tracking control for underactuated systems with matched and mismatched disturbances. Nonlinear Dyn 98(2):1447–1464

    Article  Google Scholar 

  19. Long J (2015) Shelhamer. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition. Fully convolutional networks for semantic segmentation, E., and Darrell, T

  20. Lu X, Wang W, Ma C, Shen J, Shao L, Porikli F (2019) See more, know more: Unsupervised video object segmentation with co-attention siamese networks. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, 2019-June, pp 3618–3627

  21. Malekijoo A, Fadaeieslam MJ (2019) Convolution-deconvolution architecture with the pyramid pooling module for semantic segmentation. Multimed Tools Appl 78(22):32379–32392

    Article  Google Scholar 

  22. Noh H, Hong S, Han B (2015) Learning deconvolution network for semantic segmentation. In: Proceedings of the IEEE international conference on computer vision

  23. Nurhadiyatna A, Loncaric S (2017) Semantic image segmentation for pedestrian detection. In: International symposium on image and signal processing and analysis. ISPA, pp 153–158

  24. Papandreou G, Chen LC, Murphy K (2015) Weakly-and semi-supervised learning of a deep convolutional network for semantic image segmentation. In: Proceedings of the IEEE international conference on computer vision

  25. Paszke A, Chaurasia A, Kim S, Culurciello E (2016) ENet : a deep neural network architecture for real-time semantic segmentation. arXiv:1606.102147v1 [cs, CV] 7, Jun 2016. 1–10

  26. Salscheider NO (2020) Simultaneous object detection and semantic segmentation. In: ICPRAM 2020 - Proceedings of the 9th international conference on pattern recognition applications and methods

  27. Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd international conference on learning representations, ICLR 2015 - Conference track proceedings

  28. Sun L, Zhao C, Yan Z, Liu P, Duckett T, Stolkin R (2019) A novel weakly-supervised approach for RGB-d-based nuclear waste object detection. IEEE Sensors J 19(9):3487–3500

    Article  Google Scholar 

  29. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2014) GoogLenet going deeper with convolutions. arXiv:1409.4842

  30. Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-ResNet and the impact of residual connections on learning. In: 31st AAAI conference on artificial intelligence. AAAI, p 2017

  31. Tang Z, Li C, Wu J, Liu P, Cheng S (2019) Cheng feng chuan Classification of EEG-based single-trial motor imagery tasks using a b-CSP method for BCI. Front Inf Technol Electron Eng 20(8):1087–1098

    Article  Google Scholar 

  32. Tang Z, Yu H, Lu C, Liu P, Jin X (2019) Single-trial classification of different movements on one arm based on ERD/ERs and corticomuscular coherence. IEEE Access 7(Mi):128185–128197

    Article  Google Scholar 

  33. Tian X, Wang L, Ding Q (2019) An overview of image semantic segmentation methods based on deep learning. J Softw

  34. Wang W, Lu X, Shen J, Crandall D, Shao L (2019) Zero-shot video object segmentation via attentive graph neural networks. In: Proceedings of the IEEE international conference on computer vision, 2019-Octob(Iccv), pp 9235–9244

  35. Wang J, Xiong H, Wang H, Nian X (2020) ADSCNEt: asymmetric depthwise separable convolution for semantic segmentation in real-time. Appl Intell 50(4):1045–1056. https://doi.org/10.1007/s10489-019-01587-1

    Article  Google Scholar 

  36. Wu J, Wen Z, Zhao S, Huang K (2020) Video semantic segmentation via feature propagation with holistic attention. Pattern Recogn 104:107268

    Article  Google Scholar 

  37. Xie X, Wang Z (2018) Multi-scale Semantic Segmentation Enriched Features for Pedestrian Detection. In: Proceedings-international conference on pattern recognition, 2018-August, pp 2196–2201

  38. Yang Y, Zhong Z (2018) Shen. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition. Convolutional neural networks with alternately updated clique, T., and Lin, Z

  39. Zhang S, Ma Z, Zhang G, Lei T, Zhang R, Cui Y (2020) Semantic image segmentation with deep convolutional neural networks and quick shift. Symmetry 12(3):1–11

    Google Scholar 

  40. Zhou Z, Siddiquee MMR, Tajbakhsh N, Liang J (2019) UNEt++: redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans Med Imaging 1–1

Download references

Acknowledgments

This work is supported by the Fundamental Research Funds for the Central Universities (NO.2020YJ003).

Author information

Authors and Affiliations

  1. School of Control and Computer Engineering, North China Electric Power University, Beijing, China

    Guixian Wu & Yuancheng Li

Authors
  1. Guixian Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuancheng Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yuancheng Li.

Ethics declarations

Conflict of interests

The authors declared that there is no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wu, G., Li, Y. CyclicNet: an alternately updated network for semantic segmentation. Multimed Tools Appl 80, 3213–3227 (2021). https://doi.org/10.1007/s11042-020-09791-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09791-9

Keywords

Search

Navigation