Nothing Special   »   [go: up one dir, main page]
Skip to main content

Advertisement

Springer Nature Link
Log in

A novel semi-supervised generative adversarial network based on the actor-critic algorithm for compound fault recognition

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Vibration signals can be used to extract effective fault features for fault diagnosis. However, traditional supervised learning requires considerable manpower and time to mark samples manually, and this process is difficult to apply to practical fault diagnosis. Deep reinforcement learning which combines the perception ability of deep learning with the decision-making ability of reinforcement learning, can independently extract hidden fault features and effectively improve the accuracy of fault diagnosis. Semi-supervised learning can reduce the proportion of labeled samples to decrease the learning cost while improving the recognition accuracy with unlabeled samples. In this study, we propose a novel semi-supervised deep reinforcement learning method. A semi-supervised generative adversarial network combined with the improved actor-critic algorithm is proposed to perform fault diagnosis when the labeled sample size is small. In the experiment of rolling bearing fault and engineering application, three-channel time-frequency graphs extracted from raw signals with the wavelet packet are compressed into single channel gray graphs. Then, to simulate the less labeled sample dataset, 2%, 5%, 20%, 50% and 100% sample labels are set by dislodging partial label from the processing sample. The results of the proposed method and other intelligent methods are listed to demonstrate that the proposed method could provide better performance over other methods even if the size of labeled sample is small in compound fault diagnosis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Shao H, Jiang H, Li X, Liang T (2018) Rolling bearing fault detection using continuous deep belief network with locally linear embedding. Comput Ind 96:27–39

    Article  Google Scholar 

  2. Kong D, Chen Y, Li N, Duan C, Lu L, Chen D (2019) Relevance vector machine for tool wear prediction. Mech Syst Sig Process 127:573–594

    Article  Google Scholar 

  3. Zhang K, Tang B, Qin Y, Deng L (2019) Fault diagnosis of planetary gearbox using a novel semi-supervised method of multiple association layers networks. Mech Syst Sig Process 131:243–260

    Article  Google Scholar 

  4. Gao Z, Cecati C, Ding SX (2015) A survey of fault diagnosis and fault-tolerant techniques part i: Fault diagnosis with model-based and signal-based approaches. IEEE Trans Ind Electron 62(6):3757–3767. https://doi.org/10.1109/TIE.2015.2417501

    Article  Google Scholar 

  5. Kim Kyusung, Parlos AG (2002) Induction motor fault diagnosis based on neuropredictors and wavelet signal processing. IEEE/ASME Trans Mech 7(2):201–219. https://doi.org/10.1109/TMECH.2002.1011258

    Article  Google Scholar 

  6. Zhao R, Yan R, Chen Z, Mao K, Wang P, Gao RX (2019) Deep learning and its applications to machine health monitoring. Mech Syst Sig Process 115:213–237

    Article  Google Scholar 

  7. Singh J, Darpe A, Singh S (2017) Bearing damage assessment using jensen-rnyi divergence based on eemd. Mech Syst Sig Process 87:307–339

    Article  Google Scholar 

  8. Shao H, Jiang H, Lin Y, Li X (2018) A novel method for intelligent fault diagnosis of rolling bearings using ensemble deep auto-encoders. Mech Syst Sig Process 102:278–297

    Article  Google Scholar 

  9. Shao H, Jiang H, Zhao H, Wang F (2017) A novel deep autoencoder feature learning method for rotating machinery fault diagnosis. Mech Syst Sig Process 95:187–204

    Article  Google Scholar 

  10. Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, Graves A, Riedmiller M, Fidjeland AK, Ostrovski G, Petersen S, Beattie C, Sadik A, Antonoglou I, King H, Kumaran D, Wierstra D, Legg S, Hassabis D (2015) Human-level control through deep reinforcement learning. Nature 518(7540):529–533. https://doi.org/10.1038/nature14236

    Article  Google Scholar 

  11. Liu K, Wan Q, Li Y (2018) A deep reinforcement learning algorithm with expert demonstrations and supervised loss and its application in autonomous driving. In: 2018 37th Chinese Control Conference (CCC), Technical Committee on Control Theory, Chinese Association of Automation, pp 2944–2949, https://doi.org/10.23919/ChiCC.2018.8482790

  12. Sangiovanni B, Incremona GP, Piastra M, Ferrara A (2021) Self-configuring robot path planning with obstacle avoidance via deep reinforcement learning. IEEE Control Syst Lett 5(2):397–402. https://doi.org/10.1109/LCSYS.2020.3002852

    Article  Google Scholar 

  13. Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117

    Article  Google Scholar 

  14. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature (London) 521(7553):436–444. https://doi.org/10.1038/nature14539

    Article  Google Scholar 

  15. Mishkin D, Sergievskiy N, Matas J (2017) Systematic evaluation of convolution neural network advances on the imagenet. Comput Vis Image Understand 161:11–19. https://doi.org/10.1016/j.cviu.2017.05.007

    Article  Google Scholar 

  16. Hoang DT, Kang HJ (2019) A survey on deep learning based bearing fault diagnosis. Neurocomputing 335:327–335. https://doi.org/10.1016/j.neucom.2018.06.078

    Article  Google Scholar 

  17. Chen R, Huang X, Yang L, Xu X, Zhang Y, Zhang X (2019) Intelligent fault diagnosis method of planetary gearboxes based on convolution neural network and discrete wavelet transform. Comput Ind 106:48–59. https://doi.org/10.1016/j.compind.2018.11.003

    Article  Google Scholar 

  18. Appana DK, Prosvirin A, Kim JM (2018) Reliable fault diagnosis of bearings with varying rotational speeds using envelope spectrum and convolution neural networks. Soft Comput 22(20):6719–6729. https://doi.org/10.1007/s00500-018-3256-0

    Article  Google Scholar 

  19. Dey D, Chatterjee B, Dalai S, Munshi S, Chakravorti S (2017) A deep learning framework using convolution neural network for classification of impulse fault patterns in transformers with increased accuracy. IEEE Trans Dielectric Electric Insulation 24(6):3894–3897. https://doi.org/10.1109/TDEI.2017.006793

    Article  Google Scholar 

  20. Zhang D, Lin Z, Gao Z (2018) A novel fault detection with minimizing the noise-signal ratio using reinforcement learning. Sensors 18(9):3087. https://doi.org/10.3390/s18093087

    Article  Google Scholar 

  21. Jaafra Y, Luc Laurent J, Deruyver A, Saber Naceur M (2019) Reinforcement learning for neural architecture search: a review. Image and Vis Comput 89:57–66. https://doi.org/10.1016/j.imavis.2019.06.005

    Article  Google Scholar 

  22. Feng X, Jiao Y, Lv C, Zhou D (2016) Label consistent semi-supervised non-negative matrix factorization for maintenance activities identification. Eng Appl Artificial Intell 52:161–167. https://doi.org/10.1016/j.engappai.2016.02.016

    Article  Google Scholar 

  23. Hinton G, Salakhutdinov R (2006) Reducing the dimensionality of data with neural networks. Science (New York, NY) 313:504–7. https://doi.org/10.1126/science.1127647

    Article  MathSciNet  MATH  Google Scholar 

  24. Salimans T, Goodfellow I, Zaremba W, Cheung V, Radford A, Chen X (2016) Improved techniques for training gans. 1606.03498

  25. Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Ghahramani Z, Welling M, Cortes C, Lawrence ND, Weinberger KQ (eds) Advances in Neural Information Processing Systems, Advances in Neural Information Processing Systems, vol 27. NEURAL INFORMATION PROCESSING SYSTEMS (NIPS), LA JOLLA, pp 2672–2680

    Google Scholar 

  26. Eren L, Ince T, Kiranyaz S (2019) A generic intelligent bearing fault diagnosis system using compact adaptive 1d cnn classifier. J Signal Process Syst 91(2):179C – 189

    Article  Google Scholar 

  27. Zhao Z, Xu Q, Jia M (2016) Improved shuffled frog leaping algorithm-based bp neural network and its application in bearing early fault diagnosis. Neural Comput Appl 27(2):375–385

    Article  Google Scholar 

  28. Ng A, et al. (2011) Sparse autoencoder. CS294A Lecture notes 72(2011):1–19

  29. Lee H, Grosse R, Ranganath R, Ng AY (2009) Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In: Proceedings of the 26th annual international conference on machine learning, pp 609–616

  30. Yang M, Liu N, Zuo L, Feng Y, Liu M, Gong H, Liu M (2021) Dynamic charging scheme problem with actor-critic reinforcement learning. IEEE Internet of Things J 8(1):370–380. https://doi.org/10.1109/JIOT.2020.3005598

    Article  Google Scholar 

  31. Zhong S, Liu Q, Fu Q, Franco L (2016) Efficient actor-critic algorithm with hierarchical model learning and planning. Comput Intell Neurosci. https://doi.org/10.1155/2016/4824072

    Article  Google Scholar 

  32. Chamie ME, Yu Y, Acikmese B, Ono M (2019) Controlled markov processes with safety state constraints. IEEE Trans Autom Control 64(3):1003–1018. https://doi.org/10.1109/TAC.2018.2849556

    Article  MathSciNet  MATH  Google Scholar 

  33. Yan T, Zhang W, Yang S, Yu L (2019) Soft actor-critic reinforcement learning for robotic manipulator with hindsight experience replay. Int J Robotics Autom 34

  34. Wang Z, Xuan J (2021) Intelligent fault recognition framework by using deep reinforcement learning with one dimension convolution and improved actor-critic algorithm. Adv Eng Inform. https://doi.org/10.1016/j.aei.2021.101315

    Article  Google Scholar 

  35. Zhuang Z, Lv H, Xu J, Huang Z, Qin W (2019) A deep learning method for bearing fault diagnosis through stacked residual dilated convolutions. Appl Sci 9(9):18–23. https://doi.org/10.3390/app9091823

    Article  Google Scholar 

  36. Gan M, Wang C, Zhu CA (2016) Construction of hierarchical diagnosis network based on deep learning and its application in the fault pattern recognition of rolling element bearings. Mech Syst Sig Process 72–73:92–104. https://doi.org/10.1016/j.ymssp.2015.11.014

    Article  Google Scholar 

  37. Zhao M, Kang M, Tang B, Pecht M (2018) Deep residual networks with dynamically weighted wavelet coefficients for fault diagnosis of planetary gearboxes. IEEE Trans Ind Electron 65(5):4290–4300. https://doi.org/10.1109/TIE.2017.2762639

    Article  Google Scholar 

  38. Pathak RS, Singh A (2016) Mexican hat wavelet transform of distributions. Integral Trans Special Functions 27(6):468–483. https://doi.org/10.1080/10652469.2016.1155569

    Article  MathSciNet  MATH  Google Scholar 

  39. Radford A, Metz L, Chintala S (2016) Unsupervised representation learning with deep convolutional generative adversarial networks. 1511.06434

  40. Duan J, Shi T, Duan J, Xuan J, Zhang Y (2018) A narrowband envelope spectra fusion method for fault diagnosis of rolling element bearings. Measurement Sci Technol 29(12):125106

Download references

Acknowledgements

This research is supported by the National Key R&D Program of China(Grant No. 2020YFB2007700), and the National Natural Science Foundation of China (Grant No. 52175094).

Author information

Authors and Affiliations

  1. School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, 430074, China

    Zisheng Wang, Jianping Xuan & Tielin Shi

Authors
  1. Zisheng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jianping Xuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tielin Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jianping Xuan.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, Z., Xuan, J. & Shi, T. A novel semi-supervised generative adversarial network based on the actor-critic algorithm for compound fault recognition. Neural Comput & Applic 34, 10787–10805 (2022). https://doi.org/10.1007/s00521-022-07011-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-07011-z

Keywords

Search

Navigation