Two-Stage Multi-Channel Fault Detection and Remaining Useful Life Prediction Model of Internal Gear Pumps Based on Robust-ResNet
<p>Methodological framework diagram of the proposed method. Our method is mainly based on Robust-ResNet implementation for two-stage tasks: fault detection and remaining useful life prediction. Robust-ResNet achieves robustness of the ResNet network using a small step factor <math display="inline"><semantics> <mi>h</mi> </semantics></math>. The first-stage task is the fault detection using one-channel signals of 1 × 1024 collected from pump outlet pressure pulsation sensor. The samples with acoustic faults are then used in the second stage: remaining useful life prediction. Four-channel signals were used in the RUL prediction, including signals from the pump inlet pressure pulsation sensor, pump outlet pressure pulsation sensor, pump inlet side acceleration sensor and pump outlet side acceleration sensor. The size of the input tensor is 4 × 1024. For the RUL prediction stage in the figure, a sample length of 1024 is used as an example. Different sample lengths are compared in the actual experiment.</p> "> Figure 2
<p>Residual network block structure.</p> "> Figure 3
<p>Sensor mounting positions. Four sensors were installed to collect signals: 1. pump inlet pressure pulsation sensor; 2. pump outlet pressure pulsation sensor; 3. pump inlet side acceleration sensor; 4. pump outlet side acceleration sensor.</p> "> Figure 4
<p>Comparison of frequency domain waveforms in different life stages of internal gear pumps.</p> "> Figure 5
<p>Full life variation curve of the volumetric efficiency of internal gear pumps.</p> "> Figure 6
<p>Accuracy curves of the proposed methods on different datasets, where (<b>a</b>) is the accuracy graph of the proposed method with <math display="inline"><semantics> <mrow> <mi>h</mi> <mo>=</mo> <mn>0.1</mn> </mrow> </semantics></math> for fault detection on the self-collected gear pump dataset and (<b>b</b>) is the accuracy curves of the proposed method with <math display="inline"><semantics> <mrow> <mi>h</mi> <mo>=</mo> <mn>0.1</mn> </mrow> </semantics></math> on the CWRUdataset.</p> "> Figure 7
<p>Accuracy curves of the proposed model with different sampling length: (<b>a</b>) Sampling length = 512; (<b>b</b>) Sampling length = 1024; (<b>c</b>) Sampling length = 1536; (<b>d</b>) Sampling length = 1920; (<b>e</b>) Sampling length = 2048; (<b>f</b>) Sampling length = 4096.</p> "> Figure 7 Cont.
<p>Accuracy curves of the proposed model with different sampling length: (<b>a</b>) Sampling length = 512; (<b>b</b>) Sampling length = 1024; (<b>c</b>) Sampling length = 1536; (<b>d</b>) Sampling length = 1920; (<b>e</b>) Sampling length = 2048; (<b>f</b>) Sampling length = 4096.</p> ">
Abstract
:1. Introduction
- (1)
- A multi-channel two-stage Robust-ResNet-based deep learning method for fault detection and RUL prediction is proposed, which does not require manual feature extraction or complex data processing.
- (2)
- The proposed method is based on the Robust-ResNet algorithm with a small step factor , and the robustness of the proposed method is proved in experiments examining fault detection and RUL prediction in two datasets. Robust-ResNet was used in mechanical fault diagnosis and RUL prediction for the first time. Its superior performance is more in line with the actual scenario of mechanical fault detection. When acquiring data in mechanical work, it is inevitable that noisy data will be obtained; the proposed model is robust, making it more stable and more suitable for generating training data to be used in mechanical fault detection.
- (3)
- The proposed method used multi-channel signals in RUL prediction, including pressure pulsation and vibration signals. The fusion of multi-channel signals significantly improved the prediction performance of the method.
- (4)
- The model achieves high accuracy in its performance on both tasks, reaching 99.96% accuracy in the fault detection task and 99.53% accuracy in the RUL prediction task in the self-collected internal gear pump dataset. It could also be used in fault detection for rolling bearing, which achieved 99.94% accuracy in the CWRU [36] dataset, which outperformed other state of the art methods. The superior performance of the method on both datasets demonstrates its suitability for multiple application scenarios and that it can be generalised for practical use.
2. Materials and Methods
2.1. Model Framework
2.1.1. ResNet
2.1.2. Robust-ResNet
2.1.3. Two-Stage Classifiers and Multichannel Signals
2.2. Gear Pump Data Collection
3. Experiment and Results
3.1. Experimental Setup
3.2. Results of Fault Detection
3.3. Results of RUL Prediction
3.4. Model Inference Time
3.5. Discussion
4. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Bin, H.; Liu, L.; Zhang, D. Digital twin-driven remaining useful life prediction for gear performance degradation: A review. J. Comput. Inf. Sci. Eng. 2021, 21, 030801. [Google Scholar]
- Zhang, P.; Jiang, W.; Shi, X.; Zhang, S. Remaining Useful Life Prediction of internal gear pump Based on Deep Sparse Autoencoders and Multilayer Bidirectional Long–Short–Term Memory Network. Processes 2022, 10, 2500. [Google Scholar] [CrossRef]
- Yang, Y.; Ding, L.; Xiao, J.; Fang, G.; Li, J. Current Status and Applications for Hydraulic Pump Fault Diagnosis: A Review. Sensors 2022, 22, 9714. [Google Scholar] [CrossRef] [PubMed]
- Saufi, S.R.; Ahmad, Z.A.B.; Leong, M.S.; Lim, M.H. Challenges and opportunities of deep learning models for machinery fault detection and diagnosis: A review. IEEE Access 2019, 7, 122644–122662. [Google Scholar] [CrossRef]
- Yang, M.; Jiang, Y.; Huang, J.; Zhang, X.; Han, L. Application of fault diagnosis of seawater hydraulic pump based on transfer learning. Shock Vib. 2020, 2020, 9630986. [Google Scholar]
- Lu, C.; Wang, S.; Tomovic, M. Fault severity recognition of hydraulic piston pumps based on EMD and feature energy entropy. In Proceedings of the 2015 IEEE 10th Conference on Industrial Electronics and Applications (ICIEA), Auckland, New Zealand, 15–17 June 2015. [Google Scholar]
- Yang, S.; Yue, J. Fault diagnosis of EMU rolling bearing based on EEMD and SVM. AIP Conf. Proc. 2018, 1967, 030023. [Google Scholar]
- Wang, Y.; Li, H.; Peng, Y. Fault Identification of Hydraulic Pump Based on Multi-scale Permutation Entropy. China Mech. Eng. 2015, 26, 518. [Google Scholar]
- Zhou, F.; Yang, X.; Shen, J.; Liu, W. Fault diagnosis of hydraulic pumps using PSO-VMD and refined composite multiscale fluctuation dispersion entropy. Shock Vib. 2020, 2020, 8840676. [Google Scholar] [CrossRef]
- Wang, Z.; Cao, L.; Zhang, Z.; Gong, X.; Sun, Y.; Wang, H. Short time Fourier transformation and deep neural networks for motor imagery brain computer interface recognition. Concurr. Comput. Pract. Exp. 2018, 30, e4413. [Google Scholar] [CrossRef]
- Wang, Z.; Liu, F.; Sun, Y.; Li, J.; Wang, F.; Lu, Z. The role of the precuneus and posterior cingulate cortex in the neural routes to action. Comput. Assist. Surg. 2019, 24 (Suppl. S1), 113–120. [Google Scholar] [CrossRef]
- Yao, T.; Qu, C.; Liu, Q.; Deng, R.; Tian, Y.; Xu, J.; Jha, A.; Bao, S.; Zhao, M.; Fogo, A.B.; et al. Compound figure separation of biomedical images with side loss. In Deep Generative Models, and Data Augmentation, Labelling, and Imperfections; Springer: Cham, Switzerland, 2021; pp. 173–183. [Google Scholar]
- Zhao, M.; Liu, Q.; Jha, A.; Deng, R.; Yao, T.; Mahadevan-Jansen, A.; Tyska, M.J.; Millis, B.A.; Huo, Y. VoxelEmbed: 3D instance segmentation and tracking with voxel embedding based deep learning. In International Workshop on Machine Learning in Medical Imaging; Springer: Cham, Switzerland, 2021. [Google Scholar]
- Bo, J.; Cruz, L.; Gonçalves, N. Pseudo RGB-D Face Recognition. IEEE Sens. J. 2022, 22, 21780–21794. [Google Scholar]
- Qingsheng, Z.; Cheng, G.; Han, X.; Liang, D.; Wang, X. Fault Diagnosis of Main Pump in Converter Station Based on Deep Neural Network. Symmetry 2021, 13, 1284. [Google Scholar]
- Meng, M.; Mao, Z. Deep-convolution-based LSTM network for remaining useful life prediction. IEEE Trans. Ind. Inform. 2020, 17, 1658–1667. [Google Scholar]
- Chen, Y.; Zhao, X.; Jia, X. Spectral–spatial classification of hyperspectral data based on deep belief network. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2015, 8, 2381–2392. [Google Scholar] [CrossRef]
- Michael, T.; Bachem, O.; Lucic, M. Recent Advances in Autoencoder-Based Representation Learning. arXiv 2018, arXiv:1812.05069. [Google Scholar]
- Keiron, O.; Nash, R. An Introduction to Convolutional Neural Networks. arXiv 2015, arXiv:1511.08458. [Google Scholar]
- Wang, Z.; Zhu, Y.; Shi, H.; Zhang, Y.; Yan, C. A 3D multiscale view convolutional neural network with attention for mental disease diagnosis on MRI images. Math. Biosci. Eng. 2021, 18, 6978–6994. [Google Scholar] [CrossRef]
- Zheng, Q.; Yang, M.; Yang, J.; Zhang, Q.; Zhang, X. Improvement of generalization ability of deep CNN via implicit regularization in two-stage training process. IEEE Access 2018, 6, 15844–15869. [Google Scholar] [CrossRef]
- Wojciech, Z.; Sutskever, I.; Vinyals, O. Recurrent Neural Network Regularization. arXiv 2014, arXiv:1409.2329. [Google Scholar]
- Zijian, W.; Zhang, Y.; Shi, H.; Cao, L.; Yan, C.; Xu, G. Recurrent spiking neural network with dynamic presynaptic currents based on backpropagation. Int. J. Intell. Syst. 2022, 37, 2242–2265. [Google Scholar]
- Mei, Y.; Wu, Y.; Lin, L. Fault diagnosis and remaining useful life estimation of aero engine using LSTM neural network. In Proceedings of the 2016 IEEE International Conference on Aircraft Utility Systems (AUS), Beijing, China, 10–12 October 2016; pp. 135–140. [Google Scholar]
- He, M.; He, D. Deep Learning Based Approach for Bearing Fault Diagnosis. IEEE Trans. Ind. Appl. 2017, 53, 3057–3065. [Google Scholar] [CrossRef]
- Li, X.; Xu, Y.; Li, N.; Yang, B.; Lei, Y. Remaining useful life prediction with partial sensor malfunctions using deep adversarial networks. IEEE/CAA J. Autom. Sin. 2022, 10, 121–134. [Google Scholar] [CrossRef]
- Myeong-Seok, L.; Shifat, T.A.; Hur, J.-W. Kalman Filter Assisted Deep Feature Learning for RUL Prediction of Hydraulic internal gear pump. IEEE Sens. J. 2022, 22, 11088–11097. [Google Scholar]
- Sheng, X.; Qin, Y.; Zhu, C.; Wang, Y.; Chen, H. Long short-term memory neural network with weight amplification and its application into gear remaining useful life prediction. Eng. Appl. Artif. Intell. 2020, 91, 103587. [Google Scholar]
- Chenyang, W.; Jiang, W.; Yue, Y.; Zhang, S. Research on Prediction Method of internal gear pump Remaining Useful Life Based on DCAE and Bi-LSTM. Symmetry 2022, 14, 1111. [Google Scholar]
- Guo, R.; Li, Y.; Zhao, L.; Zhao, J.; Gao, D. Remaining useful life prediction based on the Bayesian regularized radial basis function neural network for an external internal gear pump. IEEE Access 2020, 8, 107498–107509. [Google Scholar] [CrossRef]
- LeCun, Y.; Bottou, L.; Bengio, Y.; Haffner, P. Gradient-based learning applied to document recognition. Proc. IEEE 1998, 86, 2278–2324. [Google Scholar] [CrossRef] [Green Version]
- Alex, K.; Sutskever, I.; Hinton, G.E. Imagenet classification with deep convolutional neural networks. Commun. ACM 2017, 60, 84–90. [Google Scholar]
- Simonyan, K.; Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv 2014, arXiv:1409.1556. [Google Scholar]
- Szegedy, C.; Vanhoucke, V.; Ioffe, S.; Shlens, J.; Wojna, Z. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 26 June–1 July 2016. [Google Scholar]
- Jingfeng, Z.; Han, B.; Wynter, L.; Low, B.K.H.; Kankanhalli, M.S. Towards Robust ResNet: A Small Step but a Giant Leap. arXiv 2019, arXiv:1902.10887. [Google Scholar]
- Loparo, K.A. Bearings Vibration Data Set. The Case Western Reserve University Bearing Data Center. Available online: http://www.eecs.cwru.edu/laboratory/bearing/download.htm (accessed on 1 May 2022).
- He, K.; Zhang, X.; Ren, S.; Sun, J. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 26 June–1 July 2016; pp. 770–778. [Google Scholar]
- Son, J.; Kang, D.; Boo, D.; Ko, K. An experimental study on the fault diagnosis of wind turbines through a condition monitoring system. J. Mech. Sci. Technol. 2018, 32, 5573–5582. [Google Scholar] [CrossRef]
- He, Y.; Li, H.; Li, Y. Vibration signal fusion using improved empirical wavelet transform and variance contribution rate for weak fault detection of hydraulic pumps. ISA Trans. 2020, 107, 385–401. [Google Scholar]
- Yuan, L.; Hu, J.; Huang, J.; Niu, L.; Zeng, X.; Xiong, X.; Wu, B. Fault diagnosis on slipper abrasion of axial piston pump based on extreme learning machine. Measurement 2018, 124, 378–385. [Google Scholar]
- Zhao, H.S.; Zhang, X.T. Early fault prediction of wind turbine gearbox based on temperature measurement. In Proceedings of the 2012 IEEE International Conference on Power System Technology (POWERCON), Auckland, New Zealand, 30 October–2 November 2012. [Google Scholar]
- Tang, S.; Zhu, Y.; Yuan, S. An adaptive deep learning model towards fault diagnosis of hydraulic piston pump using pressure signal. Eng. Fault Anal. 2022, 138, 106300. [Google Scholar] [CrossRef]
- Kim, Y.W.; Jeong, W.B. Reliability evaluation technique of compressor using pressure pulsation and vibration signals. J. Phys. Conf. Ser. 2018, 1075, 012076. [Google Scholar] [CrossRef]
- Randall, R.B. Vibration-Based Condition Monitoring: Industrial, Aerospace and Automotive Applications; John Wiley & Sons: Hoboken, NJ, USA, 2011; Volume 3, pp. 431–477. [Google Scholar]
- Zheng, J.; Liao, J.; Chen, Z. End-to-End Continuous/Discontinuous Feature Fusion Method with Attention for Rolling Bearing Fault Diagnosis. Sensors 2022, 22, 6489. [Google Scholar] [CrossRef]
- Lei, Y.; Jia, F.; Lin, J.; Xing, S.; Ding, S.X. An Intelligent Fault Diagnosis Method Using Unsupervised Feature Learning towards Mechanical Big Data. IEEE Trans. Ind. Electron. 2016, 63, 3137–3147. [Google Scholar] [CrossRef]
- Wang, J.; Zhan, C.; Yu, D.; Zhao, Q.; Xie, Z. Rolling bearing fault diagnosis method based on SSAE and softmax classififier with improved K-fold cross-validation. Meas. Sci. Technol. 2022, 33, 105110. [Google Scholar] [CrossRef]
- Yan, J.; Kan, J.; Luo, H. Rolling Bearing Fault Diagnosis Based on Markov Transition Field and Residual Network. Sensors 2022, 22, 3936. [Google Scholar] [CrossRef]
Parameters | Settings |
---|---|
System oil temperature | 80 °C |
Test speed | Maximum pump speed |
Impact pressure | Pump 125% of rated pressure |
Impact frequency | 40 times/min |
Single-step impact (loading time) | 1.0 s |
Single-step impact (unloading time) | 0.5 s |
Fault Location | Diameter | Number of Samples | Number of Samples in CWRU-512 |
---|---|---|---|
Normal | Normal | 2,182,450 | 4261 |
Ball | 0.007 | 487,093 | 950 |
0.014 | 488,109 | 951 | |
0.021 | 487,964 | 951 | |
Inner Raceway | 0.007 | 488,309 | 952 |
0.014 | 487,239 | 948 | |
0.021 | 487,529 | 950 | |
Outer Raceway | 0.007 | 1,465,051 | 2855 |
0.014 | 487,819 | 950 | |
0.021 | 1,465,487 | 2856 |
Model | Learning Rate | Epoch | Optimizer | Loss Function | Number of Training Samples | Number of Testing Samples |
---|---|---|---|---|---|---|
FD-H0.1 | 0.03 | 50 | SGD | CrossEntropyLoss | 30,702 | 7680 |
FD-H1.0 | ||||||
RUL-512 | 0.001 | 100 | Adam | 12,288 | 3072 | |
RUL-1024 | 6114 | 1536 | ||||
RUL-1536 | 4096 | 1024 | ||||
RUL-1920 | 0.003 | 3276 | 820 | |||
RUL-2048 | 3072 | 768 | ||||
RUL-4096 | 1536 | 384 |
Dataset | Model | Accuracy (%) |
---|---|---|
Self-collected gear pump dataset | CNN | 98.43 |
CNN + Attention | 99.64 | |
C/D-FUSA [45] | 99.80 | |
FD-H1.0 | 99.81 | |
FD-H0.1 | 99.96 |
Dataset | Model | Accuracy (%) |
---|---|---|
CWRU | C/D-FUSA [45] | 99.85 |
Lei et al. (2016) [46] | 99.66 | |
Wang et al. (2022) [47] | 99.15 | |
Yan et al. (2022) [48] | 98.52 | |
FD-H1.0 | 99.90 | |
FD-H0.1 | 99.94 |
Method | Channel | Model | Accuracy (%) |
---|---|---|---|
Proposed model | Multichannel | RUL-512 | 99.53 |
RUL-1536 | 97.67 | ||
RUL-1920 | 98.66 | ||
RUL-2048 | 98.83 | ||
RUL-4096 | 99.23 | ||
RUL-1024 | 97.23 | ||
Single-channel | RUL-1024 | 78.34 | |
CNN | Multi-channel | RUL-1024 | 81.74 |
Single-channel | RUL-1024 | 52.41 | |
CNN + Attention | Multi-channel | RUL-1024 | 89.25 |
Single-channel | RUL-1024 | 70.96 | |
C/D-FUSA [37] | Multi-channel | RUL-1024 | 91.03 |
Single-channel | RUL-1024 | 77.64 |
Dataset | Sampling Time (s) | Inference Time (s) |
---|---|---|
FD-H0.1 | 0.0156 | 0.0021 |
RUL-512 | 0.0078 | 0.0058 |
RUL-1024 | 0.0156 | 0.0006 |
RUL-1536 | 0.0234 | 0.0006 |
RUL-1920 | 0.0293 | 0.0059 |
RUL-2048 | 0.0313 | 0.0058 |
RUL-4096 | 0.0625 | 0.0059 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Zheng, J.; Liao, J.; Zhu, Y. Two-Stage Multi-Channel Fault Detection and Remaining Useful Life Prediction Model of Internal Gear Pumps Based on Robust-ResNet. Sensors 2023, 23, 2395. https://doi.org/10.3390/s23052395
Zheng J, Liao J, Zhu Y. Two-Stage Multi-Channel Fault Detection and Remaining Useful Life Prediction Model of Internal Gear Pumps Based on Robust-ResNet. Sensors. 2023; 23(5):2395. https://doi.org/10.3390/s23052395
Chicago/Turabian StyleZheng, Jianbo, Jian Liao, and Yaqin Zhu. 2023. "Two-Stage Multi-Channel Fault Detection and Remaining Useful Life Prediction Model of Internal Gear Pumps Based on Robust-ResNet" Sensors 23, no. 5: 2395. https://doi.org/10.3390/s23052395