A Brief Review of Acoustic and Vibration Signal-Based Fault Detection for Belt Conveyor Idlers Using Machine Learning Models
<p>The level of detection for each method of monitoring.</p> "> Figure 2
<p>An illustrative view of the process for article selection.</p> "> Figure 3
<p>Outline of this paper.</p> "> Figure 4
<p>Structure of a belt Conveyor.</p> "> Figure 5
<p>Structure of belt conveyor idler.</p> "> Figure 6
<p>Idler rolls are shown in operation on a typical belt conveyor.</p> "> Figure 7
<p>Types of failures in belt conveyor idlers.</p> "> Figure 8
<p>The difference between deep learning and shallow machine learning models in FD systems.</p> "> Figure 9
<p>Data collection methods.</p> ">
Abstract
:1. Introduction
- Idlers are subject to high levels of wear and tear due to the constant contact with the conveyor belt and the heavy loads they support. This can lead to the development of unique faults such as misalignment, shell wear, damage to the rollers, or structural deformation [16].
- Idlers are typically exposed to harsh environments, such as dust, heat, and moisture, which can accelerate the degradation of the components and increase the likelihood of faults [19].
- Idlers have a simple construction and are low-cost components, which means that there is a high number of them in a conveyor system. This can present challenges for monitoring and diagnosis, as many idlers need to be inspected regularly.
- Idlers have an important role in the conveyor system, supporting the belt. Therefore, the early detection of faults in idlers is crucial to prevent belt damage and to ensure the conveyor system runs reliably [16].
- Idlers are part of a complex system, and they are affected by the dynamic behavior of the conveyor system, which can vary depending on the specific application, operating environment, conveyor design, and loads [20].
1.1. Contribution of the Paper
- An overview of the components of belt conveyor systems, sources of defects, and a brief introduction to ML models.
- A segmentation of the whole program of FD systems into four blocks, i.e., data acquisition, signal processing, feature extraction and selection, and ML models for fault detection.
- A review of ML models used in FD for belt conveyor idlers based on acoustic and vibration signal-based methods.
- Discussion on several challenges in detecting failures in belt conveyor idlers and highlights of future research directions.
1.2. Information Sources and Search Strategy
1.3. Organization of the Paper
2. Background
2.1. Components of a Belt Conveyor
2.2. Source of Faults in the Belt Conveyor Idlers
2.3. Fault Detection
2.4. Brief Introduction of ML Models
3. Data Acquisition of Belt Conveyor Idlers
3.1. Acoustic Data
Input Types | Vibration Methods | Acoustic Methods |
---|---|---|
Raw input domain | [44] | |
Statistical features from the time domain or frequency domain | [45,46,47,48,58] | [8,50,59] |
Statistical features from the time-frequency domain | [4,12,23,60] | [24,41] |
Combination of statistical features from all domains | [40] |
Authors | Dataset | Method for Data Collection |
---|---|---|
Rocha et al. [59] | The final dataset contains 55 audio files | Microphone |
Ericeira et al. [50] | Ten time-series in non-defective idlers and ten recordings for the defective ones. Each recording lasted for approximately 20 s | ultrasonic sensor |
Liu et al. [8] | 42 sets of acoustic data acquired from experiments, which is equal to 420 s of sound data acquisition. | microphone |
Yang et al. [40] | Not reported | Sensor |
Peng et al. [24] | A total of 8000 sets of sample data are collected | Sensor |
Xiao-ping Jiang and Guan qiang Cao [41] | Not reported | Generated sound signal |
3.2. Vibration Data
4. Signal Processing and Feature Extraction
4.1. Signal Processing
4.2. Feature Extraction & Selection Step
4.2.1. Time or Frequency Domain Transformation
4.2.2. Time-Frequency Domain Transformation
5. Review of FD Methods Based on Shallow Machine Learning and Deep Learning
5.1. Vibration Signal-Based Fault Detection Methods
5.2. Acoustic Signal-Based Fault Detection Methods
6. Results
- ML models, such as artificial neural networks and support vector machines, can improve fault detection accuracy for belt conveyor idlers compared to traditional methods.
- ML models can analyze large amounts of data from multiple sensors, including vibration, acoustic, and thermal data, to detect faults in belt conveyor idlers.
- ML models can identify patterns in the data that indicate a fault, such as changes in vibration amplitude or frequency, which can help diagnose faults in the early stages.
- ML models can also be used to classify the different types of faults, such as bearing wear or misalignment, which can help to optimize the maintenance and repair of the conveyor system.
7. Challenges and Future Research Directions
- Research on multi-information fusion and multi-model [88] approaches should be investigated. This is because multivariate versions can extract a greater amount of fault information, and in real-world applications, multiple channels of signals are measured simultaneously. Therefore, weak fault symptoms can be detected at an early fault stage; utilizing balanced health states can reduce missed diagnosis rates and improve detection accuracy [67].
- There is a lack of research addressing how the results can be generalized to dynamic settings and studies on how belt conveyors can be used under changing conditions. As part of the current data-driven approach to FD, the training and testing data must be in the same working condition and have the same distribution and feature space. As a result, future studies are recommended to improve test results’ reliability since most of the literature has been conducted in laboratory settings, and they may not be able to incorporate all types of data in real-world applications.
- Research on the development of interpretable models. As a result of the use of ML models, there is often a concern that these methods are black boxes, and it is unclear how certain decisions are derived. Thus, in order to understand the type of faults that occur in certain machines, interpretable models must be constructed.
- Using Unmanned Aerial Vehicles (UAVs) to inspect critical industrial components, such as idlers on belt conveyors, has proven to be a very interesting method of solving accessibility and mobility issues. The drone’s rotors and engines produce echo noise, which can cause a problem. In order to extract hidden information from a signal, complex signal analysis methods are required. A wide range of studies have been conducted on UAV noise [89,90]
- Research on the lack of labeled sound data. With the availability of large datasets, Deep Learning solutions can provide significant benefits in the modeling process. It should be noted that a major milestone in computer vision has been achieved with the availability of a massive labeled dataset, resulting in the birth of ImageNet [85].
- Research on model evaluation metrics. In most studies, accuracy (ACC) was used as a metric for evaluation. However, it is important to note that ACC is not the appropriate measure for imbalanced classification problems that commonly occur in belt conveyor idlers. The model can achieve a very high ACC if it can predict the majority class correctly (non-failure), even when it performs extremely poorly in predicting the minority class (failure). It is, therefore, necessary to differentiate between the accuracy of minority and majority classes, for which precision, recall, and specificity, among other metrics, are available for evaluating ML models.
8. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Liu, X. Prediction of Belt Conveyor Idler Performance; TRAIL Research School: Delft, The Netherlands, 2016. [Google Scholar]
- Govindan, V.; Palaniswamy, E.; Sambathkumar, M.; Vijayakumar, R.; Sakthimuruga, T. Conveyor Belt Troubles (Bulk Material Handling). Int. J. Emerg. Eng. Res. Technol. 2014, 2, 21–30. [Google Scholar]
- Li, J.; Miao, C. The conveyor belt longitudinal tear on-line detection based on improved SSR algorithm. Optik 2016, 127, 8002–8010. [Google Scholar] [CrossRef]
- Li, W.; Wang, Z.; Zhu, Z.; Zhou, G.; Chen, G. Design of Online Monitoring and Fault Diagnosis System for Belt Conveyors Based on Wavelet Packet Decomposition and Support Vector Machine. Adv. Mech. Eng. 2013, 5, 797183. [Google Scholar] [CrossRef]
- Nascimento, R.; Carvalho, R.; Delabrida, S.E.; Bianchi, A.G.C.; Oliveira, R.A.O.; Garcia, L.G.U. An Integrated Inspection System for Belt Conveyor Rollers—Advancing in an Enterprise Architecture. In Proceedings of the 19th International Conference on Enterprise Information Systems, Porto, Portugal, 26–29 April 2017. [Google Scholar]
- Bortnowski, P.; Kawalec, W.; Król, R.; Ozdoba, M. Types and causes of damage to the conveyor belt—Review, classification and mutual relations. Eng. Fail. Anal. 2022, 140, 106520. [Google Scholar] [CrossRef]
- Liu, Y.; Miao, C.; Li, X.; Ji, J.; Meng, D. Research on the fault analysis method of belt conveyor idlers based on sound and thermal infrared image features. Meas. J. Int. Meas. Confed. 2021, 186, 110177. [Google Scholar] [CrossRef]
- Liu, X.; Pei, D.; Lodewijks, G.; Zhao, Z.; Mei, J. Acoustic signal based fault detection on belt conveyor idlers using machine learning. Adv. Powder Technol. 2020, 31, 2689–2698. [Google Scholar] [CrossRef]
- Park, Y.-J.; Fan, S.-K.S.; Hsu, C.-Y. A Review on Fault Detection and Process Diagnostics in Industrial Processes. Processes 2020, 8, 1123. [Google Scholar]
- Gao, Z.; Cecati, C.; Ding, S.X. A Survey of Fault Diagnosis and Fault-Tolerant Techniques—Part I: Fault Diagnosis With Model-Based and Signal-Based Approaches. IEEE Trans. Ind. Electron. 2015, 62, 3757–3767. [Google Scholar] [CrossRef]
- Lei, Y.; Yang, B.; Jiang, X.; Jia, F.; Li, N.; Nandi, A.K. Applications of machine learning to machine fault diagnosis: A review and roadmap. Mech. Syst. Signal Process. 2020, 138, 106587. [Google Scholar] [CrossRef]
- Wijaya, H.; Rajeev, P.; Gad, E.; Vivekanantham, R. Automatic fault detection system for mining conveyor using distributed acoustic sensor. Measurement 2022, 187, 110330. [Google Scholar] [CrossRef]
- Alspaugh, M. Latest Developments in Belt Conveyor Technology; MINExpo: Las Vegas, Nevada, 2004. [Google Scholar]
- Qurthobi, A.; Maskeliunas, R.; Damaševičius, R. Detection of Mechanical Failures in Industrial Machines Using Overlapping Acoustic Anomalies: A Systematic Literature Review. Sensors 2022, 22, 3888. [Google Scholar] [CrossRef]
- Wei, Y.; Li, Y.; Xu, M.; Huang, W. A Review of Early Fault Diagnosis Approaches and Their Applications in Rotating Machinery. Entropy 2019, 21, 409. [Google Scholar]
- Dąbek, P.; Krot, P.; Wodecki, J.; Zimroz, P.; Szrek, J.; Zimroz, R. Measurement of idlers rotation speed in belt conveyors based on image data analysis for diagnostic purposes. Measurement 2022, 202, 111869. [Google Scholar] [CrossRef]
- Wheeler, C.A. Rotating Resistance of Belt Conveyor Idler Rolls. J. Manuf. Sci. Eng. 2015, 138, 4. [Google Scholar] [CrossRef]
- Lu, Y.; Li, Q. A regression model for prediction of idler rotational resistance on belt conveyor. Meas. Control. 2019, 52, 441–448. [Google Scholar] [CrossRef]
- Morales, A.S.; Aqueveque, P.E.; Henriquez, J.A.; Saavedra, F.; Wiechmann, E.P. A Technology Review of Idler Condition Based Monitoring Systems for Critical Overland Conveyors in Open-Pit Mining Applications. In Proceedings of the 2017 IEEE Industry Applications Society Annual Meeting, Cincinnati, OH, USA, 1–5 October 2017; pp. 1–8. [Google Scholar]
- Zeng, F.; Yan, C.; Wu, Q.; Wang, T. Dynamic Behaviour of a Conveyor Belt Considering Non-Uniform Bulk Material Distribution for Speed Control. Appl. Sci. 2020, 10, 4436. [Google Scholar] [CrossRef]
- Altaf, M.; Uzair, M.; Khan, M.; Ahmad, A.; Badshah, S.; Shah, J.; Anjum, M.A. Automatic and Efficient Fault Detection in Rotating Machinery using Sound Signals. Acoust. Aust. 2019, 47, 125–139. [Google Scholar] [CrossRef]
- Saufi, S.R.; Ahmad, Z.A.B.; Leong, M.S.; Lim, M.H. Challenges and Opportunities of Deep Learning Models for Machinery Fault Detection and Diagnosis: A Review. IEEE Access 2019, 7, 122644–122662. [Google Scholar] [CrossRef]
- Roos, W.A.; Heyns, P.S. In-belt vibration monitoring of conveyor belt idler bearings by using wavelet package decomposition and artificial intelligence. Int. J. Min. Miner. Eng. 2021, 12, 48–66. [Google Scholar] [CrossRef]
- Peng, C.; Li, Z.; Yang, M.; Fei, M.; Wang, Y. An audio-based intelligent fault diagnosis method for belt conveyor rollers in sand carrier. Control. Eng. Pract. 2020, 105, 104650. [Google Scholar] [CrossRef]
- Angelo, T.D.; Mendes, M.; Keller, B.; Ferreira, R.; Delabrida, S.; Rabelo, R.; Azpurua, H.; Bianchi, A. Deep Learning-Based Object Detection for Digital Inspection in the Mining Industry. In Proceedings of the 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA), Boca Raton, FL, USA, 16–19 December 2019; pp. 633–640. [Google Scholar]
- Yang, W.; Zhang, X.; Ma, H. An inspection robot using infrared thermography for belt conveyor. In Proceedings of the 2016 13th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), Xi’an, China, 19–22 August 2016; pp. 400–404. [Google Scholar]
- Szrek, J.; Wodecki, J.; Błażej, R.; Zimroz, R. An Inspection Robot for Belt Conveyor Maintenance in Underground Mine—Infrared Thermography for Overheated Idlers Detection. Appl. Sci. 2020, 10, 4984. [Google Scholar] [CrossRef]
- Mongeon, P.; Paul-Hus, A. The journal coverage of Web of Science and Scopus: A comparative analysis. Scientometrics 2016, 106, 213–228. [Google Scholar] [CrossRef]
- Cooper, D. Sensor Platform for Monitoring Conveyor Belt Rollers; University of Southern Queensland: Darling Heights, Austerlia, 2015. [Google Scholar]
- Conveyor Guarding in Mines. Available online: https://www.ontario.ca/page/conveyor-guarding-mines (accessed on 23 August 2022).
- Saini, K.; Dhami, S.; Vanraj. Predictive Monitoring of Incipient Faults in Rotating Machinery: A Systematic Review from Data Acquisition to Artificial Intelligence. Arch. Comput. Methods Eng. 2022, 29, 4005–4026. [Google Scholar] [CrossRef]
- Zimroz, R.; Król, R. Failure Analysis of Belt Conveyor Systems; Prace Naukowe Instytutu Górnictwa Politechniki Wrocławskiej: Wrocław, Poland, 2009; pp. 50–51. [Google Scholar]
- Gurjar, R.S. Failure analysis of belt conveyor system. Int. J. Eng. Soc. Sci. 2012, 2, 11–23. [Google Scholar]
- Reicks, A. Belt conveyor idler roll behaviors. Bulk Mater. Handl. By Conveyor Belt 2008, 7, 35–40. [Google Scholar]
- Yang, B.Y. Fibre Optic Conveyor Monitoring System; Australian Coal Research Limited: Brisbane City, Austerlia, 2014. [Google Scholar]
- Liu, X.; Pang, Y.; Lodewijks, G.; He, D. Experimental research on condition monitoring of belt conveyor idlers. Measurement 2018, 127, 277–282. [Google Scholar] [CrossRef]
- Vasić, M.; Stojanović, B.; Blagojević, M. Failure analysis of idler roller bearings in belt conveyors. Eng. Fail. Anal. 2020, 117, 104898. [Google Scholar] [CrossRef]
- Dmitrichenko, N.; Milanenko, A.; Hluhonets, A.; Minyaylo, K. A technique for forecasting the durability of rolling bearings and the optimum choice of lubricants under flood-lubrication and oil-starvation conditions. J. Frict. Wear 2017, 38, 126–131. [Google Scholar] [CrossRef]
- FLEXCO. What Affects Conveyor Roller Life? Technical Solutions for Belt Conveyor Productivity. Available online: http://documentlibrary.flexco.com/X2640_enAU_2525_INSCCTlife_0813.pdf (accessed on 5 September 2022).
- Yang, M.; Zhou, W.; Song, T. Audio-based fault diagnosis for belt conveyor rollers. Neurocomputing 2020, 397, 447–456. [Google Scholar] [CrossRef]
- Jiang, X.P.; Cao, G.Q. Belt Conveyor Roller Fault Audio Detection Based on the Wavelet Neural Network. In Proceedings of the International Conference on Natural Computation, Zhangjiajie, China, 15–17 August 2015; pp. 954–958. [Google Scholar]
- Shiri, H.; Wodecki, J.; Ziętek, B.; Zimroz, R. Inspection robotic UGV platform and the procedure for an acoustic signal-based fault detection in belt conveyor idler. Energies 2021, 14, 7646. [Google Scholar] [CrossRef]
- Skoczylas, A.; Stefaniak, P.; Anufriiev, S.; Jachnik, B. Belt Conveyors Rollers Diagnostics Based on Acoustic Signal Collected Using Autonomous Legged Inspection Robot. Appl. Sci. 2021, 11, 2299. [Google Scholar] [CrossRef]
- Bortnowski, P.; Król, R.; Ozdoba, M. Roller damage detection method based on the measurement of transverse vibrations of the conveyor belt. Eksploat. I Niezawodn. Maint. Reliab. 2022, 24, 510–521. [Google Scholar] [CrossRef]
- Ravikumar, S.; Kanagasabapathy, H.; Muralidharan, V. Fault diagnosis of self-aligning troughing rollers in belt conveyor system using k-star algorithm. Measurement 2019, 133, 341–349. [Google Scholar] [CrossRef]
- Ravikumar, S.; Kanagasabapathy, S.; Muralidharan, V.; Srijith, R.; Bimalkumar, M. Fault Diagnosis of Self-Aligning troughing Rollers in a Belt Conveyor System Using an Artificial Neural Network and Naive Bayes Algorithm. In Emerging Trends in Engineering, Science and Technology for Society, Energy and Environment; CRC Press: Boca Raton, FL, USA, 2018; pp. 425–432. [Google Scholar]
- Ravikumar, S.; Kangasabapathy, H.; Muralidharan, V. Fault Diagnosis of Self Aligning Carrying Idler (SAI) in Belt-Conveyor System Using Statistical Features and Support Vector Machine. In Proceedings of the International Conference on Computational Intelligence & Advanced Manufacturing Research, Chennai, India, 2–3 May 2014. [Google Scholar]
- Ravikumar, S.; Muralidharan, V.; Ramesh, P.; Pandian, C. Advances in Smart Grid Technology. In Fault Diagnosis of Self-aligning Conveyor Idler in Coal Handling Belt Conveyor System by Statistical Features Using Random Forest Algorithm; Springer: Singapore, 2021; pp. 207–219. [Google Scholar] [CrossRef]
- Venkatasubramanian, V.; Rengaswamy, R.; Yin, K.; Kavuri, S.N. A review of process fault detection and diagnosis: Part I: Quantitative model-based methods. Comput. Chem. Eng. 2003, 27, 293–311. [Google Scholar] [CrossRef]
- Ericeira, D.R.; Rocha, F.; Bianchi, A.G.C.; Pessin, G. Early Failure Detection of Belt Conveyor Idlers by Means of Ultrasonic Sensing. In Proceedings of the International Joint Conference on Neural Networks, Glasgow, UK, 19–24 July 2020. [Google Scholar]
- Jordan, M.I.; Mitchell, T.M. Machine learning: Trends, perspectives, and prospects. Science 2015, 349, 255–260. [Google Scholar] [CrossRef] [PubMed]
- Yang, B.; Lei, Y.; Jia, F.; Xing, S. An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings. Mech. Syst. Signal Process. 2019, 122, 692–706. [Google Scholar] [CrossRef]
- Chen, Z.; Li, C.; Sanchez, R.-V. Gearbox fault identification and classification with convolutional neural networks. Shock. Vib. 2015, 2015, 390134. [Google Scholar] [CrossRef]
- Panda, A.K.; Rapur, J.S.; Tiwari, R. Prediction of flow blockages and impending cavitation in centrifugal pumps using Support Vector Machine (SVM) algorithms based on vibration measurements. Measurement 2018, 130, 44–56. [Google Scholar] [CrossRef]
- Janssens, O.; Slavkovikj, V.; Vervisch, B.; Stockman, K.; Loccufier, M.; Verstockt, S.; Van de Walle, R.; Van Hoecke, S. Convolutional neural network based fault detection for rotating machinery. J. Sound Vib. 2016, 377, 331–345. [Google Scholar]
- Tagawa, Y.; Maskeliūnas, R.; Damaševičius, R. Acoustic Anomaly Detection of Mechanical Failures in Noisy Real-Life Factory Environments. Electronics 2021, 10, 2329. [Google Scholar] [CrossRef]
- Sharma, G.; Umapathy, K.; Krishnan, S. Trends in audio signal feature extraction methods. Appl. Acoust. 2020, 158, 107020. [Google Scholar] [CrossRef]
- Muralidharan, V.; Ravikumar, S.; Kangasabapathy, H. Condition monitoring of Self aligning carrying idler (SAI) in belt-conveyor system using statistical features and decision tree algorithm. Measurement 2014, 58, 274–279. [Google Scholar] [CrossRef]
- Rocha, F.; Garcia, G.; Pereira, R.F.S.; Faria, H.D.; Silva, T.H.; Andrade, R.H.R.; Barbosa, E.S.; Almeida, A.; Cruz, E.; Andrade, W.; et al. ROSI: A Robotic System for Harsh Outdoor Industrial Inspection—System Design and Applications. J. Intell. Robot. Syst. Theory Appl. 2021, 103. [Google Scholar] [CrossRef]
- Wijaya, H.; Rajeev, P.; Gad, E.; Vivekanamtham, R. Distributed optical fibre sensor for condition monitoring of mining conveyor using wavelet transform and artificial neural network. Struct. Control. Health Monit. 2021, 28, e2827. [Google Scholar] [CrossRef]
- Zhang, X.; Wan, S.; He, Y.; Wang, X.; Dou, L. Teager energy spectral kurtosis of wavelet packet transform and its application in locating the sound source of fault bearing of belt conveyor. Meas. J. Int. Meas. Confed. 2021, 173, 108367. [Google Scholar] [CrossRef]
- Junbo, T.; Weining, L.; Juneng, A.; Xueqian, W. Fault diagnosis method study in roller bearing based on wavelet transform and stacked auto-encoder. In Proceedings of the 27th Chinese Control and Decision Conference (2015 CCDC), Qingdao, China, 23–25 May 2015; pp. 4608–4613. [Google Scholar]
- Leukel, J.; González, J.; Riekert, M. Adoption of machine learning technology for failure prediction in industrial maintenance: A systematic review. J. Manuf. Syst. 2021, 61, 87–96. [Google Scholar] [CrossRef]
- Wang, D.; Miao, Q.; Fan, X.; Huang, H. Rolling element bearing fault detection using an improved combination of Hilbert and wavelet transforms. J. Mech. Sci. Technol. 2009, 23, 3292–3301. [Google Scholar]
- Li, C.; Song, Z.-H.; Li, P. Bearing fault detection via wavelet packet transform and rough set theory. In Proceedings of the Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788), Hangzhou, China, 15–19 June 2004; Volume 2, pp. 1663–1666. [Google Scholar]
- Hao, X.-l.; Liang, H. A multi-class support vector machine real-time detection system for surface damage of conveyor belts based on visual saliency. Measurement 2019, 146, 125–132. [Google Scholar] [CrossRef]
- Gong, W.; Chen, H.; Zhang, Z.; Zhang, M.; Wang, R.; Guan, C.; Wang, Q. A Novel Deep Learning Method for Intelligent Fault Diagnosis of Rotating Machinery Based on Improved CNN-SVM and Multichannel Data Fusion. Sensors 2019, 19, 1693. [Google Scholar] [CrossRef]
- Denisko, D.; Hoffman, M.M. Classification and interaction in random forests. Proc. Natl. Acad. Sci. USA 2018, 115, 1690–1692. [Google Scholar]
- Wang, Y.; Miao, C.; Liu, Y.; Meng, D. Research on a sound-based method for belt conveyor longitudinal tear detection. Measurement 2022, 190, 110787. [Google Scholar] [CrossRef]
- Che, J.; Qiao, T.; Yang, Y.; Zhang, H.; Pang, Y. Longitudinal tear detection method of conveyor belt based on audio-visual fusion. Measurement 2021, 176, 109152. [Google Scholar] [CrossRef]
- Fallah, A.; Jamaati, M.; Soleamani, A. A new online signature verification system based on combining Mellin transform, MFCC and neural network. Digit. Signal Process. 2011, 21, 404–416. [Google Scholar] [CrossRef]
- Glowacz, A. Recognition of Acoustic Signals of Commutator Motors. Appl. Sci. 2018, 8, 2630. [Google Scholar] [CrossRef]
- Shaikh, K.B.; Jawarkar, N.P.; Ahmed, V. Machine diagnosis using acoustic analysis: A review. In Proceedings of the 2021 IEEE Conference on Norbert Wiener in the 21st Century (21CW), Chennai, India, 22–25 July 2021; pp. 1–6. [Google Scholar]
- Tran, T.; Pham, N.T.; Lundgren, J. A deep learning approach for detecting drill bit failures from a small sound dataset. Sci. Rep. 2022, 12, 9623. [Google Scholar] [CrossRef]
- Kumar, A.; Gandhi, C.; Zhou, Y.; Kumar, R.; Xiang, J. Latest developments in gear defect diagnosis and prognosis: A review. Measurement 2020, 158, 107735. [Google Scholar]
- Wang, X.; Si, S.; Li, Y. Multiscale diversity entropy: A novel dynamical measure for fault diagnosis of rotating machinery. IEEE Trans. Ind. Inform. 2020, 17, 5419–5429. [Google Scholar] [CrossRef]
- Glowacz, A.; Tadeusiewicz, R.; Legutko, S.; Caesarendra, W.; Irfan, M.; Liu, H.; Brumercik, F.; Gutten, M.; Sulowicz, M.; Daviu, J.A.A. Fault diagnosis of angle grinders and electric impact drills using acoustic signals. Appl. Acoust. 2021, 179, 108070. [Google Scholar]
- Glowacz, A. Fault Detection of Electric Impact Drills and Coffee Grinders Using Acoustic Signals. Sensors 2019, 19, 269. [Google Scholar] [CrossRef] [Green Version]
- Hou, J.; Sun, H.; Xu, A.; Gong, Y.; Ning, D. Fault diagnosis of synchronous hydraulic motor based on acoustic signals. Adv. Mech. Eng. 2020, 12, 1687814020916107. [Google Scholar] [CrossRef]
- Glowacz, A. Acoustic fault analysis of three commutator motors. Mech. Syst. Signal Process. 2019, 133, 106226. [Google Scholar] [CrossRef]
- Glowacz, A. Fault diagnosis of single-phase induction motor based on acoustic signals. Mech. Syst. Signal Process. 2019, 117, 65–80. [Google Scholar] [CrossRef]
- Tandon, N.; Choudhury, A. A review of vibration and acoustic measurement methods for the detection of defects in rolling element bearings. Tribol. Int. 1999, 32, 469–480. [Google Scholar] [CrossRef]
- Baydar, N.; Ball, A. a Comparative Study of Acoustic and Vibration Signals in Detection of Gear Failures Using WIGNER-VILLE Distribution. Mech. Syst. Signal Process. 2001, 15, 1091–1107. [Google Scholar] [CrossRef]
- Devi, S.; Kumar, L.S.; Shanker, N.; Prabakaran, K. A comparative study between vibration and acoustic signals in HTC cooling pump and chilling pump. Int. J. Eng. Technol. 2010, 2, 273. [Google Scholar]
- Russakovsky, O.; Deng, J.; Su, H.; Krause, J.; Satheesh, S.; Ma, S.; Huang, Z.; Karpathy, A.; Khosla, A.; Bernstein, M. Imagenet large scale visual recognition challenge. Int. J. Comput. Vis. 2015, 115, 211–252. [Google Scholar] [CrossRef]
- Hinton, G.; Deng, L.; Yu, D.; Dahl, G.E.; Mohamed, A.r.; Jaitly, N.; Senior, A.; Vanhoucke, V.; Nguyen, P.; Sainath, T.N.; et al. Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups. IEEE Signal Process. Mag. 2012, 29, 82–97. [Google Scholar] [CrossRef]
- Khurana, D.; Koli, A.; Khatter, K.; Singh, S. Natural language processing: State of the art, current trends and challenges. Multimed. Tools Appl. 2022, 82, 3713–3744. [Google Scholar] [CrossRef]
- Wang, X.; Mao, D.; Li, X. Bearing fault diagnosis based on vibro-acoustic data fusion and 1D-CNN network. Measurement 2021, 173, 108518. [Google Scholar] [CrossRef]
- Wang, L.; Cavallaro, A. Acoustic Sensing From a Multi-Rotor Drone. IEEE Sens. J. 2018, 18, 4570–4582. [Google Scholar] [CrossRef]
- Djurek, I.; Petošić, A.; Grubeša, S.; Suhanek, M. Analysis of a Quadcopter’s Acoustic Signature in Different Flight Regimes. IEEE Access 2020, 8, 10662–10670. [Google Scholar]
Method | Early Detection | Detect a Wide Range of Faults | Accuracy | Detect Multiple Idlers Simultaneously | Affected by Environmental Conditions |
---|---|---|---|---|---|
Vibration-based methods | √ | √ | x | √ | √ |
Acoustic-based methods | √ | √ | x | √ | x |
Thermal image-based methods | x | x | x | √ | √ |
Inclusion Criteria |
---|
|
|
|
Exclusion Criteria |
|
|
|
|
|
AE | Autoencoder |
ANN | Artificial neural network |
CNN | Convolutional Neural Network |
DOFS | Distributed optical fiber sensors |
FD | Fault detection |
FFT | Fast Fourier transforms |
GBDT | Gradient boost decision tree |
IForest | Isolation Forest |
KNN | K-nearest neighbors algorithm |
LMD | Local mean decomposition |
MFCC | Mel Frequency Cepstrum Coefficients |
ML | Machine learning |
MLP | Multilayer perceptron |
PCA | Principal component analysis |
RF | Random Forest |
RMS | Root mean square |
STFT | Short-time Fourier transform |
SVM | Support Vector Machine |
WPD | Wavelet packet decomposition |
WT | Wavelet transform |
Models | Strengths | Limitations |
---|---|---|
Random Forest (RF) |
| RF is primarily limited by the fact that the algorithm becomes too slow and inefficient for real-time predictions if there are a large number of trees. |
K-nearest neighbors algorithm (KNN) |
|
|
Support Vector Machine (SVM) |
|
|
Gradient boost decision tree (GBDT) |
|
|
Convolutional Neural Network (CNN) |
|
|
Isolation Forest (IForest) |
|
|
Autoencoder (AE) |
| Rather than capturing as much relevant information as possible, learns to capture as much information as possible. |
Multilayer perceptron (MLP) |
| Model performance depends on the quality of the training data. |
Authors | Dataset | Methods for Data Collection |
---|---|---|
Bortnowski et al. [44] | Not reported. | Wireless measuring device. |
Li et al. [4] | 32 samples under each health condition are obtained, each load case with 8 samples. Hence, there are a total of 128 samples. | Accelerometer sensor. |
Wijaya et al. [12] | The data size can reach up to 60 MB for 1 s signal. | DOFS. |
Muralidharan et al. [58] | Collect 250 samples for each condition of the Self-aligning carrying idler. | Accelerometer sensor. |
Wijaya et al. [60] | 3000 samples were collected. | DOFS. |
Roos and Heyns [23] | Dataset of 3007 training and 3007 test signals. | Accelerometer sensor. |
Ravikumar at al. [45,46,47,48] | Collect 250 samples for each condition of the Self-aligning carrying idler. | Accelerometer sensor. |
Time Domain Feature | Definition | Formula | Remark |
---|---|---|---|
Root mean square (RMS) | It is used to compute the average energy of the signal. | N = sample size. n = single value of N. X = amplitude value of sample size. μ = mean value of sample data. σ = standard deviation. Xpeak = maximum peak value of X. XRMS = root mean square value. | |
Standard deviation | Represents the degree of variation or dispersion from the average. | ||
Kurtosis | It is dimensionless and the fourth-order normalized moment of sample data sensitive to impact signal and represents the steepness of the data distribution density function. | K = | |
Skewness | This is a dimensionless indicator of the degree of asymmetry of the data distribution as represented by the third-order normalized moment of the data distribution. | S = | |
Peak to the average value (PAR) | It is defined as the ratio of the peak to the average value of a sample of data and can be used to indicate significant transient noise. | PAR = |
Authors | Processing Techniques | Feature Extraction |
---|---|---|
Bortnowski et al. [44] | Filtering and normalization using the mean. | Spectrogram, signal autocorrelation (ACF), mean peak frequency. |
Li et al. [4] | WPD. | The energy of each frequency band is extracted as the feature |
Wijaya et al. [12] | Fast Fourier transform. | Envelope analysis. |
Ravikumar et al. [45,46,47,48] | Trimmed off to ensure the uniform length of the signal. | The various parameters are mean, median, mode, standard error, standard deviation, kurtosis, skewness, minimum value, maximum value, sample variance, range. |
Wijaya et al. [60] | Wavelet transform. | Extracted features from WT and statistical time-domain features (e.g., RMS, peak-to-peak, and standard deviation) |
Muralidharan et al. [58] | Trimmed off to ensure the uniform length of the signal. | The various parameters are mean, median, mode, standard error, standard deviation, kurtosis, skewness, minimum value, maximum value, sample variance, range. |
Roos and Heyns [23] | WPD. | A sum of squares of the frequency magnitudes of each wavelet. |
Authors | Processing Methods | Feature Extraction |
---|---|---|
Zhang et al. [61] | Wavelet packet decomposition. | Time domain analysis, Teager energy operator, and cross-correlation. |
Rocha et al. [59] | Fast Fourier Transform (FFT). | Means of the magnitude. |
Ericeira et al. [50] | Normalized Data acquisition in the time domain and Fast Fourier Transform. | Mean, median and standard deviation. |
Liu et al. [8] | Frame the audio using the hamming window, DFT, and take the logarithm of the amplitude spectrum of DFT data. | MFCC. |
Yang et al. [40] | First three seconds and the last three seconds are removed from each 20 s audio signal. | The mean value, the peak value, the root mean square (RMS), the variance, the standard deviation, the skewness and the kurtosis and zero crossing rate, MFCC used PCA and autoencoder to extract features automatically. |
Peng et al. [24] | Wavelet packet transform. | Energy spectrum, standard deviation, mean, etc. |
Xiao-ping Jiang and Guan qiang Cao [41] | Wavelet transform and normalization energy of each layer. | A sum of energy of each frequency band. |
References | Year | Publication Venue | Publication Type | Method | Signal Type |
---|---|---|---|---|---|
Bortnowski et al. [44] | 2022 | Eksploatacja I Niezawodnosc-Maintenance and Reliability. | Journal. | LSTM. | Vibration signal |
Ravikumar et al. [48] | 2021 | Advances in Smart Grid Technology. | Book Chapter. | Random Forest Algorithm. | |
Ravikumar at al. [45] | 2019 | Measurement. | Journal. | k-star algorithm. | |
Ravikumar at al. [47] | 2014 | International Conference on Computational Intelligence and Advanced Manufacturing. | Conference. | SVM. | |
Li et al. [4] | 2013 | Advances in Mechanical Engineering. | Journal. | Wavelet Packet Decomposition and Support Vector Machine. | |
Wijaya et al. [12] | 2022 | Measurement. | Journal. | Iforest. | |
Ravikumar et al. [46] | 2018 | Emerging trends in engineering, science, and technology (ICETEST). | Book section. | Artificial neural network and Naïve Bayes algorithm. | |
Muralidharan et al. [58] | 2014 | Measurement. | Journal. | Decision tree. | |
Wijaya et al. [60] | 2021 | Structural Control and Health Monitoring. | Journal. | Wavelet transform and artificial neural network. | |
Roos and Heyns [23] | 2021 | Mining and Mineral Engineering. | Journal. | Wavelet package decomposition and artificial intelligence, SVM. | |
Ericeira et al. [50] | 2020 | International Joint Conference on Neural Networks (IJCNN). | Conference. | RF and MLP. | Acoustic signal |
Liu et al. [8] | 2020 | Advanced Powder Technology. | Journal. | Decision tree Gradient boosting. | |
Yang et al. [40] | 2020 | Neurocomputing. | Journal. | SVM, KNN, ANN, CNN. | |
Peng et al. [24] | 2020 | Control Engineering Practice. | Journal. | CNN. | |
Xiao-ping Jiang and Guan qiang Cao [41] | 2015 | International Conference on Natural Computation (ICNC). | Journal. | Neural network. | |
Rocha et al. [59] | 2021 | Journal of Intelligent and Robotic Systems. | Journal. | RF. |
Authors | Detection Methods | Accuracy | Main Findings | Advantages | Disadvantages |
---|---|---|---|---|---|
Li et al. [4] | WPD and SVM techniques | 100% | The results of an experiment performed on a belt conveyor in a coal mine demonstrate that the proposed system can find faulty idlers with limited sensors. | An SVM classifier can correctly identify normal conditions and several faulty conditions. | The computation time of the classification results in a delay in the detection of faults. |
Muralidharana et al. [58] | Statistical features and decision tree algorithm | 99.52%. | The results of this study may not be generalizable to all cases. Nevertheless, the methodology employed will serve as a guide for future research in this area. | Simple to understand and interpret for feature selection and classification. | The decision tree provides more information about the classification of faults. It can result in trees that are overly complex and are not able to generalize the data well. |
Ravikumar et al. [46] | Statistical features and Artificial neural network and naïve Bayes (NB) algorithm | ANN: 90% NB: 95% | Results from artificial intelligence and NB demonstrate the accuracy of the NB performs better than the ANN algorithm in predicting self-aligning conveyor roller failures and assessing their lifetime. | NB performs better due to its simplicity and assumption of feature independence. | Since the number of faults collected is limited, the proposed method cannot be generalized. |
Bortnowski et al. [44] | LSTM Autoencoder model | 90% | The use of the autoencoder facilitated the automation of damage detection, which is invaluable when assessing the operation of long-distance conveyor routes. | The proposed method was able to detect the location of potential roller damage based on the change in the average peak frequency over time and spectral autocorrelation. | Low-frequency signals related to the specific operating conditions were regarded as potential sources of damage when they were simply sources of signal interference. |
Roos and Heyns [23] | Wavelet package decomposition and artificial intelligence | 100% | The use of SVMs for vibration monitoring in-belt systems for conveyor idler bearings is strongly recommended, together with WPDs for preprocessing the signals from the bearings. | SVM can identify bearings that are in the early stages of failure, even with added payloads, compared to ANN. |
|
Ravikumar et al. [45] | Statistical features and k-star algorithm | 91.7% | It is found that statistical features and K-star algorithms are effective tools for detecting faults in self-aligning troughing rollers on bulk material handling belt conveyors. | Since k star is an entropy-based algorithm, it can handle a wide range of complex data sets better than ANN. | A new instance of a class is assigned by comparing the closest existing instance with the new one using a distance metric, which is inefficient in terms of memory usage. |
Ravikumar et al. [48] | Statistical features and random forest algorithm | 90.2% | Random forest results summarize the accuracy of the algorithm in terms of predicting self-aligning conveyor roller failures as well as assessing the lifetime of the conveyor rollers. | The accuracy of Random Forest is generally high. | Random forests can be computationally intensive depending on the data collected. |
Ravikumar et al. [47] | Statistical Features and Support Vector Machine | 98.08% | According to SVM results, the algorithm accurately predicted self-aligning conveyor roller failures and assessed conveyor roller life expectancy. | An advantage of the SVM Algorithm is that it can handle multiclassification tasks. | It can be difficult to select the appropriate Kernel functions. |
Wijaya et al. [60] | Wavelet transform and artificial neural network | 99% | By adopting the proposed fault detection scheme, fault identification and classification can be accomplished accurately and unaffected by changes in operating modes, such as conveyor belt speed. | Three idler conditions tested using ANN provided more than 99% classification accuracy even with varying belt speeds. | Due to the limited number of faults and the inability to simulate the effect of loading on the conveyor frequency signatures, the proposed method was untrustworthy. |
Wijaya et al. [12] | A high-frequency energy and envelope spectrum and IForest method are used to determine fault location | 90% | According to the study, faulty idlers significantly increased high-frequency energy with a bearing fault detected through envelope analysis. | Most anomalous data points were detected with a 90% reduction in analysis time. | The disadvantage of this method is that data were directly divided into half rather than randomly determining where to split the data. |
Authors | Detection Methods | Accuracy | Main Findings | Advantages | Disadvantages |
---|---|---|---|---|---|
Ericeira et al. [50] | The ultrasound sensing combined with RF and MLP machine learning techniques and signal pattern recognition. | Four experiments using different numbers of samples. The best result was achieved in the fourth experiment by extracting from the FFT applied in every 5 s of the 20 recordings divided into 40 parts the MLP10, which in one case attained 89.47% of correctly classified instances. | The results show that the detection performance depends on the features they use to input the classifier. | When frequency domain features are used with more data, the proposed methods demonstrate the best accuracy. | To achieve the highest degree of accuracy, it is necessary to tune the number of trees in RF, the number of neuron layers in MLP, etc. |
Liu et al. [8] | MFCCs as features and GBDT algorithm for classification. | Detection accuracy of 94.53%. | The proposed MFCCs and GBDT approach is a viable method for detecting idler roll failures based on sound signals. | A Gradient Boost algorithm with self-learning automatically determines which MFCC feature to apply at which step and what threshold value to determine for this feature. | Window size for extracting MFCC significantly impacts the accuracy performance of GBDT models. |
Rocha et al. [59] | For the detection of roller failures, a fast Fourier transform and means of the magnitude of the sound signal are used along with a random forest algorithm. | The trained model has an accuracy of 95% in identifying damaged bearings noise correctly. | Test results demonstrated that ROSI could stand up to harsh operating conditions while carrying out all necessary inspection tasks in a mining site, establishing it as a disruptive solution for belt conveyor. | The RF is simple to use and shows better results. | An unblanched dataset was used to train the method. |
Yang et al. [40] | DNN, DCNN, SVM and KNN. | The accuracy is 90% KNN. The detection accuracy of SVM is 91.9% DNN: The average accuracy is 94.4% DCNN: The classification accuracy is 98%. | Based on the results, the fault detection system works very well for roller fault detection, with an accuracy rate of more than 90.0%. | Models based on deep learning produce better results than traditional models. | Developing a deep learning model requires a large amount of data to train and build a robust model. |
Peng et al. [24] | Wavelet packet transformation and CNN have been used. | The classification accuracy rate of the mean as a feature is 86%, and the classification accuracy rate of the standard deviation as a feature is 93%. | According to the experiment results, using the standard deviation as the data feature is more effective than the mean in detecting roller faults. | A CNN can handle a large amount of input data and take into account the location information between the data. | After extracting wavelet packet transformation, data from the lowest frequency band can significantly affect CNN performance. |
Xiao-ping Jiang and Guan qiang Cao [41] | Wavelet transform and Neural network | The accuracy rate can reach more than 96%. | In belt conveyors, fault characteristics are contained in fault sounds and can be obtained by adding the energy of each band after the wavelet transform has been applied. | The neural network can easily recognize and classify faults. | The accuracy of the method is affected by environmental noise and the sound of the belt conveyor. |
Methods | Advantages | Disadvantages |
---|---|---|
MSAF | This method can effectively detect faults in electric motors by analyzing acoustic signals. | MSAF methods require the selection of parameters and the number of groups to be determined in advance. |
SMOFS | This method helps diagnose faults accurately by using an iterative process to identify relevant frequency components. | As with the MSAF, SMOFS methods require a prior selection of parameters and groupings. |
MSAF-17-MULTIEXPANDED-FILTER-14 | More accurate results with greater resolution and detail in the signal by using 14 bandwidth and 17 frequency components. | The results of the recognition process depend on the training samples. |
SMOFS-22-MULTIEXPANDED | Useful for early fault diagnosis in rotating machines, both electrical and mechanical. | The acoustic signals in this method may overlap and merge, causing problems in analysis, such as reflections and overlapping waves. |
MSAF-RATIO-24-MULTIEXPANDED-FILTER-8 | High recognition results in diagnosing electrical motors. | Dependence on a lot of training samples and spectral leakage errors in computed frequency bandwidth. |
MSAF-RATIO-27-MULTIEXPANDED-4-GROUPS | Implementation of this method is inexpensive and has the potential to be used for a wider range of purposes than just fault detection. | Signals using this method are affected by background noise and reflected sounds. |
ML Models | Number of Studies | Studies | Type of Faults | Importance of Faults | Environment of the Tested Result | Efficiency of the Method |
---|---|---|---|---|---|---|
Random forests | 3 | [48,50,59] | Machine faults, including vibration, rotation, noise, sealing, oxidation, and elongation. Four types of conditions: no-fault, ball bearing fault, main shaft fault, and combined faults. | Important. | Laboratory and applied in on mining industry. | Level 5 |
Support vector machine | 4 | [4,23,40,47] | Damage to idler bearing and roller, off-center rotation, drum impact. | Important. | Laboratory and applied in on mining industry. | Level 5 |
Decision tree | 1 | [58] | Faulty bearings and shafts. | Less important. | Laboratory. | Level 1 |
Gradient boosting | 1 | [8] | Artificially defected bearings | Less important. | Laboratory. | Level 1 |
KNN | 1 | [40] | Broken roller and off-center rotation causing drum collision. | Important. | Laboratory and applied in on mining industry. | Level 1 |
K star | 1 | [45] | Faulty bearings and shafts. | Less important. | Laboratory. | Level 1 |
Isolation forest | 1 | [12] | Bearing fault, thermo fault, and shell collapse. | Important. | Validated in the real condition in Western Australia for 10 months Laboratory. | Level 3 |
Naïve Baise | 1 | [46] | Damage to bearings and shafts. | Less important. | Laboratory. | Level 1 |
Multilayer perceptron | 1 | [50] | Abnormal movement of a roller, off-center rotation, excessive noise, inadequate seals, damage from oxidation, and elongation of rollers. | Important. | Validated in real condition. | Level 3 |
Artificial neural network | 4 | [23,40,46,60] | Damage to idler bearings, main shaft faults, broken roller, off-center roller rotation, and tire wear. | Important. | Laboratory and validated in real conditions. | Level 5 |
Convolutional Neural network | 2 | [24,59] | Stuck and fracture roller. | Important. | Laboratory and validated in real conditions. | Level 5 |
LSTM autoencoder | 1 | [44] | Surface of roller tubes, roller unbalance, and radial offset. | Important. | Laboratory and validated in real conditions. | Level 3 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Alharbi, F.; Luo, S.; Zhang, H.; Shaukat, K.; Yang, G.; Wheeler, C.A.; Chen, Z. A Brief Review of Acoustic and Vibration Signal-Based Fault Detection for Belt Conveyor Idlers Using Machine Learning Models. Sensors 2023, 23, 1902. https://doi.org/10.3390/s23041902
Alharbi F, Luo S, Zhang H, Shaukat K, Yang G, Wheeler CA, Chen Z. A Brief Review of Acoustic and Vibration Signal-Based Fault Detection for Belt Conveyor Idlers Using Machine Learning Models. Sensors. 2023; 23(4):1902. https://doi.org/10.3390/s23041902
Chicago/Turabian StyleAlharbi, Fahad, Suhuai Luo, Hongyu Zhang, Kamran Shaukat, Guang Yang, Craig A. Wheeler, and Zhiyong Chen. 2023. "A Brief Review of Acoustic and Vibration Signal-Based Fault Detection for Belt Conveyor Idlers Using Machine Learning Models" Sensors 23, no. 4: 1902. https://doi.org/10.3390/s23041902
APA StyleAlharbi, F., Luo, S., Zhang, H., Shaukat, K., Yang, G., Wheeler, C. A., & Chen, Z. (2023). A Brief Review of Acoustic and Vibration Signal-Based Fault Detection for Belt Conveyor Idlers Using Machine Learning Models. Sensors, 23(4), 1902. https://doi.org/10.3390/s23041902