Abstract
Structural health monitoring of long-span bridge has received increasing attention in recent years. In order to achieve accurate monitoring, the integrity of data collection should be guaranteed. Unfortunately, these data inevitably contain a variety of types of anomalies due to sensor faults, harsh environments, and other issues. Identifying anomalies from the data is essential to ensure credible monitoring results. Machine learning methods have the potential to detect data anomaly automatically. However, a well-performed convolutional neural network (CNN) model requires a large number of balanced training samples and frequent tuning. When similar anomalous patterns exist in complex systems, the tuning process might be time-consuming. In this paper, a data anomaly detection method is proposed based on CNN combined with statistic features. Firstly, acceleration data are downsampled, stacked, and input into CNN as the training set. A CNN model is designed and trained. Intermediate results are obtained through the model. Subsequently, the statistic features are applied to analyze and classify the confusable patterns. The novelty of this framework is that it combines the advantages of CNN and statistical features, which can realize data anomaly detection faster and more accurately than using CNN alone. The results of the acceleration data from a bridge demonstrate the effectiveness of the proposed approach to identify the anomalous data.
Similar content being viewed by others
Data Availability
Not applicable.
Code Availability
Not applicable.
References
Pines, D., Aktan, A.E.: Status of structural health monitoring of long-span bridges in the United States. Prog. Struct. Mat. Eng. 4(4), 372–380 (2002)
Rehman, S.K.U., Ibrahim, Z., Memon, S.A., Jameel, M.: Nondestructive test methods for concrete bridges: A review. Constr. Build. Mater. 107, 58–86 (2016)
Cawley, P., Cegla, F., Galvagni, A.: Guided waves for NDT and permanently-installed monitoring. Insight-Non-Destr. Test. Cond. Monit. 54(11), 594–601 (2012)
Sun, L., Shang, Z., Xia, Y., Bhowmick, S., Nagarajaiah, S.: Review of bridge structural health monitoring aided by big data and artificial intelligence: From condition assessment to damage detection. J. Struct. Eng. 146(5), 04020073 (2020)
Brownjohn, J.M., De Stefano, A., Xu, Y.L., Wenzel, H., Aktan, A.E.: Vibration-based monitoring of civil infrastructure: Challenges and successes. J. Civ. Struct. Health 1(3–4), 79–95 (2011)
Ko, J.M., Ni, Y.Q.: Technology developments in structural health monitoring of large-scale bridges. Eng. Struct. 27(12), 1715–1725 (2005)
Yi, T.H., Huang, H.B., Li, H.N.: Development of sensor validation methodologies for structural health monitoring: A comprehensive review. Measurement 109, 200–214 (2017)
Bao, Y., Li, H., Sun, X., Yu, Y., Ou, J.: Compressive sampling—Based data loss recovery for wireless sensor networks used in civil structural health monitoring. Struct. Health Monit. 12(1), 78–95 (2013)
Mo, L., Li, J., Wang, G., Chen, L.: Passive diagnosis for WSNs using time domain features of sensing data. Int. J. Distrib. Sens. Netw. 11(6), 590430 (2015)
Thiyagarajan, K., Kodagoda, S., Van Nguyen, L.: Predictive analytics for detecting sensor failure using autoregressive integrated moving average model. In 2017 12th IEEE conference on industrial electronics and applications (ICIEA) pp. 1926–1931 (2017)
Goebel, K., Yan, W.: Correcting sensor drift and intermittency faults with data fusion and automated learning. IEEE Syst. J. 2(2), 189–197 (2008)
Li, L., Liu, G., Zhang, L., Li, Q.: Sensor fault detection with generalized likelihood ratio and correlation coefficient for bridge SHM. J. Sound Vib. 442, 445–458 (2019)
Abdelghani, M., Friswell, M.I.: Sensor validation for structural systems with additive sensor faults. Struct. Health Monit. 3(3), 265–275 (2004)
Kullaa, J.: Distinguishing between sensor fault, structural damage, and environmental or operational effects in structural health monitoring. Mech. Syst. Signal Process. 25(8), 2976–2989 (2011)
Kullaa, J.: Detection, identification, and quantification of sensor fault in a sensor network. Mech. Syst. Signal Process. 40(1), 208–221 (2013)
Yuen, K.V., Mu, H.Q.: A novel probabilistic method for robust parametric identification and outlier detection. Probab. Eng. Mech. 30, 48–59 (2012)
Dereszynski, E.W., Dietterich, T.G.: Spatiotemporal models for data-anomaly detection in dynamic environmental monitoring campaigns. ACM Trans. Sensor Netw. (TOSN) 8(1), 1–36 (2011)
Wan, H.P., Ni, Y.Q.: Bayesian modeling approach for forecast of structural stress response using structural health monitoring data. J. Struct. Eng. 144(9), 04018130 (2018)
Estevez-Tapiador, J.M., Garcia-Teodoro, P., Diaz-Verdejo, J.E.: Anomaly detection methods in wired networks: A survey and taxonomy. Comput. Commun. 27(16), 1569–1584 (2004)
Mao, J., Wang, H., Spencer, B.F., Jr.: Toward data anomaly detection for automated structural health monitoring: Exploiting generative adversarial nets and autoencoders. Struct. Health Monit. 20(4), 1609–1626 (2020)
Fu, Y., Peng, C., Gomez, F., Narazaki, Y., Spencer, B.F., Jr.: Sensor fault management techniques for wireless smart sensor networks in structural health monitoring. Struct. Control Health 26(7), e2362 (2019)
Bao, Y., Tang, Z., Li, H., Zhang, Y.: Computer vision and deep learning—Based data anomaly detection method for structural health monitoring. Struct. Health Monit. 18(2), 401–421 (2019)
Tang, Z., Chen, Z., Bao, Y., Li, H.: Convolutional neural network-based data anomaly detection method using multiple information for structural health monitoring. Struct. Control Health 26(1), e2296 (2019)
Zhang, W., Li, C., Peng, G., Chen, Y., Zhang, Z.: A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load. Mech. Syst. Signal Process. 100, 439–453 (2018)
Munir, N., Kim, H.J., Park, J., Song, S.J., Kang, S.S.: Convolutional neural network for ultrasonic weldment flaw classification in noisy conditions. Ultrasonics 94, 74–81 (2019)
Nair, V., Hinton, G. E.: Rectified linear units improve restricted boltzmann machines. ICML (2010).
Tian, J., Morillo, C., Azarian, M.H., Pecht, M.: Motor bearing fault detection using spectral kurtosis-based feature extraction coupled with K-nearest neighbor distance analysis. IEEE Trans. Ind. Electron. 63(3), 1793–1803 (2015)
Jan, S.U., Lee, Y.D., Shin, J., Koo, I.: Sensor fault classification based on support vector machine and statistical time-domain features. IEEE Access 5, 8682–8690 (2017)
Mahajan, K., Vargantwar, M.R., Rajput, S.M.: Classification of EEG using PCA, ICA and neural network. Int. J. Eng. Adv. Technol. 1(1), 80–83 (2011)
Deconinck, E., Sacré, P.Y., Coomans, D., De Beer, J.: Classification trees based on infrared spectroscopic data to discriminate between genuine and counterfeit medicines. J. Pharmaceut. Biomed. 57, 68–75 (2012)
Acknowledgements
The work is supported by the National Natural Science Foundation of China (Grant Nos. 52175073, 51805015, 91860205), the Open Foundation of Henan Key Laboratory of Underwater Intelligent Equipment (Grant No. KL03B2105), and the Open Foundation of State Key Laboratory of Digital Manufacturing Equipment and Technology (Grant No. DMETKF2021006), which are highly appreciated by the authors. The authors would like to thank the organizations of the International Project Competition for SHM (Grant No. IPC-SHM 2020) ANCRiSST, Harbin Institute of Technology (China), and University of Illinois at Urbana-Champaign (USA) for their generously providing the invaluable data from actual structures. The authors also would like to thank the chairs of IPC-SHM 2020 Prof. Hui Li, and Prof. Billie F. Spencer Jr for their leadership on the competition.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhang, H., Lin, J., Hua, J. et al. Data Anomaly Detection for Bridge SHM Based on CNN Combined with Statistic Features. J Nondestruct Eval 41, 28 (2022). https://doi.org/10.1007/s10921-022-00857-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10921-022-00857-2