Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Graph‐based Bayesian network conditional normalizing flows for multiple time series anomaly detection

Published: 29 December 2022 Publication History

Abstract

Various devices and sensors of cyber‐physical systems interact with each other in time and space, and the generated multiple time series have implicit correlations and highly nonlinear relationships. Determining how to model the multiple time series and capture dependencies through extracting features is the key to anomaly detection. In this paper, we propose a graph‐based Bayesian network conditional normalizing flows model for multiple time series anomaly detection, Bayesian network conditional normalizing flows (BNCNF). It applies a Bayesian network to model the causal relationships of multiple time series and introduces a spectral temporal dependency encoder to obtain the representations of interdependency between multiple time series. The representations are introduced as conditional information into the normalizing flows for density estimation, and the data corresponding to low density is judged as anomalies. The experiment are conducted on SWaT, WADI, and SMD datasets, the F1 score reaches 0.95, 0.92, and 0.97 on the three datasets, respectively. The results show that BNCNF has better performance in anomaly detection compared with the current mainstream methods.

References

[1]
Chen C, Huang T. Camdar‐adv: generating adversarial patches on 3D object. Int J Intell Syst. 2021;36:1441‐1453.
[2]
Yang F, Liu F, Xie M, Zheng W. Research on new speed sensor test‐bed. J East Chin Jiaotong Univ. 2020;37(4):62‐66.
[3]
Wang Y, Yang G, Li T, Zhang L, Yu X. Optimal mixed block withholding attacks based on reinforcement learning. Int J Intell Syst. 2020;35:2032‐2048.
[4]
Wu C, Li W. Enhancing intrusion detection with feature selection and neural network. Int J Intell Syst. 2021;36:3087‐3105.
[5]
Xie X, Li X, Wang B, Wan T, Xu L. Unsupervised abnormal detection using VAE with memory. Int J Soft Comput. 2022;26:6219‐6231.
[6]
Li C, Tang Y, Tang Z, Cao J, Zhang Y. Motif‐based embedding label propagation algorithm for community detection. Int J Intell Syst. 2022;37:1880‐1902.
[7]
Breunig MM, Kriegel H‐P, Ng RT, Sander J. LOF: identifying density‐based local outliers. Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data; 2000:93‐104.
[8]
Tang J, Chen Z, Fu, A, Cheung, D. Enhancing effectiveness of outlier detections for low density patterns. Proceedings of the 6th Pacific‐Asia Conference on Advances in Knowledge Discovery and Data Mining; 2002:535‐548.
[9]
Zong B, Song Q, Min MR, et al. Deep autoencoding gaussian mixture model for unsupervised anomaly detection. ICLR 2018; 2018.
[10]
Tax DM, Duin RP. Support vector data description. Int J Mach Learn Cybern. 2004;54:45‐66.
[11]
Ruff L, Vandermeulen R, Goernitz N, et al. Deep one‐class classification. Proceedings of the 35th International Conference on Machine Learning. Vol 80. PMLR; 2018:4393‐4402.
[12]
Park D, Hoshi Y, Kemp CC. A multimodal anomaly detector for robot‐assisted feeding using an LSTM‐based variational autoencoder. IEEE Robotics Automat Lett. 2018;3(8):1544‐1551.
[13]
Hochreiter S, Schmidhuber J. Long short‐term memory. Neural Computation. 1997;9(8):1735‐1780.
[14]
Kingma DP, Welling M. Auto‐encoding variational bayes. arXiv preprint arXiv:1312.6114. 2013. doi:10.46550/arXiv.1312.6114
[15]
Su Y, Zhao Y, Niu C, Liu R, Sun W, Pei D. Robust anomaly detection for multivariate time series through stochastic recurrent neural network. KDD 2019; 2019. doi:10.1145/3292500.3330672
[16]
Li Z, Zhao Y, Han J, et al. Multivariate time series anomaly detection and interpretation using hierarchical inter‐metric and temporal embedding. KDD 2021; 2021:3220‐3230.
[17]
Ai S, Hong S, Zheng X, Wang Y, Liu X. CSRT rumor spreading model based on complex network. Int J Intell Syst. 2021;36(5):1903.0‐1913.0.
[18]
Defferrard M, Bresson X, Vandergheynst P. Convolutional neural networks on graphs with fast localized spectral filtering. Advances in Neural Information Processing Systems; 2016:3844‐3852.
[19]
Kipf TN, Welling M. Semi‐supervised classification with graph convolutional networks. ICLR 2017. 2017. doi:10.48550/arXir.1609.02907
[20]
Veličković P, Cucurull G, Casanova A, et al. Graph attention networks. ICLR 2018. 2018. doi:10.48550/arXiv.1710.10903
[21]
Jiang N, Jie W, Li J, et al. GATrust: a multi‐aspect graph attention network model for trust assessment in OSNs. IEEE Transactions on Knowledge and Data Engineering. 2022. doi:10.1109/TKDE.2022.3174044
[22]
Pearl J. Bayesian networks: a model of self‐activated memory for evidential reasoning. Proceedings of the 7th Conference of the Cognitive Science Society; 1985:329‐334.
[23]
Yu Y, Chen J, Gao T, et al. DAG‐GNN: DAG structure learning with graph neural networks. International Conference on Machine Learning; 2019:7154‐7163.
[24]
Dinh L, Sohl‐Dickstein J, Bengio S. Density estimation using real NVP. ICLR 2017. 2017. doi:10.48550/arXiv.1605.08803
[25]
Papamakarios G, Pavlakou T, Murray I. Masked autoregressive flow for density estimation. Advances in Neural Information Processing Systems; 2017. doi:10.48550/arXiv.1705.07057
[26]
Rasul K, Sheikh AS, Schuster I, et al. Multivariate probabilistic time series forecasting via conditioned normalizing flows. ICLR 2021. 2021. doi:10.48550/arXiv.2002.06103
[27]
Chung J, Gulcehre C, Cho KH, et al. Empirical evaluation of gated recurrent neural networks on sequence modeling. NIPS 2014 Workshop on Deep Learning. 2014. doi:10.48550/arXiv.1412.3555
[28]
Mathur AP, Tippenhauer NO. SWaT: a water treatment test bed for research and training on ICS security. 2016 International Workshop on Cyber‐physical Systems for Smart Water Networks (CySWater); 2016:31‐36. doi:10.1109/CySWater.2016.7469060
[29]
Ahmed CM, Palleti VR, Mathur AP. WADI: a water distribution testbed for research in the design of secure cyber physical systems. Proceedings of the 3rd International Workshop on Cyber‐Physical Systems for Smart Water Networks; 2017:25‐28.
[30]
Audibert J, Michiardi P, Guyard F, Marti S, Zuluage M. USAD: unsupervised anomaly detection on multivariate time series. KDD 2020; 2020:3395‐3404. doi:10.1145/3394486.3403392

Cited By

View all
  • (2023)A Network Traffic Anomaly Detection Method Based on Shapelet and KNNArtificial Intelligence Security and Privacy10.1007/978-981-99-9785-5_5(53-64)Online publication date: 3-Dec-2023

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image International Journal of Intelligent Systems
International Journal of Intelligent Systems  Volume 37, Issue 12
December 2022
2488 pages
ISSN:0884-8173
DOI:10.1002/int.v37.12
Issue’s Table of Contents

Publisher

John Wiley and Sons Ltd.

United Kingdom

Publication History

Published: 29 December 2022

Author Tags

  1. anomaly detection
  2. Bayesian network
  3. conditional normalizing flows
  4. density estimation
  5. multiple time series

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 19 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2023)A Network Traffic Anomaly Detection Method Based on Shapelet and KNNArtificial Intelligence Security and Privacy10.1007/978-981-99-9785-5_5(53-64)Online publication date: 3-Dec-2023

View Options

View options

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media