Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1609/aaai.v33i01.33011409guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
research-article
Free access

A deep neural network for unsupervised anomaly detection and diagnosis in multivariate time series data

Published: 27 January 2019 Publication History

Abstract

Nowadays, multivariate time series data are increasingly collected in various real world systems, e.g., power plants, wearable devices, etc. Anomaly detection and diagnosis in multi-variate time series refer to identifying abnormal status in certain time steps and pinpointing the root causes. Building such a system, however, is challenging since it not only requires to capture the temporal dependency in each time series, but also need encode the inter-correlations between different pairs of time series. In addition, the system should be robust to noise and provide operators with different levels of anomaly scores based upon the severity of different incidents. Despite the fact that a number of unsupervised anomaly detection algorithms have been developed, few of them can jointly address these challenges. In this paper, we propose a Multi-Scale Convolutional Recurrent Encoder-Decoder (MSCRED), to perform anomaly detection and diagnosis in multivariate time series data. Specifically, MSCRED first constructs multi-scale (resolution) signature matrices to characterize multiple levels of the system statuses in different time steps. Subsequently, given the signature matrices, a convolutional encoder is employed to encode the inter-sensor (time series) correlations and an attention based Convolutional Long-Short Term Memory (ConvLSTM) network is developed to capture the temporal patterns. Finally, based upon the feature maps which encode the inter-sensor correlations and temporal information, a convolutional decoder is used to reconstruct the input signature matrices and the residual signature matrices are further utilized to detect and diagnose anomalies. Extensive empirical studies based on a synthetic dataset and a real power plant dataset demonstrate that MSCRED can outperform state-of-the-art baseline methods.

References

[1]
Bahdanau, D.; Cho, K.; and Bengio, Y. 2014. Neural machine translation by jointly learning to align and translate. In ICLR.
[2]
Brockwell, P. J., and Davis, R. A. 2013. Time series: theory and methods. Springer Science & Business Media.
[3]
Chandola, V.; Banerjee, A.; and Kumar, V. 2009. Anomaly detection: A survey. ACM Comput. Surv. 41(3):15.
[4]
Chen, H.; Cheng, H.; Jiang, G.; and Yoshihira, K. 2008. Exploiting local and global invariants for the management of large scale information systems. In ICDM, 113-122.
[5]
Cheng, W.; Zhang, K.; Chen, H.; Jiang, G.; Chen, Z.; and Wang, W. 2016. Ranking causal anomalies via temporal and dynamical analysis on vanishing correlations. In KDD, 805-814.
[6]
Djurdjanovic, D.; Lee, J.; and Ni, J. 2003. Watchdog agent— an infotronics-based prognostics approach for product performance degradation assessment and prediction. Adv. Eng. Inform. 17(3-4):109-125.
[7]
Görnitz, N.; Kloft, M.; Rieck, K.; and Brefeld, U. 2013. Toward supervised anomaly detection. J. Artif. Intell. Res. 46:235-262.
[8]
Günnemann, N.; Günnemann, S.; and Faloutsos, C. 2014. Robust multivariate autoregression for anomaly detection in dynamic product ratings. In WWW, 361-372.
[9]
Hallac, D.; Vare, S.; Boyd, S.; and Leskovec, J. 2017. Toeplitz inverse covariance-based clustering of multivariate time series data. In KDD, 215-223.
[10]
Hautamäki, V.; Kärkkäinen, I.; and Fräti, P. 2004. Outlier detection using k-nearest neighbour graph. In ICPR, 430-433.
[11]
He, Z.; Xu, X.; and Deng, S. 2003. Discovering cluster-based local outliers. Pattern Recognit. Lett. 24(9-10):1641-1650.
[12]
Karim, F.; Majumdar, S.; Darabi, H.; and Chen, S. 2018. Lstm fully convolutional networks for time series classification. IEEE Access 6:1662-1669.
[13]
Kingma, D. P., and Ba, J. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
[14]
Kriegel, H.-P.; Kroger, P.; Schubert, E.; and Zimek, A. 2012. Outlier detection in arbitrarily oriented subspaces. In ICDM, 379-388.
[15]
Lazarevic, A., and Kumar, V. 2005. Feature bagging for outlier detection. In KDD, 157-166.
[16]
Lemire, D. 2007. A better alternative to piecewise linear time series segmentation. In SDM, 545-550.
[17]
Len, R. A.; Vittal, V.; and Manimaran, G. 2007. Application of sensor network for secure electric energy infrastructure. IEEE Trans. Power Del. 22(2):1021-1028.
[18]
Long, J.; Shelhamer, E.; and Darrell, T. 2015. Fully convolutional networks for semantic segmentation. In CVPR, 3431-3440.
[19]
Manevitz, L. M., and Yousef, M. 2001. One-class svms for document classification. J. Mach. Learn. Res. 2(Dec):139-154.
[20]
Qin, Y.; Song, D.; Chen, H.; Cheng, W.; Jiang, G.; and Cottrell, G. 2017. A dual-stage attention-based recurrent neural network for time series prediction. In IJCAI.
[21]
Shi, X.; Chen, Z.; Wang, H.; Yeung, D.-Y.; Wong, W.-K.; and Woo, W.-c. 2015. Convolutional lstm network: A machine learning approach for precipitation nowcasting. In NIPS, 802-810.
[22]
Song, D.; Xia, N.; Cheng, W.; Chen, H.; and Tao, D. 2018. Deep r-th root of rank supervised joint binary embedding for multivariate time series retrieval. In KDD, 2229-2238.
[23]
Wu, X.; Shi, B.; Dong, Y.; Huang, C.; Faust, L.; and Chawla, N. V. 2018. Restful: Resolution-aware forecasting of behavioral time series data. In CIKM, 1073-1082.
[24]
Zhou, C., and Paffenroth, R. C. 2017. Anomaly detection with robust deep autoencoders. In KDD, 665-674.
[25]
Zong, B.; Song, Q.; Min, M. R.; Cheng, W.; Lumezanu, C.; Cho, D.; and Chen, H. 2018. Deep autoencoding gaussian mixture model for unsupervised anomaly detection. In ICLR.

Cited By

View all
  • (2024)An IIoT Temporal Data Anomaly Detection Method Combining Transformer and Adversarial TrainingInternational Journal of Information Security and Privacy10.4018/IJISP.34330618:1(1-28)Online publication date: 15-May-2024
  • (2024)An Efficient Anomaly Detection Method for Industrial Control SystemsInternational Journal of Intelligent Systems10.1155/2024/54594522024Online publication date: 1-Jan-2024
  • (2024)6G-XSec: Explainable Edge Security for Emerging OpenRAN ArchitecturesProceedings of the 23rd ACM Workshop on Hot Topics in Networks10.1145/3696348.3696881(77-85)Online publication date: 18-Nov-2024
  • Show More Cited By

Index Terms

  1. A deep neural network for unsupervised anomaly detection and diagnosis in multivariate time series data
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image Guide Proceedings
      AAAI'19/IAAI'19/EAAI'19: Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence and Thirty-First Innovative Applications of Artificial Intelligence Conference and Ninth AAAI Symposium on Educational Advances in Artificial Intelligence
      January 2019
      10088 pages
      ISBN:978-1-57735-809-1

      Sponsors

      • Association for the Advancement of Artificial Intelligence

      Publisher

      AAAI Press

      Publication History

      Published: 27 January 2019

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)235
      • Downloads (Last 6 weeks)58
      Reflects downloads up to 19 Nov 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)An IIoT Temporal Data Anomaly Detection Method Combining Transformer and Adversarial TrainingInternational Journal of Information Security and Privacy10.4018/IJISP.34330618:1(1-28)Online publication date: 15-May-2024
      • (2024)An Efficient Anomaly Detection Method for Industrial Control SystemsInternational Journal of Intelligent Systems10.1155/2024/54594522024Online publication date: 1-Jan-2024
      • (2024)6G-XSec: Explainable Edge Security for Emerging OpenRAN ArchitecturesProceedings of the 23rd ACM Workshop on Hot Topics in Networks10.1145/3696348.3696881(77-85)Online publication date: 18-Nov-2024
      • (2024)MRCA: Metric-level Root Cause Analysis for Microservices via Multi-Modal DataProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695485(1057-1068)Online publication date: 27-Oct-2024
      • (2024)Deep Learning for Time Series Anomaly Detection: A SurveyACM Computing Surveys10.1145/369133857:1(1-42)Online publication date: 7-Oct-2024
      • (2024)SA2E-AD: A Stacked Attention Autoencoder for Anomaly Detection in Multivariate Time SeriesACM Transactions on Knowledge Discovery from Data10.1145/365367718:7(1-15)Online publication date: 26-Mar-2024
      • (2024)Cluster-Wide Task Slowdown Detection in Cloud SystemProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671936(266-277)Online publication date: 25-Aug-2024
      • (2024)Paths2Pair: Meta-path Based Link Prediction in Billion-Scale Commercial Heterogeneous GraphsProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671563(5082-5092)Online publication date: 25-Aug-2024
      • (2024)Federated Heterogeneous Graph Neural Network for Privacy-preserving RecommendationProceedings of the ACM Web Conference 202410.1145/3589334.3645693(3919-3929)Online publication date: 13-May-2024
      • (2024)LARA: A Light and Anti-overfitting Retraining Approach for Unsupervised Time Series Anomaly DetectionProceedings of the ACM Web Conference 202410.1145/3589334.3645472(4138-4149)Online publication date: 13-May-2024
      • Show More Cited By

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Login options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media