CERN Accelerating science

Internal Note
Report number	CERN-CMS-DN-2023-030 ; arXiv:2412.11800 ; CERN-CMS-DN-2023-030
Title	Scalable Temporal Anomaly Causality Discovery in Large Systems: Achieving Computational Efficiency with Binary Anomaly Flag Data
Author(s)	Asres, Mulugeta Weldezgina (U. Agder, Kristiansand) ; Omlin, Christian Walter (U. Agder, Kristiansand)
Publication	2023
Imprint	01 Dec 2023
Number of pages	30
Note	30 pages, 17 figures, 9 tables
Subject category	Detectors and Experimental Techniques
Accelerator/Facility, Experiment	CERN LHC ; CMS
Abstract	Extracting anomaly causality facilitates diagnostics once system faults are detected by monitoring systems. Identifying anomaly causes in large systems involves investigating a more extensive set of monitoring variables across multiple subsystems. However, learning causal graphs comes with a significant computational burden that restrains the applicability of most existing methods in real-time and large-scale deployments. In addition, modern monitoring applications for large systems often generate large amounts of binary alarm flags, and the distinct characteristics of binary anomaly data---the meaning of state transition and data sparsity---challenge existing causality learning mechanisms. This study proposes an anomaly causal discovery approach (AnomalyCD), addressing the accuracy and computational challenges of generating causal graphs from binary flag data sets. The AnomalyCD framework presents several strategies, such as anomaly flag characteristics incorporating causality testing, sparse data and link compression, and edge pruning adjustment approaches. We validate the performance of this framework on two datasets: monitoring sensor data of the readout-box system of the Compact Muon Solenoid experiment at CERN, and a public data set for information technology monitoring. The result demonstrates the significant reduction of the computation overhead and moderate enhancement of the accuracy of causal discovery on temporal binary anomaly data sets.
Other source	Inspire
Copyright/License	preprint: (License: CC BY 4.0)