research-article

A demonstration of the exathlon benchmarking platform for explainable anomaly detection

Authors:

Arnaud Stiegler,

Nesime TatbulAuthors Info & Claims

Proceedings of the VLDB Endowment, Volume 14, Issue 12

Pages 2827 - 2830

https://doi.org/10.14778/3476311.3476355

Published: 01 July 2021 Publication History

Abstract

In this demo, we introduce Exathlon - a new benchmarking platform for explainable anomaly detection over high-dimensional time series. We designed Exathlon to support data scientists and researchers in developing and evaluating learned models and algorithms for detecting anomalous patterns as well as discovering their explanations. This demo will showcase Exathlon's curated anomaly dataset, novel benchmarking methodology, and end-to-end data science pipeline in action via example usage scenarios.

References

[1]

Peter Bailis, Edward Gan, Samuel Madden, Deepak Narayanan, Kexin Rong, and Sahaana Suri. 2017. MacroBase: Prioritizing Attention in Fast Data. In ACM SIGMOD Conference. 541--556.

Digital Library

[2]

Loïc Bontemps, Van Loi Cao, James McDermott, and Nhien-An Le-Khac. 2016. Collective Anomaly Detection Based on Long Short-Term Memory Recurrent Neural Networks. In FDSE Conference. 141--152.

[3]

Cody Coleman, Daniel Kang, Deepak Narayanan, Luigi Nardi, Tian Zhao, Jian Zhang, Peter Bailis, Kunle Olukotun, Christopher Ré, and Matei Zaharia. 2019. Analysis of DAWNBench, a Time-to-Accuracy Machine Learning Performance Benchmark. ACM SIGOPS Operating Systems Review 53, 1 (2019), 14--25.

Digital Library

[4]

Fabien Duchateau, Zohra Bellahsene, and Ela Hunt. 2007. XBenchMatch: A Benchmark for XML Schema Matching Tools. In VLDB Conference. 1318--1321.

Digital Library

[5]

Philipp Eichmann, Franco Solleza, Nesime Tatbul, and Stan Zdonik. 2019. Visual Exploration of Time Series Anomalies with Metro-Viz. In ACM SIGMOD Conference. 1901--1904.

Digital Library

[6]

Geoffrey Hinton and Ruslan Salakhutdinov. 2006. Reducing the Dimensionality of Data with Neural Networks. Science 313, 5786 (2006), 504--507.

[7]

Vincent Jacob, Fei Song, Arnaud Stiegler, Bijan Rad, Yanlei Diao, and Nesime Tatbul. 2021. Exathlon: A Benchmark for Explainable Anomaly Detection over Time Series. Proceedings of the VLDB Endowment (PVLDB) 14, 12 (2021).

Digital Library

[8]

Alexander Lavin and Subutai Ahmad. 2015. Evaluating Real-Time Anomaly Detection Algorithms - The Numenta Anomaly Benchmark. In ICMLA. 38--44.

[9]

Rodica Neamtu, Ramoza Ahsan, Charles Lovering, Cuong Nguyen, Elke A. Rundensteiner, and Gábor N. Sárközy. 2017. Interactive Time Series Analytics Powered by ONEX. In ACM SIGMOD Conference. 1595--1598.

Digital Library

[10]

Tilmann Rabl, Christoph Brücke, Philipp Härtling, Stella Stars, Rodrigo Escobar Palacios, Hamesh Patel, Satyam Srivastava, Christoph Boden, Jens Meiners, and Sebastian Schelter. 2019. ADABench - Towards an Industry Standard Benchmark for Advanced Analytics. In TPCTC. 47--63.

[11]

Marco Túlio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. "Why Should I Trust You?": Explaining the Predictions of Any Classifier. In ACM SIGKDD Conference. 1135--1144.

Digital Library

[12]

Thomas Schlegl, Philipp Seeböck, Sebastian M. Waldstein, Ursula Schmidt-Erfurth, and Georg Langs. 2017. Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery. In IPMI Conference. 146--157.

[13]

Nesime Tatbul, Tae Jun Lee, Stan Zdonik, Mejbah Alam, and Justin Gottschlich. 2018. Precision and Recall for Time Series. In NeurIPS Conference. 1924--1934.

Digital Library

[14]

Robert Ulbricht, Claudio Hartmann, Martin Hahmann, Hilko Donker, and Wolfgang Lehner. 2016. Web-based Benchmarks for Forecasting Systems: The ECAST Platform. In ACM SIGMOD Conference. 2169--2172.

Digital Library

[15]

Haopeng Zhang, Yanlei Diao, and Alexandra Meliou. 2017. EXstream: Explaining Anomalies in Event Stream Monitoring. In EDBT Conference. 156--167.

Cited By

Yepmo VSmits GSerra ESpezzano F(2024)myCADI: my Contextual Anomaly Detection using IsolationProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679208(5304-5308)Online publication date: 21-Oct-2024
https://dl.acm.org/doi/10.1145/3627673.3679208
Huang SWang ZZhang XTu YLi ZCui B(2023)DBPA: A Benchmark for Transactional Database Performance AnomaliesProceedings of the ACM on Management of Data10.1145/35889261:1(1-26)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.1145/3588926

Index Terms

A demonstration of the exathlon benchmarking platform for explainable anomaly detection

Index terms have been assigned to the content through auto-classification.

Recommendations

Toward Explainable Deep Anomaly Detection
KDD '21: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining

Anomaly explanation, also known as anomaly localization, is as important as, if not more than, anomaly detection in many real-world applications. However, it is challenging to build explainable detection models due to the lack of anomaly-supervisory ...
A Survey on Explainable Anomaly Detection
In the past two decades, most research on anomaly detection has focused on improving the accuracy of the detection, while largely ignoring the explainability of the corresponding methods and thus leaving the explanation of outcomes to practitioners. As ...
Explainable contextual anomaly detection using quantile regression forests
Abstract
Traditional anomaly detection methods aim to identify objects that deviate from most other objects by treating all features equally. In contrast, contextual anomaly detection methods aim to detect objects that deviate from other objects within a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the VLDB Endowment

Proceedings of the VLDB Endowment Volume 14, Issue 12

July 2021

587 pages

ISSN:2150-8097

Editors:
Xin Luna Dong
Amazon
,
Felix Naumann
HPI, University of Potsdam

Issue’s Table of Contents

Publisher

VLDB Endowment

Publication History

Published: 01 July 2021

Published in PVLDB Volume 14, Issue 12

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
40
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yepmo VSmits GSerra ESpezzano F(2024)myCADI: my Contextual Anomaly Detection using IsolationProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679208(5304-5308)Online publication date: 21-Oct-2024
https://dl.acm.org/doi/10.1145/3627673.3679208
Huang SWang ZZhang XTu YLi ZCui B(2023)DBPA: A Benchmark for Transactional Database Performance AnomaliesProceedings of the ACM on Management of Data10.1145/35889261:1(1-26)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.1145/3588926

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents