Dense Projection for Anomaly Detection

Authors

  • Dazhi Fu The Chinese University of Hong Kong, Shenzhen University of Electronic Science and Technology of China
  • Zhao Zhang Hefei University of Technology
  • Jicong Fan The Chinese University of Hong Kong, Shenzhen Shenzhen Research Institute of Big Data

DOI:

https://doi.org/10.1609/aaai.v38i8.28682

Keywords:

DMKM: Anomaly/Outlier Detection, ML: Unsupervised & Self-Supervised Learning

Abstract

This work presents a novel method called dense projection for unsupervised anomaly detection (DPAD). The main idea is maximizing the local density of (normal) training data and then determining whether a test data is anomalous or not by evaluating its density. Specifically, DPAD uses a deep neural network to learn locally dense representations of normal data. Since density estimation is computationally expensive, we minimize the local distances of the representations in an iteratively reweighting manner, where the weights are updated adaptively and the parameters are regularized to avoid model collapse (all representations collapse to a single point). Compared with many state-of-the-art methods of anomaly detection, our DPAD does not rely on any assumption about the distribution or spatial structure of the normal data and representations. Moreover, we provide theoretical guarantees for the effectiveness of DPAD. The experiments show that our method DPAD is effective not only in traditional one-class classification problems but also in scenarios with complex normal data composed of multiple classes.

Published

2024-03-24

How to Cite

Fu, D., Zhang, Z., & Fan, J. (2024). Dense Projection for Anomaly Detection. Proceedings of the AAAI Conference on Artificial Intelligence, 38(8), 8398-8408. https://doi.org/10.1609/aaai.v38i8.28682

Issue

Section

AAAI Technical Track on Data Mining & Knowledge Management