Skip to main navigation Skip to search Skip to main content

EXAD: A system for explainable anomaly detection on big data traces

  • INRIA Institut National de Recherche en Informatique et en Automatique
  • UMass Amherst
  • CNRS LTCI

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Big Data systems are producing huge amounts of data in real-time. Finding anomalies in these systems is becoming increasingly important, since it can help to reduce the number of failures, and improve the mean time of recovery. In this work, we present EXAD, a new prototype system for explainable anomaly detection, in particular for detecting and explaining anomalies in time-series data obtained from traces of Apache Spark jobs. Apache Spark has become the most popular software tool for processing Big Data. The new system contains the most well-known approaches to anomaly detection, and a novel generator of artificial traces, that can help the user to understand the different performances of the different methodologies. In this demo, we will show how this new framework works, and how users can benefit of detecting anomalies in an efficient and fast way when dealing with traces of jobs of Big Data systems.

Original languageEnglish
Title of host publicationProceedings - 18th IEEE International Conference on Data Mining Workshops, ICDMW 2018
EditorsHanghang Tong, Zhenhui Li, Feida Zhu, Jeffrey Yu
PublisherIEEE Computer Society
Pages1435-1440
Number of pages6
ISBN (Electronic)9781538692882
DOIs
Publication statusPublished - 2 Jul 2018
Event18th IEEE International Conference on Data Mining Workshops, ICDMW 2018 - Singapore, Singapore
Duration: 17 Nov 201820 Nov 2018

Publication series

NameIEEE International Conference on Data Mining Workshops, ICDMW
Volume2018-November
ISSN (Print)2375-9232
ISSN (Electronic)2375-9259

Conference

Conference18th IEEE International Conference on Data Mining Workshops, ICDMW 2018
Country/TerritorySingapore
CitySingapore
Period17/11/1820/11/18

Keywords

  • Spark
  • anomaly detection
  • machine learning

Fingerprint

Dive into the research topics of 'EXAD: A system for explainable anomaly detection on big data traces'. Together they form a unique fingerprint.

Cite this