Skip to main navigation Skip to search Skip to main content

Classifier concept drift detection and the illusion of progress

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

When a new concept drift detection method is proposed, a common way to show the benefits of the new method, is to use a classifier to perform an evaluation where each time the new algorithm detects change, the current classifier is replaced by a new one. Accuracy in this setting is considered a good measure of the quality of the change detector. In this paper we claim that this is not a good evaluation methodology and we show how a non-change detector can improve the accuracy of the classifier in this setting. We claim that this is due to the existence of a temporal dependence on the data and we propose not to evaluate concept drift detectors using only classifiers.

Original languageEnglish
Title of host publicationArtificial Intelligence and Soft Computing - 16th International Conference, ICAISC 2017, Proceedings
EditorsJacek M. Zurada, Lotfi A. Zadeh, Ryszard Tadeusiewicz, Leszek Rutkowski, Marcin Korytkowski, Rafal Scherer
PublisherSpringer Verlag
Pages715-725
Number of pages11
ISBN (Print)9783319590592
DOIs
Publication statusPublished - 1 Jan 2017
Externally publishedYes
Event16th International Conference on Artificial Intelligence and Soft Computing, ICAISC 2017 - Zakopane, Poland
Duration: 11 Jun 201715 Jun 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10246 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference16th International Conference on Artificial Intelligence and Soft Computing, ICAISC 2017
Country/TerritoryPoland
CityZakopane
Period11/06/1715/06/17

Keywords

  • Classification
  • Concept drift
  • Data streams
  • Evolving
  • Incremental
  • Online

Fingerprint

Dive into the research topics of 'Classifier concept drift detection and the illusion of progress'. Together they form a unique fingerprint.

Cite this