Improving the Prediction Cost of Drift Handling Algorithms by Abstaining - Sorbonne Université Access content directly
Conference Papers Year : 2016

Improving the Prediction Cost of Drift Handling Algorithms by Abstaining

Abstract

The problem considered in this paper is regression with a constraint on the precision of each prediction in the framework of data streams subject to concept drifts (when the hidden distribution which generates the observations can change over time). Concept drifts can diminish the reliability of the predictions over time and it might not be possible to output a prediction which satisfies the constraints on the precision. In this case, we claim that if the costs associated with a good and with a bad prediction are known beforehand, the overall prediction cost can be improved by allowing the regressor to abstain. To this end, we propose a generic method, compatible with any regressor, which uses an ensemble of reliability estimators to estimate whether the constraints on the precision of a given prediction can be met or not. In the later case, the regressor is allowed to abstain. Empirical results on 30 datasets including different types of drifts back our claim.
Fichier principal
Vignette du fichier
PID4471505.pdf (9.32 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01429068 , version 1 (06-01-2017)

Identifiers

  • HAL Id : hal-01429068 , version 1

Cite

Pierre-Xavier Loeffel, Vincent Lemaire, Christophe Marsala, Marcin Detyniecki. Improving the Prediction Cost of Drift Handling Algorithms by Abstaining. IEEE International Conference on Data Mining (ICDM 2016), Dec 2016, Barcelone, Spain. ⟨hal-01429068⟩
331 View
339 Download

Share

Gmail Facebook X LinkedIn More