Towards Explainable Exploratory Landscape Analysis: Extreme Feature Selection for Classifying BBOB Functions - Sorbonne Université Access content directly
Conference Papers Year : 2021

Towards Explainable Exploratory Landscape Analysis: Extreme Feature Selection for Classifying BBOB Functions

Abstract

Facilitated by the recent advances of Machine Learning (ML), the automated design of optimization heuristics is currently shaking up evolutionary computation (EC). Where the design of hand-picked guidelines for choosing a most suitable heuristic has long dominated research activities in the field, automatically trained heuristics are now seen to outperform human-derived choices even for well-researched optimization tasks. ML-based EC is therefore not any more a futuristic vision, but has become an integral part of our community. A key criticism that ML-based heuristics are often faced with is their potential lack of explainability, which may hinder future developments. This applies in particular to supervised learning techniques which extrapolate algorithms' performance based on exploratory landscape analysis (ELA). In such applications, it is not uncommon to use dozens of problem features to build the models underlying the specific algorithm selection or configuration task. Our goal in this work is to analyze whether this many features are indeed needed. Using the classification of the BBOB test functions as testbed, we show that a surprisingly small number of features-often less than four-can suffice to achieve a 98% accuracy. Interestingly, the number of features required to meet this threshold is found to decrease with the problem dimension. We show that the classification accuracy transfers to settings in which several instances are involved in training and testing. In the leave-one-instance-out setting, however, classification accuracy drops significantly, and the transformation-invariance of the features becomes a decisive success factor.
Fichier principal
Vignette du fichier
Renau.Dreo.Doerr.Doerr EvoApp arXiv version 2102.00736.pdf (632.22 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03233676 , version 1 (25-05-2021)

Identifiers

Cite

Quentin Renau, Johann Dréo, Carola Doerr, Benjamin Doerr. Towards Explainable Exploratory Landscape Analysis: Extreme Feature Selection for Classifying BBOB Functions. Applications of Evolutionary Computation (EvoApplications 2021), Apr 2021, Sevilla (Virtual), Spain. pp.17-33, ⟨10.1007/978-3-030-72699-7_2⟩. ⟨hal-03233676⟩
56 View
104 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More