Towards Self-Adjusting Weighted Expected Improvement for Bayesian Optimization - Sorbonne Université Access content directly
Conference Poster Year : 2023

Towards Self-Adjusting Weighted Expected Improvement for Bayesian Optimization

Carolin Benjamins
Elena Raponi
Anja Jankovic
Carola Doerr
Marius Lindauer

Abstract

In optimization, we often encounter expensive black-box problems with unknown problem structures. Bayesian Optimization (BO) is a popular, surrogate-assisted and thus sample-efficient approach for this setting. The BO pipeline itself is highly configurable with many different design choices regarding the initial design, surrogate model and acquisition function (AF). Unfortunately, our understanding of how to select suitable components for a problem at hand is very limited. In this work, we focus on the choice of the AF, whose main purpose it is to balance the trade-off between exploring regions with high uncertainty and those with high promise for good solutions. We propose Self-Adjusting Weighted Expected Improvement (SAWEI), where we let the exploration-exploitation trade-off self-adjust in a data-driven manner based on a convergence criterion for BO. On the BBOB functions of the COCO benchmark, our method performs favorably compared to handcrafted baselines and serves as a robust default choice for any problem structure. With SAWEI, we are a step closer to on-the-fly, data-driven and robust BO designs that automatically adjust their sampling behavior to the problem at hand.
Fichier principal
Vignette du fichier
Adaptive_Weighted_EI-GECCO_poster_HAL.pdf (9.95 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-04180598 , version 1 (12-08-2023)

Identifiers

Cite

Carolin Benjamins, Elena Raponi, Anja Jankovic, Carola Doerr, Marius Lindauer. Towards Self-Adjusting Weighted Expected Improvement for Bayesian Optimization. GECCO '23 Companion: Companion Conference on Genetic and Evolutionary Computation, Jul 2023, Lisbon, Portugal. ACM, GECCO '23 Companion: Proceedings of the Companion Conference on Genetic and Evolutionary Computation, pp.483-486, 2023, ⟨10.1145/3583133.3590753⟩. ⟨hal-04180598⟩
35 View
34 Download

Altmetric

Share

Gmail Facebook X LinkedIn More