Quantifying Individual and Joint Module Impact in Modular Optimization Frameworks - Sorbonne Université Access content directly
Conference Papers Year : 2024

Quantifying Individual and Joint Module Impact in Modular Optimization Frameworks

Ana Nikolikj
Ana Kostovska
Carola Doerr
Tome Eftimov


This study explores the influence of modules on the performance of modular optimization frameworks for continuous single-objective black-box optimization. There is an extensive variety of modules to choose from when designing algorithm variants, however, there is a rather limited understanding of how each module individually influences the algorithm performance and how the modules interact with each other when combined. We use the functional ANOVA (f-ANOVA) framework to quantify the influence of individual modules and module combinations for two algorithms, the modular Covariance Matrix Adaptation (modCMA) and the modular Differential Evolution (modDE). We analyze the performance data from 324 modCMA and 576 modDE variants on the BBOB benchmark collection, for two problem dimensions, and three computational budgets. Noteworthy findings include the identification of important modules that strongly influence the performance of modCMA, such as the~\textit{weights\ option} and~\textit{mirrored} modules for low dimensional problems, and the~\textit{base\ sampler} for high dimensional problems. The large individual influence of the~\textit{lpsr} module makes it very important for the performance of modDE, regardless of the problem dimensionality and the computational budget. When comparing modCMA and modDE, modDE undergoes a shift from individual modules being more influential, to module combinations being more influential, while modCMA follows the opposite pattern, with an increase in problem dimensionality and computational budget.
Fichier principal
Vignette du fichier
CEC-2024-fANOVA-Modules.pdf (713.93 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04580579 , version 1 (20-05-2024)


  • HAL Id : hal-04580579 , version 1


Ana Nikolikj, Ana Kostovska, Diederick Vermetten, Carola Doerr, Tome Eftimov. Quantifying Individual and Joint Module Impact in Modular Optimization Frameworks. 2024 IEEE Congress on Evolutionary Computation (CEC), IEEE, Jun 2024, Yokohama, Japan. ⟨hal-04580579⟩
0 View
0 Download


Gmail Mastodon Facebook X LinkedIn More