Adaptive Team Cooperative Co-Evolution for a Multi-Rover Distribution Problem - Sorbonne Université
Conference Papers Year : 2023

Adaptive Team Cooperative Co-Evolution for a Multi-Rover Distribution Problem

Abstract

This paper deals with policy learning for a team of heterogeneous robotic agents when the whole team shares a single reward. We address the problem of providing an accurate estimation of the contribution of each agent in tasks where coordination between agents requires joint policy updates of two (or more) agents. This is typically the case when two agents must simultaneously modify their behaviors to perform a joint action that leads to a performance gain for the whole team. We propose a cooperative co-evolutionary algorithm extended with a multi-armed bandit algorithm that dynamically adjusts the number of agents that should update their policies simultaneously, aiming both for performance and learning speed. We use a realistic robotic multi-rover task where agents must physically distribute themselves on points of interest of different natures to complete the task. Results show that the algorithm is able to select the best group size for policy updates that reflects the task's coordination requirements. Surprisingly, we also reveal that coupling between agents' actions in a realistic setup can also emerge from interactions at the phenotypical level, hinting at subtle interactions during learning between the control parameter space and the behavioral space. CCS CONCEPTS • Computing methodologies → Evolutionary robotics; • Theory of computation → Multi-agent reinforcement learning.
Fichier principal
Vignette du fichier
rover_gecco__Copy_pour_Hal_2024_02_21_.pdf (2.59 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04470158 , version 1 (21-02-2024)

Identifiers

Cite

Nicolas Fontbonne, Nicolas Maudet, Nicolas Bredeche. Adaptive Team Cooperative Co-Evolution for a Multi-Rover Distribution Problem. GECCO '23: Genetic and Evolutionary Computation Conference, Jul 2023, Lisbon, Portugal. pp.466-475, ⟨10.1145/3583131.3590500⟩. ⟨hal-04470158⟩
66 View
55 Download

Altmetric

Share

More