Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour - Sorbonne Université
Journal Articles European Journal of Neuroscience Year : 2024

Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour

Abstract

In uncertain environments in which resources fluctuate continuously, animals must permanently decide whether to stabilise learning and exploit what they currently believe to be their best option, or instead explore potential alternatives and learn fast from new observations. While such a trade‐off has been extensively studied in pretrained animals facing non‐stationary decision‐making tasks, it is yet unknown how they progressively tune it while learning the task structure during pretraining. Here, we compared the ability of different computational models to account for long‐term changes in the behaviour of 24 rats while they learned to choose a rewarded lever in a three‐armed bandit task across 24 days of pretraining. We found that the day‐by‐day evolution of rat performance and win‐shift tendency revealed a progressive stabilisation of the way they regulated reinforcement learning parameters. We successfully captured these behavioural adaptations using a meta‐learning model in which either the learning rate or the inverse temperature was controlled by the average reward rate.
Fichier principal
Vignette du fichier
Cinotti2024.pdf (4.54 Mo) Télécharger le fichier
Origin Publication funded by an institution
Licence

Dates and versions

hal-04630200 , version 1 (01-07-2024)

Licence

Identifiers

Cite

François Cinotti, Etienne Coutureau, Mehdi Khamassi, Alain R Marchand, Benoît Girard. Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour. European Journal of Neuroscience, 2024, ⟨10.1111/ejn.16449⟩. ⟨hal-04630200⟩
48 View
69 Download

Altmetric

Share

More