Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour - Sorbonne Université
Article Dans Une Revue European Journal of Neuroscience Année : 2024

Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour

Résumé

In uncertain environments in which resources fluctuate continuously, animals must permanently decide whether to stabilise learning and exploit what they currently believe to be their best option, or instead explore potential alternatives and learn fast from new observations. While such a trade‐off has been extensively studied in pretrained animals facing non‐stationary decision‐making tasks, it is yet unknown how they progressively tune it while learning the task structure during pretraining. Here, we compared the ability of different computational models to account for long‐term changes in the behaviour of 24 rats while they learned to choose a rewarded lever in a three‐armed bandit task across 24 days of pretraining. We found that the day‐by‐day evolution of rat performance and win‐shift tendency revealed a progressive stabilisation of the way they regulated reinforcement learning parameters. We successfully captured these behavioural adaptations using a meta‐learning model in which either the learning rate or the inverse temperature was controlled by the average reward rate.

Domaines

Neurosciences
Fichier principal
Vignette du fichier
Cinotti2024.pdf (4.54 Mo) Télécharger le fichier
Origine Publication financée par une institution
Licence

Dates et versions

hal-04630200 , version 1 (01-07-2024)

Licence

Identifiants

Citer

François Cinotti, Etienne Coutureau, Mehdi Khamassi, Alain R Marchand, Benoît Girard. Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour. European Journal of Neuroscience, 2024, ⟨10.1111/ejn.16449⟩. ⟨hal-04630200⟩
54 Consultations
92 Téléchargements

Altmetric

Partager

More