Computer simulations of coupled idiosyncrasies in speech perception and speech production with COSMO, a perceptuo-motor Bayesian model of speech communication

Abstract : The existence of a functional relationship between speech perception and production systems is now widely accepted, but the exact nature and role of this relationship remains quite unclear. The existence of idiosyncrasies in production and in perception sheds interesting light on the nature of the link. Indeed, a number of studies explore inter-individual variability in auditory and motor prototypes within a given language, and provide evidence for a link between both sets. In this paper, we attempt to simulate one study on coupled idiosyncrasies in the perception and production of French oral vowels, within COSMO, a Bayesian computational model of speech communication. First, we show that if the learning process in COSMO includes a communicative mechanism between a Learning Agent and a Master Agent, vowel production does display idiosyncrasies. Second, we implement within COSMO three models for speech perception that are, respectively, auditory, motor and per-ceptuo-motor. We show that no idiosyncrasy in perception can be obtained in the auditory model, since it is optimally tuned to the learning environment, which does not include the motor variability of the Learning Agent. On the contrary, motor and perceptuo-motor models provide perception idiosyncrasies correlated with idiosyncrasies in production. We draw conclusions about the role and importance of motor processes in speech perception, and propose a perceptuo-motor model in which auditory processing would enable optimal processing of learned sounds and motor processing would be helpful in unlearned adverse conditions.
Type de document :
Article dans une revue
PLoS ONE, Public Library of Science, 2019, 14 (1), pp.e0210302. 〈10.1371/journal.pone.0210302〉
Liste complète des métadonnées

Littérature citée [20 références]  Voir  Masquer  Télécharger

https://hal.sorbonne-universite.fr/hal-01994708
Contributeur : Gestionnaire Hal-Su <>
Soumis le : vendredi 25 janvier 2019 - 16:15:24
Dernière modification le : jeudi 7 février 2019 - 16:31:12

Fichier

journal.pone.0210302.pdf
Fichiers éditeurs autorisés sur une archive ouverte

Identifiants

Citation

Marie-Lou Barnaud, Jean-Luc Schwartz, Pierre Bessière, Julien Diard. Computer simulations of coupled idiosyncrasies in speech perception and speech production with COSMO, a perceptuo-motor Bayesian model of speech communication. PLoS ONE, Public Library of Science, 2019, 14 (1), pp.e0210302. 〈10.1371/journal.pone.0210302〉. 〈hal-01994708〉

Partager

Métriques

Consultations de la notice

25

Téléchargements de fichiers

11