CLEESE: An open-source audio-transformation toolbox for data-driven experiments in speech and music cognition - Sorbonne Université
Article Dans Une Revue PLoS ONE Année : 2019

CLEESE: An open-source audio-transformation toolbox for data-driven experiments in speech and music cognition

Résumé

Over the past few years, the field of visual social cognition and face processing has been dramatically impacted by a series of data-driven studies employing computer-graphics tools to synthesize arbitrary meaningful facial expressions. In the auditory modality, reverse correlation is traditionally used to characterize sensory processing at the level of spectral or spectro-temporal stimulus properties, but not higher-level cognitive processing of e.g. words, sentences or music, by lack of tools able to manipulate the stimulus dimensions that are relevant for these processes. Here, we present an open-source audio-transformation toolbox, called CLEESE, able to systematically randomize the prosody/melody of existing speech and music recordings. CLEESE works by cutting recordings in small successive time segments (e.g. every successive 100 milliseconds in a spoken utterance), and applying a random parametric transformation of each segment's pitch, duration or amplitude, using a new Python-language implementation of the phase-vocoder digital audio technique. We present here two applications of the tool to generate stimuli for studying intonation processing of interrogative vs declarative speech, and rhythm processing of sung melodies.
Fichier principal
Vignette du fichier
journal.pone.0205943.pdf (2.26 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-02122143 , version 1 (07-05-2019)

Identifiants

Citer

Juan José Burred, Emmanuel Ponsot, Louise Goupil, Marco Liuni, Jean-Julien Aucouturier. CLEESE: An open-source audio-transformation toolbox for data-driven experiments in speech and music cognition. PLoS ONE, 2019, 14 (4), pp.e0205943. ⟨10.1371/journal.pone.0205943⟩. ⟨hal-02122143⟩
366 Consultations
292 Téléchargements

Altmetric

Partager

More