Skip to Main content Skip to Navigation
Journal articles

Sensori-Motor Learning with Movement Sonification: Perspectives from Recent Interdisciplinary Studies

Abstract : This article reports on an interdisciplinary research project on movement sonification for sensori-motor learning. First, we describe different research fields which have contributed to movement sonification, from music technology including gesture-controlled sound synthesis, sonic interaction design, to research on sensori-motor learning with auditory-feedback. In particular, we propose to distinguish between sound-oriented tasks and movement-oriented tasks in experiments involving interactive sound feedback. We describe several research questions and recently published results on movement control, learning and perception. In particular, we studied the effect of the auditory feedback on movements considering several cases: from experiments on pointing and visuo-motor tracking to more complex tasks where interactive sound feedback can guide movements, or cases of sensory substitution where the auditory feedback can inform on object shapes. We also developed specific methodologies and technologies for designing the sonic feedback and movement sonification. We conclude with a discussion on key future research challenges in sensori-motor learning with movement sonification. We also point out toward promising applications such as rehabilitation, sport training or product design.
Complete list of metadatas

Cited literature [52 references]  Display  Hide  Download

https://hal.sorbonne-universite.fr/hal-01375443
Contributor : Gestionnaire Hal-Upmc <>
Submitted on : Monday, October 3, 2016 - 11:11:52 AM
Last modification on : Friday, October 23, 2020 - 4:44:22 PM

File

fnins-10-00385.pdf
Publication funded by an institution

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Frédéric Bevilacqua, Eric Boyer, Jules Françoise, Olivier Houix, Patrick Susini, et al.. Sensori-Motor Learning with Movement Sonification: Perspectives from Recent Interdisciplinary Studies. Frontiers in Neuroscience, Frontiers, 2016, 10, pp.385. ⟨10.3389/fnins.2016.00385⟩. ⟨hal-01375443⟩

Share

Metrics

Record views

831

Files downloads

909