Sonification of the self vs. sonification of the other: Differences in the sonification of performed vs. observed simple hand movements - Sorbonne Université Accéder directement au contenu
Article Dans Une Revue International Journal of Human-Computer Studies Année : 2020

Sonification of the self vs. sonification of the other: Differences in the sonification of performed vs. observed simple hand movements

Résumé

Existing works on interactive sonification of movements, i.e., the translation of human movement qualities from the physical to the auditory domain, usually adopt a predetermined approach: the way in which movement features modulate the characteristics of sound is fixed. In our work we want to go one step further and demonstrate that the user role can influence the tuning of the mapping between movement cues and sound parameters. Here, we aim to verify if and how the mapping changes when the user is either the performer or the observer of a series of body movements (tracing a square or an infinite shape with the hand in the air). We asked participants to tune movement sonification while they were directly performing the sonified movement vs. while watching another person performing the movement and listening to its sonification. Results show that the tuning of the sonification chosen by participants is influenced by three variables: role of the user (performer vs observer), movement quality (the amount of Smoothness and Directness in the movement), and physical parameters of the movements (velocity and acceleration). Performers focused more on the quality of their movement, while observers focused more on the sonic rendering, making it more expressive and more connected to low-level physical features.
Fichier principal
Vignette du fichier
1-s2.0-S1071581920301026-main.pdf (5.2 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03250918 , version 1 (08-06-2021)

Identifiants

Citer

Roberto Bresin, Maurizio Mancini, Ludvig Elblaus, Emma Frid. Sonification of the self vs. sonification of the other: Differences in the sonification of performed vs. observed simple hand movements. International Journal of Human-Computer Studies, 2020, 144, pp.102500. ⟨10.1016/j.ijhcs.2020.102500⟩. ⟨hal-03250918⟩
63 Consultations
47 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More