Touching Sounds: Audio Virtual Surfaces - Sorbonne Université Access content directly
Conference Papers Year : 2015

Touching Sounds: Audio Virtual Surfaces


This prospective study concerning the perception of audio virtual surfaces (AVSs) was inspired by two different research fields: sensory substitution and haptic and touch perception. We define Audio Virtual Surfaces as regions of space that trigger sounds when the user touches it or moves into it. First, we describe an example of interactive setup using an AVS to simulate a sonic interaction with a virtual water tank. Then, we present an experiment designed to investigate the ability of blindfolded adults to discriminate between concave and convex auditory virtual surfaces using only the gesture-sound interaction. Two groups received different sound feedback, a static one indicating presence in the AVS, and a static+dynamic one (related to the component of the hand velocity tangential to the surface). In order to demonstrate that curvature direction was correctly perceived, we estimated their discrimination thresholds with a psychophysical staircase procedure. Results show that most of the participants were able to learn the task. The best results were obtained with the additional dynamic feedback. Gestural patterns emerged from the interaction, suggesting the use of auditory representation of the virtual object. This work proposes a contribution to the introduction in virtual reality of sonic interactions with auditory virtual objects. The setups we present raise new questions, at both experimental (sensory substitution) and application levels (design of gesture-sound interaction for virtual reality).
No file

Dates and versions

hal-01265581 , version 1 (02-02-2016)


  • HAL Id : hal-01265581 , version 1


Eric O Boyer, Lucyle Vandervoorde, Frédéric Bevilacqua, Sylvain Hanneton. Touching Sounds: Audio Virtual Surfaces. SIVE 2015, IEEE 2nd VR Workshop on Sonic Interactions for Virtual Environments, satellite workshop of the IEEE Virtual Reality Conference, Mar 2015, Arles, France. ⟨hal-01265581⟩
209 View
1 Download


Gmail Mastodon Facebook X LinkedIn More