Conveying Emotions Through Device-Initiated Touch - Sorbonne Université
Journal Articles IEEE Transactions on Affective Computing Year : 2020

Conveying Emotions Through Device-Initiated Touch

Marc Teyssier
  • Function : Author
  • PersonId : 996809
Catherine I Pelachaud
Eric Lecolinet

Abstract

Humans have the ability to convey an array of emotions through complex and rich touch gestures. However, it is not clear how these touch gestures can be reproduced through interactive systems and devices in a remote mediated communication context. In this paper, we explore the design space of device-initiated touch for conveying emotions with an interactive system reproducing a collection of human touch characteristics. For this purpose, we control a robotic arm to touch the forearm of participants with different force, velocity and amplitude characteristics to simulate human touch. In view of adding touch as an emotional modality in human-machine interaction, we have conducted two studies. After designing the touch device, we explore touch in a context-free setup and then in a controlled context defined by textual scenarios and emotional facial expressions of a virtual agent. Our results suggest that certain combinations of touch characteristics are associated with the perception of different degrees of valence and of arousal. Moreover, in the case of non-congruent mixed signals (touch, facial expression, textual scenario) not conveying a priori the same emotion, the message conveyed by touch seems to prevail over the ones displayed by the visual and textual signals.
Fichier principal
Vignette du fichier
convey_emotions.pdf (1.76 Mo) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-02949047 , version 1 (25-09-2020)

Identifiers

Cite

Marc Teyssier, Gilles Bailly, Catherine I Pelachaud, Eric Lecolinet. Conveying Emotions Through Device-Initiated Touch. IEEE Transactions on Affective Computing, In press, pp.1-1. ⟨10.1109/TAFFC.2020.3008693⟩. ⟨hal-02949047⟩
254 View
662 Download

Altmetric

Share

More