Transporting Deformations of Face Emotions in the Shape Spaces: A Comparison of Different Approaches - Sorbonne Université
Journal Articles Journal of Mathematical Imaging and Vision Year : 2021

Transporting Deformations of Face Emotions in the Shape Spaces: A Comparison of Different Approaches

Abstract

Studying the changes of shape is a common concern in many scientific fields. We address here two problems: (1) quantifying the deformation between two given shapes and (2) transporting this deformation to morph a third shape. These operations can be done with or without point correspondence, depending on the availability of a surface matching algorithm, and on the type of mathematical procedure adopted. In computer vision, the re-targeting of emotions mapped on faces is a common application. We contrast here four different methods used for transporting the deformation toward a target once it was estimated upon the matching of two shapes. These methods come from very different fields such as computational anatomy, computer vision and biology. We used the large diffeomorphic deformation metric mapping and thin plate spline, in order to estimate deformations in a deformational trajectory of a human face experiencing different emotions. Then we use naive transport (NT), linear shift (LS), direct transport (DT) and fanning scheme (FS) to transport the estimated deformations toward four alien faces constituted by 240 homologous points and identifying a triangulation structure of 416 triangles. We used both local and global criteria for evaluating the performance of the 4 methods, e.g., the maintenance of the original deformation. We found DT, LS and FS very effective in recovering the original deformation while NT fails under several aspects in transporting the shape change. As the best method may differ depending on the application, we recommend carefully testing different methods in order to choose the best one for any specific application.
Fichier principal
Vignette du fichier
Piras2021_Article_TransportingDeformationsOfFace.pdf (3.29 Mo) Télécharger le fichier
Origin Publication funded by an institution

Dates and versions

hal-03249318 , version 1 (04-06-2021)

Identifiers

Cite

Paolo Piras, • Valerio Varano, • Maxime Louis, Antonio Profico, • Stanley Durrleman, et al.. Transporting Deformations of Face Emotions in the Shape Spaces: A Comparison of Different Approaches. Journal of Mathematical Imaging and Vision, 2021, ⟨10.1007/s10851-021-01030-6⟩. ⟨hal-03249318⟩
50 View
74 Download

Altmetric

Share

More