Confidence-Weighted Local Expression Predictions for Occlusion Handling in Expression Recognition and Action Unit detection - Sorbonne Université Access content directly
Journal Articles International Journal of Computer Vision Year : 2018

Confidence-Weighted Local Expression Predictions for Occlusion Handling in Expression Recognition and Action Unit detection

Abstract

Fully-Automatic Facial Expression Recognition (FER) from still images is a challenging task as it involves handling large interpersonal morphological differences, and as partial occlusions can occasionally happen. Furthermore, labelling expressions is a time-consuming process that is prone to subjectivity, thus the variability may not be fully covered by the training data. In this work, we propose to train Random Forests upon spatially defined local subspaces of the face. The output local predictions form a categorical expression-driven high-level representation that we call Local Expression Predictions (LEPs). LEPs can be combined to describe categorical facial expressions as well as Action Units (AUs). Furthermore, LEPs can be weighted by confidence scores provided by an autoencoder network. Such network is trained to locally capture the manifold of the non-occluded training data in a hierarchical way. Extensive experiments show that the proposed LEP representation yields high descriptive power for categorical expressions and AU occurrence prediction, and leads to interesting perspectives towards the design of occlusion-robust and confidence-aware FER systems.
Fichier principal
Vignette du fichier
1607.06290.pdf (5.18 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01509850 , version 1 (11-10-2023)

Identifiers

Cite

Arnaud Dapogny, Kevin Bailly, Séverine Dubuisson. Confidence-Weighted Local Expression Predictions for Occlusion Handling in Expression Recognition and Action Unit detection. International Journal of Computer Vision, 2018, 126, pp.255-271. ⟨10.1007/s11263-017-1010-1⟩. ⟨hal-01509850⟩
50 View
0 Download

Altmetric

Share

Gmail Facebook X LinkedIn More