Skip to Main content Skip to Navigation
Journal articles

Real-Time Facial Action Unit Intensity Prediction with Regularized Metric Learning

Abstract : The ability to automatically infer emotional states, engagement, depression or pain from nonverbal behavior has recently become of great interest in many research and industrial works. This will result in the emergence of a wide range of applications in robotics, biometrics, marketing and medicine. The Facial Action Coding System (FACS) proposed by Ekman features objective descriptions of facial movements, characterizing activations of facial muscles. Achieving an accurate intensity prediction of Action Units (AUs) has a significant impact on the prediction quality of more high-level information regarding human behavior (e.g. emotional states). Real-time AU intensity prediction, in many image-related machine learning tasks, is a high-dimensional problem. For solving this task, we propose adapting the Metric Learning for Kernel Regression (MLKR) framework focusing on overfitting issues induced in high-dimensional spaces. MLKR aims at estimating the optimal linear subspace for reducing the squared error of a Gaussian kernel regressor. We introduce Iterative Regularized Kernel Regression (IRKR), an iterative nonlinear feature selection method combined with a Lasso-regularized version of the original MLKR formulation that improves on the state-of-the-art results on several AU databases, ranging from prototypical to natural and wild data.
Document type :
Journal articles
Complete list of metadata

Cited literature [60 references]  Display  Hide  Download
Contributor : Gestionnaire Hal-Upmc <>
Submitted on : Thursday, May 19, 2016 - 12:21:05 PM
Last modification on : Wednesday, May 19, 2021 - 12:12:55 PM


Files produced by the author(s)



Jérémie Nicolle, Kevin Bailly, Mohamed Chetouani. Real-Time Facial Action Unit Intensity Prediction with Regularized Metric Learning. Image and Vision Computing, Elsevier, 2016, 52, pp.1-14. ⟨10.1016/j.imavis.2016.03.004⟩. ⟨hal-01318177⟩



Record views


Files downloads