Action unit intensity estimation using hierarchical partial least squares

Tobias Gehrig, Ziad Al-Halah, Hazim Kemal Ekenel, Rainer Stiefelhagen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Estimation of action unit (AU) intensities is considered a challenging problem. AUs exhibit high variations among the subjects due to the differences in facial plasticity and morphology. In this paper, we propose a novel framework to model the individual AUs using a hierarchical regression model. Our approach can be seen as a combination of locally linear Partial Least Squares (PLS) models where each one of them learns the relation between visual features and the AU intensity labels at different levels of details. It automatically adapts to the non-linearity in the source domain by adjusting the learned hierarchical structure. We evaluate our approach on the benchmark of the Bosphorus dataset and show that the proposed approach outperforms both the 2D state-of-the-art and the plain PLS baseline models. The generalization to other datasets is evaluated on the extended Cohn-Kanade dataset (CK+), where our hierarchical model outperforms linear and Gaussian kernel PLS.

Original languageEnglish (US)
Title of host publication2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781479960262
DOIs
StatePublished - Jul 17 2015
Event11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015 - Ljubljana, Slovenia
Duration: May 4 2015May 8 2015

Publication series

Name2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015

Conference

Conference11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015
Country/TerritorySlovenia
CityLjubljana
Period5/4/155/8/15

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Fingerprint

Dive into the research topics of 'Action unit intensity estimation using hierarchical partial least squares'. Together they form a unique fingerprint.

Cite this