Recovering joint and individual components in facial data

Sagonas, Christos, Ververas, Evangelos, Panagakis, Yannis and Zafeiriou, Stefanos P. (2018) Recovering joint and individual components in facial data. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40 (11). pp. 2668-2681. ISSN 0162-8828

PDF - Final accepted version (with author's formatting)
Download (7MB) | Preview


A set of images depicting faces with different expressions or in various ages consists of components that are shared across all images (i.e., joint components) and imparts to the depicted object the properties of human faces and individual components that are related to different expressions or age groups. Discovering the common (joint) and individual components in facial images is crucial for applications such as facial expression transfer. The problem is rather challenging when dealing with images captured in unconstrained conditions and thus are possibly contaminated by sparse non-Gaussian errors of large magnitude (i.e., sparse gross errors) and contain missing data. In this paper, we investigate the use of a method recently introduced in statistics, the so-called Joint and Individual Variance Explained (JIVE) method, for the robust recovery of joint and individual components in visual facial data consisting of an arbitrary number of views. Since, the JIVE is not robust to sparse gross errors, we propose alternatives, which are 1) robust to sparse gross, non-Gaussian noise, 2) able to automatically find the individual components rank, and 3) can handle missing data. We demonstrate the effectiveness of the proposed methods to several computer vision applications, namely facial expression synthesis and 2D and 3D face age progression in-the-wild.

Item Type: Article
Research Areas: A. > School of Science and Technology > Computer Science
Item ID: 23770
Notes on copyright: © 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Useful Links:
Depositing User: Yannis Panagakis
Date Deposited: 06 Mar 2018 15:41
Last Modified: 10 Jun 2019 19:32

Actions (login required)

Edit Item Edit Item

Full text downloads (NB count will be zero if no full text documents are attached to the record)

Downloads per month over the past year