Recovering joint and individual components in facial data

Sagonas, Christos, Ververas, Evangelos, Panagakis, Yannis ORCID logoORCID: and Zafeiriou, Stefanos P. (2018) Recovering joint and individual components in facial data. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40 (11) . pp. 2668-2681. ISSN 0162-8828 [Article] (doi:10.1109/TPAMI.2017.2784421)

PDF - Final accepted version (with author's formatting)
Download (7MB) | Preview


A set of images depicting faces with different expressions or in various ages consists of components that are shared across all images (i.e., joint components) and imparts to the depicted object the properties of human faces and individual components that are related to different expressions or age groups. Discovering the common (joint) and individual components in facial images is crucial for applications such as facial expression transfer. The problem is rather challenging when dealing with images captured in unconstrained conditions and thus are possibly contaminated by sparse non-Gaussian errors of large magnitude (i.e., sparse gross errors) and contain missing data. In this paper, we investigate the use of a method recently introduced in statistics, the so-called Joint and Individual Variance Explained (JIVE) method, for the robust recovery of joint and individual components in visual facial data consisting of an arbitrary number of views. Since, the JIVE is not robust to sparse gross errors, we propose alternatives, which are 1) robust to sparse gross, non-Gaussian noise, 2) able to automatically find the individual components rank, and 3) can handle missing data. We demonstrate the effectiveness of the proposed methods to several computer vision applications, namely facial expression synthesis and 2D and 3D face age progression in-the-wild.

Item Type: Article
Research Areas: A. > School of Science and Technology > Computer Science
Item ID: 23770
Notes on copyright: © 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Useful Links:
Depositing User: Yannis Panagakis
Date Deposited: 06 Mar 2018 15:41
Last Modified: 29 Nov 2022 19:32

Actions (login required)

View Item View Item


Activity Overview
6 month trend
6 month trend

Additional statistics are available via IRStats2.