Robust statistical frontalization of human and animal faces

Sagonas, Christos, Panagakis, Yannis ORCID logoORCID:, Zafeiriou, Stefanos and Pantic, Maja (2017) Robust statistical frontalization of human and animal faces. International Journal of Computer Vision, 122 (2) . pp. 270-291. ISSN 0920-5691 [Article] (doi:10.1007/s11263-016-0920-7)

PDF - Published version (with publisher's formatting)
Available under License Creative Commons Attribution 4.0.

Download (6MB) | Preview


The unconstrained acquisition of facial data in real-world conditions may result in face images with significant pose variations, illumination changes, and occlusions, affecting the performance of facial landmark localization and recognition methods. In this paper, a novel method, robust to pose, illumination variations, and occlusions is proposed for joint face frontalization and landmark localization. Unlike the state-of-the-art methods for landmark localization and pose correction, where large amount of manually annotated images or 3D facial models are required, the proposed method relies on a small set of frontal images only. By observing that the frontal facial image of both humans and animals, is the one having the minimum rank of all different poses, a model which is able to jointly recover the frontalized version of the face as well as the facial landmarks is devised. To this end, a suitable optimization problem is solved, concerning minimization of the nuclear norm (convex surrogate of the rank function) and the matrix ℓ1 norm accounting for occlusions. The proposed method is assessed in frontal view reconstruction of human and animal faces, landmark localization, pose-invariant face recognition, face verification in unconstrained conditions, and video inpainting by conducting experiment on 9 databases. The experimental results demonstrate the effectiveness of the proposed method in comparison to the state-of-the-art methods for the target problems.

Item Type: Article
Research Areas: A. > School of Science and Technology > Computer Science
Item ID: 23766
Useful Links:
Depositing User: Yannis Panagakis
Date Deposited: 06 Mar 2018 16:49
Last Modified: 29 Nov 2022 21:01

Actions (login required)

View Item View Item


Activity Overview
6 month trend
6 month trend

Additional statistics are available via IRStats2.