Robust statistical frontalization of human and animal faces

Sagonas, Christos, Panagakis, Yannis, Zafeiriou, Stefanos and Pantic, Maja (2017) Robust statistical frontalization of human and animal faces. International Journal of Computer Vision, 122 (2). pp. 270-291. ISSN 0920-5691

[img]
Preview
PDF - Published version (with publisher's formatting)
Available under License Creative Commons Attribution.

Download (6MB) | Preview

Abstract

The unconstrained acquisition of facial data in real-world conditions may result in face images with significant pose variations, illumination changes, and occlusions, affecting the performance of facial landmark localization and recognition methods. In this paper, a novel method, robust to pose, illumination variations, and occlusions is proposed for joint face frontalization and landmark localization. Unlike the state-of-the-art methods for landmark localization and pose correction, where large amount of manually annotated images or 3D facial models are required, the proposed method relies on a small set of frontal images only. By observing that the frontal facial image of both humans and animals, is the one having the minimum rank of all different poses, a model which is able to jointly recover the frontalized version of the face as well as the facial landmarks is devised. To this end, a suitable optimization problem is solved, concerning minimization of the nuclear norm (convex surrogate of the rank function) and the matrix ℓ1 norm accounting for occlusions. The proposed method is assessed in frontal view reconstruction of human and animal faces, landmark localization, pose-invariant face recognition, face verification in unconstrained conditions, and video inpainting by conducting experiment on 9 databases. The experimental results demonstrate the effectiveness of the proposed method in comparison to the state-of-the-art methods for the target problems.

Item Type: Article
Research Areas: A. > School of Science and Technology > Computer Science
Item ID: 23766
Useful Links:
Depositing User: Yannis Panagakis
Date Deposited: 06 Mar 2018 16:49
Last Modified: 04 Apr 2019 15:34
URI: https://eprints.mdx.ac.uk/id/eprint/23766

Actions (login required)

Edit Item Edit Item

Full text downloads (NB count will be zero if no full text documents are attached to the record)

Downloads per month over the past year