3D face morphable models "In-The-Wild"

Booth, James, Antonakos, Epameinondas, Ploumpis, Stylianos, Trigeorgis, George, Panagakis, Yannis ORCID: https://orcid.org/0000-0003-0153-5210 and Zafeiriou, Stefanos (2017) 3D face morphable models "In-The-Wild". The 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 21-26 Jul 2017, Honolulu, HI, USA. ISBN 9781538604571. ISSN 1063-6919 [Conference or Workshop Item] (doi:10.1109/CVPR.2017.580)

Preview

PDF - Final accepted version (with author's formatting) Download (5MB) | Preview

Abstract

3D Morphable Models (3DMMs) are powerful statistical models of 3D facial shape and texture, and among the state-of-the-art methods for reconstructing facial shape from single images. With the advent of new 3D sensors, many 3D facial datasets have been collected containing both neutral as well as expressive faces. However, all datasets are captured under controlled conditions. Thus, even though powerful 3D facial shape models can be learnt from such data, it is difficult to build statistical texture models that are sufficient to reconstruct faces captured in unconstrained conditions (in-the-wild). In this paper, we propose the first, to the best of our knowledge, in-the-wild 3DMM by combining a powerful statistical model of facial shape, which describes both identity and expression, with an in-the-wild texture model. We show that the employment of such an in-the-wild texture model greatly simplifies the fitting procedure, because there is no need to optimise with regards to the illumination parameters. Furthermore, we propose a new fast algorithm for fitting the 3DMM in arbitrary images. Finally, we have captured the first 3D facial database with relatively unconstrained conditions and report quantitative evaluations with state-of-the-art performance. Complementary qualitative reconstruction results are demonstrated on standard in-the-wild facial databases.

Actions (login required)

View Item

Statistics

DownloadsShow export options

Export as CSVXMLJSON

Activity Overview

6 month trend

0Downloads

6 month trend

0Hits

Additional statistics are available via IRStats2.