Dense 3D face decoding over 2500FPS: Joint texture and shape convolutional mesh decoders

Zhou, Yuxiang, Deng, Jiankang, Kotsia, Irene ORCID logoORCID: and Zafeiriou, Stefanos (2019) Dense 3D face decoding over 2500FPS: Joint texture and shape convolutional mesh decoders. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA. In: International Conference on Computer Vision and Pattern Recognition, 16-20 Jun 2019, Long Beach, California, USA. e-ISBN 9781728132938, pbk-ISBN 9781728132945. ISSN 1063-6919 [Conference or Workshop Item] (Published online first) (doi:10.1109/CVPR.2019.00119)

PDF - Final accepted version (with author's formatting)
Download (8MB) | Preview


3D Morphable Models (3DMMs) are statistical models that represent facial texture and shape variations using a set of linear bases and more particular Principal Component Analysis (PCA). 3DMMs were used as statistical priors for reconstructing 3D faces from images by solving non-linear least square optimization problems. Recently, 3DMMs were used as generative models for training non-linear mappings (i.e., regressors) from image to the parameters of the models via Deep Convolutional Neural Networks (DCNNs). Nev- ertheless, all of the above methods use either fully con- nected layers or 2D convolutions on parametric unwrapped UV spaces leading to large networks with many parame- ters. In this paper, we present the first, to the best of our knowledge, non-linear 3DMMs by learning joint texture and shape auto-encoders using direct mesh convolutions. We demonstrate how these auto-encoders can be used to train very light-weight models that perform Coloured Mesh Decoding (CMD) in-the-wild at a speed of over 2500 FPS.

Item Type: Conference or Workshop Item (Paper)
Research Areas: A. > School of Science and Technology > Computer Science
Item ID: 26524
Notes on copyright: © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Useful Links:
Depositing User: Irene Kotsia
Date Deposited: 02 May 2019 08:21
Last Modified: 29 Nov 2022 19:03

Actions (login required)

View Item View Item


Activity Overview
6 month trend
6 month trend

Additional statistics are available via IRStats2.