Learning the multilinear structure of visual data

Wang, Mengjiao, Panagakis, Yannis, Snape, Patrick and Zafeiriou, Stefanos (2017) Learning the multilinear structure of visual data. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 21-26 Jul 2017, Honolulu, HI, USA.

[img]
Preview
PDF - Final accepted version (with author's formatting)
Download (1MB) | Preview

Abstract

Statistical decomposition methods are of paramount importance in discovering the modes of variations of visual data. Probably the most prominent linear decomposition method is the Principal Component Analysis (PCA), which discovers a single mode of variation in the data. However, in practice, visual data exhibit several modes of variations. For instance, the appearance of faces varies in identity, expression, pose etc. To extract these modes of variations from visual data, several supervised methods, such as the TensorFaces, that rely on multilinear (tensor) decomposition (e.g., Higher Order SVD) have been developed. The main drawbacks of such methods is that they require both labels regarding the modes of variations and the same number of samples under all modes of variations (e.g., the same face under different expressions, poses etc.). Therefore, their applicability is limited to well-organised data, usually captured in well-controlled conditions. In this paper, we propose the first general multilinear method, to the best of our knowledge, that discovers the multilinear structure of visual data in unsupervised setting. That is, without the presence of labels. We demonstrate the applicability of the proposed method in two applications, namely Shape from Shading (SfS) and expression transfer.

Item Type: Conference or Workshop Item (Paper)
Research Areas: A. > School of Science and Technology > Computer Science
Item ID: 23788
Notes on copyright: © 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works
Useful Links:
Depositing User: Yannis Panagakis
Date Deposited: 07 Mar 2018 16:55
Last Modified: 03 Apr 2019 08:58
URI: https://eprints.mdx.ac.uk/id/eprint/23788

Actions (login required)

Edit Item Edit Item

Full text downloads (NB count will be zero if no full text documents are attached to the record)

Downloads per month over the past year