Recognition of affect in the wild using deep neural networks

Kollias, Dimitrios, Nicolaou, Mihalis A., Kotsia, Irene ORCID: https://orcid.org/0000-0002-3716-010X, Zhao, Guoying and Zafeiriou, Stefanos (2017) Recognition of affect in the wild using deep neural networks. 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). In: CVPRW 2017: 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA. e-ISBN 9781538607336, pbk-ISBN 9781538607343. ISSN 2160-7516 [Conference or Workshop Item] (doi:10.1109/CVPRW.2017.247)

Preview

PDF - Final accepted version (with author's formatting) Download (1MB) | Preview

Abstract

In this paper we utilize the first large-scale "in-the-wild" (Aff-Wild) database, which is annotated in terms of the valence-arousal dimensions, to train and test an end-to-end deep neural architecture for the estimation of continuous emotion dimensions based on visual cues. The proposed architecture is based on jointly training convolutional (CNN) and recurrent neural network (RNN) layers, thus exploiting both the invariant properties of convolutional features, while also modelling temporal dynamics that arise in human behaviour via the recurrent layers. Various pre-trained networks are used as starting structures which are subsequently appropriately fine-tuned to the Aff-Wild database. Obtained results show premise for the utilization of deep architectures for the visual analysis of human behaviour in terms of continuous emotion dimensions and analysis of different types of affect.

Actions (login required)

View Item

Statistics

DownloadsShow export options

Export as CSVXMLJSON

Activity Overview

6 month trend

245Downloads

6 month trend

442Hits

Additional statistics are available via IRStats2.