Behavior prediction in-the-wild

Georgakis, Christos, Panagakis, Yannis ORCID: https://orcid.org/0000-0003-0153-5210 and Pantic, Maja (2017) Behavior prediction in-the-wild. 2017 Seventh International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW). In: 2017 Seventh International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), 23-26 Oct 2017, San Antonio, TX, USA, 2017. ISBN 9781538606803. [Conference or Workshop Item] (doi:10.1109/ACIIW.2017.8272617)

Preview

PDF - Final accepted version (with author's formatting) Download (1MB) | Preview

Abstract

In this paper, the problem of audio-visual behavior prediction in-the-wild is addressed. In this context, both audio-visual descriptors of behavioral cues (features) and continuous-time real-valued characterizations of behavior (annotations) are (possibly) corrupted by non-Gaussian noise of large magnitude. The modeling assumption behind the proposed framework is that naturalistic affect and behavior captured in audio-visual episodes are smoothly-varying dynamic phenomena and thus the hidden temporal dynamics can be modeled as a generative auto-regressive process. Consequently, continuous-time real-valued characterizations of behavior (annotations) are postulated to be outputs of a low-complexity (i.e., low-order) time-invariant Linear Dynamical System (LDS) when descriptors of behavioral cues (features) act as inputs. To learn the parameters of the LDS, a recently proposed spectral method that relies on Hankel-rank minimization is adopted. Experimental evaluation on a challenging database recorded in the wild demonstrate the effectiveness of the proposed approach in behavior prediction.

Actions (login required)

View Item

Statistics

DownloadsShow export options

Export as CSVXMLJSON

Activity Overview

6 month trend

225Downloads

6 month trend

247Hits

Additional statistics are available via IRStats2.