Temporal archetypal analysis for action segmentation

Fotiadou, Eftychia, Panagakis, Yannis and Pantic, Maja (2017) Temporal archetypal analysis for action segmentation. In: 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), 30 May - 03 June 2017, Washington, DC, USA.

[img]
Preview
PDF - Final accepted version (with author's formatting)
Download (625kB) | Preview

Abstract

Unsupervised learning of invariant representations that efficiently describe high-dimensional time series has several applications in dynamic visual data analysis. Clearly, the problem becomes more challenging when dealing with multiple time series arising from different modalities. A prominent example of this multimodal setting is the human motion which can be represented by multimodal time series of pixel intensities, depth maps, and motion capture data. Here, we study, for the first time, the problem of unsupervised learning of temporally and modality invariant informative representations, referred to as archetypes, from multiple time series originating from different modalities. To this end a novel method, coined as temporal archetypal analysis, is proposed. The performance of the proposed method is assessed by conducting experiments in unsupervised action segmentation. Experimental results on three different real world datasets using single modal and multimodal visual representations indicate the robustness and effectiveness of the proposed methods, outperforming compared state-of-the-art methods by a large, in most of the cases, margin.

Item Type: Conference or Workshop Item (Paper)
Research Areas: A. > School of Science and Technology > Computer Science
Item ID: 23781
Notes on copyright: © 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works
Useful Links:
Depositing User: Yannis Panagakis
Date Deposited: 06 Mar 2018 18:24
Last Modified: 04 Apr 2019 06:13
URI: https://eprints.mdx.ac.uk/id/eprint/23781

Actions (login required)

Edit Item Edit Item

Full text downloads (NB count will be zero if no full text documents are attached to the record)

Downloads per month over the past year