Temporal archetypal analysis for action segmentation

Fotiadou, Eftychia, Panagakis, Yannis ORCID logoORCID: https://orcid.org/0000-0003-0153-5210 and Pantic, Maja (2017) Temporal archetypal analysis for action segmentation. 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017). In: 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), 30 May - 03 June 2017, Washington, DC, USA. ISBN 9781509040230. [Conference or Workshop Item] (doi:10.1109/FG.2017.66)

PDF - Final accepted version (with author's formatting)
Download (625kB) | Preview


Unsupervised learning of invariant representations that efficiently describe high-dimensional time series has several applications in dynamic visual data analysis. Clearly, the problem becomes more challenging when dealing with multiple time series arising from different modalities. A prominent example of this multimodal setting is the human motion which can be represented by multimodal time series of pixel intensities, depth maps, and motion capture data. Here, we study, for the first time, the problem of unsupervised learning of temporally and modality invariant informative representations, referred to as archetypes, from multiple time series originating from different modalities. To this end a novel method, coined as temporal archetypal analysis, is proposed. The performance of the proposed method is assessed by conducting experiments in unsupervised action segmentation. Experimental results on three different real world datasets using single modal and multimodal visual representations indicate the robustness and effectiveness of the proposed methods, outperforming compared state-of-the-art methods by a large, in most of the cases, margin.

Item Type: Conference or Workshop Item (Paper)
Research Areas: A. > School of Science and Technology > Computer Science
Item ID: 23781
Notes on copyright: © 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works
Useful Links:
Depositing User: Yannis Panagakis
Date Deposited: 06 Mar 2018 18:24
Last Modified: 29 Nov 2022 20:57
URI: https://eprints.mdx.ac.uk/id/eprint/23781

Actions (login required)

View Item View Item


Activity Overview
6 month trend
6 month trend

Additional statistics are available via IRStats2.