Audio-assisted movie dialogue detection

Kotti, Margarita and Ververidis, Dimitrios and Panagakis, Yannis and Kotropoulos, Constantine and Maragos, Petros and Pitas, Ioannis (2008) Audio-assisted movie dialogue detection. IEEE Transactions on Circuits and Systems for Video Technology, 18 (11). pp. 1618-1627. ISSN 1051-8215

[img]
Preview
PDF - Final accepted version (with author's formatting)
Download (438kB) | Preview

Abstract

An audio-assisted system is investigated that detects if a movie scene is a dialogue or not. The system is based on actor indicator functions. That is, functions which define if an actor speaks at a certain time instant. In particular, the crosscorrelation and the magnitude of the corresponding the crosspower spectral density of a pair of indicator functions are input to various classifiers, such as voted perceptrons, radial basis function networks, random trees, and support vector machines for dialogue/non-dialogue detection. To boost classifier efficiency AdaBoost is also exploited. The aforementioned classifiers are trained using ground truth indicator functions determined by human annotators for 41 dialogue and another 20 non-dialogue audio instances. For testing, actual indicator functions are derived by applying audio activity detection and actor clustering to audio recordings. 23 instances are randomly chosen among the aforementioned 41 dialogue instances, 17 of which correspond to dialogue scenes and 6 to non-dialogue ones. Accuracy ranging between 0.739 and 0.826 is reported.

Item Type: Article
Research Areas: A. > School of Science and Technology > Computer Science
Item ID: 23758
Notes on copyright: © 2008 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Useful Links:
Depositing User: Yannis Panagakis
Date Deposited: 06 Mar 2018 18:03
Last Modified: 07 Sep 2018 18:25
URI: http://eprints.mdx.ac.uk/id/eprint/23758

Actions (login required)

Edit Item Edit Item

Full text downloads (NB count will be zero if no full text documents are attached to the record)

Downloads per month over the past year