Texture and shape information fusion for facial action unit recognition

Kotsia, Irene and Zafeiriou, Stefanos and Nikolaidis, Nikolaos and Pitas, Ioannis (2008) Texture and shape information fusion for facial action unit recognition. In: The First International Conference on Advances in Computer-Human Interaction (ACHI 2008), 10 - 15 February 2008, Sainte Luce, Martinique.

Full text is not in this repository.

Official URL: http://www.iaria.org/conferences2008/ACHI08.html


A novel method that fuses texture and shape information to achieve Facial Action Unit (FAU) recognition from video sequences is proposed. In order to extract the texture information, a subspace method based on Discriminant Non- negative Matrix Factorization (DNMF) is applied on the difference images of the video sequence, calculated taking under consideration the neutral and the most expressive frame, to extract the desired classification label. The shape information consists of the deformed Candide facial grid (more specifically the grid node displacements between the neutral and the most expressive facial expression frame) that corresponds to the facial expression depicted in the video sequence. The shape information is afterwards classified using a two-class Support Vector Machine (SVM) system. The fusion of texture and shape information is performed using Median Radial Basis Functions (MRBFs) Neural Networks (NNs) in order to detect the set of present FAUs. The accuracy achieved in the Cohn-Kanade database is equal to 92.1% when recognizing the 17 FAUs that are responsible for facial expression development.

Item Type:Conference or Workshop Item (Paper)
Research Areas:School of Science and Technology > Science & Technology
ID Code:9613
Deposited On:04 Dec 2012 07:16
Last Modified:06 Feb 2013 11:35

Repository staff only: item control page

Full text downloads (NB count will be zero if no full text documents are attached to the record)

Downloads per month over the past year