A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
2.5K
TL;DR: In this paper, the authors discuss human emotion perception from a psychological perspective, examine available approaches to solving the problem of machine understanding of human affective behavior, and discuss important issues like the collection and availability of training and test data.
read more
Abstract: Automated analysis of human affective behavior has attracted increasing attention from researchers in psychology, computer science, linguistics, neuroscience, and related disciplines. However, the existing methods typically handle only deliberately displayed and exaggerated expressions of prototypical emotions despite the fact that deliberate behaviour differs in visual appearance, audio profile, and timing from spontaneously occurring behaviour. To address this problem, efforts to develop algorithms that can process naturally occurring human affective behaviour have recently emerged. Moreover, an increasing number of efforts are reported toward multimodal fusion for human affect analysis including audiovisual fusion, linguistic and paralinguistic fusion, and multi-cue visual fusion based on facial expressions, head movements, and body gestures. This paper introduces and surveys these recent advances. We first discuss human emotion perception from a psychological perspective. Next we examine available approaches to solving the problem of machine understanding of human affective behavior, and discuss important issues like the collection and availability of training and test data. We finally outline some of the scientific and engineering challenges to advancing human affect sensing technology.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Automatic landmark point detection and tracking for human facial expressions
TL;DR: An efficient and robust method for facial landmark detection and tracking from video sequences using a kernel correlation analysis approach to find the detection likelihood by maximizing a similarity criterion between the target points and the candidate points.
•Proceedings Article
Multi-view facial expression recognition using local appearance features
Nikolas Hesse,Tobias Gehrig,Hua Gao,Hazim Kemal Ekenel +3 more
- 01 Nov 2012
TL;DR: This paper presents a multi-view facial expression classification system that utilizes local features extracted around automatically located facial landmarks using pose-dependent active appearance models, and evaluates the influence of AAM fitting errors, F-score feature selection, and expression intensity levels on classification accuracy.
53
Transfer subspace learning for cross-dataset facial expression recognition
TL;DR: To better exploit more complementary information for multiple feature representations of face images, a multi-view transfer subspace learning approach where multiple different yet related subspaces are learned to transfer information from the source domain to the target domain.
52
Finding happiest moments in a social context
Abhinav Dhall,Jyoti Joshi,Ibrahim Radwan,Roland Goecke +3 more
- 05 Nov 2012
TL;DR: This work focuses on formulating a framework for happiness intensity estimation for groups based on social context information, and defines automatic frameworks for group expressions and an automatic face occlusion intensity detection method.
52
Micro-Facial Movements: An Investigation on Spatio-Temporal Descriptors
Adrian K. Davison,Moi Hoon Yap,Nicholas Costen,Kevin Tan,Cliff Lansley,Daniel Leightley +5 more
- 06 Sep 2014
TL;DR: Whether micro-facial movement sequences can be distinguished from neutral face sequences is investigated using the CASME II dataset and the results from the investigation of different descriptors have shown a higher accuracy compared to state-of-the-art methods.
References
Development and validation of brief measures of positive and negative affect: The PANAS scales.
TL;DR: Two 10-item mood scales that comprise the Positive and Negative Affect Schedule (PANAS) are developed and are shown to be highly internally consistent, largely uncorrelated, and stable at appropriate levels over a 2-month time period.
•Book
Affective Computing
Rosalind W. Picard
- 01 Jan 1997
TL;DR: Key issues in affective computing, " computing that relates to, arises from, or influences emotions", are presented and new applications are presented for computer-assisted learning, perceptual information retrieval, arts and entertainment, and human health and interaction.
5.7K
Combining Pattern Classifiers
Ludmila I. Kuncheva
- 02 Jul 2004
TL;DR: This combining pattern classifiers methods and algorithms helps people to enjoy a good book with a cup of coffee in the afternoon, instead they cope with some harmful virus inside their computer.
3K
Comprehensive database for facial expression analysis
Takeo Kanade,Jeffrey F. Cohn,Yingli Tian +2 more
- 26 Mar 2000
TL;DR: The problem space for facial expression analysis is described, which includes level of description, transitions among expressions, eliciting conditions, reliability and validity of training and test data, individual differences in subjects, head orientation and scene complexity image characteristics, and relation to non-verbal behavior.