A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
2.5K
TL;DR: In this paper, the authors discuss human emotion perception from a psychological perspective, examine available approaches to solving the problem of machine understanding of human affective behavior, and discuss important issues like the collection and availability of training and test data.
read more
Abstract: Automated analysis of human affective behavior has attracted increasing attention from researchers in psychology, computer science, linguistics, neuroscience, and related disciplines. However, the existing methods typically handle only deliberately displayed and exaggerated expressions of prototypical emotions despite the fact that deliberate behaviour differs in visual appearance, audio profile, and timing from spontaneously occurring behaviour. To address this problem, efforts to develop algorithms that can process naturally occurring human affective behaviour have recently emerged. Moreover, an increasing number of efforts are reported toward multimodal fusion for human affect analysis including audiovisual fusion, linguistic and paralinguistic fusion, and multi-cue visual fusion based on facial expressions, head movements, and body gestures. This paper introduces and surveys these recent advances. We first discuss human emotion perception from a psychological perspective. Next we examine available approaches to solving the problem of machine understanding of human affective behavior, and discuss important issues like the collection and availability of training and test data. We finally outline some of the scientific and engineering challenges to advancing human affect sensing technology.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Action unit detection with segment-based SVMs
Tomas Simon,Minh Hoai Nguyen,Fernando De la Torre,Jeffrey F. Cohn +3 more
- 13 Jun 2010
TL;DR: Experimental results suggest that the proposed method outperforms state-of-the-art static methods for AU detection and finds the best k-or-fewer segments that maximize the SVM score.
100
Automatically Recognizing Facial Indicators of Frustration: A Learning-centric Analysis
Joseph F. Grafsgaard,Joseph B. Wiggins,Kristy Elizabeth Boyer,Eric N. Wiebe,James C. Lester +4 more
- 02 Sep 2013
TL;DR: A study to analyze a video corpus of computer-mediated human tutoring using an automated facial expression recognition tool that detects fine-grained facial movements reveals three significant relationships between facial expression, frustration, and learning.
99
From the Lab to the Real World: Affect Recognition Using Multiple Cues and Modalities
Hatice Gunes,Massimo Piccardi,Maja Pantic +2 more
- 01 May 2008
TL;DR: Human affect sensing can be obtained from a broad range of behavioral cues and signals that are available via visual, acoustic, and tactual expressions or presentations of emotions, and the available emotional signals are unified in space and time.
Multi-output Laplacian dynamic ordinal regression for facial expression recognition and intensity estimation
Ognjen Rudovic,Vladimir Pavlovic,Maja Pantic +2 more
- 16 Jun 2012
TL;DR: The intrinsic topology of multidimensional continuous facial affect data is first modeled by an ordinal manifold, then incorporated into the Hidden Conditional Ordinal Random Field (H-CORF) framework for dynamic ordinal regression by constraining H- CORF parameters to lie on the ordinals manifold.
Deep Bimodal Regression of Apparent Personality Traits from Short Video Sequences
TL;DR: This paper proposes a deep learning solution to APA from short video sequences, and presents a solution for the Apparent Personality Analysis competition track in the ChaLearn Looking at People challenge in association with ECCV 2016.
98
References
Development and validation of brief measures of positive and negative affect: The PANAS scales.
TL;DR: Two 10-item mood scales that comprise the Positive and Negative Affect Schedule (PANAS) are developed and are shown to be highly internally consistent, largely uncorrelated, and stable at appropriate levels over a 2-month time period.
•Book
Affective Computing
Rosalind W. Picard
- 01 Jan 1997
TL;DR: Key issues in affective computing, " computing that relates to, arises from, or influences emotions", are presented and new applications are presented for computer-assisted learning, perceptual information retrieval, arts and entertainment, and human health and interaction.
5.7K
Combining Pattern Classifiers
Ludmila I. Kuncheva
- 02 Jul 2004
TL;DR: This combining pattern classifiers methods and algorithms helps people to enjoy a good book with a cup of coffee in the afternoon, instead they cope with some harmful virus inside their computer.
3K
Comprehensive database for facial expression analysis
Takeo Kanade,Jeffrey F. Cohn,Yingli Tian +2 more
- 26 Mar 2000
TL;DR: The problem space for facial expression analysis is described, which includes level of description, transitions among expressions, eliciting conditions, reliability and validity of training and test data, individual differences in subjects, head orientation and scene complexity image characteristics, and relation to non-verbal behavior.