A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
2.5K
TL;DR: In this paper, the authors discuss human emotion perception from a psychological perspective, examine available approaches to solving the problem of machine understanding of human affective behavior, and discuss important issues like the collection and availability of training and test data.
read more
Abstract: Automated analysis of human affective behavior has attracted increasing attention from researchers in psychology, computer science, linguistics, neuroscience, and related disciplines. However, the existing methods typically handle only deliberately displayed and exaggerated expressions of prototypical emotions despite the fact that deliberate behaviour differs in visual appearance, audio profile, and timing from spontaneously occurring behaviour. To address this problem, efforts to develop algorithms that can process naturally occurring human affective behaviour have recently emerged. Moreover, an increasing number of efforts are reported toward multimodal fusion for human affect analysis including audiovisual fusion, linguistic and paralinguistic fusion, and multi-cue visual fusion based on facial expressions, head movements, and body gestures. This paper introduces and surveys these recent advances. We first discuss human emotion perception from a psychological perspective. Next we examine available approaches to solving the problem of machine understanding of human affective behavior, and discuss important issues like the collection and availability of training and test data. We finally outline some of the scientific and engineering challenges to advancing human affect sensing technology.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Facial Expression Recognition in Videos Using Dynamic Kernels
TL;DR: This paper proposes a dynamic kernel-based representation for facial expressions that assimilates facial movements captured using local spatio-temporal representations in a large universal Gaussian mixture model (uGMM).
112
Ethical perspectives on recommending digital technology for patients with mental illness
TL;DR: To maximize the potential of technology to help patients with mental illness, physicians need education about the digital economy, and patients need help understanding the appropriate use and limitations of online websites and smartphone apps.
Recognition of Genuine Smiles
TL;DR: An informative set of features for the analysis of face dynamics, and a completely automatic system to distinguish between genuine and posed enjoyment smiles are proposed, which improves the state of the art in smile classification and provides useful insights in smile psychophysics.
111
Detecting and Addressing Frustration in a Serious Game for Military Training
Jeanine A. DeFalco,Jonathan P. Rowe,Luc Paquette,Vasiliki Georgoulas-Sherry,Keith Brawner,Bradford W. Mott,Ryan S. Baker,James C. Lester +7 more
TL;DR: The results are mixed, finding that self-efficacy enhancing interventions based on interaction-based affect detectors enhance outcomes in one of two experiments investigating affective interventions.
Ubiquitous emotion-aware computing
Egon L. van den Broek
- 01 Jan 2013
TL;DR: This study explores the rare combination of speech, electrocardiogram, and a revised Self-Assessment Mannequin to assess people’s emotions, providing a significant leap toward robust, generic, and ubiquitous emotion-aware computing.
References
Development and validation of brief measures of positive and negative affect: The PANAS scales.
TL;DR: Two 10-item mood scales that comprise the Positive and Negative Affect Schedule (PANAS) are developed and are shown to be highly internally consistent, largely uncorrelated, and stable at appropriate levels over a 2-month time period.
•Book
Affective Computing
Rosalind W. Picard
- 01 Jan 1997
TL;DR: Key issues in affective computing, " computing that relates to, arises from, or influences emotions", are presented and new applications are presented for computer-assisted learning, perceptual information retrieval, arts and entertainment, and human health and interaction.
5.7K
Combining Pattern Classifiers
Ludmila I. Kuncheva
- 02 Jul 2004
TL;DR: This combining pattern classifiers methods and algorithms helps people to enjoy a good book with a cup of coffee in the afternoon, instead they cope with some harmful virus inside their computer.
3K
Comprehensive database for facial expression analysis
Takeo Kanade,Jeffrey F. Cohn,Yingli Tian +2 more
- 26 Mar 2000
TL;DR: The problem space for facial expression analysis is described, which includes level of description, transitions among expressions, eliciting conditions, reliability and validity of training and test data, individual differences in subjects, head orientation and scene complexity image characteristics, and relation to non-verbal behavior.