Implicit Human-Centered Tagging
Alessandro Vinciarelli,N. Suditu,Maja Pantic +2 more
- 28 Jun 2009
- pp 1428-1431
TL;DR: The Implicit Human-Centered Tagging (IHCT) method as discussed by the authors ) is a technique for automatic extraction of tags from nonverbal behavioral feedback of media users, where nonverbal behaviors displayed when interacting with multimedia data (e.g., facial expressions, head nods, etc.) provide information useful for improving the tag sets associated with the data.
read more
Abstract: This paper provides a general introduction to the concept of Implicit Human-Centered Tagging (IHCT) — the automatic extraction of tags from nonverbal behavioral feedback of media users. The main idea behind IHCT is that nonverbal behaviors displayed when interacting with multimedia data (e.g., facial expressions, head nods, etc.) provide information useful for improving the tag sets associated with the data. As such behaviors are displayed naturally and spontaneously, no effort is required from the users, and this is why the resulting tagging process is said to be “implicit”. Tags obtained through IHCT are expected to be more robust than tags associated with the data explicitly, at least in terms of: generality (they make sense to everybody) and statistical reliability (all tags will be sufficiently represented). The paper discusses these issues in detail and provides an overview of pioneering efforts in the field.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Fusion of facial expressions and EEG for implicit affective tagging
Sander Koelstra,Ioannis Patras +1 more
TL;DR: This work proposes to involve the user and investigate methods for implicit tagging, wherein users' responses to the interaction with the multimedia content are analyzed in order to generate descriptive tags.
242
Video Affective Content Analysis: A Survey of State-of-the-Art Methods
Shangfei Wang,Qiang Ji +1 more
TL;DR: A general framework for video affective content analysis is proposed, which includes video content, emotional descriptors, and users' spontaneous nonverbal responses, as well as the relationships between the three.
210
Hybrid video emotional tagging using users' EEG and video content
TL;DR: The proposed fusion methods outperform the conventional emotional tagging methods that use either video or EEG features alone in both valence and arousal spaces and narrow down the semantic gap between the low-level video features and the users’ high-level emotional tags with the help of EEG features.
Human-centered implicit tagging: Overview and perspectives
Mohammad Soleymani,Maja Pantic +1 more
- 13 Dec 2012
TL;DR: The state of the art in this novel field of research is discussed, an overview of publicly available relevant databases and annotation tools are provided, and challenges and opportunities in the field are discussed.
•Posted Content
PinView: Implicit Feedback in Content-Based Image Retrieval
Zakria Hussain,Arto Klami,Jussi Kujala,Alex Po Leung,Kitsuchart Pasupa,Peter Auer,Samuel Kaski,Jorma Laaksonen,John Shawe-Taylor +8 more
Abstract: This paper describes PinView, a content-based image retrieval system that exploits implicit relevance feedback collected during a search session. PinView contains several novel methods to infer the intent of the user. From relevance feedback, such as eye movements or pointer clicks, and visual features of images, PinView learns a similarity metric between images which depends on the current interests of the user. It then retrieves images with a specialized online learning algorithm that balances the tradeoff between exploring new images and exploiting the already inferred interests of the user. We have integrated PinView to the content-based image retrieval system PicSOM, which enables applying PinView to real-world image databases. With the new algorithms PinView outperforms the original PicSOM, and in online experiments with real users the combination of implicit and explicit feedback gives the best results.
33
References
•Book
The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places
Bryon Reeves,Clifford Nass +1 more
- 01 Jan 1996
TL;DR: This chapter discusses the media equation, which describes the role media and personality play in the development of a person's identity and aims at clarifying these roles.
5.5K
Image retrieval: Ideas, influences, and trends of the new age
TL;DR: Almost 300 key theoretical and empirical contributions in the current decade related to image retrieval and automatic image annotation are surveyed, and the spawning of related subfields are discussed, to discuss the adaptation of existing image retrieval techniques to build systems that can be useful in the real world.
The automatic creation of literature abstracts
TL;DR: In the exploratory research described, the complete text of an article in machine-readable form is scanned by an IBM 704 data-processing machine and analyzed in accordance with a standard program.
3.5K
Emotion recognition in human-computer interaction
Roddy Cowie,Ellen Douglas-Cowie,Nicolas Tsapatsoulis,George N. Votsis,Stefanos Kollias,W. Fellenz,John G. Taylor +6 more
TL;DR: Basic issues in signal processing and analysis techniques for consolidating psychological and linguistic analyses of emotion are examined, motivated by the PKYSTA project, which aims to develop a hybrid system capable of using information from faces and voices to recognize people's emotions.
2.6K
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
TL;DR: In this paper, the authors discuss human emotion perception from a psychological perspective, examine available approaches to solving the problem of machine understanding of human affective behavior, and discuss important issues like the collection and availability of training and test data.
2.5K