Pupil diameter was monitored during picture viewing to assess effects of hedonic valence and emotional arousal on pupillary responses. Autonomic activity (heart rate and skin conductance) was concurrently measured to determine whether pupillary changes are mediated by parasympathetic or sympathetic activation. Following an initial light reflex, pupillary changes were larger when viewing emotionally arousing pictures, regardless of whether these were pleasant or unpleasant. Pupillary changes during picture viewing covaried with skin conductance change, supporting the interpretation that sympathetic nervous system activity modulates these changes in the context of affective picture viewing. Taken together, the data provide strong support for the hypothesis that the pupil's response during affective picture viewing reflects emotional arousal associated with increased sympathetic activity.

The pupil as a measure of emotional arousal and autonomic activation

MAHNOB-HCI is a multimodal database recorded in response to affective stimuli with the goal of emotion recognition and implicit tagging research. A multimodal setup was arranged for synchronized recording of face videos, audio signals, eye gaze data, and peripheral/central nervous system physiological signals. Twenty-seven participants from both genders and different cultural backgrounds participated in two experiments. In the first experiment, they watched 20 emotional videos and self-reported their felt emotions using arousal, valence, dominance, and predictability as well as emotional keywords. In the second experiment, short videos and images were shown once without any tag and then with correct or incorrect tags. Agreement or disagreement with the displayed tags was assessed by the participants. The recorded videos and bodily responses were segmented and stored in a database. The database is made available to the academic community via a web-based system. The collected data were analyzed and single modality and modality fusion results for both emotion recognition and implicit tagging experiments are reported. These results show the potential uses of the recorded modalities and the significance of the emotion elicitation protocol.

/pdf/a-multimodal-database-for-affect-recognition-and-implicit-3qjauh3322.pdf

A Multimodal Database for Affect Recognition and Implicit Tagging

How to measure usability is an important question in HCI research and user interface evaluation. We review current practice in measuring usability by categorizing and discussing usability measures from 180 studies published in core HCI journals and proceedings. The discussion distinguish several problems with the measures, including whether they actually measure usability, if they cover usability broadly, how they are reasoned about, and if they meet recommendations on how to measure usability. In many studies, the choice of and reasoning about usability measures fall short of a valid and reliable account of usability as quality-in-use of the user interface being studied. Based on the review, we discuss challenges for studies of usability and for research into how to measure usability. The challenges are to distinguish and empirically compare subjective and objective measures of usability; to focus on developing and employing measures of learning and retention; to study long-term use and usability; to extend measures of satisfaction beyond post-use questionnaires; to validate and standardize the host of subjective satisfaction questionnaires used; to study correlations between usability measures as a means for validation; and to use both micro and macro tasks and corresponding measures of usability. In conclusion, we argue that increased attention to the problems identified and challenges discussed may strengthen studies of usability and usability research.

/pdf/current-practice-in-measuring-usability-challenges-to-2gr7rskqvi.pdf

Current practice in measuring usability: Challenges to usability studies and research

The measurement of pupil diameter in psychology (in short, "pupillometry") has just celebrated 50 years. The method established itself after the appearance of three seminal studies (Hess & Polt, 1960, 1964; Kahneman & Beatty, 1966). Since then, the method has continued to play a significant role within the field, and pupillary responses have been successfully used to provide an estimate of the "intensity" of mental activity and of changes in mental states, particularly changes in the allocation of attention and the consolidation of perception. Remarkably, pupillary responses provide a continuous measure regardless of whether the participant is aware of such changes. More recently, research in neuroscience has revealed a tight correlation between the activity of the locus coeruleus (i.e., the "hub" of the noradrenergic system) and pupillary dilation. As we discuss in this short review, these neurophysiological findings provide new important insights to the meaning of pupillary responses for mental activity. Finally, given that pupillary responses can be easily measured in a noninvasive manner, occur from birth, and can occur in the absence of voluntary, conscious processes, they constitute a very promising tool for the study of preverbal (e.g., infants) or nonverbal participants (e.g., animals, neurological patients).

Pupillometry: A Window to the Preconscious?

Perception and expression of emotion are key factors to the success of dialogue systems or conversational agents. However, this problem has not been studied in large-scale conversation generation so far. In this paper, we propose Emotional Chatting Machine (ECM) that can generate appropriate responses not only in content (relevant and grammatical) but also in emotion (emotionally consistent). To the best of our knowledge, this is the first work that addresses the emotion factor in large-scale conversation generation. ECM addresses the factor using three new mechanisms that respectively (1) models the high-level abstraction of emotion expressions by embedding emotion categories, (2) captures the change of implicit internal emotion states, and (3) uses explicit emotion expressions with an external emotion vocabulary. Experiments show that the proposed model can generate responses appropriate not only in content but also in emotion.

pdf/emotional-chatting-machine-emotional-conversation-generation-2601ayiupn.pdf

Emotional Chatting Machine: Emotional Conversation Generation with Internal and External Memory

The present objective was to investigate pupil size variation during and after auditory emotional stimulation. Thirty subjects' (15 females and 15 males) pupil responses were measured while listening to 10 negative and 10 positive highly arousing sounds (e.g. a baby crying and laughing), and 10 emotionally neutral sounds (e.g. regular office noise). The subjects also rated their subjective experiences related to the stimuli. The results showed that the pupil size was significantly larger during both emotionally negative and positive stimuli than during neutral stimuli. The results for the time period of 2s following the stimulus offset showed that pupil size was significantly larger after both negative and positive than neutral stimulation. These results suggest that the autonomic nervous system is sensitive to highly arousing emotional stimulation. The subjective ratings confirmed that the stimuli influenced the subjects' emotional experiences as expected. Further analyses showed that female subjects had significantly larger pupil responses than males only to neutral stimuli and only during the auditory stimulation. In sum, our results showed that systematically chosen stimuli significantly affected the subjects' physiological reactions and subjective experiences. It could be possible to use pupil size variation as a computer input signal, for example, in affective computing. Auditory emotion-related cues could also be utilized to modulate the user's emotional reactions.

Pupil size variation as an indication of affective processing

Understanding the most influential user experiences in successful and unsuccessful technology adoptions

Real-time estimation of emotional experiences from facial expressions

In the current article, we address the problem of constructing radiofrequency identification (RFID)-augmented environments for mobile robots and the issues related to creating user interfaces for efficient remote navigation with a mobile robot in such environments. First, we describe an RFID-based positioning and obstacle identification solution for remotely controlled mobile robots in indoor environments. In the robot system, an architecture specifically developed by the authors for remotely controlled robotic systems was tested in practice. Second, using the developed system, three techniques for displaying information about the position and movements of a remote robot to the user were compared. The experimental visualization techniques displayed the position of the robot on an indoor floor plan augmented with (1) a video view from a camera attached to the robot, (2) display of nearby obstacles (identified using RFID technology) on the floor plan, and (3) both features. In the experiment, test subjects controlled the mobile robot through predetermined routes as quickly as possible avoiding collisions. The results suggest that the developed RFID-based environment and the remote control system can be used for efficient control of mobile robots. The results from the comparison of the visualization techniques showed that the technique without a camera view (2) was the fastest, and the number of steering motions made was smallest using this technique, but it also had the highest need for physical human interventions. The technique with both additional features (3) was subjectively preferred by the users. The similarities and differences between the current results and those found in the literature are discussed.

Remote navigation of a mobile robot in an RFID-augmented environment

The aim of this study was to investigate, if the simulated proximity level of an anthropomorphic conversational agent and the affective contents in the agent's speech influence the subjects' affective experiences. Eight subjects were exposed to messages given by the agent using synthetic speech. The agent character's simulated proximity level (intimate, personal, social, and public) and the affective contents of the speech message (negative, neutral, and positive) were systematically varied in the experiment. The proximity levels were simulated by displaying the agent on a screen in different sizes. After each speech message, the subjects rated their affective experience on four scales: valence, arousal, dominance, and message intimacy. They also chose a preferred agent proximity level. The results showed that by manipulating the agent's simulated proximity level, experienced dominance could be significantly influenced. Further, by manipulating the affective contents of the speech, experienced valence and intimacy could be significantly influenced. The personal and social proximity levels were preferred by the subjects.

Affective effects of agent proximity in conversational systems

Handle everyday research tasks with reliable, citation-backed results

Your personal Research Agent to handle research tasks with citation-backed results

Popular Tasks used by Researchers

How can I help with your research?

Meet SciSpace

Get more enhanced response by uploading the PDFs you want me to reference.

No relevant PDFs in your library

SciSpace is the AI research assistant for academics. Run systematic literature reviews on 280M+ papers, and write papers with cited sources. Trusted by 1M+ students, PhDs & researchers.

SciSpace | AI for Research

Analyze PDFs

Code & Manuscripts

Funding & Grants

Literature & Patents

Medical & Clinical Data

Systematic Review

Visualize & Present

Web & Data

Build a Google Scholar-like website for your research.

Build a website

Create charts and images for your research

Create a Chart

Write a paper for submission to a journal

Draft a manuscript

Patent Search

Design eye-catching scientific posters in minutes.

Scientific Poster Generation

Systematic Literature Review

One task is running at the moment. Your messages will be shown right after.

Drag and drop or click here to browse

Loved by <highlight>1 million+</highlight> researchers

Extract a list of specific topics and their sources from unstructured text

Topics

Compare and analyze relevant papers that matches with your search

Papers

Get insights from PDFs and bookmarked papers from your library

My library

Recent searches

Try searching for:

Catch AI-generated content in scholarly and non-scholarly content

{ai} Detector

Ai Writer

Get PDF Summaries, highlighted text explanations 

Chat with PDF

Effortlessly create in-text citations and bibliographies in APA and 2,500 other formats

Citation generator

Get explanations, summaries, and answers on academic papers

Ease up your research workflow with {scispace}'s cohort of exciting AI tools

Elevate your academic writing skills and convey your ideas the way you want

Paraphraser

Explore our range of reading and writing tools

Your file is being prepared and should be ready in a few minutes. If it's a large file, it might take a bit longer. You can close this window, and we'll email you the file when it's done.

You have reached a maximum limit of <strong>{limit}</strong> columns in the table. Remove at least <strong>1</strong> column to add or create another one.

Timo Partala

Author Tools

Chat about Author