Continuous Interaction with a Virtual Human
Dennis Reidsma,Iwan de Kok,Daniel Neiberg,Sathish Pammi,Bart van Straalen,Khiet P. Truong,Herwin van Welbergen +6 more
TL;DR: In this article, a task-based setup for a responsive Virtual Human was implemented to carry out two user studies, and the results of which are presented and discussed in this paper, are implemented.
read more
Abstract: This paper presents our progress in developing a Virtual Human capable of being an attentive speaker. Such a Virtual Human should be able to attend to its interaction partner while it is speaking—and modify its communicative behavior on-the-fly based on what it observes in the behavior of its partner. We report new developments concerning a number of aspects, such as scheduling and interrupting multimodal behavior, automatic classification of listener responses, generation of response eliciting behavior, and strategies for generating appropriate reactions to listener responses. On the basis of this progress, a task-based setup for a responsive Virtual Human was implemented to carry out two user studies, the results of which are presented and discussed in this paper.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Turn-taking, feedback and joint attention in situated human-robot interaction
TL;DR: An analysis of the users’ gaze and lexical and prosodic realisation of feedback after the robot instructions, and show that these cues reveal whether the user has yet executed the previous instruction, as well as the user’s level of uncertainty.
112
Behavior Generation for Interpersonal Coordination with Virtual Humans: on Specifying, Scheduling and Realizing Multimodal Virtual Human Behavior
van Herwin Welbergen
- 09 Sep 2011
TL;DR: This thesis combines the physical naturalness provided by physically realistic animation with the control provided by procedural animation, and builds on the notion that the requirements of physical integrity and tight temporal synchronization are often of different importance for different body parts.
AsapRealizer 2.0: The Next Steps in Fluent Behavior Realization for ECAs
Herwin van Welbergen,Ramin Yaghoubzadeh,Stefan Kopp +2 more
- 26 Aug 2014
TL;DR: The conglomeration of research efforts in enabling the realization of fluent interactions for Embodied Conversational Agents in the behavior realizer ‘AsapRealizer 2.0’ is presented and it is shown how it provides fluent realization capabilities that go beyond the state-of-the-art.
An incremental multimodal realizer for behavior co-articulation and coordination
Herwin van Welbergen,Dennis Reidsma,Stefan Kopp +2 more
- 12 Sep 2012
TL;DR: AsapRealizer is presented, a BML 1.0 behavior realizer that achieves these capabilities by building upon, and extending, two state of the art existing realizers, as the result of a collaboration between two research groups.
A Multimodal System for Real-Time Action Instruction in Motor Skill Learning
Iwan de Kok,Julian Hough,Felix Hülsmann,Mario Botsch,David Schlangen,Stefan Kopp +5 more
- 09 Nov 2015
TL;DR: A multimodal coaching system that supports online motor skill learning and an architecture that combines motion analysis, dialogue management, and virtual human animation in a motion tracking and 3D virtual reality hardware setup is presented.
References
LIBSVM: A library for support vector machines
Chih-Chung Chang,Chih-Jen Lin +1 more
TL;DR: Issues such as solving SVM optimization problems theoretical convergence multiclass classification probability estimates and parameter selection are discussed in detail.
A simplest systematics for the organization of turn-taking for conversation
TL;DR: Turn-taking is used for the ordering of moves in games, for allocating political office, for regulating traffic at intersections, for the servicing of customers at business establishments, and for talking in interviews, meetings, debates, ceremonies, conversations.
chapter 1 – A Simplest Systematics for the Organization of Turn Taking for Conversation*
Harvey Sacks,Emanuel A. Schegloff,Gail Jefferson +2 more
- 01 Jan 1978
TL;DR: On the basis of research using audio recordings of naturally occurring conversations, the chapter highlights the organization of turn taking for conversation and extracts some of the interest that organization has.
8.2K
Grounding in communication
Herbert H. Clark,Susan E. Brennan +1 more
- 01 Jan 1991
TL;DR: The issues taken up here are: coordination of content, coordination of process, and how to update their common ground moment by moment.
•Book
Perspectives on Socially Shared Cognition
Lauren B. Resnick,John M. Levine,Stephanie D. Teasley +2 more
- 01 Oct 1991
TL;DR: This volume argues that the authors' thinking is shaped by others in a process known as socially shared cognition, and contains reports on the way thought works, from investigators in psychology, social psychology, anthropology, sociology, linguistics and literature.
3.5K