Intelligent Virtual Agents: 8th International Conference, IVA 2008, Tokyo, Japan, September 1-3, 2008, Proceedings (Lecture Notes in Computer Science, 5208)

Annotation This book constitutes the refereed proceedings of the 8th International Workshop on Intelligent Virtual Agents, IVA 2008, held in Tokyo, Japan, in September 2008. The 18 revised full papers and 28 revised short papers presented together 42 poster papers were carefully reviewed and selected from 99 submissions. The papers are organized in topical sections on motion and empathy; narrative and augmented reality; conversation and negotiation; nonverbal behavior; models of culture and personality; markup and representation languages; architectures for robotic agents; cognitive architectures; agents for healthcare and training; and agents in games, museums and virtual worlds Title Page Preface Organization Table of Contents The Relation between Gaze Behavior and the Attribution of Emotion: An Empirical Study Introduction Related Work Expressive Gaze Model Gaze Warping Transformation Procedural Model of Eye Movement Approach Structure of Model Motion Capture Collection Animation Generation Category Formation Emotional Attribution Experiment Results Dimensional Results Categorical Results Discussion Conclusion References Affect Simulation with Primary and Secondary Emotions Introduction and Motivation Background and Related Work Psychological and Neurobiological Background Related Work The WASABI Architecture Nine Primary Emotions Three Secondary Emotions Emotion Dynamics and Awareness Likelihood Connecting Cognition and Embodiment Discussion and Conclusion User Study of AffectIM, an Emotionally Intelligent Instant Messaging System Introduction and Motivation Rule-Based Approach to Affect Sensing from Text Instant Messaging Application Integrated with the AffectAnalysis Model User Study of the AffectIM System Experimental Design, Subjects and Procedu Analysis of Results Discussion and Conclusions References Expressions of Empathy in ECAs Introduction Architecture of Empathic Agent Evaluation Scenario Set-Up Procedure Results Discussion Conclusions Archetype-Driven Character Dialogue Generation forInteractive Narrative Introduction Related Work CRYSTAL ISLAND Narrative-Centered Learning Environment Archetype-Driven Character Dialogue Generation Archetype-Based Character Representation Probabilistic Unification Grammars for Character Dialogue Generation An Illustrative Scenario Conclusions and Future Work References Towards a Narrative Mind: The Creation of Coherent Life Stories for Believable Virtual Agents Introduction Related Work Modelling Long-Term Memory Narrative Agents and Autobiographic Memory Narrative Autobiographic Memory for IVAs Design and On-Going Implementation Preliminary Results Evaluation Plan Conclusion and Future Work Emergent Narrative as a Novel Framework for Massively Collaborative Authoring Introduction Authoring Emergent Narratives Unpredictability: The Conceptual Authoring Challenge Knowledge Representation: The Technical Authoring Challenge Rehearsal Based Authoring Massively Collaborative Authoring Other Collaborative Authoring Projects Advantages of Collaboration Avoiding Incoherence Ignorance Is Useful Conclusion Future Work Towards Real-Time Authoring of Believable Agents in Interactive Narrative Introduction Authoring Interactive Narrative Authoring Believable Worlds: A Question of Language Authoring Believable Agents The Cinematic Authoring Process Technical Discussion Authoring Interoperability Heterogeneous Collaboration Narratoria in Production, Preliminary Results Related Work Future Work References Male Bodily Responses during an Interaction with a Virtual Woman Introduction Related Work Methodology Body Movement Annotations Independent and Explanatory Variables Assessing Body Movements Results Discussion Conclusion and Future Work A Virtual Agent for a Cooking Navigation System Using Augmented Reality Introduction Related Works SystemOverview State Recognition of Cooking Sensing Environment for the State Recognition State and Transition Model of Cooking The Virtual Agent A Wearable Camera and Markers for the Agent The User Interface Demonstration Conclusion and Future Works Social Perception and Steering for Online Avatars Introduction Related Work Automating Avatar Control Dynamic Group Behavior Approach Underlying Social Theory The Social Simulation and Visualization Platform Social Situations and Activation of Steering Behaviors Conversation Force Field Conversation Unit Conclusions and Future Work Multi-party, Multi-issue, Multi-strategy Negotiation for Multi-modal Virtual Agents Introduction Multi-modal Multi-party Dialogue Model Multi-party Negotiation Strategies Implementing the Strategies Factors in Strategy Selection Multi-issue Utilities Models of Other Agents Choosing Strategies Dialogue Realizations of Strategies The SASO-EN Three-Party Negotiation Domain Evaluation Limitations, Related and Future Work A Granular Architecture for Dynamic Realtime Dialogue Introduction Related Work Theoretical Underpinnings The Architecture Generating Dialogues for Virtual Agents Using Nested Textual Coherence Relations Introduction The Text2Dialogue System Text Analysis Component Mapper Component Assigning Turns to Speakers Preliminary Evaluation Conclusions Integrating Planning and Dialogue in a Lifestyle Agent Introduction Reasoning on User Activities with HTN Planning Ad Hoc Dialogue Control Generation Refining and Updating the Activity Model through Dialogue Integrating Planning and Dialogue Results and Discussion Relationship to Previous Work Conclusions References Audio Analysis of Human/Virtual-Human Interaction Introduction A Signal Processing Approach to H-VH Audio Analysis User Study Conclusions and Future Learning Smooth, Human-Like Turntaking in Realtime Dialogue Introduction Related Work System Architecture Perception Deciders The Learner Evaluation Setup Parameter Settings Results from System Interacting with Self Comparison to Human-Human Interaction Study Conclusions and Future Work Predicting Listener Backchannels: A Probabilistic Multimodal Approach Introduction Previous Work PredictionModel Encoding Dictionary Automatic Feature Selection Generating Listener Backchannel Experiments Data Collection Speaker Features and Listener Backchannels Methodology Results and Discussion Conclusion IGaze: Studying Reactive Gaze Behavior in Semi-immersive Human-Avatar Interactions Introduction TheIGazeSystem Gaze Strategies Experiment Pilot Study Main Study Discussion Conclusion Estimating User’s Conversational Engagement Based on Gaze Behaviors Introduction Related Research Wizard-of-Oz Experiment to Collect Verbal/Nonverbal Data Experiment Verbal/Nonverbal Data Analysis User-Adapted Engagement Estimation Evaluation Conclusion and Future Work References The Effects of Agent Nonverbal Communication on Procedural and Attitudinal Learning Outcomes Introduction Method Results Discussion References Evaluating Data-Driven Style Transformation for Gesturing Embodied Agents Introduction Related Work Style Transformation Overview Perceptive Evaluation of Style Transformation Experimental Setup Hypothesis Results Discussion Conclusion and Perspectives Culture-Specific First Meeting Encounters between Virtual Agents Introduction Related Work Combining an Empirical and a Theoretical Approach Empirical Approach Theoretical Approach Implementing Culture-Specific First Meeting Encounters Behavior Planning Behavior Selection and Modification TTS Scheduler Evaluation Conclusion Virtual Humans Elicit Skin-Tone Bias Consistent with Real-World Skin-Tone Biases Introduction Previous Work Study Design Population Metrics Procedure Results Discussion Conclusions and Future Work Cross-Cultural Evaluations of Avatar Facial Expressions Designed by Western Designers Introduction Experiment Overview Experimental Procedure Avatar and Expression Design Results Analysis of Average Matching Rates by Designs Analysis of Expressions by Recognition Accuracy Discussion Conclusion References Agreeable People Like Agreeable Virtual Humans Introduction Related Work and Research Questions Experimental Design$^1$ Participants and Procedure Equipment Measurements Response Variables Explanatory Variable Results Correlations between the Personality Traits and Self-reported Rapport Correlations between the Personality Traits and Behavioral Measures of Rapport Conclusions References A Listening Agent Exhibiting Variable Behaviour Introduction Sensitive Artificial Listener Background Personal Tendencies in Behaviour Listener’s Behaviour Related Work Overall System Description Agent Definition Backchannel Generator Listener Signal Selection Conclusion and Future Wor The Next Step towards a Function Markup Language Introduction Towards an Inventory of FML Tags Legacy Tags Proposed Issues The Role of Context Intentions Communicative Actions Architecture Conclusion Extending MPML3D to Second Life Introduction Related Work Second Life Overview Infrastructure Programming Interfaces Entities and Resources MPML3D Framework with SL-Extension MPML3D Backend Frontends SL Frontend Challenges in SL Conclusions An Extension of MPML with Emotion Recognition Functions Attached Introduction The MIML System System Architecture Tag Structure Emotion Recognition Functions Illustration Conclusion ITACO: Effects to Interactions by Relationships between Humans and Artifacts Introduction ITACOSystem Constructions of the ITACO System Experiment 1: Migrating to Robots Design of an Experiment Procedures Evaluation Methods Hypotheses and Predictions Results and Discussions Experiment 2: Migrating to Lamps Design of an Experiment Procedures Evaluation Methods Hypotheses and Predictions Results and Discussions Discussions and Conclusions References Teaching a Pet Robot through Virtual Games Introduction Related Work Framework Design and Implementation The Training Tasks Advantages of Virtual Training Tasks Selected Game Tasks The Learning Method Reward Recognition Learning Reward Association Learning Experiments Results Conclusion Modeling Self-deception within a Decision-Theoretic Framework Introduction Self Deception Framework Desired Belief Formulation Belief Integration and Decision-Making Simulation Scenario Setup Simulation Results and Discussion Related Work Future Work Alternative Decision Models Relaxed Formulation of Desired Belief Conclusion Modeling Appraisal in Theory of Mind Reasoning Introduction Related Work ThespianAgent Computational Model of Appraisal Appraisal Process Appraisal Dimensions Sample Results Scenario 1: Small Talk Scenario 2: Firing-Squad Discussion and Future Work Conclusion Improving Adaptiveness in Autonomous Characters Introduction ORIENT Architectures FAtiMA PSI FAtiMA-PSI: A Body-Mind Architecture Related Work Conclusion and Future Work The Embodiment of a DUAL/AMBR Based Cognitive Model in the RASCALLI Multi-agent Platform Introduction The RASCALLI Architecture The DUAL/AMBR Based Mind of RASCALLI Knowledge Representations Scenario and DUAL/AMBR Mechanisms Reasoning and Transfer Mechanisms Complementary Transfer and Evaluation Mechanism Discussion and Conclusion BDI Model-Based Crowd Simulation Introduction Approach BDI Model-Based Crowd Simulation Demo Sy Overview Scenario Architecture Perceiver Reasoner Selector Executor Applying BDI Model to Our Demo System Evaluation and Discussion Performance Evaluation Comparison of BDI Model with Other Approaches Conclusion The Mood and Memory of Believable Adaptable Socially Intelligent Characters Introduction BASIC v2.0 Walkthrough Model Validation Conclusions Visualizing the Importance of Medical Recommendations with Conversational Agents Introduction and Rationale System Overview and Architecture The Document Engineering Environment The Greta Platform Related Work Identifying the Rhetorical Strength of Recommendations Mapping Rhetorical Structures onto MultimodalCommunicative Acts Definition of Specific Expressions XSL-Based Transformations and APML Generation Example Results An Application to Consensus Judgments of Recommendations’ Strength Conclusions References Evaluation of Justina: A Virtual Patient with PTSD Introduction and Background Designing a Patient with Post Traumatic Stress Disorder (PTSD) Virtual Justina PTSD Domain Question / Response Categorization Method Participants Setup Process and Procedure Measures Data Analytics Results and Evaluation Assessment of the System Assessment of Student Questions and the Students Discussion of Results Future Work References Elbows Higher! Performing, Observing and Correcting Exercises by a Virtual Trainer Introduction Modeling Physical Exercises The Exercise Recordings Corpus The Training Recordings Corpus The Architecture of the RVT Monitoring the User Providing Feedback Presenting on Time, in Sync Preliminary Evaluation References A Virtual Therapist That Responds Empathically to Your Answers Introduction The Application The Emotion Model of the Agent The Resulting Website Experiment Discussion References IDEAS4Games: Building Expressive VirtualCharacters for Computer Games Motivation Poker Demonstrator Poker Algorithms Modeling of Interaction and Story Authoring Dialog Content Authoring Narrative Structure Game Control Modeling of Affect Affect Computation Authoring Affect Expressive Synthetic Voices with Reliable Quality Expressive Domain-Oriented Unit Selection Robust HMM-Based Synthesis Discussion and Conclusion Context-Aware Agents to Guide Visitors in Museums Introduction Basic Approach Background Design Principles Deployable Virtual Agent Platf Agent Host Context-Aware Agent Deployment Context-Aware Virtual Agent User-Preference Part Annotation Part Navigation Part Current Status Early Experience Related Work Conclusion Virtual Institutions: Normative EnvironmentsFacilitating Imitation Learning in Virtual Agents Introduction Virtual Institutions as Normative Virtual Worlds That Enable Learning from the Behavior of the Inhabitants Enabling Imitation Learning with Virtual Institutions Conclusions and Future Work Enculturating Conversational Agents Based on a Comparative Corpus Study Introduction Analysis of Comparative Corpus Enculturated Language-Trainer Agents References The Reactive-Causal Architecture: Towards Development of Believable Agents$^\star$ Introduction The Reactive-Causal Architecture Conclusion Gesture Recognition in Flow in the Context of Virtual Theater Automatic Generation of Conversational Behavior for Multiple Embodied Virtual Characters: The Rules a nd Models behind Our System Introduction and Motivation Behavior Generation References Implementing Social Filter Rules in a Dialogue Manager Using Statecharts Introduction Implementation Towards Realistic Real Time Speech-Driven Facial Animation References Avatar Customization and Emotions in MMORPGs Introduction Relevant Research Avatar Emotions and Avatars Method Results Discussion References Impact of the Agent’s Localization in Human-Computer Conversational Int eraction Introduction Method Impact of the Agent’s Localization Evolving Expression of Emotions in Virtual Humans Using Lights and Pixels References Motivations and Personality Traits in Decision-Making Introduction Motivations and Personality Traits Conclusion References A Flexible Behavioral Planner in Real-Time Introduction Behavioral Planner Conclusion References Face to Face Interaction with an Intelligent Virtual Agent: The Effect on Learning Tactical Picture Compilation Introduction Experiment Results Piavca: A Framework for Heterogeneous Interactionswith Virtual Characters Creating and Scripting Second Life Bots Using MPML3D Motivation Example Scenario in SL Piavca: A Framework for Heterogeneous Interactions with Virtual Characters Interpersonal Impressions of Agents for Developing Intelligent Systems Introduction Experiment on Impressions of Replies from the Agent Discussion References Comparing an On-Screen Agent with a Robotic Agent in Non-Face-to-Face Interactions Introduction Experiment Experimental Setting An On-Screen Agent and a Robotic Agent Participants Procedure Results Discussion and Conclusions References Sustainability and Predictability in a Lasting Human–Agent Interaction Introduction Methods Human–Agent Interaction Experiments Social Effects of Virtual Assistants. A Review of Empirical Results with Regard to Communication References SoNa: A Multi-agent System to Support Human Navigation in a Community, Based on Social Network Analysis Motivation Proposed System Summary Reference Animating Unstructured 3D Hand Models Introduction Hand Skeleton Extraction and Hand Segmentation Local Frame Based Hand Skinning and Animation Conclusions References Verification of Expressiveness of Procedural Parameters for Generating Emotional Motions Motivation and System Overview Preliminary Experimental Results References Individualised Product Portrayals in the Usability of a 3D Embodied Conversational Agent in an eBanking Scenario Introduction Experiment Design and Procedure Results Conclusions Multi-agent Negotiation System in Electronic Environments Introduction Conclusion References A Study of the Use of a Virtual Agent in an Ambient Intelligence Environment Introduction Evaluation of the Use of the Virtual Agent Conclusions Automatic Torso Engagement for GesturingCharacters Introduction Technical Overview Modeling the Dynamics of Virtual Agent’s Social Relations Proposal of an Artificial Emotion Expression System Based on External Stimulus and Emotional Elements Introduction Artificial Emotion Expression System (AES) Conclusion References A Reactive Architecture Integrating an Associative Memory for Sensory-Driven Intelligent Behavior Introduction Experiments Conclusion Social Responses to Virtual Humans: Automatic Over-Reliance on the "Human" Category References Adaptive Self-feeding Natural Language Generator Engine Introduction Natural Language Generation Engine Architecture Future Work A Model of Motivation for Virtual-Worlds Avatars Introduction Recognising and Reacting to Other Avatar’s Motivation Conclusions and Future Work References Towards Virtual Emotions and Emergence of Social Behaviour References Using Virtual Agents for the Teaching of Requirements Elicitation in GSD Introduction A Virtual Agent’s Behavior Selection by Using Actions for Focusing of Attention Action for Focusing of Attention Conclusion References Emergent Narrative and Late Commitment Introduction Late Commitment UsageExamples “I Would Like to Trust It but”Perceived Credibility of Embodied Social Agents: AProposal for a Research Framework Introduction References Acceptable Dialogue Start Supporting Agent for Avatar-Mediated Multi-tasking Online Communication Do You Know How I Feel? Evaluating Emotional Display of Primary and Secondary Emotions Motivation and Description of Study Results and Discussion Comparing Emotional vs. Envelope Feedback for ECAs References Intelligent Agents Living in Social Virtual Environments – Bringing Max into Second Life Introduction and Background Implementation and Architecture Max’s First Steps into Second Life – Observations Author Index