Adaptive Multimodal Interactive Systems Daten

Adaptive Multimodal Interactive Systems introduces a general framework for adapting multimodal interactive systems and comprises a detailed discussion of each of the steps required for adaptation. This book also investigates how interactive systems may be improved in terms of usability and user friendliness while describing the exhaustive user tests employed to evaluate the presented approaches. After introducing general theory, a generic approach for user modeling in interactive systems is presented, ranging from an observation of basic events to a description of higher-level user behavior. Adaptations are presented as a set of patterns similar to those known from software or usability engineering. These patterns describe recurring problems and present proven solutions. The authors include a discussion on when and how to employ patterns and provide guidance to the system designer who wants to add adaptivity to interactive systems. In addition to these patterns, the book introduces an adaptation framework, which exhibits an abstraction layer using Semantic Web technology. Adaptations are implemented on top of this abstraction layer by creating a semantic representation of the adaptation patterns. The patterns cover both graphical interfaces as well as speech-based and multimodal interactive systems 4.1.1 Predictability......Page 3 A.3 Alternative Elements......Page 5 6.3.2 Action Recognition......Page 7 Cover......Page 1 Adaptive Multimodal Interactive Systems......Page 4 Preface......Page 6 Contents......Page 8 6.3.3 Action Prediction......Page 9 6.4 Evaluation of the Adaptation Approach......Page 10 B The Evaluation Questionnaire......Page 11 1 Introduction......Page 12 Test System and Task......Page 13 A.2 List Element Selection......Page 2 1.1.1 Multimodal Interactive Systems......Page 14 1.1.3 Adaptations......Page 16 1.2.1 General Structure of Adaptive Interactive Systems......Page 17 Discussion and Lessons Learned......Page 18 The System Model......Page 19 The Interaction Model......Page 20 The User Model......Page 21 The Domain Model......Page 22 1.3 Causes of Adaptation......Page 23 1.4 Outline......Page 24 1.1.2 User Behavior......Page 15 Test System and Task......Page 25 2.1 Adaptive Interactive Systems......Page 27 2.1.1 Adaptive Hypertext and Adaptive Websites......Page 28 6.4.7 Evaluation Summary......Page 29 2.1.2 Adaptive Graphical Interfaces......Page 30 Index......Page 35 2 Related Work......Page 26 2.1.3 Adaptive Speech Interfaces......Page 34 2.2 User Modeling for Adaptive Interactive Systems......Page 38 2.2.1 User Modeling Algorithms......Page 39 2.2.2 Plan Recognition and Task Models......Page 41 2.2.3 User Modeling Architectures......Page 42 2.3 Design Patterns for Adaptations......Page 43 2.3.1 Interface and Adaptation Patterns......Page 44 2.3.2 Formalization of Design Patterns......Page 45 2.4 Semantics in Interactive Systems......Page 46 2.4.1 Ontologies in Dialog Systems......Page 47 2.4.2 Architectures for Adaptive Interactive Systems......Page 48 2.5 Discussion......Page 49 3 User Modeling in Interactive Systems......Page 51 3.1.1 User Behavior as a Sequence of Events......Page 52 3.1.2 Behavior as Actions and Data......Page 54 3.2 Recognizing User Actions in Event Sequences......Page 55 3.2.1 Probabilistic Deterministic Finite-state Automata......Page 56 3.2.2 Describing User Behavior using PDFAs......Page 58 3.3 Modeling Tasks in Interactive Systems......Page 60 3.3.1 Task Modeling......Page 61 3.3.2 Constructing Task Models......Page 63 3.3.3 Task Models in Adaptive Systems......Page 64 Predicting the Most Likely Next User Action......Page 65 Finishing the Current Task......Page 66 Detecting User Errors and Problems......Page 67 Using Markov Chains for User Action Prediction......Page 68 3.4.2 Predicting a Sequence of User Actions......Page 70 An Algorithm for Mining User Actions......Page 71 Action Sequences for Adaptive Interactive Systems......Page 73 3.4.3 Invoking User Actions......Page 74 4 Adaptation Patterns for Interactive Systems......Page 76 4.1 General Considerations for Adaptation Patterns......Page 77 4.1.1 Predictability......Page 78 4.1.3 Controllability......Page 79 4.1.5 Privacy......Page 80 4.2.1 Identifying Patterns......Page 81 4.2.2 A Pattern Format for Adaptation Patterns for Interactive Systems......Page 82 4.3 An Adaptation Pattern Collection for Interactive Systems......Page 83 4.3.1 Component Emphasis......Page 84 4.3.2 List Element Selection......Page 85 4.3.4 Adaptive Help Presentation......Page 86 4.3.5 Shortcut Area......Page 87 4.4 Discussion......Page 88 5 AdaGUIDE – An Adaptation Framework......Page 90 5.1 Overview of the Architecture......Page 91 5.2.1 Ontologies......Page 93 5.2.2 An Ontology for Interactive Adaptive Systems......Page 94 The System Model......Page 95 The Adaptation Model......Page 96 The Domain Model......Page 97 5.3 A Framework for Modeling User Behavior......Page 98 5.3.1 The User Modeling Component......Page 99 5.3.2 The User Model......Page 101 5.3.3 Connecting the User Model and the Ontology......Page 104 5.4.1 Representation of Adaptations in the Framework......Page 105 5.4.2 Executing Adaptations......Page 107 5.5.1 Reference Implementation......Page 108 5.5.2 Applying the Framework to a Non-Adaptive Interactive System......Page 111 5.6 Discussion......Page 113 6 Evaluation......Page 115 6.1 Evaluating Adaptive Interactive Systems......Page 116 6.2.2 Cultural Influence......Page 118 6.3.1 Test Data......Page 120 6.3.2 Action Recognition......Page 121 6.3.3 Action Prediction......Page 123 6.4 Evaluation of the Adaptation Approach......Page 124 6.4.1 Test Setup......Page 125 Test System and Task......Page 127 Subjective Evaluation......Page 128 Discussion and Lessons Learned......Page 129 Test System and Task......Page 130 Subjective Evaluation......Page 131 Discussion and Lessons Learned......Page 132 Test System and Task......Page 133 Subjective Evaluation......Page 135 Discussion and Lessons Learned......Page 136 Subjective Evaluation......Page 137 Discussion and Lessons Learned......Page 138 Test System and Task......Page 139 Subjective Evaluation......Page 141 Objective Evaluation......Page 142 6.4.7 Evaluation Summary......Page 143 6.5 Discussion......Page 144 7 Summary and Outlook......Page 146 7.1 Summary......Page 147 7.2 Outlook......Page 149 A.1 Component Emphasis......Page 151 A.2 List Element Selection......Page 152 A.3 Alternative Elements......Page 155 A.4 Adaptive Help Presentation......Page 156 A.5 Shortcut Area......Page 158 B The Evaluation Questionnaire......Page 161 List of Figures......Page 166 List of Tables......Page 169 References......Page 170 Index......Page 185