Mobile social signal processing : first International Workshop, MSSP 2010, Lisbon, Portugal, September 7, 2010 : invited papers

This book contains papers invited after the First International Workshop on Mobile Social Signal Processing, MSSP 2010, held in Lisbon, Portugal, in September 2010. The 9 revised papers included in this volume represent the diversity of two fields of research, Mobile HCI and Social Signal Processing, and areas of overlap. They cover a wide range of topics spanning from approaches for effective interaction with mobile and wearable devices to modelling, analysis and synthesis of nonverbal behaviour in human-human and human-machine interactions. Mobile Social Signal Processing Preface 5 Organization 11 Table of Contents 12 Mobile Phones and Social Signal Processing for Analysis and Understanding of Dyadic Conversations 13 1 Introduction 13 2 Social Signal Processing and Mobile Phones 16 3 Main Challenges 17 4 Conclusions 18 References 18 Turns Analysis for Automatic Role Recognition 21 1 Introduction 21 2 Role Recognition 22 2.1 Feature Extraction 22 2.2 Role Recognition Approach Based on Bayesian Classifiers 24 2.3 Role Recognition Approach Based on Probabilistic Sequential 26 2.4 Experiments and Results 27 2.5 Combination of Interaction and Lexical Patterns 30 3 Conclusion 31 References 32 Speaker Diarization of Multi-party Conversations Using Participants Role Information: Political Debates and Professional Meetings 34 1 Introduction 34 2 DataDescription 35 3 Turn-Taking Patterns and Roles 36 4 Speaker Diarization System 38 5 Speaker-turns Based Diarization 39 5.1 Case 1 40 5.2 Case 2 41 6 Discussions 43 References 44 Invisible, Passive, Continuous and Multimodal Authentication 46 1 Introduction 46 2 Motivation 47 3 Multimodal Biometrics 48 3.1 Keystroke Dynamics 48 3.2 Voice Analysis 49 3.3 Use Patterns 50 4 Pattern Classification 50 5 Conclusion 51 References 52 The Metaphysics of Communications Overload 54 1 Introduction 54 2 An Example 57 3 Conclusion 60 References 62 Capturing Performative Actions for Interaction and Social Awareness 63 1 Introduction 63 2 Background 64 2.1 Action and Performance 64 2.2 Performative Perspectives in HCI 65 2.3 Capturing Performances for Interactive Systems 65 3 Exploring Performance for Social Awareness 66 3.1 The MuMo Application 66 3.2 The Study 68 4 Results 68 4.1 Creating Performances 69 4.2 Imagining Others 70 4.3 Props and Performance 71 5 Discussion 72 6 Conclusion 74 References 74 Negotiation Models for Mobile Tactile Interaction 76 1 Introduction 76 2 Mobile Social Interaction 77 3 Experimental System 78 4 User Study 80 5 Results 81 6 Conclusion and Future Work 84 References 85 Direct Tactile Coupling of Mobile Phones with the System 86 1 Introduction 86 2 Related Work 87 3 Concepts 88 3.1 Implicit Context Communication 88 3.2 Direct Communication 88 4 Implementation 89 4.1 Technology 89 4.2 Signal Processing and Vibrotactile Mapping 89 5 Evaluation 91 5.1 Method 91 5.2 Results 92 6 Discussion 92 7 Conclusion 93 References 94 A Multimodal Contact List to Enhance Remote Communication 96 1 Introduction 96 1.1 Scenarios 97 2 Related Work 98 3 The Multimodal Contact List 100 3.1 Mapping the Mood Vector to a Texture 103 3.2 Tactile Communication 103 3.3 Real Time Communication 104 4 Evaluation 104 4.1 Focus Groups 105 4.2 User Evaluation 107 5 Conclusions and Future Work 111 References 111 Author Index 113 Front Matter....Pages - Mobile Phones and Social Signal Processing for Analysis and Understanding of Dyadic Conversations....Pages 1-8 Turns Analysis for Automatic Role Recognition....Pages 9-21 Speaker Diarization of Multi-party Conversations Using Participants Role Information: Political Debates and Professional Meetings....Pages 22-33 Invisible, Passive, Continuous and Multimodal Authentication....Pages 34-41 The Metaphysics of Communications Overload....Pages 42-50 Capturing Performative Actions for Interaction and Social Awareness....Pages 51-63 Negotiation Models for Mobile Tactile Interaction....Pages 64-73 Direct Tactile Coupling of Mobile Phones with the feelabuzz System....Pages 74-83 A Multimodal Contact List to Enhance Remote Communication....Pages 84-100 Back Matter....Pages -