Human-Computer Interaction. Multimodal and Natural Interaction Thematic Area, HCI 2020, Held as Part of the 22nd International Conference, HCII 2020, Copenhagen, Denmark, July 19-24, 2020, Proceedings, Part II. Information Systems and Applications, incl.

The three-volume set LNCS 12181, 12182, and 12183 constitutes the refereed proceedings of the Human Computer Interaction thematic area of the 22nd International Conference on Human-Computer Interaction, HCII 2020, which took place in Copenhagen, Denmark, in July 2020.* A total of 1439 papers and 238 posters have been accepted for publication in the HCII 2020 proceedings from a total of 6326 submissions. The 145 papers included in these HCI 2020 proceedings were organized in topical sections as follows: Part I: design theory, methods and practice in HCI; understanding users; usability, user experience and quality; and images, visualization and aesthetics in HCI. Part II: gesture-based interaction; speech, voice, conversation and emotions; multimodal interaction; and human robot interaction. Part III: HCI for well-being and Eudaimonia; learning, culture and creativity; human values, ethics, transparency and trust; and HCI in complex environments. *The conference was held virtually due to the COVID-19 pandemic. -- Provided by publisher Front Matter ....Pages i-xxi Front Matter ....Pages 1-1 A Human-Centered Approach to Designing Gestures for Natural User Interfaces (Shannon K. T. Bailey, Cheryl I. Johnson)....Pages 3-18 Comparing a Mouse and a Free Hand Gesture Interaction Technique for 3D Object Manipulation (Joao Bernardes)....Pages 19-37 Research on Gesture Interaction Design for Home Control Intelligent Terminals (Bin Jiang, Xuewei Wang, Yue Wu)....Pages 38-56 A Comparative Study of Hand-Gesture Recognition Devices for Games (Ahmed S. Khalaf, Sultan A. Alharthi, Ali Alshehri, Igor Dolgov, Z. O. Toups)....Pages 57-76 The Social Acceptability of Peripheral Interaction with 3D Gestures in a Simulated Setting (Sara Nielsen, Lucca Julie Nellemann, Lars Bo Larsen, Kashmiri Stec)....Pages 77-95 Research of Interactive Gesture Usability of Navigation Application Based on Intuitive Interaction (Zhicheng Ren, Bin Jiang, Licheng Deng)....Pages 96-105 Gesture-Based Ιnteraction: Visual Gesture Mapping (Kasper Rise, Ole Andreas Alsos)....Pages 106-124 The Potential of Gesture-Based Interaction (Kasper Rise, Ole Andreas Alsos)....Pages 125-136 Detecting Gestures Through a Gesture-Based Interface to Teach Introductory Programming Concepts (Lora Streeter, John Gauch)....Pages 137-153 A Mouth Gesture Interface Featuring a Mutual-Capacitance Sensor Embedded in a Surgical Mask (Yutaro Suzuki, Kodai Sekimori, Yuki Yamato, Yusuke Yamasaki, Buntarou Shizuki, Shin Takahashi)....Pages 154-165 Front Matter ....Pages 167-167 The Effects of Body Gestures and Gender on Viewer’s Perception of Animated Pedagogical Agent’s Emotions (Justin Cheng, Wenbin Zhou, Xingyu Lei, Nicoletta Adamo, Bedrich Benes)....Pages 169-186 Integrating Language and Emotion Features for Multilingual Speech Emotion Recognition (Panikos Heracleous, Yasser Mohammad, Akio Yoneyama)....Pages 187-196 A New Approach to Measure User Experience with Voice-Controlled Intelligent Assistants: A Pilot Study (Félix Le Pailleur, Bo Huang, Pierre-Majorique Léger, Sylvain Sénécal)....Pages 197-208 Comparing the User Preferences Towards Emotional Voice Interaction Applied on Different Devices: An Empirical Study (Qinglin Liao, Shanshan Zhang, Mei Wang, Jia Li, Xinrong Wang, Xuemei Deng)....Pages 209-220 Research on Interaction Design of Artificial Intelligence Mock Interview Application Based on Goal-Directed Design Theory (Yingying Miao, Wenqian Huang, Bin Jiang)....Pages 221-233 The Effect of Personal Pronouns on Users’ Emotional Experience in Voice Interaction (Jianhong Qu, Ronggang Zhou, Liming Zou, Yanyan Sun, Min Zhao)....Pages 234-243 The Effect of Naturalness of Voice and Empathic Responses on Enjoyment, Attitudes and Motivation for Interacting with a Voice User Interface (Jacqueline Urakami, Sujitra Sutthithatip, Billie Akwa Moore)....Pages 244-259 Impression Detection and Management Using an Embodied Conversational Agent (Chen Wang, Beatrice Biancardi, Maurizio Mancini, Angelo Cafaro, Catherine Pelachaud, Thierry Pun et al.)....Pages 260-278 Expectation and Reaction as Intention for Conversation System (Qiang Zhang)....Pages 279-289 Augmented Tension Detection in Communication: Insights from Prosodic and Content Features (Bo Zhang, Lu Xiao)....Pages 290-301 How to Design the Expression Ways of Conversational Agents Based on Affective Experience (Chenyang Zhang, Ronggang Zhou, Yaping Zhang, Yanyan Sun, Liming Zou, Min Zhao)....Pages 302-320 Deep Learning-Based Emotion Recognition from Real-Time Videos (Wenbin Zhou, Justin Cheng, Xingyu Lei, Bedrich Benes, Nicoletta Adamo)....Pages 321-332 Front Matter ....Pages 333-333 Designing an AI-Companion to Support the Driver in Highly Autonomous Cars (Emmanuel de Salis, Marine Capallera, Quentin Meteier, Leonardo Angelini, Omar Abou Khaled, Elena Mugellini et al.)....Pages 335-349 SilverCodes: Thin, Flexible, and Single-Line Connected Identifiers Inputted by Swiping with a Finger (Minto Funakoshi, Shun Fujita, Kaori Minawa, Buntarou Shizuki)....Pages 350-362 A Defocus Based Novel Keyboard Design (Priyanshu Gupta, Tushar Goswamy, Himanshu Kumar, K. S. Venkatesh)....Pages 363-379 Affective Haptics and Multimodal Experiments Research (Yang Jiao, Yingqing Xu)....Pages 380-391 Recent Multimodal Communication Methodologies in Phonology, Vision, and Touch (Chutisant Kerdvibulvech)....Pages 392-400 A Framework of Input Devices to Support Designing Composite Wearable Computers (Ahmed S. Khalaf, Sultan A. Alharthi, Bill Hamilton, Igor Dolgov, Son Tran, Z. O. Toups)....Pages 401-427 Introducing Mobile Device-Based Interactions to Users: An Investigation of Onboarding Tutorials (Mandy Korzetz, Romina Kühn, Lukas Büschel, Franz-Wilhelm Schumann, Uwe Aßmann, Thomas Schlegel)....Pages 428-442 Multimodal Analysis of Preschool Children’s Embodied Interaction with a Tangible Programming Environment (Marleny Luque Carbajal, M. Cecília C. Baranauskas)....Pages 443-462 Identification Method of Digits for Expanding Touchpad Input (Takuto Nakamura, Buntarou Shizuki)....Pages 463-474 FingerTalkie: Designing a Low-Cost Finger-Worn Device for Interactive Audio Labeling of Tactile Diagrams (Arshad Nasser, Taizhou Chen, Can Liu, Kening Zhu, PVM Rao)....Pages 475-496 A Virtual Mouse Interface for Supporting Multi-user Interactions (Matthew Peveler, Jeffery O. Kephart, Xiangyang Mou, Gordon Clement, Hui Su)....Pages 497-508 Floating Hierarchical Menus for Swipe-Based Navigation on Touchscreen Mobile Devices (Alen Salkanovic, Ivan Štajduhar, Sandi Ljubic)....Pages 509-522 Touch Position Detection on the Front of Face Using Passive High-Functional RFID Tag with Magnetic Sensor (Yuta Takayama, Yuu Ichikawa, Takumi Kitagawa, Song Shengmei, Buntarou Shizuki, Shin Takahashi)....Pages 523-531 Front Matter ....Pages 533-533 One-Hand Controller for Human-Drone Interaction – a Human-Centered Prototype Development (Sebastian Büttner, Rami Zaitoon, Mario Heinz, Carsten Röcker)....Pages 535-548 Sexual Robots: The Social-Relational Approach and the Concept of Subjective Reference (Piercosma Bisconti Lucidi, Susanna Piermattei)....Pages 549-559 Theses on the Future Design of Human-Robot Collaboration (Hans-Jürgen Buxbaum, Sumona Sen, Ruth Häusler)....Pages 560-579 Trust on Service Robots: A Pilot Study on the Influence of Eyes in Humanoid Robots During a VR Emergency Egress (André Diogo, Hande Ayanoglu, Júlia Teles, Emília Duarte)....Pages 580-591 Modelling the Collaboration of a Patient and an Assisting Humanoid Robot During Training Tasks (Peter Forbrig, Alexandru-Nicolae Bundea)....Pages 592-602 Multi-human Management of Robotic Swarms (John R. Grosh, Michael A. Goodrich)....Pages 603-619 The Current Status and Challenges in Augmented-Reality Navigation System for Robot-Assisted Laparoscopic Partial Nephrectomy (Akihiro Hamada, Atsuro Sawada, Jin Kono, Masanao Koeda, Katsuhiko Onishi, Takashi Kobayashi et al.)....Pages 620-629 Database Semantics for Talking Autonomous Robots (Roland Hausser)....Pages 630-643 Emotion Synchronization Method for Robot Facial Expression (Yushun Kajihara, Peeraya Sripian, Chen Feng, Midori Sugaya)....Pages 644-653 Human-Robot Interaction in Health Care: Focus on Human Factors (Lisanne Kremer, Sumona Sen, Monika Eigenstetter)....Pages 654-667 Evaluating a Mouse-Based and a Tangible Interface Used for Operator Intervention on Two Autonomous Robots (Andreas Mallas, Michalis Xenos, Maria Rigou)....Pages 668-678 On Positive Effect on Humans by Poor Operability of Robot (Mitsuharu Matsumoto)....Pages 679-687 Human-Drone Interaction: Using Pointing Gesture to Define a Target Object (Anna C. S. Medeiros, Photchara Ratsamee, Yuki Uranishi, Tomohiro Mashita, Haruo Takemura)....Pages 688-705 Enhancing Drone Pilots’ Engagement Through a Brain-Computer Interface (Tracy Pham, Dante Tezza, Marvin Andujar)....Pages 706-718 The Effects of Different Robot Trajectories on Situational Awareness in Human-Robot Collaboration (Sumona Sen, Hans-Jürgen Buxbaum, Lisanne Kremer)....Pages 719-729 Back Matter ....Pages 731-735