Gesture-based communication in human-computer interaction : international Gesture Workshop, GW '99, Gif-sur-Yvette, France, March 17-19, 1999 : proceedings

This book constitutes the thoroughly refereed post-proceedings of the International Gesture Workshop, GW'99, held in Gif-sur-Yvette, France, in March 1999. The 16 revised long papers and seven revised short papers were carefully reviewed for inclusion in the book. Also included are four invited papers and the transcription of a round table discussion. The papers are organized in sections on human perception and production of gesture, localization and segmentation, recognition, sign language, gesture synthesis and animation, and multimodality. The Need To Improve Communication Between Humans And Computers Has Been Instrumental In De Ning New Modalities Of Communication, And New Ways Of Interacting With Machines. Gestures Can Convey Information For Which Other Modalities Are Not E Cient Or Suitable. In Natural And User-friendly Interaction, Gesturescanbeused,asasinglemodality,orcombinedinmultimodalinteraction Schemes Which Involvespeech,or Textual Media. Speci Cation Methodologiescan Be Developed To Design Advanced Interaction Processes In Order To De Ne What Kind Of Gestures Are Used, Which Meaning They Convey, And What The Paradigms Of Interaction Are. Research Centred On Gesture Interaction Has Recently Provided Signi Cant Technologicalimprovements, In Particular: Gesture Capture And Tra- Ing (from Video Streams Or Other Input Devices), Motion Recognition, Motion Generation, And Animation. In Addition, Active Research In The Elds Of Signal Processing, Pattern Recognition, Arti Cial Intelligence, And Linguistics Is Relevant To The Areas Covered By The Multidisciplinary Research On Gesture As A Means Of Communication. Resulting Fromathree-dayinternationalworkshopin Gif-sur-yvette,france, With 80 Participants From Ten Countries All Over The World, This Book Presents Contributions On Gesture Under The Focus Of Human-computer Communication. The Workshop Was Run By Universit E Paris Sud, Orsay, On The Lines Of Gw’96 At York University, Uk, And Gw’97 At Bielefeld University, Germany. Its Purpose Was To Bring Together Scientists From Researchand Industrial Organisationswo- Ing On All Aspects Of Gesture Modelling And Interaction. The Book Is Organised In Sixsections,coveringhumanperceptionandproductionofgesture,gestureloc- Isation And Movement Segmentation, Vision-based Recognition And Sign Language Recognition, Gesture Synthesis And Animation, And Multimodality. Human Perception And Production Of Gesture -- Seeing Biological Motion - Is There A Role For Cognitive Strategies? -- The Expressive Power Of Gestures: Capturing Scent In A Spatial Shape -- Non-obvious Performer Gestures In Instrumental Music -- The Ecological Approach To Multimodal System Design -- Analysis Of Trunk And Upper Limb Articular Synergies -- Localisation And Segmentation -- Grefit: Visual Recognition Of Hand Postures -- Towards Imitation Learning Of Grasping Movements By An Autonomous Robot -- A Line-scan Computer Vision Algorithm For Identifying Human Body Features -- Hand Posture Recognition In A Body-face Centered Space -- Recognition -- Vision-based Gesture Recognition: A Review -- Person Localization And Posture Recognition For Human-robot Interaction -- Statistical Gesture Recognition Through Modelling Of Parameter Trajectories -- Gesture Recognition For Visually Mediated Interaction -- Interpretation Of Pointing Gestures: The Pog System --^ Control Of In-vehicle Systems By Gestures -- Sign Language -- French Sign Language: Proposition Of A Structural Explanation By Iconicity -- Hmm-based Continuous Sign Language Recognition Using Stochastic Grammars -- A Method For Analyzing Spatial Relationships Between Words In Sign Language Recognition -- Toward Scalability In Asl Recognition: Breaking Down Signs Into Phonemes -- Gesture Synthesis And Animation -- A Complete System For The Specification And The Generation Of Sign Language Gestures -- Sign Specification And Synthesis -- Active Character: Dynamic Reaction To The User -- Reactiva’motion Project: Motion Synthesis Based On A Reactive Representation -- The Emotional Avatar: Non-verbal Communication Between Inhabitants Of Collaborative Virtual Environments -- Multimodality -- Communicative Rhythm In Gesture And Speech -- Temporal Symbolic Integration Applied To A Multimodal System Using Gestures And Speech --^ A Multimodal Interface Framework For Using Hand Gestures And Speech In Virtual Environment Applications -- Round Table -- Stimulating Research Into Gestural Human Machine Interaction. Annelies Braffort ... [et Al.] (eds.). Includes Bibliographical References And Index. Seeing Biological Motion - Is There a Role for Cognitive Strategies?....Pages 3-22 The Expressive Power of Gestures: Capturing Scent in a Spatial Shape....Pages 23-36 Non-obvious Performer Gestures in Instrumental Music....Pages 37-48 The Ecological Approach to Multimodal System Design....Pages 49-52 Analysis of Trunk and Upper Limb Articular Synergies....Pages 53-57 GREFIT: Visual Recognition of Hand Postures....Pages 61-72 Towards Imitation Learning of Grasping Movements by an Autonomous Robot....Pages 73-84 A Line-Scan Computer Vision Algorithm for Identifying Human Body Features....Pages 85-96 Hand Posture Recognition in a Body-Face Centered Space....Pages 97-100 Vision-Based Gesture Recognition: A Review....Pages 103-115 Person Localization and Posture Recognition for Human-Robot Interaction....Pages 117-128 Statistical Gesture Recognition Through Modelling of Parameter Trajectories....Pages 129-140 Gesture Recognition for Visually Mediated Interaction....Pages 141-151 Interpretation of Pointing Gestures: The PoG System....Pages 153-157 Control of In-vehicle Systems by Gestures....Pages 159-162 French Sign Language: Proposition of a Structural Explanation by Iconicity....Pages 165-184 HMM-Based Continuous Sign Language Recognition Using Stochastic Grammars....Pages 185-196 A Method for Analyzing Spatial Relationships Between Words in Sign Language Recognition....Pages 197-209 Toward Scalability in ASL Recognition: Breaking Down Signs into Phonemes....Pages 211-224 A Complete System for the Specification and the Generation of Sign Language Gestures....Pages 227-238 Sign Specification and Synthesis....Pages 239-251 Active Character: Dynamic Reaction to the User....Pages 253-264 Reactiva’Motion Project: Motion Synthesis Based on a Reactive Representation....Pages 265-268 The Emotional Avatar: Non-verbal Communication Between Inhabitants of Collaborative Virtual Environments....Pages 269-273 Communicative Rhythm in Gesture and Speech....Pages 277-289 Temporal Symbolic Integration Applied to a Multimodal System Using Gestures and Speech....Pages 291-302 A Multimodal Interface Framework for Using Hand Gestures and Speech in Virtual Environment Applications....Pages 303-314 Stimulating Research into Gestural Human Machine Interaction....Pages 317-331 The need to improve communication between humans and computers has been instrumental in de ning new modalities of communication, and new ways of interacting with machines. Gestures can convey information for which other modalities are not e cient or suitable. In natural and user-friendly interaction, gesturescanbeused, asasinglemodality, orcombinedinmultimodalinteraction schemes which involvespeech, or textual media. Speci cation methodologiescan be developed to design advanced interaction processes in order to de ne what kind of gestures are used, which meaning they convey, and what the paradigms of interaction are. Research centred on gesture interaction has recently provided signi cant technologicalimprovements, in particular: gesture capture and tra- ing (from video streams or other input devices), motion recognition, motion generation, and animation. In addition, active research in the elds of signal processing, pattern recognition, arti cial intelligence, and linguistics is relevant to the areas covered by the multidisciplinary research on gesture as a means of communication. Resulting fromathree-dayinternationalworkshopin Gif-sur-Yvette, France, with 80 participants from ten countries all over the world, this book presents contributions on gesture under the focus of human-computer communication. The workshop was run by Universit e Paris Sud, Orsay, on the lines of GW'96 at York University, UK, and GW'97 at Bielefeld University, Germany. Its purpose was to bring together scientists from researchand industrial organisationswo- ing on all aspects of gesture modelling and interaction. The book is organised in sixsections, coveringhumanperceptionandproductionofgesture, gestureloc- isation and movement segmentation, vision-based recognition and sign language recognition, gesture synthesis and animation, and multimodality. The papers in this text are organized in sections on human perception and production of gesture; localization and segmentation; recognition; sign language; gesture synthesis and animation; and multimodality.