Encoding and Decoding of Emotional Speech: A Cross-Cultural and Multimodal Study between Chinese and Japanese (Prosody, Phonology and Phonetics)

This book addresses the subject of emotional speech, especially its encoding and decoding process during interactive communication, based on an improved version of Brunswikℓ́ℓs Lens Model. The process is shown to be influenced by the speakerℓ́ℓs and the listenerℓ́ℓs linguistic and cultural backgrounds, as well as by the transmission channels used. Through both psycholinguistic and phonetic analysis of emotional multimodality data for two typologically different languages, i.e., Chinese and Japanese, the book demonstrates and elucidates the mutual and differing decoding and encoding schemes of emotional speech in Chinese and Japanese This book addresses the subject of emotional speech, especially its encoding and decoding process during interactive communication, based on an improved version of Brunswikĺls Lens Model. The process is shown to be influenced by the speakerĺls and the listenerĺls linguistic and cultural backgrounds, as well as by the transmission channels used. Through both psycholinguistic and phonetic analysis of emotional multimodality data for two typologically different languages, i.e., Chinese and Japanese, the book demonstrates and elucidates the mutual and differing decoding and encoding schemes of emotional speech in Chinese and Japanese Front Matter....Pages i-xxiii Introduction....Pages 1-32 Perception of Multimodal Emotional Expressions By Japanese and Chinese....Pages 33-83 Emotional McGurk Effect? A Cross-Culture Study on Conflicting AV Channel....Pages 85-107 Acoustic and Articulatory Analysis of Emotional Vowels....Pages 109-132 Emotional Intonation and Its Boundary Tones in Chinese....Pages 133-164 Emotional Intonation Modeling: Applying PENTA Model to Chinese and Japanese Emotional Speech....Pages 165-188 Conclusion and Outlook....Pages 189-197 Back Matter....Pages 199-229