Encoding and Decoding of Emotional Speech: A Cross-Cultural and Multimodal Study Between Chinese and Japanese

ISBN-13: 9783662517062 / Angielski / Miękka / 2016 / 229 str.

Aijun Li

Spis treści

List of Figures.- List of Tables.- Introduction.- Perception on Multimodal Emotional Expressions Between Japanese and Chinese.- Emotional McGurk Effect? A Cross-culture Study on Conflicting AV Channel.- Acoustic and Articulatory Analysis on Emotional Vowels.- Emotional Intonation and its Boundary Tones in Chinese.- Emotional Intonation Modeling: Applying PENTA Model to Chinese and Japanese Emotional Speech.- Conclusion and Outlook.- Appendix 1.  Chinese Emotional Recording Prompts.- Appendix 2.  Japanese EMA Emotional Recoring Prompts.- Appendix 3.  Confusion Matrices of Multimodal Emotional Perception.

O autorze

Professor Aijun Li is the director of Laboratory of Phonetics and Speech Science, Institute of linguistics, Chinese Academy of Social Sciences. Her academic interests include speech prosody, first and second language acquisition especially on phonetic aspects, emotional and expressive speech analysis. She obtained Bachelor and Master in CS from Tianjin University, Tianjin and Ph.D. from Jaist, Japan. She now serves as the associate editor of Chinese Journal of Phonetics, the vice President of Phonetics Association of China, the vice chair of the SIG-CSLP, the Executive Committee Members of international Association of Chinese Linguistics and the steering committee member of Oriental COCOSDA.

Blurb

This book addresses the subject of emotional speech, especially its encoding and decoding process during interactive communication, based on an improved version of Brunswik’s Lens Model. The process is shown to be influenced by the speaker’s and the listener’s linguistic and cultural backgrounds, as well as by the transmission channels used. Through both psycholinguistic and phonetic analysis of emotional multimodality data for two typologically different languages, i.e., Chinese and Japanese, the book demonstrates and elucidates the mutual and differing decoding and encoding schemes of emotional speech in Chinese and Japanese.