Logo image
Differential Impacts of Monologue and Conversation on Speech Emotion Recognition
期刊文章   開放取用(OA)

Differential Impacts of Monologue and Conversation on Speech Emotion Recognition

Woan-Shiuan Chien, Shreya G. Upadhyay, Wei-Cheng Lin, Carlos BussoChi-Chun Lee
IEEE Transactions on Affective Computing, 卷.16(2), 頁碼.485-498
2025

摘要

acoustic variability conversation emotion perception Monologue speech emotion recognition Software Human-Computer Interaction
The advancement of Speech Emotion Recognition (SER) is significantly dependent on the quality of emotional speech corpora used for model training. Researchers in the field of SER have developed various corpora by adjusting design parameters to enhance the reliability of the training source. For this study, we focus on exploring communication modes of collection, specifically analyzing spontaneous emotional speech patterns gathered during conversation or monologue. While conversations are acknowledged as effective for eliciting authentic emotional expressions, systematic analyses are necessary to confirm their reliability as a better source of emotional speech data. We investigate this research question from perceptual differences and acoustic variability present in both emotional speeches. Our analyses on multi-lingual corpora show that, first, raters exhibit higher consistency for conversation recordings when evaluating categorical emotions, and second, perceptions and acoustic patterns observed in conversational samples align more closely with expected trends discussed in relevant emotion literature. We further examine the impact of these differences on SER modeling, which shows that we can train a more robust and stable SER model by using conversation data. This work provides comprehensive evidence suggesting that conversation may offer a better source compared to monologue for developing an SER model.

檔案與連結 (1)

url
https://doi.org/10.1109/TAFFC.2024.3509138檢視
已出版(紀錄版本) 開放

相關連結

指標

1 檢視次數

詳細資料

Logo image