Logo image
Computational Analyses of Thin-sliced Behavior Segments in Session-level Affect Perception
期刊文章   同儕審查

Computational Analyses of Thin-sliced Behavior Segments in Session-level Affect Perception

Wei-Cheng LinChi-Chun Lee
IEEE Transactions on Affective Computing
03/2020

摘要

Correlation;Databases;Emotion recognition;emotion recognition;Encoding;Feature extraction;Medical treatment;multimodal behaviors;mutual information;Mutual information;thin-sliced affect perception Software Human-Computer Interaction

The ability to accurately judge another person&null emotional states with a short duration of observations is a unique perceptual mechanism of humans, termed as the thin-sliced judgment. In this work, we propose a computational framework based on mutual information to identify the thin-sliced emotion-rich behavior segments within each session and further use these segments to train the session-level affect regressors. Our proposed thin-sliced framework obtains regression accuracies measured in Spearman correlations of 0.605, 0.633, and 0.672 on session-level attributes of activation, dominance, and valence respectively. It outperforms framework using data of the entire session as baseline. The significant improvement in the regression correlations reinforces the thin-sliced nature of human emotion perception. By properly extracting the these emotion-rich behavior segments, we obtain not only an improved overall accuracy but also bring additional insights. Specifically, our detailed analyses indicate that this thin-sliced nature in emotion perception is more evident for attributes of activation and valence, and the within-session time distribution of emotion-salient behavior is located more toward the ending portion. Lastly, we observe that there indeed exists a certain set of behavior types that carry high emotion-related content, and this is especially apparent in the extreme emotion levels.

相關連結

指標

1 檢視次數

詳細資料

Logo image