Logo image
Self-assessed affect recognition using fusion of attentional BLSTM and static acoustic features
Conference paper

Self-assessed affect recognition using fusion of attentional BLSTM and static acoustic features

Bo-Hao Su, Sung-Lin Yeh, Ming-Ya Ko, Huan-Yu Chen, Shun-Chang Zhong, Jeng-Lin Li and Chi-Chun Lee
Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, Vol.2018-September, pp.536-540
2018

Abstract

Affect recognition Attention mechanism BLSTM Computational paralinguistics Language and Linguistics Human-Computer Interaction Signal Processing Software Modeling and Simulation
In this study, we present a computational framework to participate in the Self-Assessed Affect Sub-Challenge in the INTER-SPEECH 2018 Computation Paralinguistics Challenge. The goal of this sub-challenge is to classify the valence scores given by the speaker themselves into three different levels, i.e., low, medium, and high. We explore fusion of Bi-directional LSTM with baseline SVM models to improve the recognition accuracy. In specifics, we extract frame-level acoustic LLDs as input to the BLSTM with a modified attention mechanism, and separate SVMs are trained using the standard ComParE 16 baseline feature sets with minority class upsampling. These diverse prediction results are then further fused using a decision-level score fusion scheme to integrate all of the developed models. Our proposed approach achieves a 62.94% and 67.04% unweighted average recall (UAR), which is an 6.24% and 1.04% absolute improvement over the best baseline provided by the challenge organizer. We further provide a detailed comparison analysis between different models.

Metrics

1 Record Views

Details

Logo image