Logo image
Sound event detection by consistency training and pseudo-labeling with feature-pyramid convolutional recurrent neural networks
Conference paper

Sound event detection by consistency training and pseudo-labeling with feature-pyramid convolutional recurrent neural networks

Chih-Yuan Koh, You-Siang Chen, Yi-Wen Liu and Mingsian R. Bai
ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, Vol.2021-June, pp.376-380
2021

Abstract

CRNN Feature pyramid Semi-supervised learning Sound event detection Weakly supervised learning Software Signal Processing Electrical and Electronic Engineering
Due to the high cost of large-scale strong labeling, sound event detection (SED) using only weakly-labeled and unlabeled data has drawn increasing attention in recent years. To exploit large amount of unlabeled in-domain data efficiently, we applied three semi-supervised learning strategies: Interpolation consistency training (ICT), shift consistency training (SCT), and weakly pseudo-labeling. In addition, we propose FP-CRNN, a convolutional recurrent neural network (CRNN) which contains feature-pyramid (FP) components, to leverage temporal information by utilizing features at different scales. Experiments were conducted on DCASE 2020 task 4. In terms of event-based F-measure, these approaches outperform the official baseline system, at 34.8%, with the highest Fmeasure of 48.0% achieved by an FP-CRNN that was trained with the combination of all three strategies.

Metrics

1 Record Views

Details

Logo image