Logo image
Utilizing Unlabeled Data and Synthetic Data for Bird Sound Detection: Consistency Training, Mean Teacher, and Domain Adaptation Techniques
Conference paper

Utilizing Unlabeled Data and Synthetic Data for Bird Sound Detection: Consistency Training, Mean Teacher, and Domain Adaptation Techniques

Fang-Ching Chen and Yi-Wen Liu
2023 Asia Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2023, pp.238-242
2023

Abstract

Hardware and Architecture Signal Processing Artificial Intelligence Computer Science Applications
Labeling onset and offset time and class information for audio files has always been a laborious task for sound event detection (SED) research. Therefore, it would be appealing to consider using strongly-labeled synthetic data and a large amount of unlabeled data when training a SED model. To utilize these data, previous research showed that mean-teacher based semi-supervised consistency training strategies could work with adversarial domain adaptation. However, the effectiveness has only been demonstrated in the domestic environment. In this work, we expand the scope of application to bird sound event detection in the natural environment. To achieve this, we established a synthetic strongly-labeled bird sound dataset consisting of 20 species. Then, we tuned the consistency training strategies and domain adaptation techniques that have been proven effective in the domestic environment to this new dataset. Our evaluation on the Eastern North American bird sound dataset resulted in an F1 score of >30%, which approaches the upper-bound performance that could be obtained when strongly-labeled data are assumed to be available. Thus, the strategies exhibit potential for advancing research in both indoor and outdoor SED.

Metrics

1 Record Views

Details

Logo image