Logo image
An Intelligent Infrastructure Toward Large Scale Naturalistic Affective Speech Corpora Collection
Conference paper

An Intelligent Infrastructure Toward Large Scale Naturalistic Affective Speech Corpora Collection

Shreya G. Upadhyay, Woan-Shiuan Chien, Bo-Hao Su, Lucas Goncalves, Ya-Tse Wu, Carlos Busso and Ali N. Salman
2023

Abstract

Speech Emotion Recognition;Database Consortium;Affective Computing

The field of speech emotion recognition (SER) aims to create scientifically rigorous systems that can reliably char- acterize emotional behaviors expressed in speech. A key aspect for building SER systems is to obtain emotional data that is both reliable and reproducible for practitioners. However, aca- demic researchers encounter difficulties in accessing or collecting naturalistic large-scale, reliable emotional recordings. Also, the best practices for data collection are not necessarily described or shared when presenting emotional corpora. To address this issue, the paper proposes the creation of an affective database consortium (ADC) that can encourage multidisciplinary coopera- tion among researchers and practitioners in the field of affective computing. This paper’s contribution is twofold. First, it proposes the design of the ADC with a customizable-standard framework for intelligently-controlled emotional data collection. The focus is on leveraging naturalistic spontaneous recordings available on audio-sharing websites. Second, it presents as a case study the development of a naturalistic large-scale Taiwanese Mandarin podcast corpus using the customizable-standard intelligently- controlled framework. The ADC will enable research groups to effectively collect data using the provided pipeline and to con- tribute with alternative algorithms or data collection protocols.

Metrics

1 Record Views

Details

Logo image