Logo image
應用多任務與多模態融合技術於候用校長演講自動評分系統之建構
Thesis

應用多任務與多模態融合技術於候用校長演講自動評分系統之建構

蕭善文
Masters, 國立清華大學, 電機工程學系
2016

Abstract

人類行為訊號處理 教育研究 口頭演講 多模態訊號處理 多任務學習 behavioral signal processing educational research oral presentation multimodal signal processing multi-task learning
Developing computational models of human behaviors for experts in many science fields has been at the forefront of several interdisciplinary research. In this work, we collaborate with researchers from National Academy for Educational Research (NAER) to develop an automatic scoring system for pre-service principals’ impromptu speech at the certification program. We propose a dense unit-level feature extraction and session-level encoding methods to characterize principals’ multimodal behavior. Moreover, we extend the framework by two direction. First, with inspiration from the psychological evidence in human’s decision-making mechanism, we assign confidence scores outputted from classifier as the predicted scores to all the speech. Secondly, as recent works on multi-task learning have been successfully utilized in many fields, we leverage other training tasks of the certification program to incorporate information about these new targets and achieve better performance of our scoring system. All the experiments demonstrate that our framework indeed has capability in handling high-level and subjective attributes.

Metrics

1 Record Views

Details

Logo image