Logo image
Exploring the Effectiveness of Pre-training Language Models with Incorporation of Diglossia for Hong Kong Content
期刊文章   同儕審查

Exploring the Effectiveness of Pre-training Language Models with Incorporation of Diglossia for Hong Kong Content

Yiu Cheong Yung, Ying-Jia LinHung-Yu Kao
ACM Transactions on Asian and Low-Resource Language Information Processing, 卷.24(7), 71
07/2025

摘要

Computer Science (all)
In this article, we present our works to create the first Hong Kong content-based public pre-training dataset and the experiments which resulted in the creation of ELECTRA-based models for commonly used languages in Hong Kong. The creation of pre-training dataset is required for us to study the effect of diglossia on Hong Kong language model, and this is the first ever study on the effect starting all the way from dataset creation phase. Our experiment shows that removing diglossia from pre-training data hurts model performance. We will release our data and models to encourage future studies in Hong Kong languages.

相關連結

指標

1 檢視次數

詳細資料

Logo image