Logo image
Advancing Multi-Criteria Chinese Word Segmentation Through Criterion Classification and Denoising
Conference paper   Open access

Advancing Multi-Criteria Chinese Word Segmentation Through Criterion Classification and Denoising

Tzu-Hsuan Chou, Chun-Yi Lin and Hung-Yu Kao
Proceedings of the Annual Meeting of the Association for Computational Linguistics, Vol.1, pp.6460-6476
2023

Abstract

Computer Science Applications Linguistics and Language Language and Linguistics
Recent research on multi-criteria Chinese word segmentation (MCCWS) mainly focuses on building complex private structures, adding more handcrafted features, or introducing complex optimization processes. In this work, we show that through a simple yet elegant input-hint-based MCCWS model, we can achieve state-of-the-art (SoTA) performances on several datasets simultaneously. We further propose a novel criterion-denoising objective that hurts slightly on F1 score but achieves SoTA recall on out-of-vocabulary words. Our result establishes a simple yet strong baseline for future MCCWS research. Source code is available at https://github.com/IKMLab/MCCWS.
url
https://doi.org/10.18653/v1/2023.acl-long.356View
Published (Version of record) Open

Related links

Metrics

1 Record Views

Details

Logo image