Logo image
Using sublexical translations to handle the OOV problem in machine translation
Journal article   Peer reviewed

Using sublexical translations to handle the OOV problem in machine translation

Chung-Chi Huang, Ho-Ching Yen, Ping-Che Yang, Shih-Ting Huang and Jason S. Chang
ACM Transactions on Asian Language Information Processing, Vol.10(3), 16
09/2011

Abstract

And sublexical translation Language model Machine translation Out-of-vocabulary words Phrase table Translation model Wildcard search query
We introduce a method for learning to translate out-of-vocabulary (OOV) words. The method focuses on combining sublexical/constituent translations of an OOV to generate its translation candidates. In our approach, wildcard searches are formulated based on our OOV analysis, aimed at maximizing the probability of retrieving OOVs' sublexical translations from existing resources of Machine Translation (MT) systems. At run-time, translation candidates of the unknown words are generated from their suitable sublexical translations and ranked based on monolingual and bilingual information. We have incorporated the OOV model into a state-of-the-art machine translation system and experimental results show that our model indeed helps to ease the impact of OOVs on translation quality, especially for sentences containing more OOVs (significant improvement). © 2011 ACM.

Metrics

1 Record Views

Details

Logo image