文章詳目資料

International Journal of Computational Linguistics And Chinese Language Processing THCI

  • 加入收藏
  • 下載文章
篇名 Modeling Taiwanese POS Tagging Using Statistical Methods and Mandarin Training Data
卷期 14:3
作者 Iunn, Un-gianTai, Jia-hungLau, Kiat-gakKao, Cheng-yanChen, Keh-jiann
頁次 237-256
關鍵字 Taiwan Southern MinMaximal Entropy Markov ModelHidden Markov Modelwritten TaiwanesePOS taggingTHCI Core
出刊日期 200909

中文摘要

英文摘要

In this paper, we introduce a POS tagging method for Taiwan Southern Min. We use the more than 62,000 entries of the Taiwanese-Mandarin dictionary and 10 million words of Mandarin training data to tag Taiwanese. The literary written Taiwanese corpora have both Romanized script and Han-Romanization mixed script, and include prose, novels, and dramas. We follow the tagset drawn up by CKIP.
We developed a word alignment checker to assist with the word alignment for the two scripts. It searches the Taiwanese-Mandarin dictionary to find corresponding Mandarin candidate words, selects the most suitable Mandarin word using an HMM probabilistic model from the Mandarin training data, and tags the word using an MEMM classifier.
We achieve an accuracy rate of 91.6% on Taiwanese POS tagging work, and we analyze the errors. We also discover some preliminary Taiwanese training data.

相關文獻