基于多特征融合和图匹配的维汉句子对齐

Uyghur Chinese Sentence Alignment Based on Multi Features and Optimal Matching

维吾尔语新闻网页与对应的中文翻译网页在内容上往往并非完全可比,主要表现为双语句子序列的错位甚至部分句子缺失,这给维汉句子对齐造成了困难。此外,作为新闻要素的人名地名很多是未登录词,这进一步增加了维汉句子对齐的难度。为了提高维汉词汇的匹配概率,作者自动提取中文人名、地名并翻译为维吾尔译名,构造双语名称映射表并加入维汉双语词典。然后用维文句中词典词对应的中文译词在中文句中进行串匹配,以避免中文分词错误,累计所有匹配词对得到双语句对的词汇互译率。最后融合数字、标点、长度特征计算双语句对的相似度。在所有双语句子相似度构成的矩阵上,使用图匹配算法寻找维汉平行句对,在900个句对上最高达到95.67%的维汉对齐准确率。

The content of Uyghur webpage news is usually partial comparable with the content of the Chinese counterpart.Uyghur sentence sequences may be shuffled or even partially missing in Chinese text,which cause some difficulties in mining parallel sentences（i.e.sentence bead）from bilingual news.Fist,to improve the word matching rate of this kind,person and location names in Chinese are extracted and translated into Uyghur to enhance bilingual mapping.Then we scan the Chinese sentences with translation of Uighur words and calculate the translation rate via string matching to avoid mistakes in Chinese word segmentation.The final similarity of a sentence pair is calculated by combining the word translation rate with the numbers,punctuations and length of sentences as features.Similarities of all the bilingual sentence pairs constructed a weight matrix.We used greedy algorithm and maximum weight matching algorithm in bipartite graph to find the parallel sentence pairs with highest probability.Our method achieves an accuracy of 95.67%in sentence alignment.