融合句法特征的汉-老双语词语对齐算法研究

A Research of Laos-Chinese Bilingual Word Alignment Algorithm Based on Syntax Features

词语对齐技术一直是自然语言处理的基础问题。为实现汉―老双语自动词对齐,首先对老挝语存在的修饰词与中心词顺序倒置、结构和位置上的差异性等特征进行了分析,通过分析筛选出一些汉―老双语特征并将这些特征融合,对其构建特征函数,以最小错误率算法为条件,在对数线性模型框架下训练模型参数,将IBM3模型作为基础比较模型,通过逐步添加特征函数从而实现与基础模型的对比。实验证明,该方法可有效提高汉-老双语词对齐质量。

Word alignment has been regarded as one of the basic problems in natural language processing.In order to realize Laos-Chinese bilingual automatic word alignment,this paper analyzes the features of the inverted order of modifiers and central words in sentences and the differences in structure and location of the Lao.By summarizing the above characteristics,we selecte some of the Laos-Chinese bilingual features and fused these features,constructed feature function and trained the model parameters by the minimum error rate algorithm under the framework of Log-Linear model,based on IBM Model 3.During the experiment,we achieve the contrast to the underlying model by adding feature functions to the alignment model step by step.Experimental results show that this algorithm can effectively improve the quality of the Laos-Chinese bilingual word alignment.