汉英双语库自动分段对齐研究

Automatic Chinese English Paragraph Segmentation and Alignment

双语库对齐是自然语言处理研究的重要课题之一 .其中 ,双语库段落对齐是指找出源文和译文中对应的翻译段落的对齐过程 .它上承篇章对齐 ,下接句子对齐 ,在整个双语库的对齐中起着承上启下的重要作用 .但由于种种原因 ,双语库段落对齐在当今研究中没有受到应有的重视 .直接进行通用的段落自动对齐具有相当的难度 ,也不必要 ,鉴于此 ,提出将段落对齐转化成分段对齐进行实现 .通过汉英词汇对之间的特征比较 ,首先找到可以用于汉英双语库分段的锚点词汇对 ,在此基础上 ,通过锚点词所在句子的匹配获得锚点句子对来进行分段 .实验结果表明 ,该方法具有良好的使用价值 。

The research on bilingual corpora is one of the most important topics in the field of natural language processing. Paragraph alignment is to find the translation paragraph pairs between source text and target text. Paragraph alignment is a necessary and important phase between section alignment and sentence alignment, but it is disregarded at present. This paper aims at dealing with this process. Because it is difficult and unnecessary to align paragraphs directly, this problem is changed into a “segmentation and alignment” one. This paper finds some anchors for segmentation first, and then matches the sentences which contain these anchors, finally checks the validity of the results and segments the texts into translation blocks. The experimental results show that the method can achieve good results and can also be applied to other language pairs.