利用高频词和互信息面向特定领域提取多字词表达

The Extraction of Multiword Expression in Special Field with High Frequency Words and Mutual Information

在阐述了多字词表达定义的基础上,对面向特定领域的多字词表达提取的技术路线进行了详细说明。以大规模的真实文本为研究对象,利用领域高频词和互信息统计量提取多字词表达,确定了多字词表达的最大提取长度,并通过停用词表法对候选多字词表达进行噪声处理。实验结果表明:笔者提出的方法在处理对象规模、效率等方面均有所提高。

The definition of multiword expression is fixed in the paper. The technology of extracting multiword expression in special field is discussed in detail, which appeals to high frequency word and mutual information. The texts processed in the paper amount to G level. The computation of time for large corpora is linear. The result is preferable by manual judgement.