基于CYK的藏语句法分析器研究与实现

Research and implementation of Tibetan sentence analyzer of CYK algorithm

句法分析是自然语言处理中一个很复杂的研究内容。藏语句法分析更是目前藏文信息处理中的一个基本问题,许多藏文信息处理任务都依赖着句法分析的精确度。文章根据常用的藏文短语,总结出一套基于短语结构语法的藏文单句规则库,然后在Windows平台上用C#实现基于CYK算法来分析和生成句法树的藏语句法分析器。实验结果表明,在人工标注的测试集上,藏语单句的句法分析准确率达到了81%。

Syntactic analysis is a very complex research content in natural language processing. The Tibetan sentence analysis is a basic problem in Tibetan information processing. Many Tibetan information processing tasks rely on the accuracy of syntactic analysis. According to the commonly used Tibetan phrases, this paper summarizes a set of Tibetan single sentence rule bases based on the phrase structure grammar. Then C# is used to implement the Tibetan sentence analyzer which uses CYK algorithm to parse and generate syntactic tree, on Windows platform. The experimental results show that the accuracy of the syntactic analysis of a single sentence in Tibetan reaches 81% on the manually labeled test set.