基于GLR算法的新型概率句法分析器

New probabilistic syntactic analysis parser based on GLR algorithm

为了提高句法分析器的分歧能力和分析准确率,结合上下文无关概率模型PCFG和头驱动概率模型HDSM各自的优点,提出了一种新型的概率模型PCFG_HDSM,并基于GLR算法,实现了一个新型的汉语句法分析器。在词性标注阶段,通过对助词的详细标注使部分歧义在规则阶段就被去除掉,提高了系统消歧的能力。经过开放测试,准确率和回归率分别达到82.8%、74.7%,与其他分析器分析结果比较有了较大提高,证明新模型PCFG_HDSM确实提高了分析器的分歧能力。

To improve the capacity of parser＇s processing disambiguity and the precision,this paper proposes a syntactic parsing model PCFG_HDSM based on GLR algorithm,the model combines the strongpoint of PCFG （Probabilistic Context-Free Grammar） and that of HDSM （Head-Driven Statistical Models）,and it also realizes a new syntactic parser for Chinese based on the new model.In the stage of words parsing,by adding detail information of auxiliary words into the rules some ambiguities are removed while processing the rules of system,by this way,the system obtains a high precision.In the opened test,the label precision and label recall are 82.8% and 74.7% respectively.Compared with the results of other Prop programs,it improves a lot.lt proves that the new model PCFG_HDSM can improve the capacity of parser＇s processing disambiguity.