探析中文信息处理中的“词”及分词标准问题——试比较《分词规范》与《正词法》

A Probe into "Words" and Word Segmentation Norm in Chinese Information Processing——A Comparison of Word Segmentation Norm and Orthography

《分词规范》与《正词法》1在中文信息处理中有着同样重要作用,两者既有各自的侧重点又存在一些共性的,两者所规定的词均与"语法词"、"词汇词"存在着联系,但《正词法》规定的分词连写方式并不能够解决中文信息处理的分词问题,只有充分利用《正词法》的研究成果,再结合中文信息处理的特点,才能使《分词规范》更加完善,促进中文信息处理分词问题的解决。

Word Segmentation Norm and Orthography both play a key role in Chinese information processing,the former representing word segmentation,the latter representing word segmentation in concatenation of a word in Chinese phonetic alphabet.Based on the comparisons of Word Segmentation norm and Orthography,the article probes into the features of ＂words＂ and Word Segmentation Norm in Chinese information processing as well as the enlightenment to Chinese information word segmentation processing.