智能化中文机械分词组件的设计

Design of Intelligent Mechanical Segmentation Module for Chinese Word

分词是计算机系统对自然语言处理的第一步，分词的方法与准确率将显著影响自然语言的处理效果。在分析机械分词技术的基础上，提出构建智能化机械分词组件的思想，论述构建智能化中文分词组件的基本思路与方法，指出智能化中文机械分词组件在中文信息处理领域中的应用前景。

The first step of natural language processing （NLP） on computer is the segmentation for word. It affects the effect of NLP evidently that which segmentation method is used and what its precision is. In this paper, based on the comparison of several commonly used segmentation methods for Chinese word, we propose the idea of building the intelligent mechanical segmentation module. We present the basic idea and methods of the intelligent mechanical segmentation module, and forecast its prospect of application in Chinese information processing.