一种基于词典的搜索引擎系统动态更新模型

A MODEL FOR DYNAMIC INFORMATION UPDATING IN LEXICON BASED SEARCH ENGINE

基于词汇标注的特征项提取方法是中文信息处理的有效方法 ,但词汇的析取是基于词典的 ,词典的涵盖程度决定了词汇切分的准确率 .因而不断地学习新词汇、动态地维护词典 ,使整个中文信息处理系统具有自适应性和动态性就成了一个关键问题 .以搜索引擎系统为例 ,提出了一种基于词典动态变化的搜索引擎系统更新理论模型和实现模型 .相关实验表明 ,该模型对缩短搜索引擎信息库的更新时间。

Lexicon based feature extraction is an effective method in Chinese information processing. But it highly depends on the lexicon used. The coverage of a lexicon determines the correctness of word segmentation. Therefore, it is crucial to learn new words continuously and to update lexicon dynamically, making the whole Chinese information processing system more adaptive and dynamic. Proposed in this paper are an innovative theoretical model and the implementation model for dynamic information updating in lexicon based search engine. The results of testing show that this model can reduce the time for re establishing the information database and can greatly improve the precision of a search engine.