分布式全文检索技术的研究及应用

Research and application of distributed full-text retrieval technology

为有效解决分布式对海量数据的资源管理、共享资源并发访问控制以及如何对海量数据进行快速且准确的检索,提出一种基于zookeeper的分布式服务协调模型为分布式提供资源的管理和并发访问的控制,在lucene搜索引擎的基础上,采用组件技术并在BM25F算法的基础上添加时间因子分别对文档进行解析,创建索引和检索结果排序算法进行优化的方案。系统应用结果表明,该方案有效解决了分布式的资源管理和控制问题,提高了检索的效率和准确度。

To effectively solve the distributed data management of mass data,shared resources,concurrent access control,and to retrieve massive data quickly and accurately,a distributed service coordination model based on zookeeper was proposed for distributed resource management and concurrent access control.On the basis of the lucene search engine,component technology was used and time factor was added based on BM25F algorithm to parse document respectively,and the index and retrieval results sorting algorithm was created for optimization.The application of the system shows that the proposed scheme effectively solves the problem of distributed resource management and control,and improves the efficiency and accuracy of retrieval.