垂直搜索引擎在节能减排领域中的设计与实现

Design and Implementation of a Vertical Search Engine in the Field of Energy-Saving and Emission-Reduction

在研究垂直搜索引擎的设计思想、相关技术的基础上,利用Nutch开源框架设计实现了节能减排垂直搜索引擎的设计,支持了对节能减排相关信息的检索服务。系统采用网页模板技术对网页信息进行提取,采用改进的TF-IDF算法提取特征词,利用基于特征词的向量空间模型进行主题相关性判定,利用朴素贝叶斯算法对网页信息进行分类。

Based on the research on design concept and related technologies of vertical search engines,the vertical search engine used for energy-saving and emission-reduction is designed,with the help of Nutch open source framework design,in order to support for information retrieval services related to energy-saving and emission-reduction. This system uses a Web page template technology to extract Web information,and the improved TF-IDF algorithm is adopted to extract key words; vector space model based on the key words is utilized to test subject correlation,and finally the naive bayesian classifier algorithm can help to classify Web information.