摘要
The paper proposes the research on the distributed vertical search and information integration technology based on Web mining, which aims at satisfying the requirements of the spe- cific fields' applications. Nowadays, mining, analyzing, and inte- grating Web's content have become an important trend for daily use. The technique includes the Map/Reduce model, the depth search, and the basic principles of information integration. The focus of the paper is how to implement the distributed vertical search engine based on Map/Reduce technology and the informa- tion integration system. System optimization mechanism and the system test are also proposed.
The paper proposes the research on the distributed vertical search and information integration technology based on Web mining, which aims at satisfying the requirements of the spe- cific fields' applications. Nowadays, mining, analyzing, and inte- grating Web's content have become an important trend for daily use. The technique includes the Map/Reduce model, the depth search, and the basic principles of information integration. The focus of the paper is how to implement the distributed vertical search engine based on Map/Reduce technology and the informa- tion integration system. System optimization mechanism and the system test are also proposed.
基金
Supported by China National Earthquake Project(201008007)