B2C垂直搜索引擎的网络爬虫设计

Design of Web Crawlers for B2C Vertical Search Engines

开发了基于Beautiful-Soup信息提取的B2C类垂直搜索引擎爬虫系统.测试结果表明:该爬虫的抓取有效率实际达到95%以上,满足商业应用的要求.

A vertical search engine web crawler system based on Beautiful-Soup information extraction technique is developed. Experiment results indicate that the effective rate of information extraction is up to 95% and can meet commercial requirements.