摘要
互联网发展至今已成为人类日常工作与生活中获取信息的主要途径之一。传统的信息获得方式主要是用户使用搜索引擎搜索信息,这种方式虽然具有出色的搜索速度,但也存在着搜索信息与所需信息契合度不高、信息未进行有效分类等不足。因此,如何提升用户信息搜索的质量就成为了互联网从业者当前关注的重点,而其中的很多人都将研究重点放在了通过系统层面改善用户信息获取质量上。笔者介绍一种基于Python的网络爬虫系统的设计要求,具体阐述如何实现信息的高质量获取。
The development of Internet has become one of the main ways to obtain information in daily work and life. The traditional way of obtaining information is that users use search engines to search information. This way, although it has excellent search speed, there are also shortcomings such as poor matching degree of search information and required information and no effective classification of information. Therefore, how to improve the quality of user information search has become the focus of Internet practitioners, and many of them focus on improving the quality of user information acquisition through the system level. The author introduces the design requirements of a web crawler system based on Python, and specifically describes how to achieve high quality information acquisition.
作者
刘杰
葛晓玢
闻顺杰
Liu Jie;Ge Xiaobin;Wen ShunJie(Department of Information Engineering,Tongling Polytechnic,Tongling Anhui 244061,China)
出处
《信息与电脑》
2018年第12期92-93,96,共3页
Information & Computer
基金
2017铜陵职业技术学院科研重点项目"基于网络爬虫的Web漏洞扫描的研究与设计"(项目编号:tlpt2017NK002)
2016安徽省教研一般项目"基于‘以赛促改
以赛促练
以赛促教
以赛促学’协同的高职网络技术专业实践教学模式构建与实施"(项目编号:2016jyxm1063)