网络爬虫技术的理性思考及多元规制方法

Rational thinking and multiple regulation approaches of Web crawler technology

大数据时代,恶意爬取数据的现象屡见不鲜。这使得网络爬虫行为的规制问题更具研究意义。然而,当前学界对爬虫技术的应用存在一定的认知偏差,并过于夸大了法律规范的社会效果。对此,文章期望通过加强有关法律的体系整合、明确相关监管机构的权限划分、健全国家级数据中心群与数据共享网络、以及加强数据行业协商性“立法”的多元规制方法,促进数据产业的健康发展。

In the era of big data,malicious crawling of data is common.This makes the regulation of web crawler behavior more meaningful.However,there are some cognitive biases to the application of crawler technology in the current academic circles,and the social effect of legal norms is too exaggerated.Therefore,this paper expects to promote the healthy development of the data industry with the multiple regulation approaches which includes the strengthening the system integration of relevant laws,clarifying the division of authority of relevant regulatory agencies,building a national data center group and data sharing network,and strengthening the negotiated"legislation"in the data industry.