基于主题爬虫的网络舆情系统设计与实现

Design and implementation of network public opinion system based on theme crawler

网络舆情具有快速、广泛传播的特征,发酵扩散时间极短,若未及时发现并妥善处置,可能会引发网络舆情危机,造成严重的危害与影响。为净化网络环境,减少网络舆情爆发所产生的损失,文章以网络爬虫技术为基础,设计了基于主题爬虫的网络舆情监测管理系统。首先,文章阐述了此系统设计思路,分别介绍了系统架构设计、系统功能设计、系统安全设计3个方面内容。最后,文章依次给出了舆情采集、舆情监测、舆情分析、舆情预警、舆情处置5个主要功能的实现方法,旨在为相关部门科学监控与处置网络舆情提供可靠的软件系统。

Network public opinion is characterized by rapid and wide dissemination,often fermenting and spreading in a short time.Failure to detect and dealing with it properly in time may lead to a network public opinion crisis,causing serious harm and influence.In order to purify the network environment and reduce the losses caused by the outbreak of network public opinion,the article designs a network public opinion monitoring and management system based on theme crawler technology.Firsty,the design idea of this system is elaborated,and the three aspects of system architecture design,system function design and system security design are introduced respectively.Finally,the realization methods of five main functions,namely,public opinion collection,public opinion monitoring,public opinion analysis,public opinion warning and public opinion disposal,are given in order,aiming at providing a reliable software system for the relevant departments to scientifically monitor and dispose of network public opinions.