基于大数据的热点话题舆情分析系统设计

Design of hot topic public opinion analysis system based on big data

文章着重阐述自主开发出的针对热点话题进行热度和情感分析的舆情分析系统。该系统适用于热点话题、有海量数据需求、需舆情监管效能等场景,具有热度分析、舆情情感倾向分析、动态监测和展示三大功能。采用爬虫技术、分布式系统、自然语言处理技术、深度学习、人工智能等技术,对热点话题进行挖掘。通过数据采集、数据预处理、自然语言处理、评分模型4步技术流程,最终得到热度和情感倾向分析等舆情结果,并将其进行可视化呈现,供用户监测舆情走向。系统较好地贴合了舆情特点,能及时、准确、全面、客观地向用户展示舆情结果。未来个人、企业、国家对于舆情的重视将会越来越高。随着相关技术的不断发展与深入,舆情分析技术也会展现出更为强大的活力。

This paper focuses on the self-developed public opinion analysis system for heat and emotion analysis of hot topics The system is suitable for hot topics, massive data needs, public opinion supervision efficiency and other scenes.It has three functions: heat analysis, public opinion emotional tendency analysis, dynamic monitoring and display. Use crawler technology, distributed system, natural language processing technology, deep learning, artificial intelligence and other technologies to mine hot topics. Through the 4-step technical process of data acquisition, data preprocessing,natural language processing and scoring model, the public opinion results such as heat and emotional tendency analysis are finally obtained and visually presented for users to monitor the trend of public opinion. The system fits well with the characteristics of public opinion and can display the results of public opinion to users in a timely, accurate,comprehensive and objective manner. In the future, individuals, enterprises and the state will pay more and more attention to public opinion. And with the continuous development and deepening of related technologies, public opinion analysis technology will also show more powerful vitality.