基于公有云的微博网络爬虫及舆情可视化分析实验平台设计

Design of Micro-blog Web Crawler Based on Public Cloud and Experimental Platform for Visual Analysis of Public Opinion

网络新媒体专业为顺应移动互联媒介融合的趋势而产生的新闻传播类新专业,旨在培养将新闻传播理论知识与实践技能高度结合的新媒体人才。但现有实验教学环境中,普遍缺乏综合性的数据新闻实训平台,无法实现链路化的智媒体实训。为此,本文基于公有云平台,设计了一套以提高网络新媒体专业学生学习兴趣和领会当前云计算、大数据语境下数据新闻报道的前沿技术和发展方向的实验项目。该项目包括公有云平台的虚拟环境搭建、网络爬虫编程、新浪微博评论数据自动采集、舆情分析和数据可视化等模块,形成了智媒体传播、媒介融合等创新实践特点的综合性实验项目。实践结果表明,该项目有利于提升学生的媒介素养、新闻报道实践能力和创新能力。

In order to adapt to the trend of mobile Internet media convergence, the new specialty of network new media is designed to train new media talents by combining the theoretical knowledge and practical skills of news communication. However, in the current experimental teaching environment, there is a general lack of comprehensive data news training platform, which cannot realize the linking of intelligent media training. Therefore, this paper, based on the public cloud platform, designs a set of experimental projects to enhance the learning interest of the students majoring in network new media and to acquire the frontier technology and development direction of news reporting in the context of present cloud computing and big data. The project includes virtual environment construction of public cloud platform, Web crawler programming, automatic data collection of Sina Weibo comments, public opinion analysis and data visualization modules, and forms a comprehensive experimental project with innovative practical characteristics such as intellectual media communication and media convergence. The final result of teaching practice shows that the project is conducive to improving students’ media literacy, practical ability of news reporting and innovation ability.