基于主题模型的网络信息源可视化分析研究

Research on Visualization Analysis of Network Information Sources Based on Topic Model

在科技情报收集过程中,网络信息源来源广泛且数据量庞大,对人工分析造成了巨大的压力。对从网络信息源采集的网页进行文本提取,过滤无关信息,使用主题模型对文本进行主题抽取,对抽取的主题进行可视化分析,提取出与需求相关的主题后对信息源进行分类分析。这一流程增强了信息处理能力,提高了情报收集的效率。

In the process of collecting scientific and technological information,the sources of network information are extensive and the amount of data is huge,which puts great pressure on manual analysis. This study extracts text and filters irrelevant information from web pages crawled from network information sources,and then uses topic model to extract text,then visually analyzes the extracted topics,after extracting the topics related to requirements,and classifies and analyzes the information sources. The processes enhances the information processing capability,and improves the efficiency of information collection.