摘要
随着计算机网络的发展,包含有音频等多种信息形式的动态页面广泛应用,动态页面的应用为页面数据提取带来了一定难度。针对分布式数据库的特点从大数据网络平台中建立了一套动态页面数据生成系统,首先用MapReduce方法对分布式数据库的大数据进行了预处理,之后根据页面JavaScript脚本特点建立了脚本提取子系统,结合分布式数据存储方式建立了动态页面信息采集系统,最后对系统功能进行了测试分析。
With the development of computer network,the dynamic page with audio and other information forms is widely used.The application of dynamic page brings some difficulties for page data extraction.According to the characteristics of distributed database,a set of dynamic page data generation system is established from the big data network platform.Firstly,the MapReduce method is used to preprocess the big data of distributed database,then the script extraction subsystem is established according to the characteristics of page JavaScript script,and the dynamic page information collection system is established by combining the distributed data storage method.Finally,the system function is tested and analyzed.
作者
苏莉娜
SU Lina(Jiangsu Second Chinese Medicine Hospital, Nanjing 210019, China)
出处
《微型电脑应用》
2021年第6期194-197,共4页
Microcomputer Applications
关键词
动态页面
脚本提取
系统
测试
dynamic page
script extraction
system
test
