大数据下的Web数据集成及数据挖掘技术研究

Research on Web Data Integration and Data Mining Technology under Big Data

21世纪以来,网络信息技术取得了突飞猛进的进步,移动互联网、物联网为代表的新型服务行业开始发展,Web数据也迅猛增长,成为人们关注的焦点之一。Web数据背后巨大的隐藏价值逐渐被人们关注,对Web数据进行集成和挖掘成为行业人士的工作重点,在如今大数据时代,Web数据规模大、种类广、更新快,这使得Web数据的集成及挖掘面临重重挑战。笔者通过对Web数据的相关介绍,就大数据下的Web数据集成与挖掘面临的挑战进行分析。

Since the 21 st century, the network information technology has made rapid progress. The new service industry represented by the mobile Internet and the Internet of Things has begun to spread. The rapid growth of Web data has become one of the focuses of people＇s attention. The huge hidden value behind Web data is gradually being paid attention to. The integration and mining of Web data has become the focus of industry professionals. In the era of big data, Web data is large in scale, wide in variety, and updated quickly, which makes the integration of Web data. And mining faces many challenges. The author describes the challenges faced by Web data integration and mining under big data by introducing Web data.