门户网站分布式数据挖掘云平台架构分析

Architecture Analysis of Cloud Platform Distributed Data Mining of Portal Websites

数据采集与存储、数据预处理、数据挖掘算法并行化、数据输出与应用等是数据挖掘的核心技术。在移动云时代,门户网站分布式数据挖掘云平台架构通常由数据源、大数据挖掘平台和客户端三大层级组成,并通过DNS超级代理、CDN云计算化、访问记录与日志分析、用户数据动态分发网络等实现数据挖掘与智能调度。

Data collection and storage, data preprocessing, data mining algorithm parallelization, data output and application are the core technologies of data mining. In the mobile cloud era, the distributed data mining cloud platform architecture of portal site is usually composed of data source, large data mining platform and client three levels, and through DNS super agent, CDN cloud computing, access record and log analysis, user data dynamic distribution network and other to realize data mining and intelligent scheduling.