基于改进SALS算法的大数据挖掘效率优化探究

Research on optimization of big data mining based on SALS algorism

移动互联网时代,各类移动网络终端的使用在为移动用户带来便利的同时,也为运营商提供了海量的可供挖掘数据来源。运用大数据技术对非结构、半结构、结构化数据进行数据挖掘,可以有效提高挖掘效率,帮助运营商找到潜在商机、提升用户体验、进行精确营销。针对大数据挖掘中存在的效率问题,提出了基于改进SALS算法的Hadoop推测调度,从而减少异构环境下的资源浪费,提高大数据挖掘效率。

In the Mobile Internet age, all kinds of network terminals bring convenience to the users and provide huge amount of data. Using Big Data technology to mine all the non-structured, half-structured, and structured data. The mobile operators could find potential business model, improve user＇s experience and make accurate sale. Aiming at solving efficiency problem in Hadoop speculation scheduling, this paper proposes an improved SAI.S algorithm to reduce resource wasting and improve big data mining efficiency.