基于G^4 ICCS系统的数据挖掘并行算法

Data Mining Parallel Algorithm Based on G^4 ICCS

针对传统决策树SPRINT(Scalable Parallelizable Induction of Decision Trees)算法不能处理海量地学数据挖掘的问题,设计实现了基于G4ICCS(Geology Geography Geochemistry Geophysics Information Cloud ComputingSystem)的决策树并行分类算法PSPRINT。该算法使用哈希表存储连续属性分割点两侧的数据记录,为并行节点的分割提供依据,在MapReduce架构下解决了海量地学数据挖掘问题。实验结果表明,在模拟的云计算环境下,决策树并行算法可以处理海量地学数据分类问题,并获得较好的稳定性和较高的处理速度。

For the traditional decision tree SPRINT （Scalable Parallelizable Induction of Decision Trees ） algorithm cannot solve the problem of mass geoscience data mining, the paper designed and realized PSPRINT algorithm. It is a decision tree parallel classification algorithm based on G4 ICES （Geology Geography Geochemistry Geophysics Information Cloud Computing System）. The algorithm uses hash table to save data record on both sides of continuous attributes pointof division, providing basis for the division of parallel node, and solved mass geoscience data mining problem. The experimental results show that the decision tree parallel algorithm can deal with the classification problem of mass geoscience data under the simulated environment of cloud computing. And the algorithm has better stability and processing speed.