基于Spark框架的网络大数据分类处理方法研究

Research on Classification Processing Method of Network Big Data Based on Spark Framework

传统分类方法对于动态数据处理能力较差,无法得到高精度分类结果.针对此情况,设计基于Spark框架的网络大数据分类处理方法.通过构建网络大数据分类处理平台与网络数据分类器,完成网络大数据分类处理过程.经实验结果证实,Spark框架分类方法使用效果较好,能够实现高精度数据处理.

The current classification methods have poor processing ability for dynamic data,and cannot get high-precision classification results.In view of this situation,a classification processing method of network big data based on Spark framework is designed.Through the construction of network big data classification processing platform,network data classifier and network data classification processing,the network big data classification processing process is completed.Experimental results show that Spark framework classification method is effective and can achieve high-precision data processing.