云环境下Hadoop平台的作业调度算法

Hadoop Platform Job Scheduling Algorithm Under Cloud Computing

云计算的研究和应用将有一片广阔的前景,详细研究和分析了Hadoop平台架构和核心原理,研究了Hadoop现有的典型作业调度算法,并针对算法存在需要预先配置的问题,提出了基于朴素贝叶斯分类的作业调度算法,通过仿真实验,可以看出改进的算法具备了良好的学习能力,性能良好,可以减轻管理员的负担,提高管理效率,减少人工错误的可能性.

Faced with the broad prospect in research ＆ application of cloud computing, the paper has studied and analyzed architecture and core principle of Hadoop platform, and its existing typical job scheduling algorithm. Furthermore, to resolve the pre-configuration issue of the algorithm, improved algorithm is proposed based on Naive-Bayes classification. According to the simulation test result, the improved algorithm is proven to be with satisfied performance, easy to leam. It may reduce administrator＇s workload, improve management efficiency, and reduce human error.