摘要
对Hadoop平台下的MapReduce现有的调度器进行分析研究。针对LATE调度算法在分配节点执行落后任务的备份任务时的不足,结合Hadoop集群的异构性和工作负载的特殊性,在LATE调度算法的基础上提出了一种改进的LATE调度算法。对该算法进行实验和性能分析,表明该算法在完成时间和负载均衡方面有很大改进。
The existing schedulers of MapReduce on the Hadoop platform are analyzed. To consider the lack of LATE scheduling algorithm in allocating TaskTracker to execute backup tasks for backward tasks, combining with the particularity of Hadoop cluster heterogeneity and workload, an improved scheduling algorithm is proposed based on LATE scheduling algorithm. The experiments and performance analysis for the algorithm show that it has significantly improved in the com-pletion time and load balancing.
出处
《计算机工程与应用》
CSCD
2014年第4期86-89,131,共5页
Computer Engineering and Applications
基金
国家自然科学基金(No.60863003
No.61063042)
新疆维吾尔自治区自然科学基金(No.2011211A011)
