Hadoop云平台下基于LATE改进的推测执行算法

Improved Speculated Scheduling Algorithm Based on LATE of Hadoop Cloud Platform

为解决Hadoop云平台下推测执行算法的不足,基于LATE算法提出一种新的任务进度计算方法,并且采用更细粒度的方式选择执行备份任务的节点。实验结果表明,该算法能够更精准的选定掉队者任务并选择合适的执行节点,缩短作业的执行时间,提高云平台的效率。

In order to improve the limitation of speculated scheduling algorithm of Hadoop cloud platform,a new task process algorithm based on LATE was proposed and notes of backup task were selected by adopting more fine-grained way. The experiment results showed that such algorithm could more accurately select the stragglers and choose proper executing mote,shorten executing time and improve the efficiency of cloud platform.