摘要
调度问题是目前云计算研究中的热点问题,其目的是如何协同云计算资源,使其得到充分合理的利用。数据局部性是特定云平台Hadoop的主要特性之一。针对该特性,在Hadoop原有调度算法LATE的基础上提出了一种基于数据局部性的改进算法,以解决数据局部性带来的慢任务备份执行时读取数据要占用大部分时间而影响其处理速率的问题。最后,对该算法进行了实验及性能分析,并验证了算法在提高任务的响应时间和整个系统吞吐率方面有很大改进。
In the present,scheduling problem is a hot cloud computation research issues,and the purpose is to coordinate the cloud computation resources to be fully rational use.Data locality is one of the main properties in the particular cloud platform for Hadoop.The paper discussed the property,proposed a new improvement of the Hadoop relevant data locality scheduling algorithm based on LATE.The algorithm mainly soves the bakeup of slow task performance pro-blem which arises during the implementation of data read,taking most of the time and envently influencing its processing speed.Finally,carried on experiment to the algorithm and analyzed the funcation,verified the algorithm to improve the response time and the whole system throughput.
出处
《计算机科学》
CSCD
北大核心
2011年第11期67-70,共4页
Computer Science
基金
国家工信部核高基项目(2009ZX01038-001)资助