期刊文献+

基于CMM模型的HDFS负载均衡策略 被引量:4

Load Balancing Strategy Based on CMM Model in HDFS
原文传递
导出
摘要 为实现Hadoop分布式文件系统的负载均衡,并保证较低的负载迁移代价和数据传输代价,提出了确定环境下多阶段多目标(CMM)决策模型.该模型以CPU、内存和磁盘剩余负载能力作为决策条件,以负载均衡效果、负载迁移代价和数据传输代价作为决策目标,依据决策节点间的影响关系构建有向无环图,通过多个决策阶段的决策,并计算方案效用确定最优均衡方案.仿真实验结果表明,基于CMM模型的负载均衡策略能取得较好的负载均衡效果、负载迁移代价和数据传输代价. In order to balance the load of Hadoop distributed file system with lower load migrating cost and data transmission cost, a certainty multi-stage and multi-object (CMM) decision model was pro- posed. The model is a directed acyclic graph built on decision nodes, which adopts the remaining load capacities of CPU, memory and disk as decision preconditions, and also adopts load balancing effect, load migrating cost and data transmission cost as decision targets. By CMM model, the best balancing plan is determined by selecting results of multiple decision stages and computing the plan usage. Simula- tions show that the CMM based strategy can achieve better load balancing effect, load migrating cost and data transmission cost.
出处 《北京邮电大学学报》 EI CAS CSCD 北大核心 2014年第5期20-25,共6页 Journal of Beijing University of Posts and Telecommunications
基金 国家科技重大专项项目(2012ZX03005010-003) 国家高技术研究发展计划项目(2014AA01A706)
关键词 分布式文件系统 负载均衡 决策模型 剩余负载能力 distributed file system load balancing decision model remaining load capacity
  • 相关文献

参考文献5

  • 1Wang Jun, Xiao Qiangju, Yin Jiangling, et al. DRAW: a new data-grouping-aware data placement scheme for data intensive applications with interest locality [ J ]. IEEE Transactions on Magnetics, 2013: 1-8.
  • 2刘琨,肖琳,赵海燕.Hadoop中云数据负载均衡算法的研究及优化[J].微电子学与计算机,2012,29(9):18-22. 被引量:19
  • 3姚婧,何聚厚.基于模糊聚类分析的云计算负载平衡策略[J].计算机应用,2012,32(1):213-217. 被引量:26
  • 4Rodrigo N, Calheiros, Rajiv Ranjan, et al. CloudSim: a toolkit for modeling and simulation of cloud computing en- vironments and evaluation of resource provisioning algo- rithms [ J ]. Software : Practice and Experience, 2011, 41 (1): 23-50.
  • 5Whait. Hadoop, the definitive guide [ M ]. [ s. 1. ] : O'Reilly Media, Inc, 2010: 573-575.

二级参考文献19

  • 1李冬梅,施海虎.负载平衡调度问题的一般模型研究[J].计算机工程与应用,2007,43(8):121-125. 被引量:15
  • 2GANNON D. Head in the clouds [ EB/OL]. [2011-04-05]. http://www. nature. com/uidfinder/10. 1038/449963a.
  • 3ZHENG G. Achieving high performance on extremely large parallel machines: Performance prediction and load balancing [ D]. Illinois: University of Illinois at Urbana Champaign, 2005.
  • 4BRYHNI H, KLOVNING E, KURE O. A comparison of load balancing techniques for scalable Web servers [ J]. IEEE Network, 2000, 14(4) : 58 -64.
  • 5WU RONGTENG, SUN JIZHOU, CHEN JINYAN. Parallel execution time prediction of the multitask parallel programs [ J]. Performance Evaluation, 2008, 65(10): 701-713.
  • 6WANG ZHOUJING, LI K W, WANG WEIZE. An Approach to multiattribute decision making with interval-valued intuitionistic fuzzy assessments and incomplete weights [J]. Information Science, 2009, 179(17) : 3026 -3040.
  • 7KANZAWA Y, ENDO Y, MIYAMOTO S. Fuzzy C-means algorithms for data with tolerance based on opposite criterions [ J]. IEICE Transactions on Fundamentals of Electronics, Communications and Computer Science, 2007, E90-A(10) : 2194 - 2202.
  • 8HASHEMI A B, MEYBODI M R. A note on the learning automata based algorithms for adaptive parameter selection in PSO [ J]. Applied Sott Computing, 2011, 11(1): 689 -705.
  • 9分布式基础学习[EB/OL]2009-02-22.http://www.cnblogs.com/duguguiyu/archive/2009/02/22/1396034.html.
  • 10Dhruba Borthakur. The hadoop distributed file sys- tem.- architecture and design [EB/OL]. (2008-09-02) [2010-08-25]. http://hadoop, apache, org/common/ docs/r0.16.0/hdfs_design, html.

共引文献43

同被引文献25

引证文献4

二级引证文献83

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部