期刊文献+

Hadoop云计算平台的参数优化算法 被引量:1

Cross-layer parameter optimization algorithm for Hadoop cloud computing platform
下载PDF
导出
摘要 为提高Hadoop云计算平台的性能,该文提出了一种跨层的参数优化模型.首先分析了云计算平台的工作流程,将系统参数与流程对应,并加入基础设施即服务与平台即服务层的参数,找出对Hadoop集群效率作用显著的参数,并把这些参数值作为性能参数,构建成性能参数模型,再用启发式蚁群算法搜寻性能较优的可行参数,并不断修正,找出最佳参数组合,最后整合跨层的参数来提高Hadoop云计算平台的性能.实验表明,该算法可行,性能优良. In order to improve the performance of the Hadoop cloud computing platform,aparameter optimization model is presented for across layer of IaaS,PaaS and SaaS.Firstly,the work flow of cloud computing platform is analyzed,to make the system parameters correspond to the flow.The parameters of IaaS and PaaS layer are added and parameters which significant impact on Hadoop execution time are found.Performance parameter model is formed based on the above parameters and optimized by Heuristic ant colony algorithm.Finally,cross layer parameters are integrated to improve the performance of Hadoop cloud computing platform.Experiments show that the algorithm is feasible and perform well.
出处 《华中师范大学学报(自然科学版)》 CAS 北大核心 2016年第2期183-189,共7页 Journal of Central China Normal University:Natural Sciences
基金 国家自然科学基金项目(61472135)) 广东省科技计划项目(2014B010102007)
关键词 Hadoop云计算 参数最优化 蚁群优化算法 虚拟机 Hadoop cloud computing parameter optimization ant colony system virtual machine
  • 相关文献

参考文献2

二级参考文献84

  • 1王庆波,金漳,何乐,等.虚拟化与云计算[M].北京:电子工业出版社,2010.
  • 2Apache Software Foundation. The apache hadoop project [ EB/OL]. [ 2010-06-20 ]. http://hadoop, apache, org/, as of 15/06/2009.
  • 3Wikipedia. Heterogeneous_network [ EB/OL ]. [ 2010-06-20 ]. http ://en. wikipedia, org/wiki/Heterogeneous_network.
  • 4Bhandarkar M, Gogate S, Bhat V. Hadoop performance tuning: a case study[ EB/OL]. [2010-06-20]. http://cloud, citris-uc, org/ system/files/private/BerkeleyPerformanceTuning, pdf.
  • 5Hadoop cluster setup [EB/OL]. [ 2010-06-20 ] . http: ff hadoop, apache, org/common/docs/current/cluster_setup, html.
  • 6Dean J, Ghemawat S. Mapreduce: simplified data processing on large clusters[ C]//Proc of OSDI. 2004: 137-150.
  • 7Chang F, Dean J, Ghemawat S, et al. B igtable: a distributed storage system for structured data [ J]. ACM Trans Comput Syst, 2005,26 (2) : 1-26.
  • 8Boulon J, Konwinski A, Qi R, et al. Chukwa, a large-scale monitoring system [ C ]//Cloud Computing and its Applications. Chicago, IL, October 2008 : 1-5.
  • 9Thusoo A, Sarma J S, Jain N, et al. Hive-A warehousing solution over a map-reduce framework [ J ]. PVLDB, 2009, 2 (2) : 1626-1629.
  • 10Hadoop. Powered by Hadoop [ EB/OL]. [ 2010-06-20 J. http : // wiki. apache, org/hadoop/FoweredBy.

共引文献46

同被引文献6

引证文献1

二级引证文献1

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部