期刊文献+
任意字段
题名或关键词
题名
关键词
文摘
作者
第一作者
机构
刊名
分类号
参考文献
作者简介
基金资助
栏目信息

基于MapReduce编程模型的节点失效处理与优化

下载PDF
导出
摘要 云计算环境下对MapReduce编程模型和节点失效问题进行深入研究和实践。提出了使用基于失效规律的节点资源动态提供策略的方式,来解决任务服务器上点失效之后所带来的系统不能正常提供服务的问题,以此提高整个系统的高可用性,同时使服务器集群达到负载均衡的目的。进而实现基于MapReduce编程模型节点失效的优化。
作者 黄敬良
机构地区 烟台汽车工程职业学院现代教育技术中心
出处 《电脑编程技巧与维护》 2015年第2期77-78,共2页 Computer Programming Skills & Maintenance
关键词 MapReduce编程模型 节点失效 动态提供策略
分类号 TP393.05 [自动化与计算机技术—计算机应用技术]
  • 相关文献

参考文献4

  • 1Dean J,Ghemawat S.MapReduce:Simplified data processing on large clusters.In:Proc.of the 6th Symp.on Operating System Design and Implementation.Berkeley:USENIX Association,2004:137,150.
  • 2Apache.Apache hadoop.
  • 3Sandhya S V,Sanjay H A,etc.,Fault-Tolerant Master-Workers framework for MapReduce Applications,2009 International Conference on Advances in Recent Technologies in Communication and Computing,2009:931-933.
  • 4田冠华,孟丹,詹剑锋.云计算环境下基于失效规则的资源动态提供策略[J].计算机学报,2010,33(10):1859-1872. 被引量：69

二级参考文献19

  • 1Rochwerger B, Breitgand D, Levy E et al. The Reservoir model and architecture for open federated cloud computing. IBM Journal of Research and Development, 2009,53(4) : 1-17.
  • 2Daniel Nurmi, Rich Wolski, Chris Grzegorczyk et al. The eucalyptus open-source cloud computing system//Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid. 2009:124-131.
  • 3Armbrust M, Fox A, Griffith R et al. Above the clouds: A berkeley view of cloud computing. UC Berkley, USA: Technical Report No. UCB/EECS-2009-28, 2009:1-25.
  • 4Vaquero L M, Rodero-Merino L, Caceres Jet al. A break in the clouds: Towards a cloud definition. ACM SIGCOMM Computer Communication Review, 2009, 39(1): 50-55.
  • 5Irwin D, Chase J S, Grit L et al. Sharing networked resources with brokered leases//Proceedings of the USENIX Technical Conference. Boston, MA, USA, 2006:199-212.
  • 6Padala P, Shin K G, Zhu Xiao-Yun et al. Adaptive control of virtualized resources in utility computing environments//Pro ceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007. Lisbon, Portugal, 2007: 289-302.
  • 7Schroeder B, Gibson G A. A large-scale study of failures in high-performance computing systems//Proceedings of DSN2006. Philadelphia, Pennsylvania, USA, 2006:249-258.
  • 8Heath T, Martin R P, Nguyen T D. Improving cluster avail- ability using workstation validation//Proeeedings of the ACM SIGMETRICS. Marina Del Rey, California, USA, 2002. 217-227.
  • 9Tai A T, Tso K S, Sanders W H et al. Chau: A performability-oriented software rejuvenation framework for distributed applicatioas//Proceedings of the 35th DSN 2005. Yokohama, Japan, 2005.570-579.
  • 10Vaidyanathan K, Harper R E, Hunter S W et al. Analysis and implementation of software rejuvenation in cluster systems//Proceedings of the ACM SIGMETRICS 2001. Cambridge, MA, USA, 2001. 62-71.

共引文献68

电脑编程技巧与维护
2015年 第2期

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部