期刊文献+

利用Zookeeper对HDFS中Namenode单点失败的改进方法 被引量:4

A method to avoid single failure of Namenode in HDFS using Zookeeper
下载PDF
导出
摘要 在大数据时代分布式处理的已经成为潮流,而Hadoop是一种应用十分广泛的分布式处理框架。但在Hadoop的使用中,Namenode的单点失败问题一直困扰着框架的使用者。本文提出了一种利用Zookeeper对Namenode进行冗余备份协同工作的处理方法,避免了Namenode单点失败造成的服务不可用与文件丢失问题。 In the age of big data, it has became a trend to use distributed processing to solve problems, and Hadoop is a widely used framework for distributed processing. But in the use of Hadoop, the failure of Namenode always feezes the users. In this paper, we use an open source framework, Zookeeper, to make Namenode redundant, and avoid the single point failure of Namenode which leads to the unavailable state of HDFS service.
作者 鲁阳 郑岩
出处 《软件》 2012年第12期192-196,共5页 Software
关键词 分布式系统 HADOOP HDFS Namenode失败 Zookeeper Distributed System Hadoop HDFS Namenode Failure Zookeeper
  • 相关文献

参考文献11

  • 1WEB T, et al. Hadoop Guide[M]. Yahoo Press, 2007.
  • 2胡光民,周亮,柯立新.基于Hadoop的网络日志分析系统研究[J].电脑知识与技术,2010,6(8):6163-6164. 被引量:17
  • 3王小森.基于Hadoop的海量日志处理[D].北京:北京邮电大学,2011.
  • 4The Apahce Software Foundation. Welcome to Apache Hadoop[OL]. [2011-3-11 ]. http ://hadoop. apache, org/ index, pdl.
  • 5MILLER M. Cloud Computing:Web-Based Applications that change the way you work and collaborate online[M]. Indianapolis: Que, 2008.
  • 6陈康,郑纬民.云计算:系统实例与研究现状[J].软件学报,2009,20(5):1337-1348. 被引量:1311
  • 7GHEMAWAT S, GOBIOFF H, LEUNG S. The Google File System[J]. ACM Sigpos Operating System Review, 2003, 37(5): 29- 43.
  • 8Baidu.Zookeeper介绍[OL].[2009].http://baike.baidu.com/view/3061646.htm.
  • 9王阿品,邹仕洪.基干ZooKeeper的配置信息存储方案的设计与实现[OL].[2011-08-5].http://www.paper.edu.cn.
  • 10邓鹏,李枚毅,何诚.Namenode单点故障解决方案研究[J].计算机工程,2012,38(21):40-44. 被引量:27

二级参考文献38

  • 1季根生.计算机系统日志自动分析的实现[J].铁路计算机应用,2007,16(3):48-50. 被引量:7
  • 2Sims K. IBM introduces ready-to-use cloud computing collaboration services get clients started with cloud computing. 2007. http://www-03.ibm.com/press/us/en/pressrelease/22613.wss
  • 3Boss G, Malladi P, Quan D, Legregni L, Hall H. Cloud computing. IBM White Paper, 2007. http://download.boulder.ibm.com/ ibmdl/pub/software/dw/wes/hipods/Cloud_computing_wp_final_8Oct.pdf
  • 4Zhang YX, Zhou YZ. 4VP+: A novel meta OS approach for streaming programs in ubiquitous computing. In: Proc. of IEEE the 21st Int'l Conf. on Advanced Information Networking and Applications (AINA 2007). Los Alamitos: IEEE Computer Society, 2007. 394-403.
  • 5Zhang YX, Zhou YZ. Transparent Computing: A new paradigm for pervasive computing. In: Ma JH, Jin H, Yang LT, Tsai JJP, eds. Proc. of the 3rd Int'l Conf. on Ubiquitous Intelligence and Computing (UIC 2006). Berlin, Heidelberg: Springer-Verlag, 2006. 1-11.
  • 6Barroso LA, Dean J, Holzle U. Web search for a planet: The Google cluster architecture. IEEE Micro, 2003,23(2):22-28.
  • 7Brin S, Page L. The anatomy of a large-scale hypertextual Web search engine. Computer Networks, 1998,30(1-7): 107-117.
  • 8Ghemawat S, Gobioff H, Leung ST. The Google file system. In: Proc. of the 19th ACM Symp. on Operating Systems Principles. New York: ACM Press, 2003.29-43.
  • 9Dean J, Ghemawat S. MapReduce: Simplified data processing on large clusters. In: Proc. of the 6th Symp. on Operating System Design and Implementation. Berkeley: USENIX Association, 2004. 137-150.
  • 10Burrows M. The chubby lock service for loosely-coupled distributed systems. In: Proc. of the 7th USENIX Symp. on Operating Systems Design and Implementation. Berkeley: USENIX Association, 2006. 335-350.

共引文献1350

同被引文献27

引证文献4

二级引证文献41

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部