期刊文献+

基于HADOOP分布式系统的数据处理分析 被引量:7

Analysis of Massive Data Processing based on Hadoop Cluster
原文传递
导出
摘要 各种信息数据在迅猛增长,云计算技术的出现为海量数据的处理提供了良好的解决方案。Hadoop是云计算技术中分布式并行编程框架的开源实现,它利用集群的并行计算和存储能力,高效的完成对海量数据的处理,云计算能够为社会创造出更大的价值。最后通过Hadoop组织廉价的计算机资源搭建了一个分布式云计算平台,具有高容错、高效性、高扩展性等优势,并完成对数据处理能力和平台可扩展性进行性能测试与分析。 With the rapid growth of information and data, cloud computing technology provides a fairly good solution for massive data processing. Hadoop, as an open source implementation of distributed parallel programming framework in cloud computing technology, could effeciently complete the processing of massive data by parallel computing and storage capacity of clusters. Cloud computing could create more value for the society. Finally with cheap computer resources a distributed cloud computing platform could be built up by Hadoop, and this has the superiorities of high fault-tolerance, high efficiency, high scalability. Meanwhile the performance test and analysis of data processing on Hadoop cluster is completed.
出处 《通信技术》 2013年第9期99-102,共4页 Communications Technology
关键词 云计算 HDFS MAP REDUCE 海量数据 cloud computing Hdfs Map/Reduce massive data
  • 相关文献

参考文献7

二级参考文献49

  • 1周锋,李旭伟.一种改进的MapReduce并行编程模型[J].科协论坛(下半月),2009(2):65-66. 被引量:14
  • 2虞云翔.嵌入式Linux系统中Overlay文件系统的实现[J].微电子学与计算机,2005,22(10):175-178. 被引量:3
  • 3韩德志,余顺争,谢长生.融合NAS和SAN的存储网络设计与实现[J].电子学报,2006,34(11):2012-2017. 被引量:23
  • 4HADOOP Wi-ki[EB/OL].[2009-07-01].http://wiki.apache.org/hadoop/.
  • 5GHEMAWAT S,GOBIOFF H,LEUNG S T.The google file system.[EB/OL].[2009-07-01].http://labs.google.com/papers/gfs.html.
  • 6DEAN Jean,GHEMAWAT S.Map/reduce:simplified data processing on large clusters[EB/OL].[2009-07-01].http://static.googleusercontent.com/external _ content/untrusted _ dlcp/labs.google.com/zh-CN//papers/mapreduce-osdi04.pdf.
  • 7Map/Reduce[EB/OL].[2009 -07 -01].http://wiki.apache.org/hadoop/HadoopMapReduce.
  • 8HDFS[EB/OL].[2009-07-10].http://wiki.apache.org/hadoop/ProjectDescription.
  • 9Yahoo! Launches world's largest hadoop production application[EB/OL].[2009 -07 -01].http://tinyurl.com/2hgzv7.
  • 10Applications powered by Hadoop[EB/OL].[2009-07-01].http://wiki.apache.org/hadoop/PoweredBy.

共引文献131

同被引文献46

引证文献7

二级引证文献41

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部