期刊文献+

基于Storm和Hadoop的大数据处理架构的研究 被引量:16

Research on the Big Data Process Framework Based on Storm and Hadoop
下载PDF
导出
摘要 针对现有的大数据技术Storm和Hadoop,分析其内部实现机制,业务场景以及技术优缺点,提出一种基于Storm和Hadoop的新型大数据处理解决方案,以使得大数据处理更稳定,更高效,并对新型大数据解决方案进行性能测试,证明其高效性和稳定性,所以这种新型架构是高效、稳定、可行的。 Proposes a new solution which is based on the technology of the big data named Storm and Hadoop, analyses the internal implementation mechanism of the Hadoop and Storm, the business scenario, as well as the advantages and disadvantages of them. The new solution can make the processing of the big data more efficient and stable. Tests this new solution which can prove the high efficiency and stability of the solution. So the new solution is efficient, stable and viable.
出处 《现代计算机》 2015年第3期9-12,共4页 Modern Computer
关键词 大数据 STORM HADOOP 解决方案 Big Data Storm Hadoop Solution
  • 相关文献

参考文献4

二级参考文献38

  • 1韩东红,王国仁.数据流系统中卸载技术研究综述[J].计算机科学,2005,32(8):102-105. 被引量:3
  • 2张建萍,刘希玉.基于聚类分析的K-means算法研究及应用[J].计算机应用研究,2007,24(5):166-168. 被引量:123
  • 3邓华锋,刘云生,肖迎元.分布式数据流处理系统的动态负载平衡技术[J].计算机科学,2007,34(7):120-123. 被引量:12
  • 4Zaharia M,Borthakur D,Sarma J S,et,al.Job scheduling for multi-user mapreduce clusters [C].EECS Department,University of California, Berkeley,Tech.Rep,Apr 2009.
  • 5Tian C,Zhou H,He Y.A dynamic mapreduce scheduler for heterogeneous workloads [C]//Proceedings of the 2009 Eighth International Conference on Grid and Cooperative Computing,ser.GCC'09. Washington, DC, USA:IEEE Computer Society,2009:218-224.
  • 6http://developer.yahoo.com/blogs/hadoop/posts/2011/02/mapreduce-nextgen/.
  • 7Xuhui Liu,Jizhong Han.Implementing WebGIS on Hadoop:A case study of improving small file I/O performance on HDFS[Z].CLUSTER, 2009:1-8.
  • 8Xing Y,Zdonik S,Hwang J-H. Dynamic Load Distribution in the Borealis Stream Processor. In: ICDE, 2005
  • 9Cardellini V, Colajanni M, Yu P S. Load Balancing Techniques for Distributed Stream Processing Applications in Overlay Environments. In: Ninth IEEE International Symposium on Object and Component-oriented Real-time Distributed Computing, 2006
  • 10Tatbul N,Cetintemel U ,et al. Load Shedding in a Data Stream Manager. In: VLDB, 2003

共引文献61

同被引文献108

引证文献16

二级引证文献161

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部