期刊文献+

大数据计算框架与平台分析

原文传递
导出
摘要 随着互联网、物联网等技术得到越来越广泛的应用,数据觃模不断增加,对数据的处理已无法由单台机器宋成,只能由多台机器共同承担计算仸务。本文对近几年来的大数据处理与分析的相关资料迚行整理研究,讨论了批处理计算、流计算、交互分析和图计算四种大数据计算模式,分析了不同的大数据计算模式下常用的计算框架与平台。
机构地区 西安文理学院
出处 《网络安全技术与应用》 2019年第9期47-49,共3页 Network Security Technology & Application
  • 相关文献

参考文献6

二级参考文献26

  • 1ZAGARIA M,BORTHAKUR D,SARMA J S,et al.Job Scheduling for Multi-User Map Reduce Clusters[R].USA:EECS Department,University of California,2009.
  • 2Hadoop.[EB/OL].[2013-08-24].http://hadoop.apache.org/docs/r1.2.1/capacity_scheduler.html#Overview.
  • 3ZAHARIA M,KONWINSKI A,JOSEPH A D,et al.Improving Map Reduce Performance in Heterogeneous Environments[C]//8th USENIX Symposium on Operation Systems Design and Implementation(OSDI).USA:ASM,2008:7.
  • 4CHAIKEN R,JENKINS B,LARSON P,et al.SCOPE:Easy and Efficient Parallel Processing of Massive Data Sets[J].Proceedings of the VLDB Endowment,2008,1(2):1265-1276.
  • 5ZAHARIA M,CHOWDHURY M,DAS T,et al.Resilient Distributed Datasets:A FaultTolerant Abstraction for in-Memory Cluster Computing[C]//Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation.USA:USENIX Association,2012:2-2.
  • 6XIN R S,ROSEN J,ZAHARIA M,et al.Shark:SQL and Rich Analytics at Scale[C]//Proceedings of the 2013 ACM SIGMOD International Conference on Management of data.USA:ACM Press,2013:13-24.
  • 7GONZALEZ J E,LOW Y,GU H,et al.Power Graph:Distributed Graph-Parallel Computation on Natural Graphs[C]//Proceedings of the 10th USENIX Symposium on Operating Systems Design and Implementation(OSDI).USA:USENIX Association,2012:17-30.
  • 8KREPS J,NARKHEDE N,RAO J.Kafka:A Distributed Messaging System for Log Processing[C]//Proceedings of the 6th International Workshop on Networking Meets Databases(Net DB).USA:ACM Press,2011.
  • 9PENG D,DABEK F.Large-Scale Incremental Processing Using Distributed Transactions and Notifications[C]//Proceedings of the 9th USENIX Symposium on Operating Systems Design and Implementation(OSDI).USA:USENIX Association,2010:1-15.
  • 10GUNDA P K,RAVINDRANATH L,THEKKATH C A,et al.Nectar:Automatic Management of Data and Computation in Datacenters[C]//Proceedings of the 9th USENIX Symposium on Operating Systems Design and Implementation(OSDI).USA:USENIX Association,2010:75-88.

共引文献56

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部