期刊文献+

面向大数据的分布式流处理技术综述 被引量:16

Distributed Stream Processing and Technologies for Big Data:A Review
下载PDF
导出
摘要 随着大数据的到来,数据流处理技术又成为了新的研究热点.回顾了近期提出的面向大数据的流处理技术现状,并且从流处理模型上对这些技术进行了划分,重点分析了面向大数据的并行分布式的流处理模型的设计目标和架构,同时,重点讨论了并行分布式流处理模型的关键技术以及未来技术的展望. The era of big data is coming,and the users are more eager for fresh and low-latency processing results than ever.For this reason,this paper reviews the recent stream processing models for big data and focuses on the parallel-distributed processing models,and presents their design goals and architectures.Moreover,this paper discusses the main challenges in designing the paralleldistributed stream processing model and future work.
出处 《计算机研究与发展》 EI CSCD 北大核心 2014年第S2期1-9,共9页 Journal of Computer Research and Development
基金 国家自然科学基金项目(61402464) 中国博士后科学基金面上项目(2013M541076) 国家信息安全支撑计划项目(2013F107)
关键词 数据流 并行化 负载均衡 故障容错 大数据 data stream parallel-distributed load balancing fault-tolerance big data
  • 相关文献

参考文献17

  • 1孙大为,张广艳,郑纬民.大数据流式计算:关键技术及系统实例[J].软件学报,2014,25(4):839-862. 被引量:311
  • 2孟小峰,慈祥.大数据管理:概念、技术与挑战[J].计算机研究与发展,2013,50(1):146-169. 被引量:2378
  • 3Jeffrey Dean,Sanjay Ghemawat.MapReduce[J].Communications of the ACM.2008(1)
  • 4Arvind Arasu,Shivnath Babu,Jennifer Widom.The CQL continuous query language: semantic foundations and query execution[J].The VLDB Journal.2006(2)
  • 5Hari Balakrishnan,Magdalena Balazinska,Don Carney,U?ur ?etintemel,Mitch Cherniack,Christian Convey,Eddie Galvez,Jon Salz,Michael Stonebraker,Nesime Tatbul,Richard Tibbetts,Stan Zdonik.Retrospective on Aurora[J].The VLDB Journal.2004(4)
  • 6Daniel J. Abadi,Don Carney,Ugur ?etintemel,Mitch Cherniack,Christian Convey,Sangdon Lee,Michael Stonebraker,Nesime Tatbul,Stan Zdonik.Aurora: a new model and architecture for data stream management[J].The VLDB Journal.2003(2)
  • 7Jim Gray,Goetz Graefe.The five-minute rule ten years later, and other computer storage rules of thumb[J].ACM SIGMOD Record.1997(4)
  • 8Vincenzo Gulisano,Ricardo Jimenez-Peris,Marta Patino-Martinez.StreamCloud: An Elastic and Scalable Data Streaming System[].IEEE Transactions on Parallel and Distributed Systems.2012
  • 9Stoellberger P.S4Latin :Language-based big data streaming [D/OL][].http ://analytical-labscom/downloads/msc _BigDataStreamspdf.2011
  • 10Babcock B,Datar M,Motwani R.Load shedding for aggregation queries over data streams[].Proc of the th Int Conf on Data Engineering (ICDE’’).2004

二级参考文献175

  • 1Nature. Big Data [EB/OL]. [2012-10-02]. http,//www. nature, com/news/specials/bigdata/index, html.
  • 2Bryant R E, Katz R H, Lazowska E D. Big-Data computing : Creating revolutionary breakthroughs in commerce, science, and society [R]. [2012-10-02]. http:// www. cra. org/ccc/docs/init/Big_Data, pdf.
  • 3Science. Special online collection: Dealing with data [EB/OL]. [2012-10-02]. http://www, sciencemag, org/site/ special/data/, 2011.
  • 4Agrawal D, Bernstein P, Bertino E, et al. Challenges and opportunities with big data A community white paper developed by leading researchers across the United States [R/OL]. [2012-10-02]. http://cra, org/ccc/docs/init/bigdata whitepaper, pdf.
  • 5Manyika J, Chui M, Brown B, et al. Big data: The next frontier for innovation, competition, and productivity [R/OL]. [ 2012-10-02 ]. http://www, mekinsey, corn/ Insights]MGI[Research/Teehnology _ and _ Innovation]Big _ data The next frontier for innovation.
  • 6World Economic Forum. Big data, big impact: New possibilities for international development [R/OL]. [2012- 10-02]. http://www3, weforum, org/docs/WEF TC MFS BigDataBigImpact_Briefing 2012. pdf.
  • 7Big Data Across the Federal Government [EB/OL]. [2012-10-02]. http://www, whitehouse, gov/sites/default/ files/microsites/ostp/big_data fact sheet_final_ 1. pdf.
  • 8UN Global Pulse. Big Data for Development:Challenges Opportunities [R/OL]. [ 2012-10-02 ]. http://www. unglobalpulse, org/proj ects/BigDataforDevelopment.
  • 9Times N Y. The age of big data fEB/OLd. [2012-10 -02]. http://www, nytimes, com/2012/02/12/sunday review/big- datas-impact in-the-world, html?pagewanted=all.
  • 10Grobelnik M. Big-data computing: Creating revolutionary breakthroughs in commerce, science, and society [R/OL]. [2012-10 -02]. http://videolectures, net/cswc2012_grobelnik_ big_data/.

共引文献2653

同被引文献71

引证文献16

二级引证文献86

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部