期刊文献+

基于云平台的大数据处理流程的关键技术研究 被引量:10

Research on key technologies of data processing based on cloud computing
下载PDF
导出
摘要 随着云计算,物联网和各种社交网站,以及各类智能移动终端设备的发展,现在互联网正面临着海量的数据量,如何更好地使用和管理这些数据便是一个极大的挑战。文中解释了大数据的一些基本概念,对大数据的数据源进行了分析和归纳,然后展示了大数据的基本的数据处理流程,最后总结了在数据处理流程中使用的若干关键技术。 With the development of cloud computing, networking and various social networking sites,and a variety of smart mobile equipment, now the Internet is facing the massive amount of data, how to use and manage these data is a great challenge. This article explains some basic concepts of big data and analyzes the data' s source, and then reveals the basic data processing of big data, finally summarizes some key technologies which used in the data processing.
作者 王裕
出处 《信息技术》 2014年第9期143-146,151,共5页 Information Technology
关键词 大数据 云计算 数据处理 big data cloud computing data processing
  • 相关文献

参考文献16

  • 1李国杰.大数据研究的科学价值[J].中国计算机学会通讯,2012,8(9):8-15.
  • 2Big Data[EB/OL].[2013-07-09].http://en.wikipedia.org.
  • 3Agrawal D,Bernstein P,Bertino E,et al.Challenges and opportunities with big data[J].Proceedings of the VLDB Endowment,2012,5(12):2032-2033.
  • 4张兴旺,李晨晖,秦晓珠.云计算环境下大规模数据处理的研究与初步实现[J].现代图书情报技术,2011(4):17-23. 被引量:37
  • 5孟小峰,慈祥.大数据管理:概念、技术与挑战[J].计算机研究与发展,2013,50(1):146-169. 被引量:2384
  • 6Dean J,Ghemawat S.MapReduce:simplified data processing on large clusters[J].Communications of the ACM,2008,51 (1):107-113.
  • 7王珊,王会举,覃雄派,周烜.架构大数据:挑战、现状与展望[J].计算机学报,2011,34(10):1741-1752. 被引量:616
  • 8Whitney A,Neeman Y,Koneru S,et al.Distributed file system:European Patent EP 0661652[P].2001-7-11.
  • 9Ghemawat S,Gobioff H,Leung S T.The Google file system[C]//ACM SIGOPS Operating Systems Review.ACM,2003,37 (5):29-43.
  • 10Borthakur D.The hadoop distributed file system:Architecture and design[J].Hadoop Project website,2007,11:21.

二级参考文献400

  • 1毛国君.数据挖掘的概念、系统结构和方法[J].计算机工程与设计,2002,23(8):13-17. 被引量:28
  • 2[1]Inselberg A,Dimsdale B.Parallel Coordinates:A Tool for Visualizing Multi-dimensional Geometry. Visualization ′90,San Francisco,CA,1990:361
  • 3[2]Keim D A.Pixel-oriented Visualization Techniques for Exploring Very Large Databases. Journal of Computational and Graphical Statistics,1996,5(1):58
  • 4[3]Pickett R M,Grinstein G G.Iconographic Displays for Visualizing Multidimensional Data, Proc. IEEE Conf. on Systems,Man and Cybern-etics. IEEE Press,Beijing and Shenyang, 1988-05:514
  • 5[4]Shneiderman B.Tree Visualization with Treemaps:A 2D Space-Filling Approach.ACM Transactions on Graphics, 1992,11 ( 1):92
  • 6[5]Siirtola H.Direct Manipulation of Parallel Coordinates. Proceedings of the IEEE International Conference on Information Visualization (IV-2000), London,2000-07:373
  • 7孙兆玉,袁志平,黄宇光.面向数据密集型计算Hadoop及其应用初探[C].见:2008年全国高性能计算学术年会.2008:441-443.
  • 8Armbrust M, Fox A, Griffith R, et al. Above the Clouds : A Berkeley View of Cloud Computing [ EB/OL ]. [ 2011 - 01 - 10 ]. http://www. EECS. berkeley, edu./Pubs/TechRpts/2009/EECS - 2009 - 28. pdf.
  • 9Davis D. Server Virtualization, Network Virtualization & Storage Virtualization Explained [ EB/OL ]. [ 2011 - 01 - 10 ]. http:// www. petri, co. il/server - virtualization - network - stroage - virtualization, html.
  • 10Menken I, Blokdijk G. Cloud Computing Virtualization Specialist Complete Certification Kit[ M-. 2009 : 26 - 166.

共引文献3237

同被引文献90

引证文献10

二级引证文献59

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部