期刊文献+

大数据分析平台建设与应用研究

Research on the Construction and Application of Big Data Analysis Platform
下载PDF
导出
摘要 随着大数据技术的不断发展及应用,提高大数据分析与处理能力,是提高大数据分析平台应用价值的关键。大数据分析平台建设,需要完善的架构体系,以满足功能体系的需求。大数据分析平台建设,是信息时代的发展需求,也是实现海量信息分析处理的重要载体,具有重要的现实意义。笔者立足4种主流大数据分析架构,阐述了架构的共性及差异性,并从大数据分析平台的应用构建、大数据分析平台的功能体系生成几方面提出了几点建议,希望能够为相关研究提供借鉴。 With the continuous development and application of big data technology,improving the ability of big data analysis and processing is the key to improving the application value of big data analysis platform.The construction of big data analysis platform needs perfect architecture system to meet the needs of functional system.The construction of big data analysis platform is not only the development demand of the information age,but also the important carrier to realize the massive information analysis and processing,which has important practical significance.Based on the four mainstream big data analysis architectures,the author expounds the commonness and differences of the architectures,and puts forward several suggestions from the application construction of big data analysis platform and the generation of function system of big data analysis platform,hoping to provide reference for relevant research.
作者 杨小玲 Yang Xiaoling(Armen Police Inner Mongolia Corps,Hohhot Inner Mongolia 010020,China)
机构地区 武警内蒙古总队
出处 《信息与电脑》 2020年第9期36-37,共2页 Information & Computer
关键词 大数据分析 平台建设 应用 big data analysis platform construction application
  • 相关文献

参考文献2

二级参考文献14

  • 1DEAN,JEFFREY,SANJAY G.Map Reduce:Simplified Data Processing on Large Clusters[J].Communications of the ACM,2008,51(1):107-113.DOI:10.1145/1327452.1327492.
  • 2ZAHARIA M,CHOWDHURY M,DAS T,et al.Resilient Distributed Datasets:A FaultTolerant Abstraction for In-Memory Cluster Computing[C]//Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation.USA:USENIX Association,2012:15-28.
  • 3THUSOO A,SARMA S J,JAIN N,et al.Hive:A Warehousing Solution over a Map-Reduce Framework[J].Proceedings of the VLDB Endowment,2009,2(2):1626-1629.DOI:10.14778/1687553.1687609.
  • 4GROPP W,LUSK E,DOSS N,et al."A HighPerformance,Portable Implementation of the MPI Message Passing Interface Standard[J].Parallel Computing,1996,22(6):789-828.DOI:10.1016/0167-8191(96)00024-5.
  • 5BU Y,HOWE B,BALAZINSKA M,et al.Ha Loop:Efficient Iterative Data Processing on Large Clusters[J].Proceedings of the VLDB Endowment,2010,3(1):285-296.DOI:10.14778/1920841.1920881.
  • 6EKANAYAKE,JALIYA.Twister:A Runtime for Iterative Mapreduce[C]//Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing.USA:ACM,2010:810-818.
  • 7FRANK M,MICHAEL I,MURRAY D G.Scalability!But at what COST[C]//5th Workshop on Hot Topics in Operating Systems(Hot OS XV).USA:USENIX Association,2015.
  • 8KWAK,HAEWOON.What is Twitter,A Social Network or A News Media?[C]/Proceedings of the 19th International Conference on World Wide Web.USA:ACM,2010:591-600.
  • 9MALEWICZ,GRZEGORZ.Pregel:A System for Large-Scale Graph[C]//Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data.USA:ACM,2010:135-146.
  • 10LOW,YU C.Distributed Graph Lab:A Framework for Machine Learning and Data Mining in the Cloud[J].Proceedings of the VLDB Endowment,2012,5(8):716-727.

共引文献11

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部