期刊文献+

基于Hadoop的农技推广数据存储平台设计 被引量:1

Design of Agricultural Technology Popularization Data Storage Platform Based on Hadoop
下载PDF
导出
摘要 农业数据具有大量、复杂、多样等特点,随着农技推广工作的进一步推进,将产生PB级以上的数据,应用传统的数据处理技术来处理这些海量数据,不仅低效而且需要耗费大量资源,如何对海量农技推广数据进行高效存储和处理成为亟待解决的问题。以Hadoop处理技术为基础,设计了一种农技推广数据存储平台,为上述难题提供了一种解决途径。 Agricultural data has the characteristics of large, complex, diverse and so on. As the extension of agricultural technology popularization, more than petabytes of data will produce. Application of traditional data processing technology to deal with the huge amounts of data, is not only inefficient but also requires a lot of resources. How to efficiently store and process massive agri-technique extension data become a problem.Based on the Hadoop processing technology, we design a storage platform of agri-technique extension data,and provide a solution for the problem.
出处 《农业展望》 2015年第3期66-69,共4页 Agricultural Outlook
基金 国家科技支撑计划(2013BAD15B02)
关键词 农技推广 HADOOP 数据存储 平台设计 agricultural technology popularization Hadoop data storage platform design
  • 相关文献

参考文献6

二级参考文献24

  • 1周志明.深入理解Java虚拟机[M].北京:机械工业出版社.2011.
  • 2中国共产党第十八次代表大会报告[R].人民出版社.2012.
  • 3王文生.中央1号文件的农业农村信息化政策研读[J].中国农村科技,2012,(7):24-28.
  • 4WHITE T. Hadoop: the definitive guide [ M]. 影印版.3版.南京:东南大学出版社,2011.
  • 5ZIKOPOLOS P C, EATON C, DEROOS D, et al. Understanding big data: analytics for enterprise class hadoop and streaming data [ M]. New York: McGraw-Hill, 2012.
  • 6HIDALGO C A. How to transform big data into knowledge[ EB/ OL]. [ 2013- 02- 10]. http://enterprise, huawei, com/en/about/e- journal/ict/detail,/hw-195167, htm.
  • 7ABOUZEID A, BAJDA-PAWLIKOWSKI K, ABADI D J, et al. HadoopDB: an architectural hybrid of MapReduce and DBMS tech- nologies for analytical workloads[ C]//Proceedings of the 35th Inter- national Conference on Very Large Data Bases. New York: ACM Press, 2009:733-743.
  • 8ApacheSqoop Project. Sqoop User Guide ( V 1 . 4. 3 ) [ EB / OL ] . [ 2013-02-10]. http://sqoop, apache, org/does/1.4.3/SqoopUser- Guide. html.
  • 9HWANG K, FOX G, DONGARRA J. Distributed and cloud compu- ting: from parallel processing to the Interact of things[ M].北京:机械工业出版社,2012.
  • 10TANENBAUM A S, VAN-STEEN M. Distributed systems principles and paradigms[ M]. 北京:清华大学出版社,2012.

共引文献159

同被引文献12

引证文献1

二级引证文献1

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部