基于Hadoop的农技推广数据存储平台设计

Design of Agricultural Technology Popularization Data Storage Platform Based on Hadoop

农业数据具有大量、复杂、多样等特点,随着农技推广工作的进一步推进,将产生PB级以上的数据,应用传统的数据处理技术来处理这些海量数据,不仅低效而且需要耗费大量资源,如何对海量农技推广数据进行高效存储和处理成为亟待解决的问题。以Hadoop处理技术为基础,设计了一种农技推广数据存储平台,为上述难题提供了一种解决途径。

Agricultural data has the characteristics of large, complex, diverse and so on. As the extension of agricultural technology popularization, more than petabytes of data will produce. Application of traditional data processing technology to deal with the huge amounts of data, is not only inefficient but also requires a lot of resources. How to efficiently store and process massive agri-technique extension data become a problem.Based on the Hadoop processing technology, we design a storage platform of agri-technique extension data,and provide a solution for the problem.