面向大数据挖掘的自然资源云平台设计实现研究

Research on the Design and Implementation of the Natural Resource Cloud Platform for Big Data Mining

围绕“山水林田湖草”自然资源协同管理要求,建立时空大数据云平台,以汇聚各类基础数据和业务数据,将数据相互关联与融合,依托平台的分析能力与支撑能力,以分析结果辅助业务工作开展。文章以市级自然资源应用为基础,探讨时空大数据云平台技术。通过超融合、海量数据存储、云安全等技术构筑云平台基础,同时引入数据抽取、清洗、挖掘分析、可视化等数据处理技术,以及分布式平行计算、面向服务的架构(Service-Oriented Architecture,SOA)、微服务、容器等云化技术,提升时空大数据云平台的服务能力,为同类平台建设提供借鉴。

Focusing on the requirements of the collaborative management of the natural resources of"mountains,rivers,forests,farmlands,lakes and grasslands",a spatio-temporal big data cloud platform is established to gather various basic data and business data and correlate and integrate data,and relying on the analysis and support capabilities of the platfom,analysis results are used to assist the development of business work.This article is based on the applications of municipal natural resources and explores the technology of the spatio-temporal big data cloud platform.The foundation of the cloud platform is built through technologies such as hyper-convergence,massive data storage and cloud security,and data processing technologies such as data extraction,cleaning,mining analysis and visualization,as well as cloudification technologies such as parallel distributed computing,service-oriented architecture(SOA),microservices and containers are introduced to enhance the service capabilities of the spatio-temporal big data cloud platform,so as to provide reference for similar platform construction.