期刊文献+

基于GeoTrellis的海量栅格数据计算分布式系统建设 被引量:1

Construction of Distributed System for Computing MassiveRaster Data Based on GeoTrellis
下载PDF
导出
摘要 为实现海量栅格数据的分布式处理,本文基于Hadoop和Spark分布式计算技术,结合开源框架GeoTrellis地理处理引擎,设计并实现了一个海量栅格数据的分布式计算系统。重点探讨了海量栅格数据分布式存储和计算架构,并基于GeoTrellis设计并实现了该分布式计算系统。最后,以10 m分辨率的全球地表覆盖地图对系统计算性能进行测试,结果表明:基于GeoTrellis开发的分布式计算系统能够有效地提升海量栅格数据的处理能力。 In order to realize the distributed processing of massive raster data,this article is based on Hadoop and Spark distributed computing technology,combined with the open-source framework GeoTrellis geoprocessing engine to design and implement a distributed computing system of massive raster data.It focuses on the distributed storage and computing architecture of massive raster data,designs and implements this distributed computing system based on GeoTrellis.Finally,the system's computing performance was tested with a 10 m resolution global land coverage map.The results show that the distributed computing system based on GeoTrellis can effectively improve the processing capacity of massive raster data.
作者 向虹锟 徐柱 XIANG Hongkun;XU Zhu(Faculty of Geosciences and Environmental Engineering,Southwest Jiaotong University,Chengdu 610000,China)
出处 《测绘与空间地理信息》 2021年第8期44-47,51,共5页 Geomatics & Spatial Information Technology
基金 国家重点研发计划“固废资源化”重点专项项目——城市固废大数据挖掘及全生命周期管控新技术(2019YFC1905600)资助。
关键词 栅格数据 分布式计算 HADOOP GeoTrellis SPARK raster data distributed computing Hadoop GeoTrellis Sparks
  • 相关文献

参考文献4

二级参考文献31

  • 1冯敏,尹芳,诸云强,宋佳.基于MapReduce的分布式地形数据计算研究[J].华中科技大学学报(自然科学版),2011,39(S1):24-27. 被引量:9
  • 2沈占锋,骆剑承,马伟锋,郑江,明冬萍,陈秋晓.网格计算在遥感图像地学处理中的应用[J].计算机工程,2005,31(7):37-39. 被引量:4
  • 3高昂.面向空间数据的分布式计算服务研究[D].北京:中科院中国科学院研究生院(地理科学与资源研究所),2011.
  • 4Lee C, Percivall G. Standards based computing capa- bilities for distributed geospatial applications [J]. Computer, 2008, 41(11): 50-59.
  • 5刘峰.基于网格服务的地理空间信息共享平台关键技术研究[D].青岛:山东科技大学测绘科学与工程学院,2003.
  • 6Yang H, Dasdan A, Hsiao R L, et al. Map-reduce merge: simplified relational data processing on large clusters[C] // Proceedings of the 2007 International Conference on Management of Data. New York: As- sociation for Computing Machinery, 2007: 1029- 1040.
  • 7Ariel C, Sun Zhengguo, Vagelis H, et al. Experi ences on processing spatial data with mapReduce[J]. Lecture Notes in Computer Science, 2009, 5566:302-319.
  • 8Han Jizhong, Liu Zhiyong, Wang Kai. SJMR: paral- lelizing spatial join with mapReduce on clusters[C]// 2009 International Conference on Cluster Computing and Workshops. New York: IEEE, 2009: 1-4.
  • 9Wang Kai, Han Jizhong, Tu Bibo, et al. Accelera- ting spatial data processing with mapReduce[C]// 2010 16th International Conference on Parallel and Distributed Systems. New York: IEEE, 2010: 229- 236.
  • 10Le C M,,Delclaux F,Genthon P,et al.Assessmentof digital elevation model(DEM)aggregation meth-ods for hydrological modeling:Lake Chad basin,Af-rica. Computers and Geosciences . 2009

共引文献236

同被引文献15

引证文献1

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部