期刊文献+

分布式属性相似空间插值算法及其对流域土壤属性插值的计算性能评估

DISTRIBUTED ATTRIBUTE-SIMILARITY SPATIAL NTERPOLATION ALGORITHM AND ITS PERFORMANCE EVALUATION ON SOIL ATTRIBUTE INTERPOLATION AT THE WATERSHED SCALE
原文传递
导出
摘要 [目的]如何准确、高效地实现点源数据向面源数据的空间拓展,是现代数字土壤制图技术实现由中小尺度制图转向大尺度、乃至全球尺度制图所需解决的关键问题之一。[方法]依托前期提出的局部属性相似性加权回归空间插值算法(LASWR),文章构建了一种基于云计算技术Hadoop的分布式空间插值算法(DLASWR),以应对大规模数字土壤制图的海量数据处理需要。DLASWR算法是基于Hadoop的MapReduce框架结构。算法的核心思想在于:(1)将待插值数据集分割成多个子数据集,由单个Map任务使用集中式LASWR算法对一个子数据集进行插值;(2)由Reduce任务归并所有Map任务的插值结果,并作为最终结果输出。[结果]对实际土壤样点属性的空间插值实验结果表明DLASWR算法具有良好的加速性能,与集中式LASWR算法相比显著提高了空间插值的计算效率。[结论]DLASWR算法可为数字土壤制图领域当前应用的空间插值方法由传统的集中式计算拓展成分布式计算提供技术参考。 Accurately upscaling data from point to spatial surface data with high efficiency is one key problem to be solved in the field of modern technologies for digital soil mapping that focuses on upscaling maps at small and medium scales to large,or even global scales.In order to meet the necessity of processing large amount of data by digital soil mapping,this study developed a distributed local attribute similarity weighted spatial interpolation model(DLASWR)based on the cloud computing technology of Hadoop and a local attribute similarity weighted spatial interpolation model(LASWR).The MapReduce framework in the Hadoop was adopted as the base for the DLASWR model.The core principle of the model included:(1)The database to be interpolated was first divided into multiple subsets,on which the centralized LASWR algorithm was implemented using a single Map mission.(2)The Reduce mission collected results from all Map mission and exported the outputs.Evaluation results by interpolating observed spatial soil properties indicated that the DLASWR model showed excellent accelerating capabilities,and the computing efficiency was significantly improved compared to those by the LASWR model.In summary,the DLASWR model provides technological reference for extending the current spatial interpolating method in digital soil mapping from centralized to distributing computing.
作者 周脚根 雷秋良 李勇 张天鹏 Zhou Jiaogen;Lei Qiuliang;Li Yong;Zhang Tianpeng(Jiangsu Provincial Engineering Research Center for Intelligent Monitoring and Ecological Management of Pond and Reservoir Water Environment,Huai'an 223300,Jiangsu,China;School of Urban and Environmental Sciences,Huaiyin Normal University,Huai'an 223300,Jiangsu,China;Institute of Subtropical Agriculture,Chinese Academy of Sciences,Changsha 410125,Hunan,China;Key laboratory of Nonpoint Source Pollution Control,Ministry of Agriculture and Rural Affairs,Beijing 100081,China;Institute of Agricultural Resources and Regional Planning,Chinese Academy of Agricultural Sciences,Beijing 100081,China)
出处 《中国农业资源与区划》 CSSCI CSCD 北大核心 2022年第5期66-73,共8页 Chinese Journal of Agricultural Resources and Regional Planning
基金 国家自然科学基金项目“亚热带农业小流域塘库水体氮磷化学计量特征的时空变异及其环境效应”(41877009) 国家自然科学基金区域创新发展联合基金项目“宁夏灌区典型农田氮磷迁移规律及其地表水水质响应机理研究”(U20A20114)。
关键词 云计算 分布式空间插值 数字土壤制图 局部属性相似加权回归 土壤景观模型 cloud computing distributed spatial interpolation digital soil mapping local attribute similarity weighting regression soil landscape model
  • 相关文献

参考文献5

二级参考文献44

  • 1张桂刚,李超,张勇,邢春晓.一种基于海量信息处理的云存储模型研究[J].计算机研究与发展,2012,49(S1):32-36. 被引量:23
  • 2付国珍,摆万奇.耕地质量评价研究进展及发展趋势[J].资源科学,2015,37(2):226-236. 被引量:143
  • 3王吉春,金山,薛一波,王建中.加速比的局限性分析[J].计算机工程与设计,1996,17(4):14-19. 被引量:1
  • 4王劲秋,徐良贤.分布式系统中任务粒度和加速比关系[J].上海交通大学学报,1996,30(12):152-156. 被引量:1
  • 5Gustafson J L.The consequences of fixed time performance measurement[EB/OL].http://www.scl.ameslab.gov/Publications/Gus/FixedTime/FixedTime.html,2004-04-16.
  • 6Sun X H,Ni L M.Another view on parallel speedup[A].Pryor D V.Proceedings of the 1990 ACM/IEEE Conference on Supercomputing[C].Gary Montry: IEEE Computer Society,1990.324-333.
  • 7BRYANT R E. Data intensive supercomputing: the case for DISC, CMU technical report CMU-CS- 07-128 [ R]. Pittsburgh: Department of Computer Science, Carnegie Mellon University,2007.
  • 8PAVLO A,PAULSON E,RASIN A,et al. A comparison of approaches to large-scale data analysis [ C ]//Proc of SIGMOD International Conference on Management of Data. New York :ACM Press ,2009:165-178.
  • 9DEAN J,GHEMAWAT .S. MapReduce : simplified data processing on large clusters[ C ]//Proc of the 6th Conference on Operating Systems De- sign & Implementation. Berkeley: USENIX Association ,21304:137-150.
  • 10Apache Hadoop [ EB/OL ]. [ 2009 - 03- 06 ]. http://hadoop, apache. otg/.

共引文献29

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部