摘要
[目的]如何准确、高效地实现点源数据向面源数据的空间拓展,是现代数字土壤制图技术实现由中小尺度制图转向大尺度、乃至全球尺度制图所需解决的关键问题之一。[方法]依托前期提出的局部属性相似性加权回归空间插值算法(LASWR),文章构建了一种基于云计算技术Hadoop的分布式空间插值算法(DLASWR),以应对大规模数字土壤制图的海量数据处理需要。DLASWR算法是基于Hadoop的MapReduce框架结构。算法的核心思想在于:(1)将待插值数据集分割成多个子数据集,由单个Map任务使用集中式LASWR算法对一个子数据集进行插值;(2)由Reduce任务归并所有Map任务的插值结果,并作为最终结果输出。[结果]对实际土壤样点属性的空间插值实验结果表明DLASWR算法具有良好的加速性能,与集中式LASWR算法相比显著提高了空间插值的计算效率。[结论]DLASWR算法可为数字土壤制图领域当前应用的空间插值方法由传统的集中式计算拓展成分布式计算提供技术参考。
Accurately upscaling data from point to spatial surface data with high efficiency is one key problem to be solved in the field of modern technologies for digital soil mapping that focuses on upscaling maps at small and medium scales to large,or even global scales.In order to meet the necessity of processing large amount of data by digital soil mapping,this study developed a distributed local attribute similarity weighted spatial interpolation model(DLASWR)based on the cloud computing technology of Hadoop and a local attribute similarity weighted spatial interpolation model(LASWR).The MapReduce framework in the Hadoop was adopted as the base for the DLASWR model.The core principle of the model included:(1)The database to be interpolated was first divided into multiple subsets,on which the centralized LASWR algorithm was implemented using a single Map mission.(2)The Reduce mission collected results from all Map mission and exported the outputs.Evaluation results by interpolating observed spatial soil properties indicated that the DLASWR model showed excellent accelerating capabilities,and the computing efficiency was significantly improved compared to those by the LASWR model.In summary,the DLASWR model provides technological reference for extending the current spatial interpolating method in digital soil mapping from centralized to distributing computing.
作者
周脚根
雷秋良
李勇
张天鹏
Zhou Jiaogen;Lei Qiuliang;Li Yong;Zhang Tianpeng(Jiangsu Provincial Engineering Research Center for Intelligent Monitoring and Ecological Management of Pond and Reservoir Water Environment,Huai'an 223300,Jiangsu,China;School of Urban and Environmental Sciences,Huaiyin Normal University,Huai'an 223300,Jiangsu,China;Institute of Subtropical Agriculture,Chinese Academy of Sciences,Changsha 410125,Hunan,China;Key laboratory of Nonpoint Source Pollution Control,Ministry of Agriculture and Rural Affairs,Beijing 100081,China;Institute of Agricultural Resources and Regional Planning,Chinese Academy of Agricultural Sciences,Beijing 100081,China)
出处
《中国农业资源与区划》
CSSCI
CSCD
北大核心
2022年第5期66-73,共8页
Chinese Journal of Agricultural Resources and Regional Planning
基金
国家自然科学基金项目“亚热带农业小流域塘库水体氮磷化学计量特征的时空变异及其环境效应”(41877009)
国家自然科学基金区域创新发展联合基金项目“宁夏灌区典型农田氮磷迁移规律及其地表水水质响应机理研究”(U20A20114)。
关键词
云计算
分布式空间插值
数字土壤制图
局部属性相似加权回归
土壤景观模型
cloud computing
distributed spatial interpolation
digital soil mapping
local attribute similarity weighting regression
soil landscape model