Traditional Chinese villages,vital carriers of traditional culture,have faced significant alterations due to urbanization in recent years,urgently necessitating artificial intelligence data updates.This study integrat...Traditional Chinese villages,vital carriers of traditional culture,have faced significant alterations due to urbanization in recent years,urgently necessitating artificial intelligence data updates.This study integrates high spatial resolution remote sensing imagery with deep learning techniques,proposing a novel method for identifying rooftops of traditional Chinese village buildings using high-definition remote sensing images.Using 0.54 m spatial resolution imagery of traditional village areas as the data source,this method analyzes the geometric and spectral image characteristics of village building rooftops.It constructs a deep learning feature sample library tailored to the target types.Employing a semantically enhanced version of the improved Mask R-CNN(Mask Region-based Convolutional Neural Network)for building recognition,the study conducts experiments on localized imagery from different regions.The results demonstrated that the modified Mask R-CNN effectively identifies traditional village building rooftops,achieving an of 0.7520 and an of 0.7400.It improves the current problem of misidentification and missed detection caused by feature heterogeneity.This method offers a viable and effective approach for industrialized data monitoring of traditional villages,contributing to their sustainable development.展开更多
Aiming at the land cover (features) recognition of outdoor sports venues (football field, basketball court, tennis court and baseball field), this paper proposed a set of object recognition methods and technical flow ...Aiming at the land cover (features) recognition of outdoor sports venues (football field, basketball court, tennis court and baseball field), this paper proposed a set of object recognition methods and technical flow based on Mask R-CNN. Firstly, through the preprocessing of high spatial resolution remote sensing imagery (HSRRSI) and collecting the artificial samples of outdoor sports venues, the training data set required for object recognition of land cover features was constructed. Secondly, the Mask R-CNN was used as the basic training model to be adapted to cope with outdoor sports venues. Thirdly, the recognition results were compared with the four object-oriented machine learning classification methods in eCognition®. The experiment results of effectiveness verification show that the Mask R-CNN is superior to traditional methods not only in technical procedures but also in outdoor sports venues (football field, basketball court, tennis court and baseball field) recognition results, and it achieves the precision of 0.8927, a recall of 0.9356 and an average precision of 0.9235. Finally, from the aspect of practical engineering application, using and validating the well-trained model, an empirical application experiment was performed on the HSRRSI of Xicheng and Daxing District of Beijing respectively, and the generalization ability of the trained model of Mask R-CNN was thoroughly evaluated.展开更多
Soil moisture plays an important role in crop yield estimation,irrigation management,etc.Remote sensing technology has potential for large-scale and high spatial soil moisture mapping.However,offline remote sensing da...Soil moisture plays an important role in crop yield estimation,irrigation management,etc.Remote sensing technology has potential for large-scale and high spatial soil moisture mapping.However,offline remote sensing data processing is time-consuming and resource-intensive,and significantly hampers the efficiency and timeliness of soil moisture mapping.Due to the high-speed computing capabilities of remote sensing cloud platforms,a High Spatial Resolution Soil Moisture Estimation Framework(HSRSMEF)based on the Google Earth Engine(GEE)platform was developed in this study.The functions of the HSRSMEF include research area and input datasets customization,radar speckle noise filtering,optical-radar image spatio-temporal matching,soil moisture retrieving,soil moisture visualization and exporting.This paper tested the performance of HSRSMEF by combining Sentinel-1,Sentinel-2 images and insitu soil moisture data in the central farmland area of Jilin Province,China.Reconstructed Normalized Difference Vegetation Index(NDVI)based on the Savitzky-Golay algorithm conforms to the crop growth cycle,and its correlation with the original NDVI is about 0.99(P<0.001).The soil moisture accuracy of the random forest model(R 2=0.942,RMSE=0.013 m3/m3)is better than that of the water cloud model(R 2=0.334,RMSE=0.091 m3/m3).HSRSMEF transfers time-consuming offline operations to cloud computing platforms,achieving rapid and simplified high spatial resolution soil moisture mapping.展开更多
[ Objective] The study aimed to improve methods of monitoring Karst Rocky Desertification (KRD) control projects and increase the working efficiency. [Method] Based on remote sensing images with medium and high spat...[ Objective] The study aimed to improve methods of monitoring Karst Rocky Desertification (KRD) control projects and increase the working efficiency. [Method] Based on remote sensing images with medium and high spatial resolution, KRD control projects in Disi River basin in Puan County were monitored, that is, information of the project construction in the study area was extracted using supervised classification and hu- man-computer interactive interpretation, and the monitoring results were testified with the aid of GPS. [Result] It was feasible to monitor KRD con- trol projects in Disi River basin based on remote sensing images with medium and high resolution, and the monitoring accuracy was satisfactory, reaching above 80% or 90%, so the method is worthy of popularizing. [ Conclusion] Remote sensing images with medium and high resolution can be used to monitor other KRD control Droiects.展开更多
This paper introduces some of the image processing techniques developed in the Canada Research Chair in Advanced Geomatics Image Processing Laboratory (CRC-AGIP Lab) and in the Department of Geodesy and Geomatics Engi...This paper introduces some of the image processing techniques developed in the Canada Research Chair in Advanced Geomatics Image Processing Laboratory (CRC-AGIP Lab) and in the Department of Geodesy and Geomatics Engineering (GGE) at the University of New Brunswick (UNB), Canada. The techniques were developed by innovatively/“smartly” utilizing the characteristics of the available very high resolution optical remote sensing images to solve important problems or create new applications in photogrammetry and remote sensing. The techniques to be introduced are: automated image fusion (UNB-PanSharp), satellite image online mapping, street view technology, moving vehicle detection using single set satellite imagery, supervised image segmentation, image matching in smooth areas, and change detection using images from different viewing angles. Because of their broad application potential, some of the techniques have made a global impact, and some have demonstrated the potential for a global impact.展开更多
The aim of this project is to create high resolution land cover classification as well as tree canopy density maps at a regional level using high resolution spatial data. Modeling and the data manipulation and analysi...The aim of this project is to create high resolution land cover classification as well as tree canopy density maps at a regional level using high resolution spatial data. Modeling and the data manipulation and analysis of LiDAR LAS point cloud dataset as well as multispectral aerial photographs from the National Agriculture Imagery Program (NAIP) were carried out. Using geoprocessing modeling, a land cover map is created based on filtered returns from LiDAR point cloud data (LAS dataset) to extract features based on their class and return values, and traditional classification methods of high resolution multi-spectral aerial photographs of the remaining ground cover for Clarion County in Pennsylvania. The newly developed model produced 7 classes at 10 ft × 10 ft spatial resolution, namely: water bodies, structures, streets and paved surfaces, bare ground, grassland, trees, and artificial surfaces (e.g. turf). The model was tested against areas with different sizes (townships and municipalities) which revealed a classification accuracy between 94% and 96%. A visual observation of the results shows that some tree-covered areas were misclassified as built up/structures due to the nature of the available LiDAR data, an area of improvement for further studies. Furthermore, a geoprocessing service was created in order to disseminate the results of the land cover classification as well as the tree canopy density calculation to a broader audience. The service was tested and delivered in the form of a web application where users can select an area of interest and the model produces the land cover and/or the tree canopy density results (http://maps.clarion.edu/LandCoverExtractor). The produced output can be printed as a final map layout with the highlighted area of interest and its corresponding legend. The interface also allows the download of the results of an area of interest for further investigation and/or analysis.展开更多
High spatial resolution and high temporal frequency fractional vegetation cover(FVC) products have been increasingly in demand to monitor and research land surface processes. This paper develops an algorithm to estima...High spatial resolution and high temporal frequency fractional vegetation cover(FVC) products have been increasingly in demand to monitor and research land surface processes. This paper develops an algorithm to estimate FVC at a 30-m/15-day resolution over China by taking advantage of the spatial and temporal information from different types of sensors: the 30-m resolution sensor on the Chinese environment satellite(HJ-1) and the 1-km Moderate Resolution Imaging Spectroradiometer(MODIS). The algorithm was implemented for each main vegetation class and each land cover type over China. First, the high spatial resolution and high temporal frequency normalized difference vegetation index(NDVI) was acquired by using the continuous correction(CC) data assimilation method. Then, FVC was generated with a nonlinear pixel unmixing model. Model coefficients were obtained by statistical analysis of the MODIS NDVI. The proposed method was evaluated based on in situ FVC measurements and a global FVC product(GEOV1 FVC). Direct validation using in situ measurements at 97 sampling plots per half month in 2010 showed that the annual mean errors(MEs) of forest, cropland, and grassland were-0.025, 0.133, and 0.160, respectively, indicating that the FVCs derived from the proposed algorithm were consistent with ground measurements [R2 = 0.809,root-mean-square deviation(RMSD) = 0.065]. An intercomparison between the proposed FVC and GEOV1 FVC demonstrated that the two products had good spatial–temporal consistency and similar magnitude(RMSD approximates 0.1). Overall, the approach provides a new operational way to estimate high spatial resolution and high temporal frequency FVC from multiple remote sensing datasets.展开更多
由于受到硬件条件的限制,通常难以获得具有高分辨率(HR)的遥感图像。利用单幅图像超分辨率(SISR)技术对低分辨率(LR)遥感图像进行超分辨率重建是获取高分辨率遥感图像的常用方法。近年来,在图像超分辨率领域引入的卷积神经网络(CNN)改...由于受到硬件条件的限制,通常难以获得具有高分辨率(HR)的遥感图像。利用单幅图像超分辨率(SISR)技术对低分辨率(LR)遥感图像进行超分辨率重建是获取高分辨率遥感图像的常用方法。近年来,在图像超分辨率领域引入的卷积神经网络(CNN)改进了图像重建性能。然而,现有的基于CNN的超分辨率模型通常使用低阶注意力机制提取深层特征,其表征能力有待提高,且常规卷积的感受野有限,缺乏对远距离依赖关系的学习。为了解决以上问题,提出了一种基于递归门控卷积的遥感图像超分辨率方法RGCSR。该方法引入递归门控卷积g n Conv学习全局依赖和局部细节,通过高阶空间交互来获取高阶特征。首先,使用由高阶交互子模块(HorBlock)和前馈神经网络(FFN)组成的高阶交互——前馈神经网络模块(HFB)提取高阶特征。其次,利用由通道注意力(CA)和g n Conv构建的特征优化模块(FOB)优化各个中间模块的输出特征。最后,在多个数据集上的对比结果表明,RGCSR比现有的基于CNN的超分辨率方法具备更好的重建性能和视觉效果。展开更多
Rapid and accurate landslide inventory mapping is significant for emergency rescue and post-disaster reconstruction.Nowadays,deep learning methods exhibit excellent performance in supervised landslide detection.Howeve...Rapid and accurate landslide inventory mapping is significant for emergency rescue and post-disaster reconstruction.Nowadays,deep learning methods exhibit excellent performance in supervised landslide detection.However,due to differences between cross-scene images,the performance of existing methods is significantly degraded when directly applied to another scene,which limits the application of rapid landslide inventory mapping.In this study,we propose a novel Domain Style and Feature Adaptation(DSFA)method for cross-scene landslide detection from high spatial resolution images,which can leverage labeled source domain images and unlabeled target domain images to mine robust landslide representations for different scenes.Specifically,we mitigate the large discrepancy between domains at the dataset level and feature level.At the dataset level,we introduce a domain style adaptation strategy to shift landslide styles,which not only bridges the domain gap,but also increases the diversity of landslide samples.At the feature level,adversarial learning and domain distance minimization are integrated to narrow large feature distribution discrepancies for learning domain-invariant information.In addition,to avoid information omission,we improve the U-Net3+model.Extensive experimental results demonstrate that DSFA has superior detection capability and outperforms other methods,showing its great application potential in unsupervised landslide domain detection.展开更多
文摘Traditional Chinese villages,vital carriers of traditional culture,have faced significant alterations due to urbanization in recent years,urgently necessitating artificial intelligence data updates.This study integrates high spatial resolution remote sensing imagery with deep learning techniques,proposing a novel method for identifying rooftops of traditional Chinese village buildings using high-definition remote sensing images.Using 0.54 m spatial resolution imagery of traditional village areas as the data source,this method analyzes the geometric and spectral image characteristics of village building rooftops.It constructs a deep learning feature sample library tailored to the target types.Employing a semantically enhanced version of the improved Mask R-CNN(Mask Region-based Convolutional Neural Network)for building recognition,the study conducts experiments on localized imagery from different regions.The results demonstrated that the modified Mask R-CNN effectively identifies traditional village building rooftops,achieving an of 0.7520 and an of 0.7400.It improves the current problem of misidentification and missed detection caused by feature heterogeneity.This method offers a viable and effective approach for industrialized data monitoring of traditional villages,contributing to their sustainable development.
文摘Aiming at the land cover (features) recognition of outdoor sports venues (football field, basketball court, tennis court and baseball field), this paper proposed a set of object recognition methods and technical flow based on Mask R-CNN. Firstly, through the preprocessing of high spatial resolution remote sensing imagery (HSRRSI) and collecting the artificial samples of outdoor sports venues, the training data set required for object recognition of land cover features was constructed. Secondly, the Mask R-CNN was used as the basic training model to be adapted to cope with outdoor sports venues. Thirdly, the recognition results were compared with the four object-oriented machine learning classification methods in eCognition®. The experiment results of effectiveness verification show that the Mask R-CNN is superior to traditional methods not only in technical procedures but also in outdoor sports venues (football field, basketball court, tennis court and baseball field) recognition results, and it achieves the precision of 0.8927, a recall of 0.9356 and an average precision of 0.9235. Finally, from the aspect of practical engineering application, using and validating the well-trained model, an empirical application experiment was performed on the HSRRSI of Xicheng and Daxing District of Beijing respectively, and the generalization ability of the trained model of Mask R-CNN was thoroughly evaluated.
基金Under the auspices of National Key Research and Development Project of China(No.2021YFD1500103)Strategic Priority Research Program of the Chinese Academy of Sciences(No.XDA28100500)+2 种基金National Natural Science Foundation of China(No.4197132)Science and Technology Development Plan Project of Jilin Province(No.20210201044GX)Land Observation Satellite Supporting Platform of National Civil Space Infrastructure Project(No.CASPLOS-CCSI)。
文摘Soil moisture plays an important role in crop yield estimation,irrigation management,etc.Remote sensing technology has potential for large-scale and high spatial soil moisture mapping.However,offline remote sensing data processing is time-consuming and resource-intensive,and significantly hampers the efficiency and timeliness of soil moisture mapping.Due to the high-speed computing capabilities of remote sensing cloud platforms,a High Spatial Resolution Soil Moisture Estimation Framework(HSRSMEF)based on the Google Earth Engine(GEE)platform was developed in this study.The functions of the HSRSMEF include research area and input datasets customization,radar speckle noise filtering,optical-radar image spatio-temporal matching,soil moisture retrieving,soil moisture visualization and exporting.This paper tested the performance of HSRSMEF by combining Sentinel-1,Sentinel-2 images and insitu soil moisture data in the central farmland area of Jilin Province,China.Reconstructed Normalized Difference Vegetation Index(NDVI)based on the Savitzky-Golay algorithm conforms to the crop growth cycle,and its correlation with the original NDVI is about 0.99(P<0.001).The soil moisture accuracy of the random forest model(R 2=0.942,RMSE=0.013 m3/m3)is better than that of the water cloud model(R 2=0.334,RMSE=0.091 m3/m3).HSRSMEF transfers time-consuming offline operations to cloud computing platforms,achieving rapid and simplified high spatial resolution soil moisture mapping.
基金Supported by the Key Science and Technology Projects of Guizhou Province,China[(2007)3017,(2008)3022]Major Special Project of Guizhou Province,China(2006-6006-2)
文摘[ Objective] The study aimed to improve methods of monitoring Karst Rocky Desertification (KRD) control projects and increase the working efficiency. [Method] Based on remote sensing images with medium and high spatial resolution, KRD control projects in Disi River basin in Puan County were monitored, that is, information of the project construction in the study area was extracted using supervised classification and hu- man-computer interactive interpretation, and the monitoring results were testified with the aid of GPS. [Result] It was feasible to monitor KRD con- trol projects in Disi River basin based on remote sensing images with medium and high resolution, and the monitoring accuracy was satisfactory, reaching above 80% or 90%, so the method is worthy of popularizing. [ Conclusion] Remote sensing images with medium and high resolution can be used to monitor other KRD control Droiects.
文摘This paper introduces some of the image processing techniques developed in the Canada Research Chair in Advanced Geomatics Image Processing Laboratory (CRC-AGIP Lab) and in the Department of Geodesy and Geomatics Engineering (GGE) at the University of New Brunswick (UNB), Canada. The techniques were developed by innovatively/“smartly” utilizing the characteristics of the available very high resolution optical remote sensing images to solve important problems or create new applications in photogrammetry and remote sensing. The techniques to be introduced are: automated image fusion (UNB-PanSharp), satellite image online mapping, street view technology, moving vehicle detection using single set satellite imagery, supervised image segmentation, image matching in smooth areas, and change detection using images from different viewing angles. Because of their broad application potential, some of the techniques have made a global impact, and some have demonstrated the potential for a global impact.
文摘The aim of this project is to create high resolution land cover classification as well as tree canopy density maps at a regional level using high resolution spatial data. Modeling and the data manipulation and analysis of LiDAR LAS point cloud dataset as well as multispectral aerial photographs from the National Agriculture Imagery Program (NAIP) were carried out. Using geoprocessing modeling, a land cover map is created based on filtered returns from LiDAR point cloud data (LAS dataset) to extract features based on their class and return values, and traditional classification methods of high resolution multi-spectral aerial photographs of the remaining ground cover for Clarion County in Pennsylvania. The newly developed model produced 7 classes at 10 ft × 10 ft spatial resolution, namely: water bodies, structures, streets and paved surfaces, bare ground, grassland, trees, and artificial surfaces (e.g. turf). The model was tested against areas with different sizes (townships and municipalities) which revealed a classification accuracy between 94% and 96%. A visual observation of the results shows that some tree-covered areas were misclassified as built up/structures due to the nature of the available LiDAR data, an area of improvement for further studies. Furthermore, a geoprocessing service was created in order to disseminate the results of the land cover classification as well as the tree canopy density calculation to a broader audience. The service was tested and delivered in the form of a web application where users can select an area of interest and the model produces the land cover and/or the tree canopy density results (http://maps.clarion.edu/LandCoverExtractor). The produced output can be printed as a final map layout with the highlighted area of interest and its corresponding legend. The interface also allows the download of the results of an area of interest for further investigation and/or analysis.
基金Supported by the National Key Research and Development Program of China (2018YFC1506501, 2018YFA0605503, and2016YFB0501502)Special Program of Gaofen Satellites (04-Y30B01-9001-18/20-3-1)National Natural Science Foundation of China (41871230 and 41871231)。
文摘High spatial resolution and high temporal frequency fractional vegetation cover(FVC) products have been increasingly in demand to monitor and research land surface processes. This paper develops an algorithm to estimate FVC at a 30-m/15-day resolution over China by taking advantage of the spatial and temporal information from different types of sensors: the 30-m resolution sensor on the Chinese environment satellite(HJ-1) and the 1-km Moderate Resolution Imaging Spectroradiometer(MODIS). The algorithm was implemented for each main vegetation class and each land cover type over China. First, the high spatial resolution and high temporal frequency normalized difference vegetation index(NDVI) was acquired by using the continuous correction(CC) data assimilation method. Then, FVC was generated with a nonlinear pixel unmixing model. Model coefficients were obtained by statistical analysis of the MODIS NDVI. The proposed method was evaluated based on in situ FVC measurements and a global FVC product(GEOV1 FVC). Direct validation using in situ measurements at 97 sampling plots per half month in 2010 showed that the annual mean errors(MEs) of forest, cropland, and grassland were-0.025, 0.133, and 0.160, respectively, indicating that the FVCs derived from the proposed algorithm were consistent with ground measurements [R2 = 0.809,root-mean-square deviation(RMSD) = 0.065]. An intercomparison between the proposed FVC and GEOV1 FVC demonstrated that the two products had good spatial–temporal consistency and similar magnitude(RMSD approximates 0.1). Overall, the approach provides a new operational way to estimate high spatial resolution and high temporal frequency FVC from multiple remote sensing datasets.
基金National Basic Research Program(973 Program) (No.2011 CB952001) National High Technology Research and Development Program of China (863 Program) (No.2008AA 12 Z 106)+1 种基金 National Natural Science Foundation of China (No.40801166) China Postdoctoral Science Foundation (No.2012M510053 )
文摘由于受到硬件条件的限制,通常难以获得具有高分辨率(HR)的遥感图像。利用单幅图像超分辨率(SISR)技术对低分辨率(LR)遥感图像进行超分辨率重建是获取高分辨率遥感图像的常用方法。近年来,在图像超分辨率领域引入的卷积神经网络(CNN)改进了图像重建性能。然而,现有的基于CNN的超分辨率模型通常使用低阶注意力机制提取深层特征,其表征能力有待提高,且常规卷积的感受野有限,缺乏对远距离依赖关系的学习。为了解决以上问题,提出了一种基于递归门控卷积的遥感图像超分辨率方法RGCSR。该方法引入递归门控卷积g n Conv学习全局依赖和局部细节,通过高阶空间交互来获取高阶特征。首先,使用由高阶交互子模块(HorBlock)和前馈神经网络(FFN)组成的高阶交互——前馈神经网络模块(HFB)提取高阶特征。其次,利用由通道注意力(CA)和g n Conv构建的特征优化模块(FOB)优化各个中间模块的输出特征。最后,在多个数据集上的对比结果表明,RGCSR比现有的基于CNN的超分辨率方法具备更好的重建性能和视觉效果。
基金supported by the National Natural Science Foundation of China under grants 42311530065in part by the Joint Funds of the National Natural Science Foundation of China under grant U21A2013.
文摘Rapid and accurate landslide inventory mapping is significant for emergency rescue and post-disaster reconstruction.Nowadays,deep learning methods exhibit excellent performance in supervised landslide detection.However,due to differences between cross-scene images,the performance of existing methods is significantly degraded when directly applied to another scene,which limits the application of rapid landslide inventory mapping.In this study,we propose a novel Domain Style and Feature Adaptation(DSFA)method for cross-scene landslide detection from high spatial resolution images,which can leverage labeled source domain images and unlabeled target domain images to mine robust landslide representations for different scenes.Specifically,we mitigate the large discrepancy between domains at the dataset level and feature level.At the dataset level,we introduce a domain style adaptation strategy to shift landslide styles,which not only bridges the domain gap,but also increases the diversity of landslide samples.At the feature level,adversarial learning and domain distance minimization are integrated to narrow large feature distribution discrepancies for learning domain-invariant information.In addition,to avoid information omission,we improve the U-Net3+model.Extensive experimental results demonstrate that DSFA has superior detection capability and outperforms other methods,showing its great application potential in unsupervised landslide domain detection.