Extensive identification of landslide boundaries using remote sensing images and deep learning method

The frequent occurrence of extreme weather events has rendered numerous landslides to a global natural disaster issue.It is crucial to rapidly and accurately determine the boundaries of landslides for geohazards evaluation and emergency response.Therefore,the Skip Connection DeepLab neural network(SCDnn),a deep learning model based on 770 optical remote sensing images of landslide,is proposed to improve the accuracy of landslide boundary detection.The SCDnn model is optimized for the over-segmentation issue which occurs in conventional deep learning models when there is a significant degree of similarity between topographical geomorphic features.SCDnn exhibits notable improvements in landslide feature extraction and semantic segmentation by combining an enhanced Atrous Spatial Pyramid Convolutional Block(ASPC)with a coding structure that reduces model complexity.The experimental results demonstrate that SCDnn can identify landslide boundaries in 119 images with MIoU values between 0.8and 0.9;while 52 images with MIoU values exceeding 0.9,which exceeds the identification accuracy of existing techniques.This work can offer a novel technique for the automatic extensive identification of landslide boundaries in remote sensing images in addition to establishing the groundwork for future inve stigations and applications in related domains.

Smart Photogrammetric and Remote Sensing Image Processing for Very High Resolution Optical Images——Examples from the CRC-AGIP Lab at UNB

This paper introduces some of the image processing techniques developed in the Canada Research Chair in Advanced Geomatics Image Processing Laboratory (CRC-AGIP Lab) and in the Department of Geodesy and Geomatics Engineering (GGE) at the University of New Brunswick (UNB), Canada. The techniques were developed by innovatively/“smartly” utilizing the characteristics of the available very high resolution optical remote sensing images to solve important problems or create new applications in photogrammetry and remote sensing. The techniques to be introduced are: automated image fusion (UNB-PanSharp), satellite image online mapping, street view technology, moving vehicle detection using single set satellite imagery, supervised image segmentation, image matching in smooth areas, and change detection using images from different viewing angles. Because of their broad application potential, some of the techniques have made a global impact, and some have demonstrated the potential for a global impact.

Weakly Supervised Network with Scribble-Supervised and Edge-Mask for Road Extraction from High-Resolution Remote Sensing Images

Significant advancements have been achieved in road surface extraction based on high-resolution remote sensingimage processing. Most current methods rely on fully supervised learning, which necessitates enormous humaneffort to label the image. Within this field, other research endeavors utilize weakly supervised methods. Theseapproaches aim to reduce the expenses associated with annotation by leveraging sparsely annotated data, such asscribbles. This paper presents a novel technique called a weakly supervised network using scribble-supervised andedge-mask (WSSE-net). This network is a three-branch network architecture, whereby each branch is equippedwith a distinct decoder module dedicated to road extraction tasks. One of the branches is dedicated to generatingedge masks using edge detection algorithms and optimizing road edge details. The other two branches supervise themodel’s training by employing scribble labels and spreading scribble information throughout the image. To addressthe historical flaw that created pseudo-labels that are not updated with network training, we use mixup to blendprediction results dynamically and continually update new pseudo-labels to steer network training. Our solutiondemonstrates efficient operation by simultaneously considering both edge-mask aid and dynamic pseudo-labelsupport. The studies are conducted on three separate road datasets, which consist primarily of high-resolutionremote-sensing satellite photos and drone images. The experimental findings suggest that our methodologyperforms better than advanced scribble-supervised approaches and specific traditional fully supervised methods.

High-resolution Remote Sensing Image Segmentation Using Minimum Spanning Tree Tessellation and RHMRF-FCM Algorithm

It is proposed a high resolution remote sensing image segmentation method which combines static minimum spanning tree(MST)tessellation considering shape information and the RHMRF-FCM algorithm.It solves the problems in the traditional pixel-based HMRF-FCM algorithm in which poor noise resistance and low precision segmentation in a complex boundary exist.By using the MST model and shape information,the object boundary and geometrical noise can be expressed and reduced respectively.Firstly,the static MST tessellation is employed for dividing the image domain into some sub-regions corresponding to the components of homogeneous regions needed to be segmented.Secondly,based on the tessellation results,the RHMRF model is built,and regulation terms considering the KL information and the information entropy are introduced into the FCM objective function.Finally,the partial differential method and Lagrange function are employed to calculate the parameters of the fuzzy objective function for obtaining the global optimal segmentation results.To verify the robustness and effectiveness of the proposed algorithm,the experiments are carried out with WorldView-3(WV-3)high resolution image.The results from proposed method with different parameters and comparing methods(multi-resolution method and watershed segmentation method in eCognition software)are analyzed qualitatively and quantitatively.

Effective distributed convolutional neural network architecture for remote sensing images target classification with a pre-training approach

How to recognize targets with similar appearances from remote sensing images(RSIs) effectively and efficiently has become a big challenge. Recently, convolutional neural network(CNN) is preferred in the target classification due to the powerful feature representation ability and better performance. However,the training and testing of CNN mainly rely on single machine.Single machine has its natural limitation and bottleneck in processing RSIs due to limited hardware resources and huge time consuming. Besides, overfitting is a challenge for the CNN model due to the unbalance between RSIs data and the model structure.When a model is complex or the training data is relatively small,overfitting occurs and leads to a poor predictive performance. To address these problems, a distributed CNN architecture for RSIs target classification is proposed, which dramatically increases the training speed of CNN and system scalability. It improves the storage ability and processing efficiency of RSIs. Furthermore,Bayesian regularization approach is utilized in order to initialize the weights of the CNN extractor, which increases the robustness and flexibility of the CNN model. It helps prevent the overfitting and avoid the local optima caused by limited RSI training images or the inappropriate CNN structure. In addition, considering the efficiency of the Na¨?ve Bayes classifier, a distributed Na¨?ve Bayes classifier is designed to reduce the training cost. Compared with other algorithms, the proposed system and method perform the best and increase the recognition accuracy. The results show that the distributed system framework and the proposed algorithms are suitable for RSIs target classification tasks.

CrossFormer Embedding DeepLabv3+ for Remote Sensing Images Semantic Segmentation

High-resolution remote sensing image segmentation is a challenging task. In urban remote sensing, the presenceof occlusions and shadows often results in blurred or invisible object boundaries, thereby increasing the difficultyof segmentation. In this paper, an improved network with a cross-region self-attention mechanism for multi-scalefeatures based onDeepLabv3+is designed to address the difficulties of small object segmentation and blurred targetedge segmentation. First,we use CrossFormer as the backbone feature extraction network to achieve the interactionbetween large- and small-scale features, and establish self-attention associations between features at both large andsmall scales to capture global contextual feature information. Next, an improved atrous spatial pyramid poolingmodule is introduced to establish multi-scale feature maps with large- and small-scale feature associations, andattention vectors are added in the channel direction to enable adaptive adjustment of multi-scale channel features.The proposed networkmodel is validated using the PotsdamandVaihingen datasets. The experimental results showthat, compared with existing techniques, the network model designed in this paper can extract and fuse multiscaleinformation, more clearly extract edge information and small-scale information, and segment boundariesmore smoothly. Experimental results on public datasets demonstrate the superiority of ourmethod compared withseveral state-of-the-art networks.

Instance Segmentation of Outdoor Sports Ground from High Spatial Resolution Remote Sensing Imagery Using the Improved Mask R-CNN

Aiming at the land cover (features) recognition of outdoor sports venues (football field, basketball court, tennis court and baseball field), this paper proposed a set of object recognition methods and technical flow based on Mask R-CNN. Firstly, through the preprocessing of high spatial resolution remote sensing imagery (HSRRSI) and collecting the artificial samples of outdoor sports venues, the training data set required for object recognition of land cover features was constructed. Secondly, the Mask R-CNN was used as the basic training model to be adapted to cope with outdoor sports venues. Thirdly, the recognition results were compared with the four object-oriented machine learning classification methods in eCognition&#174. The experiment results of effectiveness verification show that the Mask R-CNN is superior to traditional methods not only in technical procedures but also in outdoor sports venues (football field, basketball court, tennis court and baseball field) recognition results, and it achieves the precision of 0.8927, a recall of 0.9356 and an average precision of 0.9235. Finally, from the aspect of practical engineering application, using and validating the well-trained model, an empirical application experiment was performed on the HSRRSI of Xicheng and Daxing District of Beijing respectively, and the generalization ability of the trained model of Mask R-CNN was thoroughly evaluated.

Research on a Watermarking Algorithm for Remote Sensing Images Resist Screen Capture Attacks in Urban Planning Information Management

Remote Sensing data, as an essential urban basic information in urban planning, has the characteristics of large information capacity, real time, high update speed and accuracy. Because of urban spatial information involving multi-faceted public and public interests, its data security is very important. The use of digital watermarking technology can effectively protect the secu-rity of urban planning basic data. In practical applications, the “screen capture” poses a great threat to the security of remote sensing image. In order to resist the screen capture attacks, the QR code watermark information is encoded and converted, and combined with a circular angle template watermark, a digital watermarking algorithm for remote sensing images in urban planning information management is proposed. And the proposed algorithm is experimentally verified. Experiments show that the algorithm is robust against screen capture attacks, and provide security guarantee for urban construction and management.

High-Resolution Remote Sensing Imagery for the Recognition of Traditional Villages

Traditional Chinese villages,vital carriers of traditional culture,have faced significant alterations due to urbanization in recent years,urgently necessitating artificial intelligence data updates.This study integrates high spatial resolution remote sensing imagery with deep learning techniques,proposing a novel method for identifying rooftops of traditional Chinese village buildings using high-definition remote sensing images.Using 0.54 m spatial resolution imagery of traditional village areas as the data source,this method analyzes the geometric and spectral image characteristics of village building rooftops.It constructs a deep learning feature sample library tailored to the target types.Employing a semantically enhanced version of the improved Mask R-CNN(Mask Region-based Convolutional Neural Network)for building recognition,the study conducts experiments on localized imagery from different regions.The results demonstrated that the modified Mask R-CNN effectively identifies traditional village building rooftops,achieving an of 0.7520 and an of 0.7400.It improves the current problem of misidentification and missed detection caused by feature heterogeneity.This method offers a viable and effective approach for industrialized data monitoring of traditional villages,contributing to their sustainable development.

A two-scale approach for estimating forest aboveground biomass with optical remote sensing images in a subtropical forest of Nepal

Forests account for 80%of the total carbon exchange between the atmosphere and terrestrial ecosystems.Thus,to better manage our responses to global warming,it is important to monitor and assess forest aboveground carbon and forest aboveground biomass(FAGB).Different levels of detail are needed to estimate FAGB at local,regional and national scales.Multi-scale remote sensing analysis from high,medium and coarse spatial resolution data,along with field sampling,is one approach often used.However,the methods developed are still time consuming,expensive,and inconvenient for systematic monitoring,especially for developing countries,as they require vast numbers of field samples for upscaling.Here,we recommend a convenient two-scale approach to estimate FAGB that was tested in our study sites.The study was conducted in the Chitwan district of Nepal using GeoEye-1(0.5 m),Landsat(30 m)and Google Earth very high resolution(GEVHR)Quickbird(0.65 m)images.For the local scale(Kayerkhola watershed),tree crowns of the area were delineated by the object-based image analysis technique on GeoEye images.An overall accuracy of 83%was obtained in the delineation of tree canopy cover(TCC)per plot.A TCC vs.FAGB model was developed based on the TCC estimations from GeoEye and FAGB measurements from field sample plots.A coefficient of determination(R2)of 0.76 was obtained in the modelling,and a value of 0.83 was obtained in the validation of the model.To upscale FAGB to the entire district,open source GEVHR images were used as virtual field plots.We delineated their TCC values and then calculated FAGB based on a TCC versus FAGB model.Using the multivariate adaptive regression splines machine learning algorithm,we developed a model from the relationship between the FAGB of GEVHR virtual plots with predictor parameters from Landsat 8 bands and vegetation indices.The model was then used to extrapolate FAGB to the entire district.This approach considerably reduced the need for field data and commercial very high resolution imagery while achieving two-scale forest information and FAGB estimates at high resolution(30 m)and accuracy(R2=0.76 and 0.7)with minimal error(RMSE=64 and 38 tons ha-1)at local and regional scales.This methodology is a promising technique for cost-effective FAGB and carbon estimations and can be replicated with limited resources and time.The method is especially applicable for developing countries that have low budgets for carbon estimations,and it is also applicable to the Reducing Emissions from Deforestation and Forest Degradation(REDD?)monitoring reporting and verification processes.

Remote Sensing Image Fusion Using Bidimensional Empirical Mode Decomposition and the Least Squares Theory

Due to the data acquired by most optical earth observation satellite such as IKONOS, QuickBird-2 and GF-1 consist of a panchromatic image with high spatial resolution and multiple multispectral images with low spatial resolution. Many image fusion techniques have been developed to produce high resolution multispectral image. Considering panchromatic image and multispectral images contain the same spatial information with different accuracy, using the least square theory could estimate optimal spatial information. Compared with previous spatial details injection mode, this mode is more accurate and robust. In this paper, an image fusion method using Bidimensional Empirical Mode Decomposition (BEMD) and the least square theory is proposed to merge multispectral images and panchromatic image. After multi-spectral images were transformed from RGB space into IHS space, next I component and Panchromatic are decomposed by BEMD, then using the least squares theory to evaluate optimal spatial information and inject spatial information, finally completing fusion through inverse BEMD and inverse intensity-hue-saturation transform. Two data sets are used to evaluate the proposed fusion method, GF-1 images and QuickBird-2 images. The fusion images were evaluated visually and statistically. The evaluation results show the method proposed in this paper achieves the best performance compared with the conventional method.

Experimental investigation on the optical remote sensing images of internal solitary waves with a smooth surface

The parameter inversion of internal solitary waves (ISWs) based on optical remote sensing images is a key work. A new approach is proposed and demonstrated for simulating the optical remote sensing images of ISWs with a smooth surface in the laboratory. An optical remote sensing simulation system used to detect ISWs is constructed by a two-dimensional ISW flume, a LED (light emitting diode) light source and two CCD (charge coupled device) cameras. The optical remote sensing images of the horizontal surface and ISWs propagation images of a vertical side are detected simultaneously, which aims to explore the response of optical remote sensing corresponding to ISWs with the smooth surface. The results show that during the propagation of ISWs, dark pattern images are obtained by CCD 1 camera. The characteristics of the dark patterns vary along with the incident angle of the light source. The characteristic parameters of the optical remote sensing images correspond to the wave factors of vertical profiles. The experiment also shows a positive correlation between the dark pattern width and the half wave width under different amplitudes of ISWs. The system has the advantages of clear phenomenon and high repeatability, which provides the scientific basis for quantitative investigation on imaging mechanism of ISW by optical remote sensing.

Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual Network

alient object detection aims at identifying the visually interesting object regions that are consistent with human perception. Multispectral remote sensing images provide rich radiometric information in revealing the physical properties of the observed objects, which leads to great potential to perform salient object detection for remote sensing images. Conventional salient object detection methods often employ handcrafted features to predict saliency by evaluating the pixel-wise or superpixel-wise contrast. With the recent use of deep learning framework, in particular, fully convolutional neural networks, there has been profound progress in visual saliency detection. However, this success has not been extended to multispectral remote sensing images, and existing multispectral salient object detection methods are still mainly based on handcrafted features, essentially due to the difficulties in image acquisition and labeling. In this paper, we propose a novel deep residual network based on a top-down model, which is trained in an end-to-end manner to tackle the above issues in multispectral salient object detection. Our model effectively exploits the saliency cues at different levels of the deep residual network. To overcome the limited availability of remote sensing images in training of our deep residual network, we also introduce a new spectral image reconstruction model that can generate multispectral images from RGB images. Our extensive experimental results using both multispectral and RGB salient object detection datasets demonstrate a significant performance improvement of more than 10% improvement compared with the state-of-the-art methods.

Privacy‐preserving remote sensing images recognition based on limited visual cryptography

With the arrival of new data acquisition platforms derived from the Internet of Things(IoT),this paper goes beyond the understanding of traditional remote sensing technologies.Deep fusion of remote sensing and computer vision has hit the industrial world and makes it possible to apply Artificial intelligence to solve problems such as automatic extraction of information and image interpretation.However,due to the complex architecture of IoT and the lack of a unified security protection mechanism,devices in remote sensing are vulnerable to privacy leaks when sharing data.It is necessary to design a security scheme suitable for computation‐limited devices in IoT,since traditional encryption methods are based on computational complexity.Visual Cryptography(VC)is a threshold scheme for images that can be decoded directly by the human visual system when superimposing encrypted images.The stacking‐to‐see feature and simple Boolean decryption operation make VC an ideal solution for privacy‐preserving recognition for large‐scale remote sensing images in IoT.In this study,the secure and efficient transmission of high‐resolution remote sensing images by meaningful VC is achieved.By diffusing the error between the encryption block and the original block to adjacent blocks,the degradation of quality in recovery images is mitigated.By fine‐tuning the pre‐trained model from large‐scale datasets,we improve the recognition performance of small encryption datasets for remote sensing images.The experimental results show that the proposed lightweight privacy‐preserving recognition framework maintains high recognition performance while enhancing security.

Analysis of Urban Greening of Tai'an City in China Based on Remote Sensing Image with High Resolution

By taking urban greening of Tai'an City of Shandong Province for example,selecting remote sensing image Quickbird with high resolution,and combining visual interpretation with automatic classification of the computer,based on urban green space systematic planning map,green space information of the built-up area has been selected for the research centering on green lands in urban parks,productive green lands,green lands attached to residential areas and units,green lands attached to the road,other green lands,water surfaces and so on.Through the statistics and analysis,the distribution condition of each type of urban green land has been obtained,and some suggestions have been proposed in view of existing problems of urban greening.It should enhance the construction of green lands in urban parks,residential areas and units,improve road greening level,implement vertical greening,increase the area of productive green lands and fully make use of idle lands.

Road Vector Map Change Monitoring Based on High Resolution Remote Sensing Images

Some studies about road vector map change detection were done in this paper. Firstly, on the basis of old road vector data, the original high resolution remote sensing image was cut into segments. Then, gray analysis and edge extraction of those segments were done so that changes of roads could be detected. Finally, according to the vector data and gray information of roads which were not changed, road templates were extracted and saved automatically. This method was performed on the World View high resolution image of certain parts in the country. The detection result shows that detection correctness is 79.56% and completeness can reach 97.72%. Moreover, the extracted road templates are essentials for the template matching method of road extraction.

VLCA: vision-language aligning model with cross-modal attention for bilingual remote sensing image captioning

In the field of satellite imagery, remote sensing image captioning(RSIC) is a hot topic with the challenge of overfitting and difficulty of image and text alignment. To address these issues, this paper proposes a vision-language aligning paradigm for RSIC to jointly represent vision and language. First, a new RSIC dataset DIOR-Captions is built for augmenting object detection in optical remote(DIOR) sensing images dataset with manually annotated Chinese and English contents. Second, a Vision-Language aligning model with Cross-modal Attention(VLCA) is presented to generate accurate and abundant bilingual descriptions for remote sensing images. Third, a crossmodal learning network is introduced to address the problem of visual-lingual alignment. Notably, VLCA is also applied to end-toend Chinese captions generation by using the pre-training language model of Chinese. The experiments are carried out with various baselines to validate VLCA on the proposed dataset. The results demonstrate that the proposed algorithm is more descriptive and informative than existing algorithms in producing captions.

Estimation of Poverty Based on Remote Sensing Image and Convolutional Neural Network

Poverty has always been one of the topics concerned by governments and researchers all over the world, especially in developing countries. Remote sensing image is widely used in poverty estimation because of its large area observation, timeliness and periodicity. In this study, we explore the applicability of convolution neural network (CNN) combined with remote sensing image in regional poverty estimation. In the 2016 economic indicators estimation of Guizhou Province, China, the Pearson coefficient of per capita GDP (PCGDP) reached 0.76, which means that the image features extracted by CNN can explain the change of PCGDP of county level economic indicators up to 76%. Compared with other methods, our method still has high precision. Based on these results, we found that convolutional neural network combined with remote sensing image can be used in regional poverty estimation.

A NEW METHOD FOR MEASURING OCEAN WAVE FROM SEASAT SAR REMOTE SENSING IMAGE

A new method for measuring ocean wave length and direction from SEASAT SyntheticAperture Radar (SAR)remote sensing image is presented in the paper. In the new method, an ocean waveimage is sampled in certain directions, the samples are then analyzed by using one dimensional FourierTransformation to calculate the ocean wave correlation function. Finally the ocean wave length and direc-tion are determined from the ocean wave correlation function. The new method is better than the tradition-al two-dimensional Fourier Transformation method in both consuming time and precision .

Optimizing Spatial Relationships in GCN to Improve the Classification Accuracy of Remote Sensing Images

Semantic segmentation of remote sensing images is one of the core tasks of remote sensing image interpretation.With the continuous develop-ment of artificial intelligence technology,the use of deep learning methods for interpreting remote-sensing images has matured.Existing neural networks disregard the spatial relationship between two targets in remote sensing images.Semantic segmentation models that combine convolutional neural networks(CNNs)and graph convolutional neural networks(GCNs)cause a lack of feature boundaries,which leads to the unsatisfactory segmentation of various target feature boundaries.In this paper,we propose a new semantic segmentation model for remote sensing images(called DGCN hereinafter),which combines deep semantic segmentation networks(DSSN)and GCNs.In the GCN module,a loss function for boundary information is employed to optimize the learning of spatial relationship features between the target features and their relationships.A hierarchical fusion method is utilized for feature fusion and classification to optimize the spatial relationship informa-tion in the original feature information.Extensive experiments on ISPRS 2D and DeepGlobe semantic segmentation datasets show that compared with the existing semantic segmentation models of remote sensing images,the DGCN significantly optimizes the segmentation effect of feature boundaries,effectively reduces the noise in the segmentation results and improves the segmentation accuracy,which demonstrates the advancements of our model.