Transformer-Based Cloud Detection Method for High-Resolution Remote Sensing Imagery

Cloud detection from satellite and drone imagery is crucial for applications such as weather forecasting and environmentalmonitoring.Addressing the limitations of conventional convolutional neural networks,we propose an innovative transformer-based method.This method leverages transformers,which are adept at processing data sequences,to enhance cloud detection accuracy.Additionally,we introduce a Cyclic Refinement Architecture that improves the resolution and quality of feature extraction,thereby aiding in the retention of critical details often lost during cloud detection.Our extensive experimental validation shows that our approach significantly outperforms established models,excelling in high-resolution feature extraction and precise cloud segmentation.By integrating Positional Visual Transformers(PVT)with this architecture,our method advances high-resolution feature delineation and segmentation accuracy.Ultimately,our research offers a novel perspective for surmounting traditional challenges in cloud detection and contributes to the advancement of precise and dependable image analysis across various domains.

Weakly Supervised Network with Scribble-Supervised and Edge-Mask for Road Extraction from High-Resolution Remote Sensing Images

Significant advancements have been achieved in road surface extraction based on high-resolution remote sensingimage processing. Most current methods rely on fully supervised learning, which necessitates enormous humaneffort to label the image. Within this field, other research endeavors utilize weakly supervised methods. Theseapproaches aim to reduce the expenses associated with annotation by leveraging sparsely annotated data, such asscribbles. This paper presents a novel technique called a weakly supervised network using scribble-supervised andedge-mask (WSSE-net). This network is a three-branch network architecture, whereby each branch is equippedwith a distinct decoder module dedicated to road extraction tasks. One of the branches is dedicated to generatingedge masks using edge detection algorithms and optimizing road edge details. The other two branches supervise themodel’s training by employing scribble labels and spreading scribble information throughout the image. To addressthe historical flaw that created pseudo-labels that are not updated with network training, we use mixup to blendprediction results dynamically and continually update new pseudo-labels to steer network training. Our solutiondemonstrates efficient operation by simultaneously considering both edge-mask aid and dynamic pseudo-labelsupport. The studies are conducted on three separate road datasets, which consist primarily of high-resolutionremote-sensing satellite photos and drone images. The experimental findings suggest that our methodologyperforms better than advanced scribble-supervised approaches and specific traditional fully supervised methods.

High-Resolution Remote Sensing Imagery for the Recognition of Traditional Villages

Traditional Chinese villages,vital carriers of traditional culture,have faced significant alterations due to urbanization in recent years,urgently necessitating artificial intelligence data updates.This study integrates high spatial resolution remote sensing imagery with deep learning techniques,proposing a novel method for identifying rooftops of traditional Chinese village buildings using high-definition remote sensing images.Using 0.54 m spatial resolution imagery of traditional village areas as the data source,this method analyzes the geometric and spectral image characteristics of village building rooftops.It constructs a deep learning feature sample library tailored to the target types.Employing a semantically enhanced version of the improved Mask R-CNN(Mask Region-based Convolutional Neural Network)for building recognition,the study conducts experiments on localized imagery from different regions.The results demonstrated that the modified Mask R-CNN effectively identifies traditional village building rooftops,achieving an of 0.7520 and an of 0.7400.It improves the current problem of misidentification and missed detection caused by feature heterogeneity.This method offers a viable and effective approach for industrialized data monitoring of traditional villages,contributing to their sustainable development.

High-resolution Remote Sensing Image Segmentation Using Minimum Spanning Tree Tessellation and RHMRF-FCM Algorithm

It is proposed a high resolution remote sensing image segmentation method which combines static minimum spanning tree(MST)tessellation considering shape information and the RHMRF-FCM algorithm.It solves the problems in the traditional pixel-based HMRF-FCM algorithm in which poor noise resistance and low precision segmentation in a complex boundary exist.By using the MST model and shape information,the object boundary and geometrical noise can be expressed and reduced respectively.Firstly,the static MST tessellation is employed for dividing the image domain into some sub-regions corresponding to the components of homogeneous regions needed to be segmented.Secondly,based on the tessellation results,the RHMRF model is built,and regulation terms considering the KL information and the information entropy are introduced into the FCM objective function.Finally,the partial differential method and Lagrange function are employed to calculate the parameters of the fuzzy objective function for obtaining the global optimal segmentation results.To verify the robustness and effectiveness of the proposed algorithm,the experiments are carried out with WorldView-3(WV-3)high resolution image.The results from proposed method with different parameters and comparing methods(multi-resolution method and watershed segmentation method in eCognition software)are analyzed qualitatively and quantitatively.

Instance Segmentation of Outdoor Sports Ground from High Spatial Resolution Remote Sensing Imagery Using the Improved Mask R-CNN

Aiming at the land cover (features) recognition of outdoor sports venues (football field, basketball court, tennis court and baseball field), this paper proposed a set of object recognition methods and technical flow based on Mask R-CNN. Firstly, through the preprocessing of high spatial resolution remote sensing imagery (HSRRSI) and collecting the artificial samples of outdoor sports venues, the training data set required for object recognition of land cover features was constructed. Secondly, the Mask R-CNN was used as the basic training model to be adapted to cope with outdoor sports venues. Thirdly, the recognition results were compared with the four object-oriented machine learning classification methods in eCognition&#174. The experiment results of effectiveness verification show that the Mask R-CNN is superior to traditional methods not only in technical procedures but also in outdoor sports venues (football field, basketball court, tennis court and baseball field) recognition results, and it achieves the precision of 0.8927, a recall of 0.9356 and an average precision of 0.9235. Finally, from the aspect of practical engineering application, using and validating the well-trained model, an empirical application experiment was performed on the HSRRSI of Xicheng and Daxing District of Beijing respectively, and the generalization ability of the trained model of Mask R-CNN was thoroughly evaluated.

Quantizing and analyzing the feature information of coastal zone based on high-resolution remote sensing image

On the basis of realization of beach information and its differentiating of high-resolution remote sensing image on coastal zone, extracting objects are carried through RS multi-scale diagnostic analysis, and fast information extraction methods and key technologies are put forward. Meanwhile image segmentation methods are set forth for objects of coastal zone. And through the application of Otsu2D to the segmentation of water area and dock and the applying of Gabor filter to the separation and extraction of construction, some typical applications of high-resolution RS image are presented in the field of coastal zone surface objects＇ recognition. Quantizing high-resolution RS information on the coastal zone proved to be of great scientific and practical significance for coastal development and management.

Correg-Yolov3:a Method for Dense Buildings Detection in High-resolution Remote Sensing Images

The exploration of building detection plays an important role in urban planning,smart city and military.Aiming at the problem of high overlapping ratio of detection frames for dense building detection in high resolution remote sensing images,we present an effective YOLOv3 framework,corner regression-based YOLOv3(Correg-YOLOv3),to localize dense building accurately.This improved YOLOv3 algorithm establishes a vertex regression mechanism and an additional loss item about building vertex offsets relative to the center point of bounding box.By extending output dimensions,the trained model is able to output the rectangular bounding boxes and the building vertices meanwhile.Finally,we evaluate the performance of the Correg-YOLOv3 on our self-produced data set and provide a comparative analysis qualitatively and quantitatively.The experimental results achieve high performance in precision(96.45%),recall rate(95.75%),F1 score(96.10%)and average precision(98.05%),which were 2.73%,5.4%,4.1%and 4.73%higher than that of YOLOv3.Therefore,our proposed algorithm effectively tackles the problem of dense building detection in high resolution images.

Road Vector Map Change Monitoring Based on High Resolution Remote Sensing Images

Some studies about road vector map change detection were done in this paper. Firstly, on the basis of old road vector data, the original high resolution remote sensing image was cut into segments. Then, gray analysis and edge extraction of those segments were done so that changes of roads could be detected. Finally, according to the vector data and gray information of roads which were not changed, road templates were extracted and saved automatically. This method was performed on the World View high resolution image of certain parts in the country. The detection result shows that detection correctness is 79.56% and completeness can reach 97.72%. Moreover, the extracted road templates are essentials for the template matching method of road extraction.

Monitoring of Karst Rocky Desertification Control Projects Based on Remote Sensing Images with Medium and High Spatial Resolution——A Case Study of Disi River Basin in Puan County

[ Objective] The study aimed to improve methods of monitoring Karst Rocky Desertification （KRD） control projects and increase the working efficiency. [Method] Based on remote sensing images with medium and high spatial resolution, KRD control projects in Disi River basin in Puan County were monitored, that is, information of the project construction in the study area was extracted using supervised classification and hu- man-computer interactive interpretation, and the monitoring results were testified with the aid of GPS. [Result] It was feasible to monitor KRD con- trol projects in Disi River basin based on remote sensing images with medium and high resolution, and the monitoring accuracy was satisfactory, reaching above 80% or 90%, so the method is worthy of popularizing. [ Conclusion] Remote sensing images with medium and high resolution can be used to monitor other KRD control Droiects.

Smart Photogrammetric and Remote Sensing Image Processing for Very High Resolution Optical Images——Examples from the CRC-AGIP Lab at UNB

This paper introduces some of the image processing techniques developed in the Canada Research Chair in Advanced Geomatics Image Processing Laboratory (CRC-AGIP Lab) and in the Department of Geodesy and Geomatics Engineering (GGE) at the University of New Brunswick (UNB), Canada. The techniques were developed by innovatively/“smartly” utilizing the characteristics of the available very high resolution optical remote sensing images to solve important problems or create new applications in photogrammetry and remote sensing. The techniques to be introduced are: automated image fusion (UNB-PanSharp), satellite image online mapping, street view technology, moving vehicle detection using single set satellite imagery, supervised image segmentation, image matching in smooth areas, and change detection using images from different viewing angles. Because of their broad application potential, some of the techniques have made a global impact, and some have demonstrated the potential for a global impact.

New Mathematical Model Based on Affine ransformation for Remote Sensing Image with High Resolution

This paper calculates the parameters of image position and orientation,proposes a mathematical model and adopts a new method with three steps of transformations based on parallel ray projection.Every step of the model is strict,and the map function of each transformation is the first order polynomials and other simple function.The final calculation of the parameters is for the linear equations with good status.As a result,the problem of the relativity of image parameter calculation is solved completely.Some experiments are carried out.

Analysis of Urban Greening of Tai'an City in China Based on Remote Sensing Image with High Resolution

By taking urban greening of Tai'an City of Shandong Province for example,selecting remote sensing image Quickbird with high resolution,and combining visual interpretation with automatic classification of the computer,based on urban green space systematic planning map,green space information of the built-up area has been selected for the research centering on green lands in urban parks,productive green lands,green lands attached to residential areas and units,green lands attached to the road,other green lands,water surfaces and so on.Through the statistics and analysis,the distribution condition of each type of urban green land has been obtained,and some suggestions have been proposed in view of existing problems of urban greening.It should enhance the construction of green lands in urban parks,residential areas and units,improve road greening level,implement vertical greening,increase the area of productive green lands and fully make use of idle lands.

Perspective of Chinese GF-1 high-resolution satellite data in agricultural remote sensing monitoring

High-resolution satellite data have been playing an important role in agricultural remote sensing monitoring. However, the major data sources of high-resolution images are not owned by China. The cost of large scale use of high resolution imagery data becomes prohibitive. In pace of the launch of the Chinese ＂High Resolution Earth Observation Systems＂, China is able to receive superb high-resolution remotely sensed images （GF series） that equalizes or even surpasses foreign similar satellites in respect of spatial resolution, scanning width and revisit period. This paper provides a perspective of using high resolution remote sensing data from satellite GF-1 for agriculture monitoring. It also assesses the applicability of GF-1 data for agricultural monitoring, and identifies potential applications from regional to national scales. GF-1＇s high resolution （i.e., 2 m/8 m）, high revisit cycle （i.e., 4 days）, and its visible and near-infrared （VNIR） spectral bands enable a continuous, efficient and effective agricultural dynamics monitoring. Thus, it has gradually substituted the foreign data sources for mapping crop planting areas, monitoring crop growth, estimating crop yield, monitoring natural disasters, and supporting precision and facility agriculture in China agricultural remote sensing monitoring system （CHARMS）. However, it is still at the initial stage of GF-1 data application in agricultural remote sensing monitoring. Advanced algorithms for estimating agronomic parameters and soil quality with GF-1 data need to be further investigated, especially for improving the performance of remote sensing monitoring in the fragmented landscapes. In addition, the thematic product series in terms of land cover, crop allocation, crop growth and production are required to be developed in association with other data sources at multiple spatial scales. Despite the advantages, the issues such as low spectrum resolution and image distortion associated with high spatial resolution and wide swath width, might pose challenges for GF-1 data applications and need to be addressed in future agricultural monitoring.

Technical foundation research on high resolution remote sensing system of China's coastal zone

China's coastal zone is a region with a highly developed economy that contrasts clearly with the slow paced regular investigation on its natural environment,which cannot keep pace with the requirement of economic development and modern management.Laying a theoretical foundation for the modern management of China's costal zone is aimed at. This research focuses on the following processing and analyzing technologies for coastal zone high-resolution remote sensing data: organization and management of large amounts of high-resolution remote sensing data, quick and precise spatial positioning system,algorithms for image fusion in feature level and coastal zone feature extraction. They will form a technical foundation of the system. And, if combined with other research results such as coastal zone remote sensing classification system and its mapping subsystem, an advanced technical frame for remote sensing investigation of coastal zone resource will be constructed.

Influences of Atmospheric Turbulence on Image Resolution of Airborne and Space-Borne Optical Remote Sensing System

A new way is proposed to evaluate the influence of atmospheric turbulence on image resolution of airborne and space-borne optical remote sensing system, which is called as arrival angle-method. Applying this method, some engineering examples are selected to analyze the turbulence influences on image resolution based on three different atmospheric turbulence models quantificationally, for the airborne remote sensing system, the resolution errors caused by the atmospheric turbulence are less than 1 cm, and for the space-borne remote sensing system, the errors are around 1 cm. The results are similar to that obtained by the previous Friedmethod. Compared with the Fried-method, the arrival angle-method is rather simple and can be easily used in engineering fields.

CFM-UNet:A Joint CNN and Transformer Network via Cross Feature Modulation for Remote Sensing Images Segmentation

The semantic segmentation methods based on CNN have made great progress,but there are still some shortcomings in the application of remote sensing images segmentation,such as the small receptive field can not effectively capture global context.In order to solve this problem,this paper proposes a hybrid model based on ResNet50 and swin transformer to directly capture long-range dependence,which fuses features through Cross Feature Modulation Module(CFMM).Experimental results on two publicly available datasets,Vaihingen and Potsdam,are mIoU of 70.27%and 76.63%,respectively.Thus,CFM-UNet can maintain a high segmentation performance compared with other competitive networks.

Alternative Fuzzy Cluster Segmentation of Remote Sensing Images Based on Adaptive Genetic Algorithm

Remote sensing image segmentation is the basis of image understanding and analysis. However,the precision and the speed of segmentation can not meet the need of image analysis,due to strong uncertainty and rich texture details of remote sensing images. We proposed a new segmentation method based on Adaptive Genetic Algorithm(AGA) and Alternative Fuzzy C-Means(AFCM) . Segmentation thresholds were identified by AGA. Then the image was segmented by AFCM. The results indicate that the precision and the speed of segmentation have been greatly increased,and the accuracy of threshold selection is much higher compared with traditional Otsu and Fuzzy C-Means(FCM) segmentation methods. The segmentation results also show that multi-thresholds segmentation has been achieved by combining AGA with AFCM.

A method of remote sensing image water segmentation based on adaptive morphological elliptical structuring elements

The use of visible and infrared remote sensing images to calculate the water area is an effective means to grasp the basic situation of water resources,and water segmentation is the premise of statistics.Generally,the edge features of the water in the remote sensing images are complex.When the traditional morphology is used for image segmentation,it is easy to change the image edge and affect the accuracy of image segmentation because the fixed structuring elements are used to perform morphological operations on the image.To segment water in the remote sensing image accurately,a remote sensing image water segmentation method based on adaptive morphological elliptical structuring elements is proposed.Firstly,the eigenvalue and eigenvector of the image are estimated by linear structure tensor,and the elliptical structuring elements are constructed by the eigenvalue and eigenvector.Then adaptive morphological operations are defined,combining the close operation to eliminate the influence of dark detail noise on water without overstretching the water edge,so that the water edge can be maintained more accurately.Finally,on this basis,the water area can be segmented by gray slice.The experimental results show that the proposed method has higher segmentation accuracy and the average segmentation error is less than 1.43%.

Super-resolution Restoration of Remote-sensing Images

A novel image restoration scheme, which is super-resolution image restoration algorithm Poisson-maximum-afterword-probability based on Markvo constraint (MPMAP) combined with evaluating image detail parameter D, has been proposed. The advantage of super-resolution algorithm MPMAP incorporated with parameter D lies in the fact that super-resolution algorithm MPMAP model is discrete, which is in accordance with remote-sensing imaging model, and the algorithm MPMAP is proved applicable to linear and non-linear imaging models with a unique solution when noise is not severe. According to simulation experiments for practical images, super-resolution algorithm MPMAP can retain image details better than most of traditional restoration methods; at the same time, the proposed parameter D can help to identify real point spread function (PSF) value of degradation process. Processing result of practical remote-sensing images by MPMAP combined with parameter D are given, it illustrates that MPMAP restoration scheme combined PSF estimation has a better restoration result than that of Photoshop processing, based on the same original images. It is proved that the proposed scheme is helpful to offset the lack of resolution of the original remote-sensing images and has its extensive application foreground.

A Remote Sensing Image Semantic Segmentation Method by Combining Deformable Convolution with Conditional Random Fields

Currently,deep convolutional neural networks have made great progress in the field of semantic segmentation.Because of the fixed convolution kernel geometry,standard convolution neural networks have been limited the ability to simulate geometric transformations.Therefore,a deformable convolution is introduced to enhance the adaptability of convolutional networks to spatial transformation.Considering that the deep convolutional neural networks cannot adequately segment the local objects at the output layer due to using the pooling layers in neural network architecture.To overcome this shortcoming,the rough prediction segmentation results of the neural network output layer will be processed by fully connected conditional random fields to improve the ability of image segmentation.The proposed method can easily be trained by end-to-end using standard backpropagation algorithms.Finally,the proposed method is tested on the ISPRS dataset.The results show that the proposed method can effectively overcome the influence of the complex structure of the segmentation object and obtain state-of-the-art accuracy on the ISPRS Vaihingen 2D semantic labeling dataset.