To create a green and healthy living environment,people have put forward higher requirements for the refined management of ecological resources.A variety of technologies,including satellite remote sensing,Internet of ...To create a green and healthy living environment,people have put forward higher requirements for the refined management of ecological resources.A variety of technologies,including satellite remote sensing,Internet of Things,artificial intelligence,and big data,can build a smart environmental monitoring system.Remote sensing image classification is an important research content in ecological environmental monitoring.Remote sensing images contain rich spatial information andmulti-temporal information,but also bring challenges such as difficulty in obtaining classification labels and low classification accuracy.To solve this problem,this study develops a transductive transfer dictionary learning(TTDL)algorithm.In the TTDL,the source and target domains are transformed fromthe original sample space to a common subspace.TTDL trains a shared discriminative dictionary in this subspace,establishes associations between domains,and also obtains sparse representations of source and target domain data.To obtain an effective shared discriminative dictionary,triple-induced ordinal locality preserving term,Fisher discriminant term,and graph Laplacian regularization termare introduced into the TTDL.The triplet-induced ordinal locality preserving term on sub-space projection preserves the local structure of data in low-dimensional subspaces.The Fisher discriminant term on dictionary improves differences among different sub-dictionaries through intra-class and inter-class scatters.The graph Laplacian regularization term on sparse representation maintains the manifold structure using a semi-supervised weight graphmatrix,which can indirectly improve the discriminative performance of the dictionary.The TTDL is tested on several remote sensing image datasets and has strong discrimination classification performance.展开更多
Remote sensing image(RSI)classifier roles a vital play in earth observation technology utilizing Remote sensing(RS)data are extremely exploited from both military and civil fields.More recently,as novel DL approaches ...Remote sensing image(RSI)classifier roles a vital play in earth observation technology utilizing Remote sensing(RS)data are extremely exploited from both military and civil fields.More recently,as novel DL approaches develop,techniques for RSI classifiers with DL have attained important breakthroughs,providing a new opportunity for the research and development of RSI classifiers.This study introduces an Improved Slime Mould Optimization with a graph convolutional network for the hyperspectral remote sensing image classification(ISMOGCN-HRSC)model.The ISMOGCN-HRSC model majorly concentrates on identifying and classifying distinct kinds of RSIs.In the presented ISMOGCN-HRSC model,the synergic deep learning(SDL)model is exploited to produce feature vectors.The GCN model is utilized for image classification purposes to identify the proper class labels of the RSIs.The ISMO algorithm is used to enhance the classification efficiency of the GCN method,which is derived by integrating chaotic concepts into the SMO algorithm.The experimental assessment of the ISMOGCN-HRSC method is tested using a benchmark dataset.展开更多
The remote sensing ships’fine-grained classification technology makes it possible to identify certain ship types in remote sensing images,and it has broad application prospects in civil and military fields.However,th...The remote sensing ships’fine-grained classification technology makes it possible to identify certain ship types in remote sensing images,and it has broad application prospects in civil and military fields.However,the current model does not examine the properties of ship targets in remote sensing images with mixed multi-granularity features and a complicated backdrop.There is still an opportunity for future enhancement of the classification impact.To solve the challenges brought by the above characteristics,this paper proposes a Metaformer and Residual fusion network based on Visual Attention Network(VAN-MR)for fine-grained classification tasks.For the complex background of remote sensing images,the VAN-MR model adopts the parallel structure of large kernel attention and spatial attention to enhance the model’s feature extraction ability of interest targets and improve the classification performance of remote sensing ship targets.For the problem of multi-grained feature mixing in remote sensing images,the VAN-MR model uses a Metaformer structure and a parallel network of residual modules to extract ship features.The parallel network has different depths,considering both high-level and lowlevel semantic information.The model achieves better classification performance in remote sensing ship images with multi-granularity mixing.Finally,the model achieves 88.73%and 94.56%accuracy on the public fine-grained ship collection-23(FGSC-23)and FGSCR-42 datasets,respectively,while the parameter size is only 53.47 M,the floating point operations is 9.9 G.The experimental results show that the classification effect of VAN-MR is superior to that of traditional CNNs model and visual model with Transformer structure under the same parameter quantity.展开更多
Hyperspectral remote sensing/imaging spectroscopy is a novel approach to reaching a spectrum from all the places of a huge array of spatial places so that several spectral wavelengths are utilized for making coherent ...Hyperspectral remote sensing/imaging spectroscopy is a novel approach to reaching a spectrum from all the places of a huge array of spatial places so that several spectral wavelengths are utilized for making coherent images.Hyperspectral remote sensing contains acquisition of digital images from several narrow,contiguous spectral bands throughout the visible,Thermal Infrared(TIR),Near Infrared(NIR),and Mid-Infrared(MIR)regions of the electromagnetic spectrum.In order to the application of agricultural regions,remote sensing approaches are studied and executed to their benefit of continuous and quantitativemonitoring.Particularly,hyperspectral images(HSI)are considered the precise for agriculture as they can offer chemical and physical data on vegetation.With this motivation,this article presents a novel Hurricane Optimization Algorithm with Deep Transfer Learning Driven Crop Classification(HOADTL-CC)model onHyperspectralRemote Sensing Images.The presentedHOADTL-CC model focuses on the identification and categorization of crops on hyperspectral remote sensing images.To accomplish this,the presentedHOADTL-CC model involves the design ofHOAwith capsule network(CapsNet)model for generating a set of useful feature vectors.Besides,Elman neural network(ENN)model is applied to allot proper class labels into the input HSI.Finally,glowworm swarm optimization(GSO)algorithm is exploited to fine tune the ENNparameters involved in this article.The experimental result scrutiny of the HOADTL-CC method can be tested with the help of benchmark dataset and the results are assessed under distinct aspects.Extensive comparative studies stated the enhanced performance of the HOADTL-CC model over recent approaches with maximum accuracy of 99.51%.展开更多
Over the past decade,the significant growth of the convolutional neural network(CNN)based on deep learning(DL)approaches has greatly improved the machine learning(ML)algorithm’s performance on the semantic scene clas...Over the past decade,the significant growth of the convolutional neural network(CNN)based on deep learning(DL)approaches has greatly improved the machine learning(ML)algorithm’s performance on the semantic scene classification(SSC)of remote sensing images(RSI).However,the unbalanced attention to classification accuracy and efficiency has made the superiority of DL-based algorithms,e.g.,automation and simplicity,partially lost.Traditional ML strategies(e.g.,the handcrafted features or indicators)and accuracy-aimed strategies with a high trade-off(e.g.,the multi-stage CNNs and ensemble of multi-CNNs)are widely used without any training efficiency optimization involved,which may result in suboptimal performance.To address this problem,we propose a fast and simple training CNN framework(named FST-EfficientNet)for RSI-SSC based on an EfficientNetversion2 small(EfficientNetV2-S)CNN model.The whole algorithm flow is completely one-stage and end-to-end without any handcrafted features or discriminators introduced.In the implementation of training efficiency optimization,only several routine data augmentation tricks coupled with a fixed ratio of resolution or a gradually increasing resolution strategy are employed,so that the algorithm’s trade-off is very cheap.The performance evaluation shows that our FST-EfficientNet achieves new state-of-the-art(SOTA)records in the overall accuracy(OA)with about 0.8%to 2.7%ahead of all earlier methods on the Aerial Image Dataset(AID)and Northwestern Poly-technical University Remote Sensing Image Scene Classification 45 Dataset(NWPU-RESISC45D).Meanwhile,the results also demonstrate the importance and indispensability of training efficiency optimization strategies for RSI-SSC by DL.In fact,it is not necessary to gain better classification accuracy by completely relying on an excessive trade-off without efficiency.Ultimately,these findings are expected to contribute to the development of more efficient CNN-based approaches in RSI-SSC.展开更多
Recently,the convolutional neural network(CNN)has been dom-inant in studies on interpreting remote sensing images(RSI).However,it appears that training optimization strategies have received less attention in relevant ...Recently,the convolutional neural network(CNN)has been dom-inant in studies on interpreting remote sensing images(RSI).However,it appears that training optimization strategies have received less attention in relevant research.To evaluate this problem,the author proposes a novel algo-rithm named the Fast Training CNN(FST-CNN).To verify the algorithm’s effectiveness,twenty methods,including six classic models and thirty archi-tectures from previous studies,are included in a performance comparison.The overall accuracy(OA)trained by the FST-CNN algorithm on the same model architecture and dataset is treated as an evaluation baseline.Results show that there is a maximal OA gap of 8.35%between the FST-CNN and those methods in the literature,which means a 10%margin in performance.Meanwhile,all those complex roadmaps,e.g.,deep feature fusion,model combination,model ensembles,and human feature engineering,are not as effective as expected.It reveals that there was systemic suboptimal perfor-mance in the previous studies.Most of the CNN-based methods proposed in the previous studies show a consistent mistake,which has made the model’s accuracy lower than its potential value.The most important reasons seem to be the inappropriate training strategy and the shift in data distribution introduced by data augmentation(DA).As a result,most of the performance evaluation was conducted based on an inaccurate,suboptimal,and unfair result.It has made most of the previous research findings questionable to some extent.However,all these confusing results also exactly demonstrate the effectiveness of FST-CNN.This novel algorithm is model-agnostic and can be employed on any image classification model to potentially boost performance.In addition,the results also show that a standardized training strategy is indeed very meaningful for the research tasks of the RSI-SC.展开更多
Recently,the semantic classification(SC)algorithm for remote sensing images(RSI)has been greatly improved by deep learning(DL)techniques,e.g.,deep convolutional neural networks(CNNs).However,too many methods employ co...Recently,the semantic classification(SC)algorithm for remote sensing images(RSI)has been greatly improved by deep learning(DL)techniques,e.g.,deep convolutional neural networks(CNNs).However,too many methods employ complex procedures(e.g.,multi-stages),excessive hardware budgets(e.g.,multi-models),and an extreme reliance on domain knowledge(e.g.,handcrafted features)for the pure purpose of improving accuracy.It obviously goes against the superiority of DL,i.e.,simplicity and automation.Meanwhile,these algorithms come with unnecessarily expensive overhead on parameters and hardware costs.As a solution,the author proposed a fast and simple training algorithm based on the smallest architecture of EfficientNet version 2,which is called FST-EfficientNet.The approach employs a routine transfer learning strategy and has fast training characteristics.It outperforms all the former methods by a 0.8%–2.7%increase in accuracy.It does,however,use a higher testing resolution of 5122 and 6002,which results in high consumption of graphics processing units(GPUs).As an upgrade option,the author proposes a novel and more efficient method named FSTEfficientNetV2 as the successor.The new algorithm still employs a routine transfer learning strategy and maintains fast training characteristics.But a set of crucial algorithmic tweaks and hyperparameter re-optimizations have been updated.As a result,it achieves a noticeable increase in accuracy of 0.3%–1.1%over its predecessor.More importantly,the algorithm’sGPU costs are reduced by 75%–81%,with a significant reduction in training time costs of 60%–80%.The results demonstrate that an efficient training optimization strategy can significantly boost the CNN algorithm’s performance for RSISC.More crucially,the results prove that the distribution shift introduced by data augmentation(DA)techniques is vital to the method’s performance for RSI-SC,which has been ignored to date.These findings may help us gain a correct understanding of the CNN algorithm for RSI-SC.展开更多
As the key technology of extracting remote sensing information,the classification of remote sensing images has always been the research focus in the field of remote sensing. The paper introduces the classification pro...As the key technology of extracting remote sensing information,the classification of remote sensing images has always been the research focus in the field of remote sensing. The paper introduces the classification process and system of remote sensing images. According to the recent research status of domestic and international remote sensing classification methods,the new study dynamics of remote sensing classification,such as artificial neural networks,support vector machine,active learning and ensemble multi-classifiers,were introduced,providing references for the automatic and intelligent development of remote sensing images classification.展开更多
The remote sensing image classification has stimulated considerable interest as an effective method for better retrieving information from the rapidly increasing large volume, complex and distributed satellite remote ...The remote sensing image classification has stimulated considerable interest as an effective method for better retrieving information from the rapidly increasing large volume, complex and distributed satellite remote imaging data of large scale and cross-time, due to the increase of remote image quantities and image resolutions. In the paper, the genetic algorithms were employed to solve the weighting of the radial basis faction networks in order to improve the precision of remote sensing image classification. The remote sensing image classification was also introduced for the GIS spatial analysis and the spatial online analytical processing (OLAP), and the resulted effectiveness was demonstrated in the analysis of land utilization variation of Daqing city.展开更多
The development of image classification is one of the most important research topics in remote sensing. The prediction accuracy depends not only on the appropriate choice of the machine learning method but also on the...The development of image classification is one of the most important research topics in remote sensing. The prediction accuracy depends not only on the appropriate choice of the machine learning method but also on the quality of the training datasets. However, real-world data is not perfect and often suffers from noise. This paper gives an overview of noise filtering methods. Firstly, the types of noise and the consequences of class noise on machine learning are presented. Secondly, class noise handling methods at both the data level and the algorithm level are introduced. Then ensemble-based class noise handling methods including class noise removal, correction, and noise robust ensemble learners are presented. Finally, a summary of existing data-cleaning techniques is given.展开更多
In order to improve the accuracy of building structure identification using remote sensing images,a building structure classification method based on multi-feature fusion of UAV remote sensing image is proposed in thi...In order to improve the accuracy of building structure identification using remote sensing images,a building structure classification method based on multi-feature fusion of UAV remote sensing image is proposed in this paper.Three identification approaches of remote sensing images are integrated in this method:object-oriented,texture feature,and digital elevation based on DSM and DEM.So RGB threshold classification method is used to classify the identification results.The accuracy of building structure classification based on each feature and the multi-feature fusion are compared and analyzed.The results show that the building structure classification method is feasible and can accurately identify the structures in large-area remote sensing images.展开更多
How to recognize targets with similar appearances from remote sensing images(RSIs) effectively and efficiently has become a big challenge. Recently, convolutional neural network(CNN) is preferred in the target classif...How to recognize targets with similar appearances from remote sensing images(RSIs) effectively and efficiently has become a big challenge. Recently, convolutional neural network(CNN) is preferred in the target classification due to the powerful feature representation ability and better performance. However,the training and testing of CNN mainly rely on single machine.Single machine has its natural limitation and bottleneck in processing RSIs due to limited hardware resources and huge time consuming. Besides, overfitting is a challenge for the CNN model due to the unbalance between RSIs data and the model structure.When a model is complex or the training data is relatively small,overfitting occurs and leads to a poor predictive performance. To address these problems, a distributed CNN architecture for RSIs target classification is proposed, which dramatically increases the training speed of CNN and system scalability. It improves the storage ability and processing efficiency of RSIs. Furthermore,Bayesian regularization approach is utilized in order to initialize the weights of the CNN extractor, which increases the robustness and flexibility of the CNN model. It helps prevent the overfitting and avoid the local optima caused by limited RSI training images or the inappropriate CNN structure. In addition, considering the efficiency of the Na¨?ve Bayes classifier, a distributed Na¨?ve Bayes classifier is designed to reduce the training cost. Compared with other algorithms, the proposed system and method perform the best and increase the recognition accuracy. The results show that the distributed system framework and the proposed algorithms are suitable for RSIs target classification tasks.展开更多
Wetland research has become a hot spot linking multiple disciplines presently. Wetland classification and mapping is the basis for wetland research. It is difficult to generate wetland data sets using traditional meth...Wetland research has become a hot spot linking multiple disciplines presently. Wetland classification and mapping is the basis for wetland research. It is difficult to generate wetland data sets using traditional methods because of the low accessibility of wetlands, hence remote sensing data have become one of the primary data sources in wetland research. This paper presents a case study conducted at the core area of Honghe National Nature Reserve in the Sanjiang Plain, Northeast China. In this study, three images generated by airship, from Thematic Mapper and from SPOT 5 were selected to produce wetland maps at three different wetland landscape levels. After assessing classification accuracies of the three maps, we compared the different wetland mapping results of 11 plant communities to the airship image, 6 plant ecotypes to the TM image and 9 landscape classifications to the SPOT 5 image. We discussed the different characteristics of the hierarchical ecosystem classifications based on the spatial scales of the different images. The results indicate that spatial scales of remote sensing data have an important link to the hierarchies of wetland plant ecosystems displayed on the wetland landscape maps. The richness of wetland landscape information derived from an image closely relates to its spatial resolution. This study can enrich the ecological classification methods and mapping techniques dealing with the spatial scales of different remote sensing images. With a better understanding of classification accuracies in mapping wetlands by using different scales of remote sensing data, we can make an appropriate approach for dealing with the scale issue of remote sensing images.展开更多
The classification of hyperspectral remote sensing data is an important problem theoretically and practically. With the increase of spectral bands, the separability of objects on remote sensing image should be improve...The classification of hyperspectral remote sensing data is an important problem theoretically and practically. With the increase of spectral bands, the separability of objects on remote sensing image should be improved. But the effects of traditional algorithm on feature extraction such as principal component analysis(PCA) is not so good for hyperspectral image. The key problem is that PCA can only represent the linear structure of data set; while the data clouds of different objects on hyperspectral image usually distribute on a nonlinear manifold. This paper established an algorithm of nonlinear feature extraction named as nonlinear principal poly lines, based on the algorithm, a classifier is constructed and the classification accuracy of hyperspectral image can be improved.展开更多
This paper presents a new kind of back propagation neural network (BPNN) based on rough sets,called rough back propagation neural network (RBPNN).The architecture and training method of RBPNN are presented and the sur...This paper presents a new kind of back propagation neural network (BPNN) based on rough sets,called rough back propagation neural network (RBPNN).The architecture and training method of RBPNN are presented and the survey and analysis of RBPNN for the classification of remote sensing multi_spectral image is discussed.The successful application of RBPNN to a land cover classification illustrates the simple computation and high accuracy of the new neural network and the flexibility and practicality of this new approach.展开更多
Classification is always the key point in the field of remote sensing. Fuzzy c-Means is a traditional clustering algorithm that has been widely used in fuzzy clustering. However, this algorithm usually has some weakne...Classification is always the key point in the field of remote sensing. Fuzzy c-Means is a traditional clustering algorithm that has been widely used in fuzzy clustering. However, this algorithm usually has some weaknesses, such as the problems of falling into a local minimum, and it needs much time to accomplish the classification for a large number of data. In order to overcome these shortcomings and increase the classifi-cation accuracy, Gustafson-Kessel (GK) and Gath-Geva (GG) algorithms are proposed to improve the tradi-tional FCM algorithm which adopts Euclidean distance norm in this paper. The experimental result shows that these two methods are able to detect clusters of varying shapes, sizes and densities which FCM cannot do. Moreover, they can improve the classification accuracy of remote sensing images.展开更多
Remote sensing technique, replacing conventional sonar bathymetry technique, has become an effective complementary method of mapping submarine terrain where special conditions make the sonar technique difficult to be ...Remote sensing technique, replacing conventional sonar bathymetry technique, has become an effective complementary method of mapping submarine terrain where special conditions make the sonar technique difficult to be carried out. At the same time, as one kind of data set, multispectral remote sensing data has the disadvantage of being influenced by the variable bottom types in shallow seawater, when it is applied in bathymetry. This paper puts forward a new method to extract water depth information from multispectral data, considering the bottom classification and the true water depth accuracy. That is the Principal Component Analysis (PCA) technique based on the bottom classification. By the least square regression with significance, the experiment near Qingdao City has obtained more satisfactory bathymetry accuracy than that of the traditional single-band method, with the mean absolute error about 2.57m.展开更多
UAV remote sensing images have the advantages of high spatial resolution,fast speed,strong real-time performance,and convenient operation,etc.,and have become a recently developed,vital means of acquiring surface info...UAV remote sensing images have the advantages of high spatial resolution,fast speed,strong real-time performance,and convenient operation,etc.,and have become a recently developed,vital means of acquiring surface information.It is an important research task for precision agriculture to make full use of the spectrum,texture,color and other characteristic information of crops,especially the spatial arrangement and structure information of features,to explore effective methods for the classification of multiple varieties of crops.In order to explore the applicability of the object-oriented method to achieve accurate classification of UAV high-resolution images,the paper used the object-oriented classification method in ENVI to classify the UAV high-resolution remote sensing image obtained from the orderly structured 28 species of crops in the test field,which mainly includes image segmentation and object classification.The results showed that the plots obtained after classification were continuous and complete,basically in line with the actual situation,and the overall accuracy of crop classification was 91.73%,with Kappa coefficient of 0.87.Compared with the crop planting area based on remote sensing interpretation and field survey,the area error of 17 species of crops in this study was controlled within 15%,which provides a basis for object-oriented crop classification of UAV remote sensing images.展开更多
基金This research was funded in part by the Natural Science Foundation of Jiangsu Province under Grant BK 20211333by the Science and Technology Project of Changzhou City(CE20215032).
文摘To create a green and healthy living environment,people have put forward higher requirements for the refined management of ecological resources.A variety of technologies,including satellite remote sensing,Internet of Things,artificial intelligence,and big data,can build a smart environmental monitoring system.Remote sensing image classification is an important research content in ecological environmental monitoring.Remote sensing images contain rich spatial information andmulti-temporal information,but also bring challenges such as difficulty in obtaining classification labels and low classification accuracy.To solve this problem,this study develops a transductive transfer dictionary learning(TTDL)algorithm.In the TTDL,the source and target domains are transformed fromthe original sample space to a common subspace.TTDL trains a shared discriminative dictionary in this subspace,establishes associations between domains,and also obtains sparse representations of source and target domain data.To obtain an effective shared discriminative dictionary,triple-induced ordinal locality preserving term,Fisher discriminant term,and graph Laplacian regularization termare introduced into the TTDL.The triplet-induced ordinal locality preserving term on sub-space projection preserves the local structure of data in low-dimensional subspaces.The Fisher discriminant term on dictionary improves differences among different sub-dictionaries through intra-class and inter-class scatters.The graph Laplacian regularization term on sparse representation maintains the manifold structure using a semi-supervised weight graphmatrix,which can indirectly improve the discriminative performance of the dictionary.The TTDL is tested on several remote sensing image datasets and has strong discrimination classification performance.
文摘Remote sensing image(RSI)classifier roles a vital play in earth observation technology utilizing Remote sensing(RS)data are extremely exploited from both military and civil fields.More recently,as novel DL approaches develop,techniques for RSI classifiers with DL have attained important breakthroughs,providing a new opportunity for the research and development of RSI classifiers.This study introduces an Improved Slime Mould Optimization with a graph convolutional network for the hyperspectral remote sensing image classification(ISMOGCN-HRSC)model.The ISMOGCN-HRSC model majorly concentrates on identifying and classifying distinct kinds of RSIs.In the presented ISMOGCN-HRSC model,the synergic deep learning(SDL)model is exploited to produce feature vectors.The GCN model is utilized for image classification purposes to identify the proper class labels of the RSIs.The ISMO algorithm is used to enhance the classification efficiency of the GCN method,which is derived by integrating chaotic concepts into the SMO algorithm.The experimental assessment of the ISMOGCN-HRSC method is tested using a benchmark dataset.
文摘The remote sensing ships’fine-grained classification technology makes it possible to identify certain ship types in remote sensing images,and it has broad application prospects in civil and military fields.However,the current model does not examine the properties of ship targets in remote sensing images with mixed multi-granularity features and a complicated backdrop.There is still an opportunity for future enhancement of the classification impact.To solve the challenges brought by the above characteristics,this paper proposes a Metaformer and Residual fusion network based on Visual Attention Network(VAN-MR)for fine-grained classification tasks.For the complex background of remote sensing images,the VAN-MR model adopts the parallel structure of large kernel attention and spatial attention to enhance the model’s feature extraction ability of interest targets and improve the classification performance of remote sensing ship targets.For the problem of multi-grained feature mixing in remote sensing images,the VAN-MR model uses a Metaformer structure and a parallel network of residual modules to extract ship features.The parallel network has different depths,considering both high-level and lowlevel semantic information.The model achieves better classification performance in remote sensing ship images with multi-granularity mixing.Finally,the model achieves 88.73%and 94.56%accuracy on the public fine-grained ship collection-23(FGSC-23)and FGSCR-42 datasets,respectively,while the parameter size is only 53.47 M,the floating point operations is 9.9 G.The experimental results show that the classification effect of VAN-MR is superior to that of traditional CNNs model and visual model with Transformer structure under the same parameter quantity.
基金the Deanship of Scientific Research at King Khalid University for funding this work through Large Groups Project under Grant Number(25/43)Princess Nourah bint Abdulrahman University Researchers Supporting Project Number(PNURSP2022R303)Princess Nourah bint Abdulrahman University,Riyadh,Saudi Arabia.The authors would like to thank the Deanship of Scientific Research at Umm Al-Qura University for supporting this work by Grant Code:22UQU4340237DSR28.
文摘Hyperspectral remote sensing/imaging spectroscopy is a novel approach to reaching a spectrum from all the places of a huge array of spatial places so that several spectral wavelengths are utilized for making coherent images.Hyperspectral remote sensing contains acquisition of digital images from several narrow,contiguous spectral bands throughout the visible,Thermal Infrared(TIR),Near Infrared(NIR),and Mid-Infrared(MIR)regions of the electromagnetic spectrum.In order to the application of agricultural regions,remote sensing approaches are studied and executed to their benefit of continuous and quantitativemonitoring.Particularly,hyperspectral images(HSI)are considered the precise for agriculture as they can offer chemical and physical data on vegetation.With this motivation,this article presents a novel Hurricane Optimization Algorithm with Deep Transfer Learning Driven Crop Classification(HOADTL-CC)model onHyperspectralRemote Sensing Images.The presentedHOADTL-CC model focuses on the identification and categorization of crops on hyperspectral remote sensing images.To accomplish this,the presentedHOADTL-CC model involves the design ofHOAwith capsule network(CapsNet)model for generating a set of useful feature vectors.Besides,Elman neural network(ENN)model is applied to allot proper class labels into the input HSI.Finally,glowworm swarm optimization(GSO)algorithm is exploited to fine tune the ENNparameters involved in this article.The experimental result scrutiny of the HOADTL-CC method can be tested with the help of benchmark dataset and the results are assessed under distinct aspects.Extensive comparative studies stated the enhanced performance of the HOADTL-CC model over recent approaches with maximum accuracy of 99.51%.
基金This research has been supported by Doctoral Research funding from Hunan University of Arts and Science,Grant Number E07016033.
文摘Over the past decade,the significant growth of the convolutional neural network(CNN)based on deep learning(DL)approaches has greatly improved the machine learning(ML)algorithm’s performance on the semantic scene classification(SSC)of remote sensing images(RSI).However,the unbalanced attention to classification accuracy and efficiency has made the superiority of DL-based algorithms,e.g.,automation and simplicity,partially lost.Traditional ML strategies(e.g.,the handcrafted features or indicators)and accuracy-aimed strategies with a high trade-off(e.g.,the multi-stage CNNs and ensemble of multi-CNNs)are widely used without any training efficiency optimization involved,which may result in suboptimal performance.To address this problem,we propose a fast and simple training CNN framework(named FST-EfficientNet)for RSI-SSC based on an EfficientNetversion2 small(EfficientNetV2-S)CNN model.The whole algorithm flow is completely one-stage and end-to-end without any handcrafted features or discriminators introduced.In the implementation of training efficiency optimization,only several routine data augmentation tricks coupled with a fixed ratio of resolution or a gradually increasing resolution strategy are employed,so that the algorithm’s trade-off is very cheap.The performance evaluation shows that our FST-EfficientNet achieves new state-of-the-art(SOTA)records in the overall accuracy(OA)with about 0.8%to 2.7%ahead of all earlier methods on the Aerial Image Dataset(AID)and Northwestern Poly-technical University Remote Sensing Image Scene Classification 45 Dataset(NWPU-RESISC45D).Meanwhile,the results also demonstrate the importance and indispensability of training efficiency optimization strategies for RSI-SSC by DL.In fact,it is not necessary to gain better classification accuracy by completely relying on an excessive trade-off without efficiency.Ultimately,these findings are expected to contribute to the development of more efficient CNN-based approaches in RSI-SSC.
基金Hunan University of Arts and Science provided doctoral research funding for this study (grant number 16BSQD23)Fund of Geography Subject ([2022]351)also provided funding.
文摘Recently,the convolutional neural network(CNN)has been dom-inant in studies on interpreting remote sensing images(RSI).However,it appears that training optimization strategies have received less attention in relevant research.To evaluate this problem,the author proposes a novel algo-rithm named the Fast Training CNN(FST-CNN).To verify the algorithm’s effectiveness,twenty methods,including six classic models and thirty archi-tectures from previous studies,are included in a performance comparison.The overall accuracy(OA)trained by the FST-CNN algorithm on the same model architecture and dataset is treated as an evaluation baseline.Results show that there is a maximal OA gap of 8.35%between the FST-CNN and those methods in the literature,which means a 10%margin in performance.Meanwhile,all those complex roadmaps,e.g.,deep feature fusion,model combination,model ensembles,and human feature engineering,are not as effective as expected.It reveals that there was systemic suboptimal perfor-mance in the previous studies.Most of the CNN-based methods proposed in the previous studies show a consistent mistake,which has made the model’s accuracy lower than its potential value.The most important reasons seem to be the inappropriate training strategy and the shift in data distribution introduced by data augmentation(DA).As a result,most of the performance evaluation was conducted based on an inaccurate,suboptimal,and unfair result.It has made most of the previous research findings questionable to some extent.However,all these confusing results also exactly demonstrate the effectiveness of FST-CNN.This novel algorithm is model-agnostic and can be employed on any image classification model to potentially boost performance.In addition,the results also show that a standardized training strategy is indeed very meaningful for the research tasks of the RSI-SC.
基金Hunan University of Arts and Science provided doctoral research funding for this study(grant number 16BSQD23)Fund of Geography Subject([2022]351)also provided funding.
文摘Recently,the semantic classification(SC)algorithm for remote sensing images(RSI)has been greatly improved by deep learning(DL)techniques,e.g.,deep convolutional neural networks(CNNs).However,too many methods employ complex procedures(e.g.,multi-stages),excessive hardware budgets(e.g.,multi-models),and an extreme reliance on domain knowledge(e.g.,handcrafted features)for the pure purpose of improving accuracy.It obviously goes against the superiority of DL,i.e.,simplicity and automation.Meanwhile,these algorithms come with unnecessarily expensive overhead on parameters and hardware costs.As a solution,the author proposed a fast and simple training algorithm based on the smallest architecture of EfficientNet version 2,which is called FST-EfficientNet.The approach employs a routine transfer learning strategy and has fast training characteristics.It outperforms all the former methods by a 0.8%–2.7%increase in accuracy.It does,however,use a higher testing resolution of 5122 and 6002,which results in high consumption of graphics processing units(GPUs).As an upgrade option,the author proposes a novel and more efficient method named FSTEfficientNetV2 as the successor.The new algorithm still employs a routine transfer learning strategy and maintains fast training characteristics.But a set of crucial algorithmic tweaks and hyperparameter re-optimizations have been updated.As a result,it achieves a noticeable increase in accuracy of 0.3%–1.1%over its predecessor.More importantly,the algorithm’sGPU costs are reduced by 75%–81%,with a significant reduction in training time costs of 60%–80%.The results demonstrate that an efficient training optimization strategy can significantly boost the CNN algorithm’s performance for RSISC.More crucially,the results prove that the distribution shift introduced by data augmentation(DA)techniques is vital to the method’s performance for RSI-SC,which has been ignored to date.These findings may help us gain a correct understanding of the CNN algorithm for RSI-SC.
基金Supported by the Science Research Foundation(2010Y290) of Yunnan Department of Education
文摘As the key technology of extracting remote sensing information,the classification of remote sensing images has always been the research focus in the field of remote sensing. The paper introduces the classification process and system of remote sensing images. According to the recent research status of domestic and international remote sensing classification methods,the new study dynamics of remote sensing classification,such as artificial neural networks,support vector machine,active learning and ensemble multi-classifiers,were introduced,providing references for the automatic and intelligent development of remote sensing images classification.
基金Sponsored by the National Natural Science Foundation of China (Grant No.40271044), Natural Science Foundation(Grant No.TK2005 -17) and Projectof Science Backbone of Heilongjiang Province(Grant No.1151G021).
文摘The remote sensing image classification has stimulated considerable interest as an effective method for better retrieving information from the rapidly increasing large volume, complex and distributed satellite remote imaging data of large scale and cross-time, due to the increase of remote image quantities and image resolutions. In the paper, the genetic algorithms were employed to solve the weighting of the radial basis faction networks in order to improve the precision of remote sensing image classification. The remote sensing image classification was also introduced for the GIS spatial analysis and the spatial online analytical processing (OLAP), and the resulted effectiveness was demonstrated in the analysis of land utilization variation of Daqing city.
基金supported by the National Natural Science Foundation of China (62201438,61772397,12005169)the Basic Research Program of Natural Sciences of Shaanxi Province (2021JC-23)+2 种基金Yulin Science and Technology Bureau Science and Technology Development Special Project (CXY-2020-094)Shaanxi Forestry Science and Technology Innovation Key Project (SXLK2022-02-8)the Project of Shaanxi F ederation of Social Sciences (2022HZ1759)。
文摘The development of image classification is one of the most important research topics in remote sensing. The prediction accuracy depends not only on the appropriate choice of the machine learning method but also on the quality of the training datasets. However, real-world data is not perfect and often suffers from noise. This paper gives an overview of noise filtering methods. Firstly, the types of noise and the consequences of class noise on machine learning are presented. Secondly, class noise handling methods at both the data level and the algorithm level are introduced. Then ensemble-based class noise handling methods including class noise removal, correction, and noise robust ensemble learners are presented. Finally, a summary of existing data-cleaning techniques is given.
基金sponsored by National Key R&D Program of China(2018YFC1504504)Youth Foundation of Yunnan Earthquake Agency(2021K01)Project of Yunnan Earthquake Agency“Chuan bang dai”(CQ3-2021001).
文摘In order to improve the accuracy of building structure identification using remote sensing images,a building structure classification method based on multi-feature fusion of UAV remote sensing image is proposed in this paper.Three identification approaches of remote sensing images are integrated in this method:object-oriented,texture feature,and digital elevation based on DSM and DEM.So RGB threshold classification method is used to classify the identification results.The accuracy of building structure classification based on each feature and the multi-feature fusion are compared and analyzed.The results show that the building structure classification method is feasible and can accurately identify the structures in large-area remote sensing images.
基金supported by the National Natural Science Foundation of China(U1435220)
文摘How to recognize targets with similar appearances from remote sensing images(RSIs) effectively and efficiently has become a big challenge. Recently, convolutional neural network(CNN) is preferred in the target classification due to the powerful feature representation ability and better performance. However,the training and testing of CNN mainly rely on single machine.Single machine has its natural limitation and bottleneck in processing RSIs due to limited hardware resources and huge time consuming. Besides, overfitting is a challenge for the CNN model due to the unbalance between RSIs data and the model structure.When a model is complex or the training data is relatively small,overfitting occurs and leads to a poor predictive performance. To address these problems, a distributed CNN architecture for RSIs target classification is proposed, which dramatically increases the training speed of CNN and system scalability. It improves the storage ability and processing efficiency of RSIs. Furthermore,Bayesian regularization approach is utilized in order to initialize the weights of the CNN extractor, which increases the robustness and flexibility of the CNN model. It helps prevent the overfitting and avoid the local optima caused by limited RSI training images or the inappropriate CNN structure. In addition, considering the efficiency of the Na¨?ve Bayes classifier, a distributed Na¨?ve Bayes classifier is designed to reduce the training cost. Compared with other algorithms, the proposed system and method perform the best and increase the recognition accuracy. The results show that the distributed system framework and the proposed algorithms are suitable for RSIs target classification tasks.
基金Under the auspices of National Natural Science Foundation of China (No. 40871241, 40771170)National High Technology Research and Development Program of China (No. 2007AA12Z176)
文摘Wetland research has become a hot spot linking multiple disciplines presently. Wetland classification and mapping is the basis for wetland research. It is difficult to generate wetland data sets using traditional methods because of the low accessibility of wetlands, hence remote sensing data have become one of the primary data sources in wetland research. This paper presents a case study conducted at the core area of Honghe National Nature Reserve in the Sanjiang Plain, Northeast China. In this study, three images generated by airship, from Thematic Mapper and from SPOT 5 were selected to produce wetland maps at three different wetland landscape levels. After assessing classification accuracies of the three maps, we compared the different wetland mapping results of 11 plant communities to the airship image, 6 plant ecotypes to the TM image and 9 landscape classifications to the SPOT 5 image. We discussed the different characteristics of the hierarchical ecosystem classifications based on the spatial scales of the different images. The results indicate that spatial scales of remote sensing data have an important link to the hierarchies of wetland plant ecosystems displayed on the wetland landscape maps. The richness of wetland landscape information derived from an image closely relates to its spatial resolution. This study can enrich the ecological classification methods and mapping techniques dealing with the spatial scales of different remote sensing images. With a better understanding of classification accuracies in mapping wetlands by using different scales of remote sensing data, we can make an appropriate approach for dealing with the scale issue of remote sensing images.
基金Project(40174003) supported by the National Natural Science Foundation of China
文摘The classification of hyperspectral remote sensing data is an important problem theoretically and practically. With the increase of spectral bands, the separability of objects on remote sensing image should be improved. But the effects of traditional algorithm on feature extraction such as principal component analysis(PCA) is not so good for hyperspectral image. The key problem is that PCA can only represent the linear structure of data set; while the data clouds of different objects on hyperspectral image usually distribute on a nonlinear manifold. This paper established an algorithm of nonlinear feature extraction named as nonlinear principal poly lines, based on the algorithm, a classifier is constructed and the classification accuracy of hyperspectral image can be improved.
文摘This paper presents a new kind of back propagation neural network (BPNN) based on rough sets,called rough back propagation neural network (RBPNN).The architecture and training method of RBPNN are presented and the survey and analysis of RBPNN for the classification of remote sensing multi_spectral image is discussed.The successful application of RBPNN to a land cover classification illustrates the simple computation and high accuracy of the new neural network and the flexibility and practicality of this new approach.
基金the Scientific Research Foundation for the Returned Overseas Chinese Scholars, State Education Ministry
文摘Classification is always the key point in the field of remote sensing. Fuzzy c-Means is a traditional clustering algorithm that has been widely used in fuzzy clustering. However, this algorithm usually has some weaknesses, such as the problems of falling into a local minimum, and it needs much time to accomplish the classification for a large number of data. In order to overcome these shortcomings and increase the classifi-cation accuracy, Gustafson-Kessel (GK) and Gath-Geva (GG) algorithms are proposed to improve the tradi-tional FCM algorithm which adopts Euclidean distance norm in this paper. The experimental result shows that these two methods are able to detect clusters of varying shapes, sizes and densities which FCM cannot do. Moreover, they can improve the classification accuracy of remote sensing images.
基金Foundation item: Under the auspices of Scientific Foundation Research Project of the Ministry of Science and Technology and Chinese Academy of Surveying and Mapping (No. F0610)
文摘Remote sensing technique, replacing conventional sonar bathymetry technique, has become an effective complementary method of mapping submarine terrain where special conditions make the sonar technique difficult to be carried out. At the same time, as one kind of data set, multispectral remote sensing data has the disadvantage of being influenced by the variable bottom types in shallow seawater, when it is applied in bathymetry. This paper puts forward a new method to extract water depth information from multispectral data, considering the bottom classification and the true water depth accuracy. That is the Principal Component Analysis (PCA) technique based on the bottom classification. By the least square regression with significance, the experiment near Qingdao City has obtained more satisfactory bathymetry accuracy than that of the traditional single-band method, with the mean absolute error about 2.57m.
基金Supported by College Students Innovation and Entrepreneurship Training Program of Jilin University(No.202010183695)。
文摘UAV remote sensing images have the advantages of high spatial resolution,fast speed,strong real-time performance,and convenient operation,etc.,and have become a recently developed,vital means of acquiring surface information.It is an important research task for precision agriculture to make full use of the spectrum,texture,color and other characteristic information of crops,especially the spatial arrangement and structure information of features,to explore effective methods for the classification of multiple varieties of crops.In order to explore the applicability of the object-oriented method to achieve accurate classification of UAV high-resolution images,the paper used the object-oriented classification method in ENVI to classify the UAV high-resolution remote sensing image obtained from the orderly structured 28 species of crops in the test field,which mainly includes image segmentation and object classification.The results showed that the plots obtained after classification were continuous and complete,basically in line with the actual situation,and the overall accuracy of crop classification was 91.73%,with Kappa coefficient of 0.87.Compared with the crop planting area based on remote sensing interpretation and field survey,the area error of 17 species of crops in this study was controlled within 15%,which provides a basis for object-oriented crop classification of UAV remote sensing images.