Automated Deep Learning Driven Crop Classification on Hyperspectral Remote Sensing Images

Hyperspectral remote sensing/imaging spectroscopy is a novel approach to reaching a spectrum from all the places of a huge array of spatial places so that several spectral wavelengths are utilized for making coherent images.Hyperspectral remote sensing contains acquisition of digital images from several narrow,contiguous spectral bands throughout the visible,Thermal Infrared(TIR),Near Infrared(NIR),and Mid-Infrared(MIR)regions of the electromagnetic spectrum.In order to the application of agricultural regions,remote sensing approaches are studied and executed to their benefit of continuous and quantitativemonitoring.Particularly,hyperspectral images(HSI)are considered the precise for agriculture as they can offer chemical and physical data on vegetation.With this motivation,this article presents a novel Hurricane Optimization Algorithm with Deep Transfer Learning Driven Crop Classification(HOADTL-CC)model onHyperspectralRemote Sensing Images.The presentedHOADTL-CC model focuses on the identification and categorization of crops on hyperspectral remote sensing images.To accomplish this,the presentedHOADTL-CC model involves the design ofHOAwith capsule network(CapsNet)model for generating a set of useful feature vectors.Besides,Elman neural network(ENN)model is applied to allot proper class labels into the input HSI.Finally,glowworm swarm optimization(GSO)algorithm is exploited to fine tune the ENNparameters involved in this article.The experimental result scrutiny of the HOADTL-CC method can be tested with the help of benchmark dataset and the results are assessed under distinct aspects.Extensive comparative studies stated the enhanced performance of the HOADTL-CC model over recent approaches with maximum accuracy of 99.51%.

Hyperspectral Images-Based Crop Classification Scheme for Agricultural Remote Sensing

Hyperspectral imaging is gaining a significant role in agricultural remote sensing applications.Its data unit is the hyperspectral cube which holds spatial information in two dimensions while spectral band information of each pixel in the third dimension.The classification accuracy of hyperspectral images(HSI)increases significantly by employing both spatial and spectral features.For this work,the data was acquired using an airborne hyperspectral imager system which collected HSI in the visible and near-infrared(VNIR)range of 400 to 1000 nm wavelength within 180 spectral bands.The dataset is collected for nine different crops on agricultural land with a spectral resolution of 3.3 nm wavelength for each pixel.The data was cleaned from geometric distortions and stored with the class labels and annotations of global localization using the inertial navigation system.In this study,a unique pixel-based approach was designed to improve the crops'classification accuracy by using the edge-preserving features(EPF)and principal component analysis(PCA)in conjunction.The preliminary processing generated the high-dimensional EPF stack by applying the edge-preserving filters on acquired HSI.In the second step,this high dimensional stack was treated with the PCA for dimensionality reduction without losing significant spectral information.The resultant feature space(PCA-EPF)demonstrated enhanced class separability for improved crop classification with reduced dimensionality and computational cost.The support vector machines classifier was employed for multiclass classification of target crops using PCA-EPF.The classification performance evaluation was measured in terms of individual class accuracy,overall accuracy,average accuracy,and Cohen kappa factor.The proposed scheme achieved greater than 90%results for all the performance evaluation metrics.The PCA-EPF proved to be an effective attribute for crop classification using hyperspectral imaging in the VNIR range.The proposed scheme is well-suited for practical applications of crops and landfill estimations using agricultural remote sensing methods.

Evaluation of a deep-learning model for multispectral remote sensing of land use and crop classification

High-resolution deep-learning-based remote-sensing imagery analysis has been widely used in land-use and crop-classification mapping. However, the influence of composite feature bands, including complex feature indices arising from different sensors on the backbone, patch size, and predictions in transferable deep models require further testing. The experiments were conducted in six sites in Henan province from2019 to 2021. This study sought to enable the transfer of classification models across regions and years for Sentinel-2 A(10-m resolution) and Gaofen PMS(2-m resolution) imagery. With feature selection and up-sampling of small samples, the performance of UNet++ architecture on five backbones and four patch sizes was examined. Joint loss, mean Intersection over Union(m Io U), and epoch time were analyzed, and the optimal backbone and patch size for both sensors were Timm-Reg Net Y-320 and 256 × 256, respectively. The overall accuracy and Fscores of the Sentinel-2 A predictions ranged from 96.86% to 97.72%and 71.29% to 80.75%, respectively, compared to 75.34%–97.72% and 54.89%–73.25% for the Gaofen predictions. The accuracies of each site indicated that patch size exerted a greater influence on model performance than the backbone. The feature-selection-based predictions with UNet++ architecture and upsampling of minor classes demonstrated the capabilities of deep-learning generalization for classifying complex ground objects, offering improved performance compared to the UNet, Deeplab V3+, Random Forest, and Object-Oriented Classification models. In addition to the overall accuracy, confusion matrices,precision, recall, and F1 scores should be evaluated for minor land-cover types. This study contributes to large-scale, dynamic, and near-real-time land-use and crop mapping by integrating deep learning and multi-source remote-sensing imagery.

Temporal sequence Object-based CNN(TS-OCNN) for crop classification from fine resolution remote sensing image time-series

Accurate crop distribution mapping is required for crop yield prediction and field management. Due to rapid progress in remote sensing technology, fine spatial resolution(FSR) remotely sensed imagery now offers great opportunities for mapping crop types in great detail. However, within-class variance can hamper attempts to discriminate crop classes at fine resolutions. Multi-temporal FSR remotely sensed imagery provides a means of increasing crop classification from FSR imagery, although current methods do not exploit the available information fully. In this research, a novel Temporal Sequence Object-based Convolutional Neural Network(TS-OCNN) was proposed to classify agricultural crop type from FSR image time-series. An object-based CNN(OCNN) model was adopted in the TS-OCNN to classify images at the object level(i.e., segmented objects or crop parcels), thus, maintaining the precise boundary information of crop parcels. The combination of image time-series was first utilized as the input to the OCNN model to produce an ‘original’ or baseline classification. Then the single-date images were fed automatically into the deep learning model scene-by-scene in order of image acquisition date to increase successively the crop classification accuracy. By doing so, the joint information in the FSR multi-temporal observations and the unique individual information from the single-date images were exploited comprehensively for crop classification. The effectiveness of the proposed approach was investigated using multitemporal SAR and optical imagery, respectively, over two heterogeneous agricultural areas. The experimental results demonstrated that the newly proposed TS-OCNN approach consistently increased crop classification accuracy, and achieved the greatest accuracies(82.68% and 87.40%) in comparison with state-of-the-art benchmark methods, including the object-based CNN(OCNN)(81.63% and85.88%), object-based image analysis(OBIA)(78.21% and 84.83%), and standard pixel-wise CNN(79.18%and 82.90%). The proposed approach is the first known attempt to explore simultaneously the joint information from image time-series with the unique information from single-date images for crop classification using a deep learning framework. The TS-OCNN, therefore, represents a new approach for agricultural landscape classification from multi-temporal FSR imagery. Besides, it is readily generalizable to other landscapes(e.g., forest landscapes), with a wide application prospect.

Stacked spectral feature space patch: An advanced spectral representation for precise crop classification based on convolutional neural network

Spectral and spatial features in remotely sensed data play an irreplaceable role in classifying crop types for precision agriculture. Despite the thriving establishment of the handcrafted features, designing or selecting such features valid for specific crop types requires prior knowledge and thus remains an open challenge. Convolutional neural networks(CNNs) can effectively overcome this issue with their advanced ability to generate high-level features automatically but are still inadequate in mining spectral features compared to mining spatial features. This study proposed an enhanced spectral feature called Stacked Spectral Feature Space Patch(SSFSP) for CNN-based crop classification. SSFSP is a stack of twodimensional(2 D) gridded spectral feature images that record various crop types’ spatial and intensity distribution characteristics in a 2 D feature space consisting of two spectral bands. SSFSP can be input into2 D-CNNs to support the simultaneous mining of spectral and spatial features, as the spectral features are successfully converted to 2 D images that can be processed by CNN. We tested the performance of SSFSP by using it as the input to seven CNN models and one multilayer perceptron model for crop type classification compared to using conventional spectral features as input. Using high spatial resolution hyperspectral datasets at three sites, the comparative study demonstrated that SSFSP outperforms conventional spectral features regarding classification accuracy, robustness, and training efficiency. The theoretical analysis summarizes three reasons for its excellent performance. First, SSFSP mines the spectral interrelationship with feature generality, which reduces the required number of training samples.Second, the intra-class variance can be largely reduced by grid partitioning. Third, SSFSP is a highly sparse feature, which reduces the dependence on the CNN model structure and enables early and fast convergence in model training. In conclusion, SSFSP has great potential for practical crop classification in precision agriculture.

Object-oriented crop classification based on UAV remote sensing imagery

UAV remote sensing images have the advantages of high spatial resolution,fast speed,strong real-time performance,and convenient operation,etc.,and have become a recently developed,vital means of acquiring surface information.It is an important research task for precision agriculture to make full use of the spectrum,texture,color and other characteristic information of crops,especially the spatial arrangement and structure information of features,to explore effective methods for the classification of multiple varieties of crops.In order to explore the applicability of the object-oriented method to achieve accurate classification of UAV high-resolution images,the paper used the object-oriented classification method in ENVI to classify the UAV high-resolution remote sensing image obtained from the orderly structured 28 species of crops in the test field,which mainly includes image segmentation and object classification.The results showed that the plots obtained after classification were continuous and complete,basically in line with the actual situation,and the overall accuracy of crop classification was 91.73%,with Kappa coefficient of 0.87.Compared with the crop planting area based on remote sensing interpretation and field survey,the area error of 17 species of crops in this study was controlled within 15%,which provides a basis for object-oriented crop classification of UAV remote sensing images.

Crop Classification Using MODIS NDVI Data Denoised by Wavelet: A Case Study in Hebei Plain, China

Time-series Moderate Resolution Imaging Spectroradiometer (MODIS) Normalized Difference Vegetation Index (NDVI) data have been widely used for large area crop mapping.However,the temporal crop signatures generated from these data were always accompanied by noise.In this study,a denoising method combined with Time series Inverse Distance Weighted (T-IDW) interpolating and Discrete Wavelet Transform (DWT) was presented.The detail crop planting patterns in Hebei Plain,China were classified using denoised time-series MODIS NDVI data at 250 m resolution.The denoising approach improved original MODIS NDVI product significantly in several periods,which may affect the accuracy of classification.The MODIS NDVI-derived crop map of the Hebei Plain achieved satisfactory classification accuracies through validation with field observation,statistical data and high resolution image.The field investigation accuracy was 85% at pixel level.At county-level,for winter wheat,there is relatively more significant correlation between the estimated area derived from satellite data with noise reduction and the statistical area (R2 = 0.814,p < 0.01).Moreover,the MODIS-derived crop patterns were highly consistent with the map generated by high resolution Landsat image in the same period.The overall accuracy achieved 91.01%.The results indicate that the method combining T-IDW and DWT can provide a gain in time-series MODIS NDVI data noise reduction and crop classification.

Hybrid Multi-Strategy Aquila Optimization with Deep Learning Driven Crop Type Classification on Hyperspectral Images

Hyperspectral imaging instruments could capture detailed spatial information and rich spectral signs of observed scenes.Much spatial information and spectral signatures of hyperspectral images(HSIs)present greater potential for detecting and classifying fine crops.The accurate classification of crop kinds utilizing hyperspectral remote sensing imaging(RSI)has become an indispensable application in the agricultural domain.It is significant for the prediction and growth monitoring of crop yields.Amongst the deep learning(DL)techniques,Convolution Neural Network(CNN)was the best method for classifying HSI for their incredible local contextual modeling ability,enabling spectral and spatial feature extraction.This article designs a Hybrid Multi-Strategy Aquila Optimization with a Deep Learning-Driven Crop Type Classification(HMAODL-CTC)algorithm onHSI.The proposed HMAODL-CTC model mainly intends to categorize different types of crops on HSI.To accomplish this,the presented HMAODL-CTC model initially carries out image preprocessing to improve image quality.In addition,the presented HMAODL-CTC model develops dilated convolutional neural network(CNN)for feature extraction.For hyperparameter tuning of the dilated CNN model,the HMAO algorithm is utilized.Eventually,the presented HMAODL-CTC model uses an extreme learning machine(ELM)model for crop type classification.A comprehensive set of simulations were performed to illustrate the enhanced performance of the presented HMAODL-CTC algorithm.Extensive comparison studies reported the improved performance of the presented HMAODL-CTC algorithm over other compared methods.

A Scale Sequence Object-based Convolutional Neural Network(SS-OCNN)for crop classification from fine spatial resolution remotely sensed imagery

The highly dynamic nature of agro-ecosystems in space and time usually leads to high intra-class variance and low inter-class separability in the fine spatial resolution(FSR)remotely sensed imagery.This makes traditional classifiers essentially relying on spectral information for crop mapping from FSR imagery an extremely challenging task.To mine effectively the rich spectral and spatial information in FSR imagery,this paper proposed a Scale Sequence Object-based Convolutional Neural Network(SS-OCNN)that classifies images at the object level by taking segmented objects(crop parcels)as basic units of analysis,thus,ensuring that the boundaries between crop parcels are delineated precisely.These segmented objects were subsequently classified using a CNN model integrated with an automatically generated scale sequence of input patch sizes.This scale sequence can fuse effectively the features learned at different scales by transforming progressively the information extracted at small scales to larger scales.The effectiveness of the SS-OCNN was investigated using two heterogeneous agricultural areas with FSR SAR and optical imagery,respectively.Experimental results revealed that the SS-OCNN consistently achieved the most accurate classification results.The SS-OCNN,thus,provides a new paradigm for crop classification over heterogeneous areas using FSR imagery,and has a wide application prospect.

Crop classification based on the spectrotemporal signature derived from vegetation indices and accumulated temperature

Due to differences in environmental factors,the phenology of the same crop is different every year,causing divergent performances of the classifier built by spectral or time-series features Here,we proposed a random forest classifier(RFC)based on an asymmetric double S curve model fitted by accumulated temperature(AT)and Vegetation Index(VI),which can be applied in different years without ground samples.We built AT and VI time series from Moderate Resolution Imaging Spectroradiometer 8-day composites of land surface temperatures and Sentinel-2 and Landsat-8,respectively.The RFC was trained by characteristics from the asymmetric double S curve.We prepared RFC by ground samples of 2018 and 2019 and then mapped crops of the same region in 2017.Results indicated that,compared with diverse VI-AT series,the overall accuracy based on universal normalized vegetation index(UNVI)was the best of all(2017:F1=0.91,2018:F1=0.92,2019:F1=0.91)and better than that based on the UNVI-TIME series(2017:F1=0.84,2018:F1=0.81,2019:F1=0.88).It proved that the classification features from the VI-AT series have smaller intra-class differences in 2017,2018,and 2019.

Phenological metrics-based crop classification using HJ-1 CCD images and Landsat 8 imagery

Crop type data are an important piece of information for many applications in agriculture.Extracting crop type using remote sensing is not easy because multiple crops are usually planted into small parcels with limited availability of satellite images due to weather conditions.In this research,we aim at producing crop maps for areas with abundant rainfall and small-sized parcels by making full use of Landsat 8 and HJ-1 charge-coupled device(CCD)data.We masked out non-vegetation areas by using Landsat 8 images and then extracted a crop map from a longterm time-series of HJ-1 CCD satellite images acquired at 30-m spatial resolution and two-day temporal resolution.To increase accuracy,four key phenological metrics of crops were extracted from time-series Normalized Difference Vegetation Index curves plotted from the HJ-1 CCD images.These phenological metrics were used to further identify each of the crop types with less,but easier to access,ancillary field survey data.We used crop area data from the Jingzhou statistical yearbook and 5.8-m spatial resolution ZY-3 satellite images to perform an accuracy assessment.The results show that our classification accuracy was 92%when compared with the highly accurate but limited ZY-3 images and matched up to 80%to the statistical crop areas.

Early-season crop type mapping using 30-m reference time series

Early-season crop type mapping could provide important information for crop growth monitoring and yield prediction,but the lack of ground-surveyed training samples is the main challenge for crop type identification.Although reference time series based method(RBM)has been proposed to identify crop types without the use of ground-surveyed training samples,the methods are not suitable for study regions with small field size because the reference time series are mainly generated using data set with low spatial resolution.As the combination of Landsat data and Sentinel-2 data could increase the temporal resolution of 30-m image time series,we improved the RBM by generating reference normalized difference vegetation index(NDVI)/enhanced vegetation index(EVI)time series at 30-m resolution(30-m RBM)using both Landsat and Sentinel-2 data,then tried to estimate the potential of the reference NDVI/EVI time series for crop identification at early season.As a test case,we tried to use the 30-m RBM to identify major crop types in Hengshui,China at early season of 2018,the results showed that when the time series of the entire growing season were used for classification,overall classification accuracies of the 30-m RBM were higher than 95%,which were similar to the accuracies acquired using the ground-surveyed training samples.In addition,cotton,spring maize and summer maize distribution could be accurately generated 8,6 and 8 weeks before their harvest using the 30-m RBM;but winter wheat can only be accurately identified around the harvest time phase.Finally,NDVI outperformed EVI for crop type classification as NDVI had better separability for distinguishing crops at the green-up time phases.Comparing with the previous RBM,advantage of 30-m RBM is that the method could use the samples of the small fields to generate reference time series and process image time series with missing value for early-season crop casification;while,samples collected from multiple years should be futher used so that the reference time series could contain more crop growth conditions.

Insect classification and detection in field crops using modern machine learning techniques

The agriculture sector has an immense potential to improve the requirement of food and supplies healthy and nutritious food.Crop insect detection is a challenging task for farmers as a significant portion of the crops are damaged,and the quality is degraded due to the pest attack.Traditional insect identification has the drawback of requiring well-trained tax-onomists to identify insects based on morphological features accurately.Experiments were conducted for classification on nine and 24 insect classes of Wang and Xie dataset using the shape features and applying machine learning techniques such as artificial neural net-works(ANN),support vector machine(SVM),k-nearest neighbors(KNN),naive bayes(NB)and convolutional neural network(CNN)model.This paper presents the insect pest detec-tion algorithm that consists of foreground extraction and contour identification to detect the insects for Wang,Xie,Deng,and IP102 datasets in a highly complex background.The 9-fold cross-validation was applied to improve the performance of the classification mod-els.The highest classification rate of 91.5%and 90%was achieved for nine and 24 class insects using the CNN model.The detection performance was accomplished with less com-putation time for Wang,Xie,Deng,and IP102 datasets using insect pest detection algo-rithm.The comparison results with the state-of-the-art classification algorithms exhibited considerable improvement in classification accuracy,computation time perfor-mance while apply more efficiently in field crops to recognize the insects.The results of classification accuracy are used to recognize the crop insects in the early stages and reduce the time to enhance the crop yield and crop quality in agriculture.

Crop type mapping using LiDAR,Sentinel-2 and aerial imagery with machine learning algorithms

LiDAR data are becoming increasingly available,which has opened up many new applications.One such application is crop type mapping.Accurate crop type maps are critical for monitoring water use,estimating harvests and in precision agriculture.The traditional approach to obtaining maps of cultivated fields is by manually digitizing the fields from satellite or aerial imagery and then assigning crop type labels to each field-often informed by data collected during ground and aerial surveys.However,manual digitizing and labeling is time-consuming,expensive and subject to human error.Automated remote sensing methods is a cost-effective alternative,with machine learning gaining popularity for classifying crop types.This study evaluated the use of LiDAR data,Sentinel-2 imagery,aerial imagery and machine learning for differentiating five crop types in an intensively cultivated area.Different combinations of the three datasets were evaluated along with ten machine learning.The classification results were interpreted by comparing overall accuracies,kappa,standard deviation and f-score.It was found that LiDAR data successfully differentiated between different crop types,with XGBoost providing the highest overall accuracy of 87.8%.Furthermore,the crop type maps produced using the LiDAR data were in general agreement with those obtained by using Sentinel-2 data,with LiDAR obtaining a mean overall accuracy of 84.3%and Sentinel-2 a mean overall accuracy of 83.6%.However,the combination of all three datasets proved to be the most effective at differentiating between the crop types,with RF providing the highest overall accuracy of 94.4%.These findings provide a foundation for selecting the appropriate combination of remotely sensed data sources and machine learning algorithms for operational crop type mapping.