Hyperspectral remote sensing identification of marine oil emulsions based on the fusion of spatial and spectral features

Marine oil spill emulsions are difficult to recover,and the damage to the environment is not easy to eliminate.The use of remote sensing to accurately identify oil spill emulsions is highly important for the protection of marine environments.However,the spectrum of oil emulsions changes due to different water content.Hyperspectral remote sensing and deep learning can use spectral and spatial information to identify different types of oil emulsions.Nonetheless,hyperspectral data can also cause information redundancy,reducing classification accuracy and efficiency,and even overfitting in machine learning models.To address these problems,an oil emulsion deep-learning identification model with spatial-spectral feature fusion is established,and feature bands that can distinguish between crude oil,seawater,water-in-oil emulsion(WO),and oil-in-water emulsion(OW)are filtered based on a standard deviation threshold–mutual information method.Using oil spill airborne hyperspectral data,we conducted identification experiments on oil emulsions in different background waters and under different spatial and temporal conditions,analyzed the transferability of the model,and explored the effects of feature band selection and spectral resolution on the identification of oil emulsions.The results show the following.(1)The standard deviation–mutual information feature selection method is able to effectively extract feature bands that can distinguish between WO,OW,oil slick,and seawater.The number of bands was reduced from 224 to 134 after feature selection on the Airborne Visible Infrared Imaging Spectrometer(AVIRIS)data and from 126 to 100 on the S185 data.(2)With feature selection,the overall accuracy and Kappa of the identification results for the training area are 91.80%and 0.86,respectively,improved by 2.62%and 0.04,and the overall accuracy and Kappa of the identification results for the migration area are 86.53%and 0.80,respectively,improved by 3.45%and 0.05.(3)The oil emulsion identification model has a certain degree of transferability and can effectively identify oil spill emulsions for AVIRIS data at different times and locations,with an overall accuracy of more than 80%,Kappa coefficient of more than 0.7,and F1 score of 0.75 or more for each category.(4)As the spectral resolution decreasing,the model yields different degrees of misclassification for areas with a mixed distribution of oil slick and seawater or mixed distribution of WO and OW.Based on the above experimental results,we demonstrate that the oil emulsion identification model with spatial–spectral feature fusion achieves a high accuracy rate in identifying oil emulsion using airborne hyperspectral data,and can be applied to images under different spatial and temporal conditions.Furthermore,we also elucidate the impact of factors such as spectral resolution and background water bodies on the identification process.These findings provide new reference for future endeavors in automated marine oil spill detection.

Extensive identification of landslide boundaries using remote sensing images and deep learning method

The frequent occurrence of extreme weather events has rendered numerous landslides to a global natural disaster issue.It is crucial to rapidly and accurately determine the boundaries of landslides for geohazards evaluation and emergency response.Therefore,the Skip Connection DeepLab neural network(SCDnn),a deep learning model based on 770 optical remote sensing images of landslide,is proposed to improve the accuracy of landslide boundary detection.The SCDnn model is optimized for the over-segmentation issue which occurs in conventional deep learning models when there is a significant degree of similarity between topographical geomorphic features.SCDnn exhibits notable improvements in landslide feature extraction and semantic segmentation by combining an enhanced Atrous Spatial Pyramid Convolutional Block(ASPC)with a coding structure that reduces model complexity.The experimental results demonstrate that SCDnn can identify landslide boundaries in 119 images with MIoU values between 0.8and 0.9;while 52 images with MIoU values exceeding 0.9,which exceeds the identification accuracy of existing techniques.This work can offer a novel technique for the automatic extensive identification of landslide boundaries in remote sensing images in addition to establishing the groundwork for future inve stigations and applications in related domains.

Integration of remotely sensed indices for land cover changes caused by the 2009 Victorian bushfires using Landsat TM imagery

In order to minimise the bushfires negative impacts on society, an efficient andreliable bushfire detection system was proposed to assess the devastated effects of the2009 Victorian bushfires.It is possible to utilise the repetitive capability of satellite remotesensing imagery to identify the location of change to the Earth's surface and integrate thedifferent remotely sensed indices.The results confirm that the procedure can offer essentialspatial information for bushfire assessment.

Two-Staged Method for Ice Channel Identification Based on Image Segmentation and Corner Point Regression

Identification of the ice channel is the basic technology for developing intelligent ships in ice-covered waters,which is important to ensure the safety and economy of navigation.In the Arctic,merchant ships with low ice class often navigate in channels opened up by icebreakers.Navigation in the ice channel often depends on good maneuverability skills and abundant experience from the captain to a large extent.The ship may get stuck if steered into ice fields off the channel.Under this circumstance,it is very important to study how to identify the boundary lines of ice channels with a reliable method.In this paper,a two-staged ice channel identification method is developed based on image segmentation and corner point regression.The first stage employs the image segmentation method to extract channel regions.In the second stage,an intelligent corner regression network is proposed to extract the channel boundary lines from the channel region.A non-intelligent angle-based filtering and clustering method is proposed and compared with corner point regression network.The training and evaluation of the segmentation method and corner regression network are carried out on the synthetic and real ice channel dataset.The evaluation results show that the accuracy of the method using the corner point regression network in the second stage is achieved as high as 73.33%on the synthetic ice channel dataset and 70.66%on the real ice channel dataset,and the processing speed can reach up to 14.58frames per second.

Power of SAR Imagery and Machine Learning in Monitoring Ulva prolifera:A Case Study of Sentinel-1 and Random Forest

Automatically detecting Ulva prolifera(U.prolifera)in rainy and cloudy weather using remote sensing imagery has been a long-standing problem.Here,we address this challenge by combining high-resolution Synthetic Aperture Radar(SAR)imagery with the machine learning,and detect the U.prolifera of the South Yellow Sea of China(SYS)in 2021.The findings indicate that the Random Forest model can accurately and robustly detect U.prolifera,even in the presence of complex ocean backgrounds and speckle noise.Visual inspection confirmed that the method successfully identified the majority of pixels containing U.prolifera without misidentifying noise pixels or seawater pixels as U.prolifera.Additionally,the method demonstrated consistent performance across different im-ages,with an average Area Under Curve(AUC)of 0.930(+0.028).The analysis yielded an overall accuracy of over 96%,with an average Kappa coefficient of 0.941(+0.038).Compared to the traditional thresholding method,Random Forest model has a lower estimation error of 14.81%.Practical application indicates that this method can be used in the detection of unprecedented U.prolifera in 2021 to derive continuous spatiotemporal changes.This study provides a potential new method to detect U.prolifera and enhances our under-standing of macroalgal outbreaks in the marine environment.

Delineation of groundwater potential zones using remote sensing and Geographic Information Systems(GIS)in Kadaladi region,Southern India

The primary objective of this research is to delineate potential groundwater recharge zones in the Kadaladi taluk of Ramanathapuram,Tamil Nadu,India,using a combination of remote sensing and Geographic Information Systems(GIS)with the Analytical Hierarchical Process(AHP).Various factors such as geology,geomorphology,soil,drainage,density,lineament density,slope,rainfall were analyzed at a specific scale.Thematic layers were evaluated for quality and relevance using Saaty's scale,and then inte-grated using the weighted linear combination technique.The weights assigned to each layer and features were standardized using AHP and the Eigen vector technique,resulting in the final groundwater potential zone map.The AHP method was used to normalize the scores following the assignment of weights to each criterion or factor based on Saaty's 9-point scale.Pair-wise matrix analysis was utilized to calculate the geometric mean and normalized weight for various parameters.The groundwater recharge potential zone map was created by mathematically overlaying the normalized weighted layers.Thematic layers indicating major elements influencing groundwater occurrence and recharge were derived from satellite images.2 Results indicate that approximately 21.8 km of the total area exhibits high potential for groundwater recharge.Groundwater recharge is viable in areas with moderate slopes,particularly in the central and southeastern regions.

Rapid identification of landslide,collapse and crack based on low-altitude remote sensing image of UAV

Landslides,collapses and cracks are the main types of geological hazards,which threaten the safety of human life and property at all times.In emergency surveying and mapping,it is timeconsuming and laborious to use the method of field artificial investigation and recognition and using satellite image to identify ground hazards,there are some problems,such as time lag,low resolution,and difficult to select the map on demand.In this paper,a10 cm per pixel resolution photogrammetry of a geological hazard-prone area of Taohuagou,Shanxi Province,China is carried out by DJ 4 UAV.The digital orthophoto model(DOM),digital surface model(DSM) and three-dimensional point cloud model(3 DPCM) are generated in this region.The method of visual interpretation of cracks based on DOM(as main)-3 DPCM(as auxiliary) and landslide and collapse based on 3 DPCM(as main)-DOM and DSM(as auxiliary) are proposed.Based on the low altitude remote sensing image of UAV,the shape characteristics,geological characteristics and distribution of the identified hazards are analyzed.The results show that using UAV low altitude remote sensing image,the method of combination of main and auxiliary data can quickly and accurately identify landslide,collapse and crack,the accuracy of crack identification is 93%,and the accuracy of landslide and collapse identification is 100%.It mainly occurs in silty clay and mudstone geology and is greatly affected by slope foot excavation.This study can play a great role in the recognition of sudden hazards by low altitude remote sensing images of UAV.

Automated detection and identification of white-backed planthoppers in paddy fields using image processing

A survey of the population densities of rice planthoppers is important for forecasting decisions and efficient control. Tra- ditional manual surveying of rice planthoppers is time-consuming, fatiguing, and subjective. A new three-layer detection method was proposed to detect and identify white-backed planthoppers （WBPHs, Sogatella furcifera （Horvath）） and their developmental stages using image processing. In the first two detection layers, we used an AdaBoost classifier that was trained on a histogram of oriented gradient （HOG） features and a support vector machine （SVM） classifier that was trained on Gabor and Local Binary Pattern （LBP） features to detect WBPHs and remove impurities. We achieved a detection rate of 85.6% and a false detection rate of 10.2%. In the third detection layer, a SVM classifier that was trained on the HOG features was used to identify the different developmental stages of the WBPHs, and we achieved an identification rate of 73.1%, a false identification rate of 23.3%, and a 5.6% false detection rate for the images without WBPHs. The proposed three-layer detection method is feasible and effective for the identification of different developmental stages of planthoppers on rice plants in paddy fields.

Monitoring Land Use Dynamics in Chanthaburi Province of Thailand Using Digital Remotely Sensed Images

A comprehensive method of image classification was developed for monitoring land use dynamics in Chanthaburi Province of Tailand. RS (Remote Sensing), GIS (Geographical Information System), GPS (Global Positioning System) and ancillary data were combined by the method which adopts the main idea of classifying images by steps from decision tree method and the hybridized supervised and unsupervised classification. An integration of automatic image interpretation, ancillary materials and expert knowledge was realized. Two subscenes of Landsat 5 Thematic Mapper (TM) images of bands 3, 4 and 5 obtained on December 15, 1992, and January 17, 1999, were used for image processing and spatial data analysis in the study. The overall accuracy of the results of classification reached 90%, which was verified by field check.Results showed that shrimp farm land, urban and traffic land, barren land, bush and agricultural developing area increased in area, mangrove, paddy field, swamp and marsh land, orchard and plantation, and tropical grass land decreased, and the forest land kept almost stable. Ecological analysis on the land use changes showed that more attentions should be paid on the effect of land development on ecological environment in the future land planning and management.

Deep learning of rock microscopic images for intelligent lithology identification: Neural network comparison and selection

An intelligent lithology identification method is proposed based on deep learning of the rock microscopic images.Based on the characteristics of rock images in the dataset,we used Xception,MobileNet_v2,Inception_ResNet_v2,Inception_v3,Densenet121,ResNet101_v2,and ResNet-101 to develop microscopic image classification models,and then the network structures of seven different convolutional neural networks(CNNs)were compared.It shows that the multi-layer representation of rock features can be represented through convolution structures,thus better feature robustness can be achieved.For the loss function,cross-entropy is used to back propagate the weight parameters layer by layer,and the accuracy of the network is improved by frequent iterative training.We expanded a self-built dataset by using transfer learning and data augmentation.Next,accuracy(acc)and frames per second(fps)were used as the evaluation indexes to assess the accuracy and speed of model identification.The results show that the Xception-based model has the optimum performance,with an accuracy of 97.66%in the training dataset and 98.65%in the testing dataset.Furthermore,the fps of the model is 50.76,and the model is feasible to deploy under different hardware conditions and meets the requirements of rapid lithology identification.This proposed method is proved to be robust and versatile in generalization performance,and it is suitable for both geologists and engineers to identify lithology quickly.

The State-of-the-Art Review on Applications of Intrusive Sensing,Image Processing Techniques,and Machine Learning Methods in Pavement Monitoring and Analysis

In modern transportation,pavement is one of the most important civil infrastructures for the movement of vehicles and pedestrians.Pavement service quality and service life are of great importance for civil engineers as they directly affect the regular service for the users.Therefore,monitoring the health status of pavement before irreversible damage occurs is essential for timely maintenance,which in turn ensures public transportation safety.Many pavement damages can be detected and analyzed by monitoring the structure dynamic responses and evaluating road surface conditions.Advanced technologies can be employed for the collection and analysis of such data,including various intrusive sensing techniques,image processing techniques,and machine learning methods.This review summarizes the state-ofthe-art of these three technologies in pavement engineering in recent years and suggests possible developments for future pavement monitoring and analysis based on these approaches.

Scale Issues of Wetland Classification and Mapping Using Remote Sensing Images: A Case of Honghe National Nature Reserve in Sanjiang Plain, Northeast China

Wetland research has become a hot spot linking multiple disciplines presently. Wetland classification and mapping is the basis for wetland research. It is difficult to generate wetland data sets using traditional methods because of the low accessibility of wetlands, hence remote sensing data have become one of the primary data sources in wetland research. This paper presents a case study conducted at the core area of Honghe National Nature Reserve in the Sanjiang Plain, Northeast China. In this study, three images generated by airship, from Thematic Mapper and from SPOT 5 were selected to produce wetland maps at three different wetland landscape levels. After assessing classification accuracies of the three maps, we compared the different wetland mapping results of 11 plant communities to the airship image, 6 plant ecotypes to the TM image and 9 landscape classifications to the SPOT 5 image. We discussed the different characteristics of the hierarchical ecosystem classifications based on the spatial scales of the different images. The results indicate that spatial scales of remote sensing data have an important link to the hierarchies of wetland plant ecosystems displayed on the wetland landscape maps. The richness of wetland landscape information derived from an image closely relates to its spatial resolution. This study can enrich the ecological classification methods and mapping techniques dealing with the spatial scales of different remote sensing images. With a better understanding of classification accuracies in mapping wetlands by using different scales of remote sensing data, we can make an appropriate approach for dealing with the scale issue of remote sensing images.

Identification Method of Gas-Liquid Two-phase Flow Regime Based on Image Multi-feature Fusion and Support Vector Machine

The knowledge of flow regime is very important for quantifying the pressure drop, the stability and safety of two-phase flow systems. Based on image multi-feature fusion and support vector machine, a new method to identify flow regime in two-phase flow was presented. Firstly, gas-liquid two-phase flow images including bub- bly flow, plug flow, slug flow, stratified flow, wavy flow, annular flow and mist flow were captured by digital high speed video systems in the horizontal tube. The image moment invariants and gray level co-occurrence matrix texture features were extracted using image processing techniques. To improve the performance of a multiple classifier system, the rough sets theory was used for reducing the inessential factors. Furthermore, the support vector machine was trained by using these eigenvectors to reduce the dimension as flow regime samples, and the flow regime intelligent identification was realized. The test results showed that image features which were reduced with the rough sets theory could excellently reflect the difference between seven typical flow regimes, and successful training the support vector machine could quickly and accurately identify seven typical flow regimes of gas-liquid two-phase flow in the horizontal tube. Image multi-feature fusion method provided a new way to identify the gas-liquid two-phase flow, and achieved higher identification ability than that of single characteristic. The overall identification accuracy was 100%, and an estimate of the image processing time was 8 ms for online flow regime identification.

Bayesian and Geostatistical Approaches to Combining Categorical Data Derived from Visual and Digital Processing of Remotely Sensed Images

This paper seeks a synthesis of Bayesian and geostatistical approaches to combining categorical data in the context of remote sensing classification. By experiment with aerial photographs and Landsat TM data, accuracy of spectral, spatial, and combined classification results was evaluated. It was confirmed that the incorporation of spatial information in spectral classification increases accuracy significantly. Secondly, through test with a 5-class and a 3-class classification schemes, it was revealed that setting a proper semantic framework for classification is fundamental to any endeavors of categorical mapping and the most important factor affecting accuracy. Lastly, this paper promotes non-parametric methods for both definition of class membership profiling based on band-specific histograms of image intensities and derivation of spatial probability via indicator kriging, a non-parametric geostatistical technique.

INFRARED THERMAL IMAGE STUDY ON THE FOREWARNING OF COAL AND SANDSTONE FAILURE UNDER LOAD

In the experimental study, AGE-782 thermal instrument was used to detect the infrared radiation variation of coal and sandstone (wave-length range 3.6～5.5 μm was used). It's discovered that coal and sandstone failure under load have three kinds of infrared thermal features as well as infrared forewarning messages. That are: (1) temperature rises gradually but drops before failure ; (2) temperature rises gradually but quickly rises before failure; (3) first rises,then drops and lower temperature emerges before failure. The further researches and the prospect of micro-wave remote sensing detection .on ground pressure is also discussed.

Study of Forest Cover Change Dynamics between 2000 and 2015 in the Ikongo District of Madagascar Using Multi-Temporal Landsat Satellite Images

Satellite images are considered reliable data that preserve land cover information. In the field of remote sensing, these images allow relevant analyses of changes in space over time through the use of computer tools. In this study, we have applied the “discriminant” change detection algorithm. In this, we have verified its effectiveness in multi-temporal studies. Also, we have determined the change in forest dynamics in the Ikongo district of Madagascar between 2000 and 2015. During the treatments, we have used the Landsat TM satellite images for the years 2000, 2005 and 2010 as well as ETM+ for 2015. Thus, analyses carried out have allowed us to note that between 2000-2005, 1.4% of natural forest disappeared. And, between 2005-2010, forests degradation was 1.8%. Also, between 2010-2015, about 0.5% of the natural forest conserved in 2010 disappeared. Furthermore, we have found that the discriminant algorithm is considerably efficient in terms of monitoring the dynamics of forest cover change.

QoE Assessment of Fairness between Players in Networked Virtual 3D Objects Identification Game Using Haptic, Olfactory, and Auditory Senses

In this paper, we carry out QoE (Quality of Experience) assessment to investigate influences of olfactory and auditory senses on fairness for a networked virtual 3D object identification game with haptics. In the game, two players try to identify objects which are placed in a shared 3D virtual space. In the assessment, we carry out the game in four cases. Smells and sounds are presented in the first case, only sounds are done in the second case, and only smells are done in the third case. In the last case, we present neither smell nor sound. As a result, we demonstrate that the fairness deteriorates more largely as the difference in conditions between two users becomes larger.

Retrieval of the ground surface reflectance along coast zone and island with MODIS image

A new method based on lookup tables (LUTs) for retrieval of the ground surface reflectance along coastal zones and islands with MODIS (Moderate-resolution imaging spectroradiometer) image was descibed.Through simulation of the AHMAD radiative transfer model, we can retrieve the aerosol optical character with water pixels of MODIS image. Postulating the background is cloudless and the atmosphere on the water is the same as that on the island, we can use the 6S radiative transfer model to compute the LUT about the ground surface reflectance, then use the interpolate method to get the reflectance of the ground surface along coastal zones and islands through the reflectance of the land pixels of MODIS image, the geometric condition and the aerosol optical thickness. The LUT method is applied to determine the ground surface reflectance in Xiamen’s zone from the MODIS image. At last, the results were analyzed and its expectation errors were reported.

Geographic Object-Based Image Analysis of Changes in Land Cover in the Coastal Zones of the Red River Delta (Vietnam)

The majority of the population and economic activity of the northern half of Vietnam is clustered in the Red River Delta and about half of the country’s rice production takes place here. There are significant problems associated with its geographical position and the intensive exploitation of resources by an overabundant population (population density of 962 inhabitants/km2). Some thirty years after the economic liberalization and the opening of the country to international markets, agricultural land use patterns in the Red River Delta, particularly in the coastal area, have undergone many changes. Remote sensing is a particularly powerful tool in processing and providing spatial information for monitoring land use changes. The main methodological objective is to find a solution to process the many heterogeneous coastal land use parameters, so as to describe it in all its complexity, specifically by making use of the latest European satellite data (Sentinel-2). This complexity is due to local variations in ecological conditions, but also to anthropogenic factors that directly and indirectly influence land use dynamics. The methodological objective was to develop a new Geographic Object-based Image Analysis (GEOBIA) approach for mapping coastal areas using Sentinel-2 data and Landsat 8. By developing a new segmentation, accuracy measure, in this study was determined that segmentation accuracies decrease with increasing segmentation scales and that the negative impact of under-segmentation errors significantly increases at a large scale. An Estimation of Scale Parameter (ESP) tool was then used to determine the optimal segmentation parameter values. A popular machine learning algorithms (Random Forests-RFs) is used. For all classifications algorithm, an increase in overall accuracy was observed with the full synergistic combination of available data sets.