Road Traffic Monitoring from Aerial Images Using Template Matching and Invariant Features

Road traffic monitoring is an imperative topic widely discussed among researchers.Systems used to monitor traffic frequently rely on cameras mounted on bridges or roadsides.However,aerial images provide the flexibility to use mobile platforms to detect the location and motion of the vehicle over a larger area.To this end,different models have shown the ability to recognize and track vehicles.However,these methods are not mature enough to produce accurate results in complex road scenes.Therefore,this paper presents an algorithm that combines state-of-the-art techniques for identifying and tracking vehicles in conjunction with image bursts.The extracted frames were converted to grayscale,followed by the application of a georeferencing algorithm to embed coordinate information into the images.The masking technique eliminated irrelevant data and reduced the computational cost of the overall monitoring system.Next,Sobel edge detection combined with Canny edge detection and Hough line transform has been applied for noise reduction.After preprocessing,the blob detection algorithm helped detect the vehicles.Vehicles of varying sizes have been detected by implementing a dynamic thresholding scheme.Detection was done on the first image of every burst.Then,to track vehicles,the model of each vehicle was made to find its matches in the succeeding images using the template matching algorithm.To further improve the tracking accuracy by incorporating motion information,Scale Invariant Feature Transform(SIFT)features have been used to find the best possible match among multiple matches.An accuracy rate of 87%for detection and 80%accuracy for tracking in the A1 Motorway Netherland dataset has been achieved.For the Vehicle Aerial Imaging from Drone(VAID)dataset,an accuracy rate of 86%for detection and 78%accuracy for tracking has been achieved.

Robust and Discriminative Feature Learning via Mutual Information Maximization for Object Detection in Aerial Images

Object detection in unmanned aerial vehicle(UAV)aerial images has become increasingly important in military and civil applications.General object detection models are not robust enough against interclass similarity and intraclass variability of small objects,and UAV-specific nuisances such as uncontrolledweather conditions.Unlike previous approaches focusing on high-level semantic information,we report the importance of underlying features to improve detection accuracy and robustness fromthe information-theoretic perspective.Specifically,we propose a robust and discriminative feature learning approach through mutual information maximization(RD-MIM),which can be integrated into numerous object detection methods for aerial images.Firstly,we present the rank sample mining method to reduce underlying feature differences between the natural image domain and the aerial image domain.Then,we design a momentum contrast learning strategy to make object features similar to the same category and dissimilar to different categories.Finally,we construct a transformer-based global attention mechanism to boost object location semantics by leveraging the high interrelation of different receptive fields.We conduct extensive experiments on the VisDrone and Unmanned Aerial Vehicle Benchmark Object Detection and Tracking(UAVDT)datasets to prove the effectiveness of the proposed method.The experimental results show that our approach brings considerable robustness gains to basic detectors and advanced detection methods,achieving relative growth rates of 51.0%and 39.4%in corruption robustness,respectively.Our code is available at https://github.com/cq100/RD-MIM(accessed on 2 August 2024).

Investigating the relationship between intracranial atherosclerotic plaque remodelling and diabetes using high-resolution vessel wall imaging

BACKGROUND Intracranial atherosclerosis,a leading cause of stroke,involves arterial plaque formation.This study explores the link between plaque remodelling patterns and diabetes using high-resolution vessel wall imaging(HR-VWI).AIM To investigate the factors of intracranial atherosclerotic remodelling patterns and the relationship between intracranial atherosclerotic remodelling and diabetes mellitus using HR-VWI.METHODS Ninety-four patients diagnosed with middle cerebral artery or basilar artery INTRODUCTION Intracranial atherosclerotic disease is one of the main causes of ischaemic stroke in the world,accounting for approx-imately 10%of transient ischaemic attacks and 30%-50%of ischaemic strokes[1].It is the most common factor among Asian people[2].The adaptive changes in the structure and function of blood vessels that can adapt to changes in the internal and external environment are called vascular remodelling,which is a common and important pathological mechanism in atherosclerotic diseases,and the remodelling mode of atherosclerotic plaques is closely related to the occurrence of stroke.Positive remodelling(PR)is an outwards compensatory remodelling where the arterial wall grows outwards in an attempt to maintain a constant lumen diameter.For a long time,it was believed that the degree of stenosis can accurately reflect the risk of ischaemic stroke[3-5].Previous studies have revealed that lesions without significant luminal stenosis can also lead to acute events[6,7],as summarized in a recent meta-analysis study in which approximately 50%of acute/subacute ischaemic events were due to this type of lesion[6].Research[8,9]has pointed out that the PR of plaques is more dangerous and more likely to cause acute ischaemic stroke.Previous studies[10-13]have found that there are specific vascular remodelling phenomena in the coronary and carotid arteries of diabetic patients.However,due to the deep location and small lumen of intracranial arteries and limitations of imaging techniques,the relationship between intracranial arterial remodelling and diabetes is still unclear.In recent years,with the development of magnetic resonance technology and the emergence of high-resolution(HR)vascular wall imaging,a clear and multidimensional display of the intracranial vascular wall has been achieved.Therefore,in this study,HR wall imaging(HR-VWI)was used to display the remodelling characteristics of bilateral middle cerebral arteries and basilar arteries and to explore the factors of intracranial vascular remodelling and its relationship with diabetes.

In vivo pilot study into superficial microcirculatory characteristics of colorectal adenomas using novel high-resolution magnifying endoscopy with blue laser imaging

BACKGROUND No studies have yet been conducted on changes in microcirculatory hemody-namics of colorectal adenomas in vivo under endoscopy.The microcirculation of the colorectal adenoma could be observed in vivo by a novel high-resolution magnification endoscopy with blue laser imaging(BLI),thus providing a new insight into the microcirculation of early colon tumors.AIM To observe the superficial microcirculation of colorectal adenomas using the novel magnifying colonoscope with BLI and quantitatively analyzed the changes in hemodynamic parameters.METHODS From October 2019 to January 2020,11 patients were screened for colon adenomas with the novel high-resolution magnification endoscope with BLI.Video images were recorded and processed with Adobe Premiere,Adobe Photoshop and Image-pro Plus software.Four microcirculation parameters:Microcirculation vessel density(MVD),mean vessel width(MVW)with width standard deviation(WSD),and blood flow velocity(BFV),were calculated for adenomas and the surrounding normal mucosa.RESULTS A total of 16 adenomas were identified.Compared with the normal surrounding mucosa,the superficial vessel density in the adenomas was decreased(MVD:0.95±0.18 vs 1.17±0.28μm/μm2,P<0.05).MVW(5.11±1.19 vs 4.16±0.76μm,P<0.05)and WSD(11.94±3.44 vs 9.04±3.74,P<0.05)were both increased.BFV slowed in the adenomas(709.74±213.28 vs 1256.51±383.31μm/s,P<0.05).CONCLUSION The novel high-resolution magnification endoscope with BLI can be used for in vivo study of adenoma superficial microcirculation.Superficial vessel density was decreased,more irregular,with slower blood flow.

High-resolution magnetic resonance imaging in the diagnosis and management of vertebral artery dissection:A case report

BACKGROUND Vertebral artery dissection(VAD)is a rare but life-threatening condition characterized by tearing of the intimal layer of the vertebral artery,leading to stenosis,occlusion or rupture.The clinical presentation of VAD can be heterogeneous,with common symptoms including headache,dizziness and balance problems.Timely diagnosis and treatment are crucial for favorable outcomes;however,VAD is often missed due to its variable clinical presentation and lack of robust diagnostic guidelines.High-resolution magnetic resonance imaging(HRMRI)has emerged as a reliable diagnostic tool for VAD,providing detailed visualization of vessel wall abnormalities.CASE SUMMARY A young male patient presented with an acute onset of severe headache,vomiting,and seizures,followed by altered consciousness.Imaging studies revealed bilateral VAD,basilar artery thrombosis,multiple brainstem and cerebellar infarcts,and subarachnoid hemorrhage.Digital subtraction angiography(DSA)revealed vertebral artery stenosis but failed to detect the dissection,potentially because intramural thrombosis obscured the VAD.In contrast,HRMRI confirmed the diagnosis by revealing specific signs of dissection.The patient was managed conservatively with antiplatelet therapy and other supportive measures,such as blood pressure control and pain management.After 5 mo of rehabilitation,the patient showed significant improvement in swallowing and limb strength.CONCLUSION HR-MRI can provide precise evidence for the identification of VAD.

A Systematic Literature Review of Machine Learning and Deep Learning Approaches for Spectral Image Classification in Agricultural Applications Using Aerial Photography

Recently,there has been a notable surge of interest in scientific research regarding spectral images.The potential of these images to revolutionize the digital photography industry,like aerial photography through Unmanned Aerial Vehicles(UAVs),has captured considerable attention.One encouraging aspect is their combination with machine learning and deep learning algorithms,which have demonstrated remarkable outcomes in image classification.As a result of this powerful amalgamation,the adoption of spectral images has experienced exponential growth across various domains,with agriculture being one of the prominent beneficiaries.This paper presents an extensive survey encompassing multispectral and hyperspectral images,focusing on their applications for classification challenges in diverse agricultural areas,including plants,grains,fruits,and vegetables.By meticulously examining primary studies,we delve into the specific agricultural domains where multispectral and hyperspectral images have found practical use.Additionally,our attention is directed towards utilizing machine learning techniques for effectively classifying hyperspectral images within the agricultural context.The findings of our investigation reveal that deep learning and support vector machines have emerged as widely employed methods for hyperspectral image classification in agriculture.Nevertheless,we also shed light on the various issues and limitations of working with spectral images.This comprehensive analysis aims to provide valuable insights into the current state of spectral imaging in agriculture and its potential for future advancements.

Automatic area estimation of algal blooms in water bodies from UAV images using texture analysis

Algal blooms,the spread of algae on the surface of water bodies,have adverse effects not only on aquatic ecosystems but also on human life.The adverse effects of harmful algal blooms(HABs)necessitate a convenient solution for detection and monitoring.Unmanned aerial vehicles(UAVs)have recently emerged as a tool for algal bloom detection,efficiently providing on-demand images at high spatiotemporal resolutions.This study developed an image processing method for algal bloom area estimation from the aerial images(obtained from the internet)captured using UAVs.As a remote sensing method of HAB detection,analysis,and monitoring,a combination of histogram and texture analyses was used to efficiently estimate the area of HABs.Statistical features like entropy(using the Kullback-Leibler method)were emphasized with the aid of a gray-level co-occurrence matrix.The results showed that the orthogonal images demonstrated fewer errors,and the morphological filter best detected algal blooms in real time,with a precision of 80%.This study provided efficient image processing approaches using on-board UAVs for HAB monitoring.

Adaptive Boundary and Semantic Composite Segmentation Method for Individual Objects in Aerial Images

There are two types of methods for image segmentation.One is traditional image processing methods,which are sensitive to details and boundaries,yet fail to recognize semantic information.The other is deep learning methods,which can locate and identify different objects,but boundary identifications are not accurate enough.Both of them cannot generate entire segmentation information.In order to obtain accurate edge detection and semantic information,an Adaptive Boundary and Semantic Composite Segmentation method(ABSCS)is proposed.This method can precisely semantic segment individual objects in large-size aerial images with limited GPU performances.It includes adaptively dividing and modifying the aerial images with the proposed principles and methods,using the deep learning method to semantic segment and preprocess the small divided pieces,using three traditional methods to segment and preprocess original-size aerial images,adaptively selecting traditional results tomodify the boundaries of individual objects in deep learning results,and combining the results of different objects.Individual object semantic segmentation experiments are conducted by using the AeroScapes dataset,and their results are analyzed qualitatively and quantitatively.The experimental results demonstrate that the proposed method can achieve more promising object boundaries than the original deep learning method.This work also demonstrates the advantages of the proposed method in applications of point cloud semantic segmentation and image inpainting.

Rice Bacterial Infection Detection Using Ensemble Technique on Unmanned Aerial Vehicles Images

Establishing a system for measuring plant health and bacterial infection is critical in agriculture.Previously,the farmers themselves,who observed them with their eyes and relied on their experience in analysis,which could have been incorrect.Plant inspection can determine which plants reflect the quantity of green light and near-infrared using infrared light,both visible and eye using a drone.The goal of this study was to create algorithms for assessing bacterial infections in rice using images from unmanned aerial vehicles(UAVs)with an ensemble classification technique.Convolution neural networks in unmanned aerial vehi-cles image were used.To convey this interest,the rice’s health and bacterial infec-tion inside the photo were detected.The project entailed using pictures to identify bacterial illnesses in rice.The shape and distinct characteristics of each infection were observed.Rice symptoms were defined using machine learning and image processing techniques.Two steps of a convolution neural network based on an image from a UAV were used in this study to determine whether this area will be affected by bacteria.The proposed algorithms can be utilized to classify the types of rice deceases with an accuracy rate of 89.84 percent.

Monitoring of vegetation coverage based on high-resolution images

Measurement of vegetation coverage on a small scale is the foundation for the monitoring of changes in vegetation coverage and of the inversion model of monitoring vegetation coverage on a large scale by remote sensing. Using the object-oriented analytical software, Definiens Professional 5, a new method for calculating vegetation coverage based on high-resolution images （aerial photographs or near-surface photography） is proposed. Our research supplies references to remote sensing measurements of vegetation coverage on a small scale and accurate fundamental data for the inversion model of vegetation coverage on a large and intermediate scale to improve the accuracy of remote sensing monitoring of changes in vegetation coverage.

Level study on fractal characteristics of tidal creeks and information of seashell habitats in the Gaizhou Beach based on high-resolution satellite images

The fractal characteristics of tidal creeks in the Gaizhou Beach are analyzed based on high-resolution images fusionof Landsat TM and ERS2, and then the graphic models and characteristics of converse information tree of tidalcreeks in the Gaizhou Beach are established. A calculation model is established based on the above results, and at thesame time, quantitative calculation of the evolution characteristics and the diversity between the northern and thesouthern parts of the Gaizhou Beach is carried out. By the supervised classification of these images, distribution andareas of high tidal flats, middle tidal flats and low tidal flats in the Gaizhou Beach are studied quantitatively, and imagecharactistics of seashell habitats in the Gaizhou Beach and the correlation between mudflat distribution and seashellhabitats are studied. At last, the engineering problems in the Gaizhou Beach are discussed.

Coherence-coefficient-based Markov random field approach for building segmentation from high-resolution SAR images

Building segmentation from high-resolution synthetic aperture radar (SAR) images has always been one of the important research issues. Due to the existence of speckle noise and multipath effect, the pixel values change drastically, causing the large intensity differences in pixels of building areas. Moreover, the geometric structure of buildings can cause strong scattering spots, which brings difficulties to the segmentation and extraction of buildings. To solve of these problems, this paper presents a coherence-coefficient-based Markov random field (CCMRF) approach for building segmentation from high-resolution SAR images. The method introduces the coherence coefficient of interferometric synthetic aperture radar (InSAR) into the neighborhood energy based on traditional Markov random field (MRF), which makes interferometric and spatial contextual information more fully used in SAR image segmentation. According to the Hammersley-Clifford theorem, the problem of maximum a posteriori (MAP) for image segmentation is transformed into the solution of minimizing the sum of likelihood energy and neighborhood energy. Finally, the iterative condition model (ICM) is used to find the optimal solution. The experimental results demonstrate that the proposed method can segment SAR building effectively and obtain more accurate results than the traditional MRF method and K-means clustering.

Use of high-resolution X-ray computed tomography and 3D image analysis to quantify mineral dissemination and pore space in oxide copper ore particles

Mineral dissemination and pore space distribution in ore particles are important features that influence heap leaching performance. To quantify the mineral dissemination and pore space distribution of an ore particle, a cylindrical copper oxide ore sample (I center dot 4.6 mm x 5.6 mm) was scanned using high-resolution X-ray computed tomography (HRXCT), a nondestructive imaging technology, at a spatial resolution of 4.85 mu m. Combined with three-dimensional (3D) image analysis techniques, the main mineral phases and pore space were segmented and the volume fraction of each phase was calculated. In addition, the mass fraction of each mineral phase was estimated and the result was validated with that obtained using traditional techniques. Furthermore, the pore phase features, including the pore size distribution, pore surface area, pore fractal dimension, pore centerline, and the pore connectivity, were investigated quantitatively. The pore space analysis results indicate that the pore size distribution closely fits a log-normal distribution and that the pore space morphology is complicated, with a large surface area and low connectivity. This study demonstrates that the combination of HRXCT and 3D image analysis is an effective tool for acquiring 3D mineralogical and pore structural data.

A fast decoupled ISAR high-resolution imaging method using structural sparse information under low SNR

Inverse synthetic aperture radar (ISAR) image can be represented and reconstructed by sparse recovery (SR) approaches. However, the existing SR algorithms, which are used for ISAR imaging, have suffered from high computational cost and poor imaging quality under a low signal to noise ratio (SNR) condition. This paper proposes a fast decoupled ISAR imaging method by exploiting the inherent structural sparse information of the targets. Firstly, the ISAR imaging problem is decoupled into two sub-problems. One is range direction imaging and the other is azimuth direction focusing. Secondly, an efficient two-stage SR method is proposed to obtain higher resolution range profiles by using jointly sparse information. Finally, the residual linear Bregman iteration via fast Fourier transforms (RLBI-FFT) is proposed to perform the azimuth focusing on low SNR efficiently. Theoretical analysis and simulation results show that the proposed method has better performence to efficiently implement higher-resolution ISAR imaging under the low SNR condition.

Tree species classification using deep learning and RGB optical images obtained by an unmanned aerial vehicle

The diversity of tree species and the complexity of land use in cities create challenging issues for tree species classification.The combination of deep learning methods and RGB optical images obtained by unmanned aerial vehicles(UAVs) provides a new research direction for urban tree species classification.We proposed an RGB optical image dataset with 10 urban tree species,termed TCC10,which is a benchmark for tree canopy classification(TCC).TCC10 dataset contains two types of data:tree canopy images with simple backgrounds and those with complex backgrounds.The objective was to examine the possibility of using deep learning methods(AlexNet,VGG-16,and ResNet-50) for individual tree species classification.The results of convolutional neural networks(CNNs) were compared with those of K-nearest neighbor(KNN) and BP neural network.Our results demonstrated:(1) ResNet-50 achieved an overall accuracy(OA) of 92.6% and a kappa coefficient of 0.91 for tree species classification on TCC10 and outperformed AlexNet and VGG-16.(2) The classification accuracy of KNN and BP neural network was less than70%,while the accuracy of CNNs was relatively higher.(3)The classification accuracy of tree canopy images with complex backgrounds was lower than that for images with simple backgrounds.For the deciduous tree species in TCC10,the classification accuracy of ResNet-50 was higher in summer than that in autumn.Therefore,the deep learning is effective for urban tree species classification using RGB optical images.

Bidirectional parallel multi-branch convolution feature pyramid network for target detection in aerial images of swarm UAVs

In this paper,based on a bidirectional parallel multi-branch feature pyramid network(BPMFPN),a novel one-stage object detector called BPMFPN Det is proposed for real-time detection of ground multi-scale targets by swarm unmanned aerial vehicles(UAVs).First,the bidirectional parallel multi-branch convolution modules are used to construct the feature pyramid to enhance the feature expression abilities of different scale feature layers.Next,the feature pyramid is integrated into the single-stage object detection framework to ensure real-time performance.In order to validate the effectiveness of the proposed algorithm,experiments are conducted on four datasets.For the PASCAL VOC dataset,the proposed algorithm achieves the mean average precision(mAP)of 85.4 on the VOC 2007 test set.With regard to the detection in optical remote sensing(DIOR)dataset,the proposed algorithm achieves 73.9 mAP.For vehicle detection in aerial imagery(VEDAI)dataset,the detection accuracy of small land vehicle(slv)targets reaches 97.4 mAP.For unmanned aerial vehicle detection and tracking(UAVDT)dataset,the proposed BPMFPN Det achieves the mAP of 48.75.Compared with the previous state-of-the-art methods,the results obtained by the proposed algorithm are more competitive.The experimental results demonstrate that the proposed algorithm can effectively solve the problem of real-time detection of ground multi-scale targets in aerial images of swarm UAVs.

Multi-temporal NDVI analysis using UAV images of tree crowns in a northern Mexican pine-oak forest

The use of unmanned aerial vehicles(UAV)for forest monitoring has grown significantly in recent years,providing information with high spatial resolution and temporal versatility.UAV with multispectral sensors allow the use of indexes such as the normalized difference vegetation index(NDVI),which determines the vigor,physiological stress and photo synthetic activity of vegetation.This study aimed to analyze the spectral responses and variations of NDVI in tree crowns,as well as their correlation with climatic factors over the course of one year.The study area encompassed a 1.6-ha site in Durango,Mexico,where Pinus cembroides,Pinus engelmannii,and Quercus grisea coexist.Multispectral images were acquired with UAV and information on meteorological variables was obtained from NASA/POWER database.An ANOVA explored possible differences in NDVI among the three species.Pearson correlation was performed to identify the linear relationship between NDVI and meteorological variables.Significant differences in NDVI values were found at the genus level(Pinus and Quercus),possibly related to the physiological features of the species and their phenology.Quercus grisea had the lowest NDVI values throughout the year which may be attributed to its sensitivity to relative humidity and temperatures.Although the use of UAV with a multispectral sensor for NDVI monitoring allowed genera differentiation,in more complex forest analyses hyperspectral and LiDAR sensors should be integrated,as well other vegetation indexes be considered.

Geographic,Geometrical and Semantic Reconstruction of Urban Scene from High Resolution Oblique Aerial Images

An effective approach is proposed for 3D urban scene reconstruction in the form of point cloud with semantic labeling. Starting from high resolution oblique aerial images,our approach proceeds through three main stages: geographic reconstruction, geometrical reconstruction and semantic reconstruction. The absolute position and orientation of all the cameras relative to the real world are recovered in the geographic reconstruction stage. Then, in the geometrical reconstruction stage,an improved multi-view stereo matching method is employed to produce 3D dense points with color and normal information by taking into account the prior knowledge of aerial imagery.Finally the point cloud is classified into three classes(building,vegetation, and ground) by a rule-based hierarchical approach in the semantic reconstruction step. Experiments on complex urban scene show that our proposed 3-stage approach could generate reasonable reconstruction result robustly and efficiently.By comparing our final semantic reconstruction result with the manually labeled ground truth, classification accuracies from86.75% to 93.02% are obtained.

Computational Intelligence Driven Secure Unmanned Aerial Vehicle Image Classification in Smart City Environment

Computational intelligence(CI)is a group of nature-simulated computationalmodels and processes for addressing difficult real-life problems.The CI is useful in the UAV domain as it produces efficient,precise,and rapid solutions.Besides,unmanned aerial vehicles(UAV)developed a hot research topic in the smart city environment.Despite the benefits of UAVs,security remains a major challenging issue.In addition,deep learning(DL)enabled image classification is useful for several applications such as land cover classification,smart buildings,etc.This paper proposes novel meta-heuristics with a deep learning-driven secure UAV image classification(MDLS-UAVIC)model in a smart city environment.Themajor purpose of the MDLS-UAVIC algorithm is to securely encrypt the images and classify them into distinct class labels.The proposedMDLS-UAVIC model follows a two-stage process:encryption and image classification.The encryption technique for image encryption effectively encrypts the UAV images.Next,the image classification process involves anXception-based deep convolutional neural network for the feature extraction process.Finally,shuffled shepherd optimization(SSO)with a recurrent neural network(RNN)model is applied for UAV image classification,showing the novelty of the work.The experimental validation of the MDLS-UAVIC approach is tested utilizing a benchmark dataset,and the outcomes are examined in various measures.It achieved a high accuracy of 98%.

CHANGE DETECTION FROM AERIAL IMAGES ACQUIRED IN DIFFERENT DURATIONS

Because of quick development of cities, the update of urban GIS data is very important. Change detection is the base of automatic or semi-automatic data update. One way of change detections in urban area is based on old and new aerial images acquired in different durations. The corresponding theory and experiments are introduced and analyzed in this paper. The main procedure includes four stages. The new and old images have to be registered firstly. Then image matching, based on the maximum correlation coefficient, is performed between registered images after the low contrast areas have been removed. The regions with low matching quality are extracted as candidate changed areas. Thirdly, the Gaussian-Laplacian operator is used to detect edges in candidate changed areas on both the registered images, and the straight lines are detected by Hough transformation. Finally, the changed houses and roads can be detected on the basis of straight line matching in candidate changed areas between registered images. Some experimental results show that the method introduced in this paper is effective.