Road Traffic Monitoring from Aerial Images Using Template Matching and Invariant Features

Road traffic monitoring is an imperative topic widely discussed among researchers.Systems used to monitor traffic frequently rely on cameras mounted on bridges or roadsides.However,aerial images provide the flexibility to use mobile platforms to detect the location and motion of the vehicle over a larger area.To this end,different models have shown the ability to recognize and track vehicles.However,these methods are not mature enough to produce accurate results in complex road scenes.Therefore,this paper presents an algorithm that combines state-of-the-art techniques for identifying and tracking vehicles in conjunction with image bursts.The extracted frames were converted to grayscale,followed by the application of a georeferencing algorithm to embed coordinate information into the images.The masking technique eliminated irrelevant data and reduced the computational cost of the overall monitoring system.Next,Sobel edge detection combined with Canny edge detection and Hough line transform has been applied for noise reduction.After preprocessing,the blob detection algorithm helped detect the vehicles.Vehicles of varying sizes have been detected by implementing a dynamic thresholding scheme.Detection was done on the first image of every burst.Then,to track vehicles,the model of each vehicle was made to find its matches in the succeeding images using the template matching algorithm.To further improve the tracking accuracy by incorporating motion information,Scale Invariant Feature Transform(SIFT)features have been used to find the best possible match among multiple matches.An accuracy rate of 87%for detection and 80%accuracy for tracking in the A1 Motorway Netherland dataset has been achieved.For the Vehicle Aerial Imaging from Drone(VAID)dataset,an accuracy rate of 86%for detection and 78%accuracy for tracking has been achieved.

A landslide monitoring method using data from unmanned aerial vehicle and terrestrial laser scanning with insufficient and inaccurate ground control points

Non-contact remote sensing techniques,such as terrestrial laser scanning(TLS)and unmanned aerial vehicle(UAV)photogrammetry,have been globally applied for landslide monitoring in high and steep mountainous areas.These techniques acquire terrain data and enable ground deformation monitoring.However,practical application of these technologies still faces many difficulties due to complex terrain,limited access and dense vegetation.For instance,monitoring high and steep slopes can obstruct the TLS sightline,and the accuracy of the UAV model may be compromised by absence of ground control points(GCPs).This paper proposes a TLS-and UAV-based method for monitoring landslide deformation in high mountain valleys using traditional real-time kinematics(RTK)-based control points(RCPs),low-precision TLS-based control points(TCPs)and assumed control points(ACPs)to achieve high-precision surface deformation analysis under obstructed vision and impassable conditions.The effects of GCP accuracy,GCP quantity and automatic tie point(ATP)quantity on the accuracy of UAV modeling and surface deformation analysis were comprehensively analyzed.The results show that,the proposed method allows for the monitoring accuracy of landslides to exceed the accuracy of the GCPs themselves by adding additional low-accuracy GCPs.The proposed method was implemented for monitoring the Xinhua landslide in Baoxing County,China,and was validated against data from multiple sources.

A Systematic Literature Review of Machine Learning and Deep Learning Approaches for Spectral Image Classification in Agricultural Applications Using Aerial Photography

Recently,there has been a notable surge of interest in scientific research regarding spectral images.The potential of these images to revolutionize the digital photography industry,like aerial photography through Unmanned Aerial Vehicles(UAVs),has captured considerable attention.One encouraging aspect is their combination with machine learning and deep learning algorithms,which have demonstrated remarkable outcomes in image classification.As a result of this powerful amalgamation,the adoption of spectral images has experienced exponential growth across various domains,with agriculture being one of the prominent beneficiaries.This paper presents an extensive survey encompassing multispectral and hyperspectral images,focusing on their applications for classification challenges in diverse agricultural areas,including plants,grains,fruits,and vegetables.By meticulously examining primary studies,we delve into the specific agricultural domains where multispectral and hyperspectral images have found practical use.Additionally,our attention is directed towards utilizing machine learning techniques for effectively classifying hyperspectral images within the agricultural context.The findings of our investigation reveal that deep learning and support vector machines have emerged as widely employed methods for hyperspectral image classification in agriculture.Nevertheless,we also shed light on the various issues and limitations of working with spectral images.This comprehensive analysis aims to provide valuable insights into the current state of spectral imaging in agriculture and its potential for future advancements.

Secure Transmission Scheme for Blocks in Blockchain-Based Unmanned Aerial Vehicle Communication Systems

In blockchain-based unmanned aerial vehicle(UAV)communication systems,the length of a block affects the performance of the blockchain.The transmission performance of blocks in the form of finite character segments is also affected by the block length.Therefore,it is crucial to balance the transmission performance and blockchain performance of blockchain communication systems,especially in wireless environments involving UAVs.This paper investigates a secure transmission scheme for blocks in blockchain-based UAV communication systems to prevent the information contained in blocks from being completely eavesdropped during transmission.In our scheme,using a friendly jamming UAV to emit jamming signals diminishes the quality of the eavesdropping channel,thus enhancing the communication security performance of the source UAV.Under the constraints of maneuverability and transmission power of the UAV,the joint design of UAV trajectories,transmission power,and block length are proposed to maximize the average minimum secrecy rate(AMSR).Since the optimization problem is non-convex and difficult to solve directly,we first decompose the optimization problem into subproblems of trajectory optimization,transmission power optimization,and block length optimization.Then,based on firstorder approximation techniques,these subproblems are reformulated as convex optimization problems.Finally,we utilize an alternating iteration algorithm based on the successive convex approximation(SCA)technique to solve these subproblems iteratively.The simulation results demonstrate that our proposed scheme can achieve secure transmission for blocks while maintaining the performance of the blockchain.

Robust and Discriminative Feature Learning via Mutual Information Maximization for Object Detection in Aerial Images

Object detection in unmanned aerial vehicle(UAV)aerial images has become increasingly important in military and civil applications.General object detection models are not robust enough against interclass similarity and intraclass variability of small objects,and UAV-specific nuisances such as uncontrolledweather conditions.Unlike previous approaches focusing on high-level semantic information,we report the importance of underlying features to improve detection accuracy and robustness fromthe information-theoretic perspective.Specifically,we propose a robust and discriminative feature learning approach through mutual information maximization(RD-MIM),which can be integrated into numerous object detection methods for aerial images.Firstly,we present the rank sample mining method to reduce underlying feature differences between the natural image domain and the aerial image domain.Then,we design a momentum contrast learning strategy to make object features similar to the same category and dissimilar to different categories.Finally,we construct a transformer-based global attention mechanism to boost object location semantics by leveraging the high interrelation of different receptive fields.We conduct extensive experiments on the VisDrone and Unmanned Aerial Vehicle Benchmark Object Detection and Tracking(UAVDT)datasets to prove the effectiveness of the proposed method.The experimental results show that our approach brings considerable robustness gains to basic detectors and advanced detection methods,achieving relative growth rates of 51.0%and 39.4%in corruption robustness,respectively.Our code is available at https://github.com/cq100/RD-MIM(accessed on 2 August 2024).

Comparison of aerial and ground spraying applications in controlling fusarium crown rot in wheat

Fusarium crown rot (FCR) is a chronic disease in many regions of the world in wheat, caused by Fusarium culmorum, Fusarium pseudograminearum, and Fusarium graminearum. The operational efficacy of pesticide applications using unmanned aerial vehicles (UAVs) significantly affects the biological efficacy of the pesticides. This study aimed to compare the effectiveness of unmanned aerial vehicle and field sprayer applications in controlling crown rot diseases frequently observed in wheat crops in the Thrace region, Turkey. A licensed fungicide containing the active ingredients, prochloraz plus trifloxystrobin plus cyproconazole mixture was applied to wheat during the ZGS 27 growth stage. The disease severity, disease incidence, and the effectiveness of fungicide treatment on disease severity (%) were evaluated for F. culmorum crown rot disease. The results showed that the severity of the disease during the seedling stage was 11.25% and 18.33% for unmanned aerial vehicle and field sprayer applications, respectively. In the harvest stage, the incidence of disease was 28.33%-39.99% and 48.75%-51.25%, respectively, and the effectiveness of unmanned aerial vehicle application was found to be high, approximately 52%, during the seedling and harvest stages. The unmanned aerial vehicle, acting similarly to the field sprayer, exhibited higher grain quality under conditions of stress from disease. Furthermore, spike weight, grain weight, and number of grains exhibited stronger positive correlations compared to unmanned aerial vehicle treatment. Therefore, unmanned aerial vehicles have promising potential as viable options to manage FCR when the prevailing environmental conditions are not conducive to the use of field sprayer. The results of this research will guide future studies to investigate the efficacy of UAVs on a wider range of pesticides and to further develop the technology to investigate its effectiveness, cost-effectiveness, and sustainability in agricultural applications.

Estimating Key Phenological Dates of Multiple Rice Accessions Using Unmanned Aerial Vehicle-Based Plant Height Dynamics for Breeding

Efficient and high-quality estimation of key phenological dates in rice is of great significance in breeding work. Plant height(PH) dynamics are valuable for estimating phenological dates. However, research on estimating the key phenological dates of multiple rice accessions based on PH dynamics has been limited. In 2022, field traits were collected using unmanned aerial vehicle(UAV)-based images across 435 plots, including 364 rice varieties. PH, dates of initial heading(IH) and full heading(FH), and panicle initiation(PI), and growth period after transplanting(GPAT) were collected during the rice growth stage. PHs were extracted using a digital surface model(DSM) and fitted using Fourier and logistic models. Machine learning algorithms, including multiple linear regression, random forest(RF), support vector regression, least absolute shrinkage and selection operator, and elastic net regression, were employed to estimate phenological dates. Results indicated that the optimal percentile of the DSM for extracting rice PH was the 95th(R^(2) = 0.934, RMSE = 0.056 m). The Fourier model provided a better fit for PH dynamics compared with the logistic models. Additionally, curve features(CF) and GPAT were significantly associated with PI, IH, and FH. The combination of CF and GPAT outperformed the use of CF alone, with RF demonstrating the best performance among the algorithms. Specifically, the combination of CF extracted from the logistic models, GPAT, and RF yielded the best performance for estimating PI(R^(2) = 0.834, RMSE = 4.344 d), IH(R^(2) = 0.877, RMSE = 2.721 d), and FH(R^(2) = 0.883, RMSE = 2.694 d). Overall, UAV-based rice PH dynamics combined with machine learning effectively estimated the key phenological dates of multiple rice accessions, providing a novel approach for investigating key phenological dates in breeding work.

An Aerial Target Recognition Algorithm Based on Self-Attention and LSTM

In the application of aerial target recognition,on the one hand,the recognition error produced by the single measurement of the sensor is relatively large due to the impact of noise.On the other hand,it is difficult to apply machine learning methods to improve the intelligence and recognition effect due to few or no actual measurement samples.Aiming at these problems,an aerial target recognition algorithm based on self-attention and Long Short-Term Memory Network(LSTM)is proposed.LSTM can effectively extract temporal dependencies.The attention mechanism calculates the weight of each input element and applies the weight to the hidden state of the LSTM,thereby adjusting the LSTM’s attention to the input.This combination retains the learning ability of LSTM and introduces the advantages of the attention mechanism,making the model have stronger feature extraction ability and adaptability when processing sequence data.In addition,based on the prior information of the multidimensional characteristics of the target,the three-point estimation method is adopted to simulate an aerial target recognition dataset to train the recognition model.The experimental results show that the proposed algorithm achieves more than 91%recognition accuracy,lower false alarm rate and higher robustness compared with the multi-attribute decision-making(MADM)based on fuzzy numbers.

Determining beam transverse absolute position by triangulation of multi-electrode signal phase differences

Accurate measurement of the transverse position of a beam is crucial in particle accelerators because it plays a key role in determining the beam parameters.Existing methods for beam-position measurement rely on the detection of image currents induced on electrodes or narrow-band wake field induced by a beam passing through a cavity-type structure.However,these methods have limitations.The indirect measurement of multiple parameters is computationally complex,requiring external calibration to determine the system parameters in advance.Furthermore,the utilization of the beam signal information is incomplete.Hence,this study proposes a novel method for measuring the absolute electron beam transverse position.By utilizing the geometric relationship between the center position of the measured electron beam and multiple detection electrodes and by analyzing the differences in the arrival times of the beam signals detected by these electrodes,the absolute transverse position of the electron beam crossing the electrode plane can be calculated.This method features absolute position measurement,a position sensitivity coefficient independent of vacuum chamber apertures,and no requirement for a symmetrical detector electrode layout.The feasibility of this method is validated through numerical simulations and beam experiments.

The Influence of Aerial Exposure on Sea Anemones Aulactinia veratra Mucin Genes Expression Using the RNA Sequencing

Mucin genes are the main component of mucus. The sea anemone species, Aulactinia veratra (Phylum Cnidaria) contains different types of mucin genes. In the intertidal zone, A. veratra is found to be exposed to air during the low tide and produces large quantities of mucus as an external covering. The relation between low tide and mucus secretion is still unclear, and what is the role of mucin during arial exposure is not yet investigated. This study hypothesised that the mucin genes in A. veratra would have significantly high expression in response to aerial exposure. Therefore, the aim of current study was to examine and analyses the response of A. veratra mucins in response to an experiment involving three hours of aerial exposure. To achieve this, aim the RNA-sequencing and bioinformatics analyses were used to examine the expression profile of A. veratra mucin genes in response to aerial exposure. The generated results have shown that, Mucin4-like and mucin5B-like were up-regulated in response to the three hours of aerial exposure in A. veratra. This finding shows a significant role of mucin5B-like and mucin4-like genes in response to air stress at low tide. The data generated from this study could be used in conjunction with future mucin gene studies of sea anemones and other cnidarians to compare A. veratra mucin gene expression results across time, and to extend our understanding of mucin stress response in this phylum.

Adaptive state-constrained/model-free iterative sliding mode control for aerial robot trajectory tracking

This paper develops a novel hierarchical control strategy for improving the trajectory tracking capability of aerial robots under parameter uncertainties.The hierarchical control strategy is composed of an adaptive sliding mode controller and a model-free iterative sliding mode controller(MFISMC).A position controller is designed based on adaptive sliding mode control(SMC)to safely drive the aerial robot and ensure fast state convergence under external disturbances.Additionally,the MFISMC acts as an attitude controller to estimate the unmodeled dynamics without detailed knowledge of aerial robots.Then,the adaption laws are derived with the Lyapunov theory to guarantee the asymptotic tracking of the system state.Finally,to demonstrate the performance and robustness of the proposed control strategy,numerical simulations are carried out,which are also compared with other conventional strategies,such as proportional-integralderivative(PID),backstepping(BS),and SMC.The simulation results indicate that the proposed hierarchical control strategy can fulfill zero steady-state error and achieve faster convergence compared with conventional strategies.

Guaranteed Cost Attitude Tracking Control for Uncertain Quadrotor Unmanned Aerial Vehicle Under Safety Constraints

In this paper,guaranteed cost attitude tracking con-trol for uncertain quadrotor unmanned aerial vehicle(QUAV)under safety constraints is studied.First,an augmented system is constructed by the tracking error system and reference system.This transformation aims to convert the tracking control prob-lem into a stabilization control problem.Then,control barrier function and disturbance attenuation function are designed to characterize the violations of safety constraints and tolerance of uncertain disturbances,and they are incorporated into the reward function as penalty items.Based on the modified reward function,the problem is simplified as the optimal regulation problem of the nominal augmented system,and a new Hamilton-Jacobi-Bellman equation is developed.Finally,critic-only rein-forcement learning algorithm with a concurrent learning tech-nique is employed to solve the Hamilton-Jacobi-Bellman equa-tion and obtain the optimal controller.The proposed algorithm can not only ensure the reward function within an upper bound in the presence of uncertain disturbances,but also enforce safety constraints.The performance of the algorithm is evaluated by the numerical simulation.

A Novel Tensor Decomposition-Based Efficient Detector for Low-Altitude Aerial Objects With Knowledge Distillation Scheme

Unmanned aerial vehicles(UAVs) have gained significant attention in practical applications, especially the low-altitude aerial(LAA) object detection imposes stringent requirements on recognition accuracy and computational resources. In this paper, the LAA images-oriented tensor decomposition and knowledge distillation-based network(TDKD-Net) is proposed,where the TT-format TD(tensor decomposition) and equalweighted response-based KD(knowledge distillation) methods are designed to minimize redundant parameters while ensuring comparable performance. Moreover, some robust network structures are developed, including the small object detection head and the dual-domain attention mechanism, which enable the model to leverage the learned knowledge from small-scale targets and selectively focus on salient features. Considering the imbalance of bounding box regression samples and the inaccuracy of regression geometric factors, the focal and efficient IoU(intersection of union) loss with optimal transport assignment(F-EIoU-OTA)mechanism is proposed to improve the detection accuracy. The proposed TDKD-Net is comprehensively evaluated through extensive experiments, and the results have demonstrated the effectiveness and superiority of the developed methods in comparison to other advanced detection algorithms, which also present high generalization and strong robustness. As a resource-efficient precise network, the complex detection of small and occluded LAA objects is also well addressed by TDKD-Net, which provides useful insights on handling imbalanced issues and realizing domain adaptation.

Method for Improving Digital Elevation Model Precision of Consumer Level Unmanned Aerial Vehicles

Currently,the aerial survey system of low-altitude unmanned aerial vehicles(UAVs)has been widely used in acquiring digital map 4D products,mapping,digital linear maps,and other aspects.However,there are problems,such as low precision and weak practicability in constructing digital elevation model(DEM)products through the data collected using consumption level UAVs.Therefore,improving the accuracy of DEM products obtained by consumption level UAVs is a crucial and complex issue in the research of UAV aerial survey systems.In precision elevation measurement,the geodetic height of a certain number of ground points with reasonable distribution in the region is often obtained first.Then,the normal height of the ground points is obtained by leveling,and the elevation residual value surface of the region is fitted.Finally,the normal height of the points to be solved in the region is obtained by fitting the elevation residual surface.Therefore,the elevation residual fitting method was used to improve the accuracy of consumer UAV DEM products in this study.First,a high-quality ground point cloud was obtained by constructing the gradient filtering-cloth simulation filtering(GF-CSF)model.Second,an abnormal elevation fitting residual DEM model was constructed.Lastly,the final DEM was obtained using the DEM difference method.The experimental results show that among the 20 random sampling inspection points,the average elevation residual was 2.3 mm,and the root mean square error(RMSE)was 16.7 mm after the DEM accuracy was improved by the method.The average elevation residual without improving the DEM accuracy was 28.6 mm,and RMSE was 33.7 mm.

Average Secrecy Capacity of the Reconfigurable Intelligent Surface-Assisted Integrated Satellite Unmanned Aerial Vehicle Relay Networks

Integrated satellite unmanned aerial vehicle relay networks(ISUAVRNs)have become a prominent topic in recent years.This paper investigates the average secrecy capacity(ASC)for reconfigurable intelligent surface(RIS)-enabled ISUAVRNs.Especially,an eve is considered to intercept the legitimate information from the considered secrecy system.Besides,we get detailed expressions for the ASC of the regarded secrecy system with the aid of the reconfigurable intelligent.Furthermore,to gain insightful results of the major parameters on the ASC in high signalto-noise ratio regime,the approximate investigations are further gotten,which give an efficient method to value the secrecy analysis.At last,some representative computer results are obtained to prove the theoretical findings.

Ground target localization of unmanned aerial vehicle based on scene matching

In order to improve target localization precision,accuracy,execution efficiency,and application range of the unmanned aerial vehicle(UAV)based on scene matching,a ground target localization method for unmanned aerial vehicle based on scene matching(GTLUAVSM)is proposed.The sugges-ted approach entails completing scene matching through a feature matching algorithm.Then,multi-sensor registration is optimized by robust estimation based on homologous registration.Finally,basemap generation and model solution are utilized to improve basemap correspondence and accom-plish aerial image positioning.Theoretical evidence and experimental verification demonstrate that GTLUAVSM can improve localization accuracy,speed,and precision while minimizing reliance on task equipment.

Underdetermined direction of arrival estimation with nonuniform linear motion sampling based on a small unmanned aerial vehicle platform

Uniform linear array(ULA)radars are widely used in the collision-avoidance radar systems of small unmanned aerial vehicles(UAVs).In practice,a ULA's multi-target direction of arrival(DOA)estimation performance suffers from significant performance degradation owing to the limited number of physical elements.To improve the underdetermined DOA estimation performance of a ULA radar mounted on a small UAV platform,we propose a nonuniform linear motion sampling underdetermined DOA estimation method.Using the motion of the UAV platform,the echo signal is sampled at different positions.Then,according to the concept of difference co-array,a virtual ULA with multiple array elements and a large aperture is synthesized to increase the degrees of freedom(DOFs).Through position analysis of the original and motion arrays,we propose a nonuniform linear motion sampling method based on ULA for determining the optimal DOFs.Under the condition of no increase in the aperture of the physical array,the proposed method obtains a high DOF with fewer sampling runs and greatly improves the underdetermined DOA estimation performance of ULA.The results of numerical simulations conducted herein verify the superior performance of the proposed method.

Received Power Based Unmanned Aerial Vehicles (UAVs) Jamming Detection and Nodes Classification Using Machine Learning

This paper presents a machine-learning method for detecting jamming UAVs and classifying nodes during jamming attacks onWireless Sensor Networks(WSNs).Jamming is a type of Denial of Service(DoS)attack and intentional interference where a malicious node transmits a high-power signal to increase noise on the receiver side to disrupt the communication channel and reduce performance significantly.To defend and prevent such attacks,the first step is to detect them.The current detection approaches use centralized techniques to detect jamming,where each node collects information and forwards it to the base station.As a result,overhead and communication costs increased.In this work,we present a jamming attack and classify nodes into different categories based on their location to the jammer by employing a single node observer.As a result,we introduced a machine learning model that uses distance ratios and power received as features to detect such attacks.Furthermore,we considered several types of jammers transmitting at different power levels to evaluate the proposed metrics using MATLAB.With a detection accuracy of 99.7%for the k-nearest neighbors(KNN)algorithm and average testing accuracy of 99.9%,the presented solution is capable of efficiently and accurately detecting jamming attacks in wireless sensor networks.

Coati Optimization-Based Energy Efficient Routing Protocol for Unmanned Aerial Vehicle Communication

With the flexible deployment and high mobility of Unmanned Aerial Vehicles(UAVs)in an open environment,they have generated con-siderable attention in military and civil applications intending to enable ubiquitous connectivity and foster agile communications.The difficulty stems from features other than mobile ad-hoc network(MANET),namely aerial mobility in three-dimensional space and often changing topology.In the UAV network,a single node serves as a forwarding,transmitting,and receiving node at the same time.Typically,the communication path is multi-hop,and routing significantly affects the network’s performance.A lot of effort should be invested in performance analysis for selecting the optimum routing system.With this motivation,this study modelled a new Coati Optimization Algorithm-based Energy-Efficient Routing Process for Unmanned Aerial Vehicle Communication(COAER-UAVC)technique.The presented COAER-UAVC technique establishes effective routes for communication between the UAVs.It is primarily based on the coati characteristics in nature:if attacking and hunting iguanas and escaping from predators.Besides,the presented COAER-UAVC technique concentrates on the design of fitness functions to minimize energy utilization and communication delay.A varied group of simulations was performed to depict the optimum performance of the COAER-UAVC system.The experimental results verified that the COAER-UAVC technique had assured improved performance over other approaches.

An aerial ammunition ad hoc network collaborative localization algorithm based on relative ranging and velocity measurement in a highly-dynamic topographic structure

In the internet of battlefield things, ammunition is becoming networked and intelligent, which depends on location information. Therefore, this paper focuses on the self-organized network collaborative localization of munitions with an aerial three-dimensional(3D) highly-dynamic topographic structure under a satellite denied environment. As for aerial networked munitions, the measurement of munitions is objectively incomplete due to the degenerated and interrupted link of munitions. For this reason, a cluster-oriented collaborative localization method is put forward in this paper. Multidimensional scaling(MDS) was first integrated with a trilateration localization method(TLM) to construct a relative localization algorithm for determining the relative location of a mobile cluster network. The information related to relative velocity was then combined into a collaborative localization framework to devise a TLM-vMDS algorithm. Finally, an iterative refinement algorithm based on scaling by majorizing a complicated function(SMACOF) was employed to effectively eliminate the influence of incomplete link observation on localization accuracy. Compared with the currently available advanced algorithms, the proposed TLM-vMDS algorithm achieves higher localization accuracy and faster convergence for a cluster of extensively networked munitions, and also offers better numerical stability and robustness for highspeed motion models.