Ground target localization of unmanned aerial vehicle based on scene matching

In order to improve target localization precision,accuracy,execution efficiency,and application range of the unmanned aerial vehicle(UAV)based on scene matching,a ground target localization method for unmanned aerial vehicle based on scene matching(GTLUAVSM)is proposed.The sugges-ted approach entails completing scene matching through a feature matching algorithm.Then,multi-sensor registration is optimized by robust estimation based on homologous registration.Finally,basemap generation and model solution are utilized to improve basemap correspondence and accom-plish aerial image positioning.Theoretical evidence and experimental verification demonstrate that GTLUAVSM can improve localization accuracy,speed,and precision while minimizing reliance on task equipment.

Multi-Modal Scene Matching Location Algorithm Based on M2Det

In recent years,many visual positioning algorithms have been proposed based on computer vision and they have achieved good results.However,these algorithms have a single function,cannot perceive the environment,and have poor versatility,and there is a certain mismatch phenomenon,which affects the positioning accuracy.Therefore,this paper proposes a location algorithm that combines a target recognition algorithm with a depth feature matching algorithm to solve the problem of unmanned aerial vehicle(UAV)environment perception and multi-modal image-matching fusion location.This algorithm was based on the single-shot object detector based on multi-level feature pyramid network(M2Det)algorithm and replaced the original visual geometry group(VGG)feature extraction network with the ResNet-101 network to improve the feature extraction capability of the network model.By introducing a depth feature matching algorithm,the algorithm shares neural network weights and realizes the design of UAV target recognition and a multi-modal image-matching fusion positioning algorithm.When the reference image and the real-time image were mismatched,the dynamic adaptive proportional constraint and the random sample consensus consistency algorithm(DAPC-RANSAC)were used to optimize the matching results to improve the correct matching efficiency of the target.Using the multi-modal registration data set,the proposed algorithm was compared and analyzed to verify its superiority and feasibility.The results show that the algorithm proposed in this paper can effectively deal with the matching between multi-modal images(visible image–infrared image,infrared image–satellite image,visible image–satellite image),and the contrast,scale,brightness,ambiguity deformation,and other changes had good stability and robustness.Finally,the effectiveness and practicability of the algorithm proposed in this paper were verified in an aerial test scene of an S1000 sixrotor UAV.

Scene matching based on non-linear pre-processing on referenceimage and sensed image

To solve the heterogeneous image scene matching problem, a non-linear pre-processing method for the original images before intensity-based correlation is proposed. The result shows that the proper matching probability is raised greatly. Especially for the low S/N image pairs, the effect is more remarkable.

Reliability analysis of multimodal scene matching based on correlation peaks

The navigation system plays a pivotal role in guiding aircraft along designated routes,ensuring precise and punctual arrival at destinations.The integration of scene matching with an inertial navigation system enhances the capability of providing a dependable guarantee for success-ful accomplishment of flight missions.Nonetheless,assuring reliability in scene matching encoun-ters significant challenges in areas characterized by repetitive or weak textures.To tackle these challenges,we propose a novel method to assess the reliability of scene matching based on the dis-tinctive characteristics of correlation peaks.The proposed method leverages the fact that the sim-ilarity of the optimal matching result is significantly higher than that of the surrounding area,and three novel indicators(e.g.,relative height,slope of a correlation peak,and ratio of a sub peak to the main peak)are determined to conjointly evaluate the reliability of scene matching.The pro-posed method entails matching a real-time image with a reference image to generate a correlation surface.A correlation peak is then obtained by extracting the portion of the correlation surface exhibiting a significant gradient.Additionally,the matching reliability is determined by considering the relative height,slope,and ratio of the peak collectively.Exhaustive experimental results with two sets of data demonstrate that the proposed method significantly outperforms traditional approaches in terms of precision,recall,and F1-score.These experiments also establish the efficacy of the proposed method in achieving reliable matching in challenging environments characterized by repetitive and weak textures.This enhancement holds the potential to significantly elevate scene-matching-based navigation.

CALTM:A Context-Aware Long-Term Time-Series Forecasting Model

Time series data plays a crucial role in intelligent transportation systems.Traffic flow forecasting represents a precise estimation of future traffic flow within a specific region and time interval.Existing approaches,including sequence periodic,regression,and deep learning models,have shown promising results in short-term series forecasting.However,forecasting scenarios specifically focused on holiday traffic flow present unique challenges,such as distinct traffic patterns during vacations and the increased demand for long-term forecastings.Consequently,the effectiveness of existing methods diminishes in such scenarios.Therefore,we propose a novel longterm forecasting model based on scene matching and embedding fusion representation to forecast long-term holiday traffic flow.Our model comprises three components:the similar scene matching module,responsible for extracting Similar Scene Features;the long-short term representation fusion module,which integrates scenario embeddings;and a simple fully connected layer at the head for making the final forecasting.Experimental results on real datasets demonstrate that our model outperforms other methods,particularly in medium and long-term forecasting scenarios.

An area-based position and attitude estimation for unmanned aerial vehicle navigation

The paper aims to challenge non-GPS navigation problems by using visual sensors and geo-referenced images. An area-based method is proposed to estimate full navigation parameters(FNPs), including attitude, altitude and horizontal position, for unmanned aerial vehicle(UAV) navigation. Our method is composed of three main modules: geometric transfer function, local normalized sobel energy image(LNSEI) based objective function and simplex-simulated annealing(SSA) based optimization algorithm. The adoption of relatively rich scene information and LNSEI, makes it possible to yield a solution robustly even in the presence of very noisy cases, such as multi-modal and/or multi-temporal images that differ in the type of visual sensor, season, illumination, weather, and so on, and also to handle the sparsely textured regions where features are barely detected or matched. Simulation experiments using many synthetic images clearly support noise resistance and estimation accuracy, and experimental results using 2367 real images show the maximum estimation error of 5.16(meter) for horizontal position, 9.72(meter) for altitude and 0.82(degree) for attitude.