Feature Matching via Topology-Aware Graph Interaction Model

Feature matching plays a key role in computer vision. However, due to the limitations of the descriptors, the putative matches are inevitably contaminated by massive outliers.This paper attempts to tackle the outlier filtering problem from two aspects. First, a robust and efficient graph interaction model,is proposed, with the assumption that matches are correlated with each other rather than independently distributed. To this end, we construct a graph based on the local relationships of matches and formulate the outlier filtering task as a binary labeling energy minimization problem, where the pairwise term encodes the interaction between matches. We further show that this formulation can be solved globally by graph cut algorithm. Our new formulation always improves the performance of previous localitybased method without noticeable deterioration in processing time,adding a few milliseconds. Second, to construct a better graph structure, a robust and geometrically meaningful topology-aware relationship is developed to capture the topology relationship between matches. The two components in sum lead to topology interaction matching(TIM), an effective and efficient method for outlier filtering. Extensive experiments on several large and diverse datasets for multiple vision tasks including general feature matching, as well as relative pose estimation, homography and fundamental matrix estimation, loop-closure detection, and multi-modal image matching, demonstrate that our TIM is more competitive than current state-of-the-art methods, in terms of generality, efficiency, and effectiveness. The source code is publicly available at http://github.com/YifanLu2000/TIM.

Distributed Matching Theory-Based Task Re-Allocating for Heterogeneous Multi-UAV Edge Computing

Many efforts have been devoted to efficient task scheduling in Multi-Unmanned Aerial Vehicle(UAV)edge computing.However,the heterogeneity of UAV computation resource,and the task re-allocating between UAVs have not been fully considered yet.Moreover,most existing works neglect the fact that a task can only be executed on the UAV equipped with its desired service function(SF).In this backdrop,this paper formulates the task scheduling problem as a multi-objective task scheduling problem,which aims at maximizing the task execution success ratio while minimizing the average weighted sum of all tasks’completion time and energy consumption.Optimizing three coupled goals in a realtime manner with the dynamic arrival of tasks hinders us from adopting existing methods,like machine learning-based solutions that require a long training time and tremendous pre-knowledge about the task arrival process,or heuristic-based ones that usually incur a long decision-making time.To tackle this problem in a distributed manner,we establish a matching theory framework,in which three conflicting goals are treated as the preferences of tasks,SFs and UAVs.Then,a Distributed Matching Theory-based Re-allocating(DiMaToRe)algorithm is put forward.We formally proved that a stable matching can be achieved by our proposal.Extensive simulation results show that Di Ma To Re algorithm outperforms benchmark algorithms under diverse parameter settings and has good robustness.

A Time Series Short-Term Prediction Method Based on Multi-Granularity Event Matching and Alignment

Accurate forecasting of time series is crucial across various domains.Many prediction tasks rely on effectively segmenting,matching,and time series data alignment.For instance,regardless of time series with the same granularity,segmenting them into different granularity events can effectively mitigate the impact of varying time scales on prediction accuracy.However,these events of varying granularity frequently intersect with each other,which may possess unequal durations.Even minor differences can result in significant errors when matching time series with future trends.Besides,directly using matched events but unaligned events as state vectors in machine learning-based prediction models can lead to insufficient prediction accuracy.Therefore,this paper proposes a short-term forecasting method for time series based on a multi-granularity event,MGE-SP(multi-granularity event-based short-termprediction).First,amethodological framework for MGE-SP established guides the implementation steps.The framework consists of three key steps,including multi-granularity event matching based on the LTF(latest time first)strategy,multi-granularity event alignment using a piecewise aggregate approximation based on the compression ratio,and a short-term prediction model based on XGBoost.The data from a nationwide online car-hailing service in China ensures the method’s reliability.The average RMSE(root mean square error)and MAE(mean absolute error)of the proposed method are 3.204 and 2.360,lower than the respective values of 4.056 and 3.101 obtained using theARIMA(autoregressive integratedmoving average)method,as well as the values of 4.278 and 2.994 obtained using k-means-SVR(support vector regression)method.The other experiment is conducted on stock data froma public data set.The proposed method achieved an average RMSE and MAE of 0.836 and 0.696,lower than the respective values of 1.019 and 0.844 obtained using the ARIMA method,as well as the values of 1.350 and 1.172 obtained using the k-means-SVR method.

Artificial Immune Detection for Network Intrusion Data Based on Quantitative Matching Method

Artificial immune detection can be used to detect network intrusions in an adaptive approach and proper matching methods can improve the accuracy of immune detection methods.This paper proposes an artificial immune detection model for network intrusion data based on a quantitative matching method.The proposed model defines the detection process by using network data and decimal values to express features and artificial immune mechanisms are simulated to define immune elements.Then,to improve the accuracy of similarity calculation,a quantitative matching method is proposed.The model uses mathematical methods to train and evolve immune elements,increasing the diversity of immune recognition and allowing for the successful detection of unknown intrusions.The proposed model’s objective is to accurately identify known intrusions and expand the identification of unknown intrusions through signature detection and immune detection,overcoming the disadvantages of traditional methods.The experiment results show that the proposed model can detect intrusions effectively.It has a detection rate of more than 99.6%on average and a false alarm rate of 0.0264%.It outperforms existing immune intrusion detection methods in terms of comprehensive detection performance.

Road Traffic Monitoring from Aerial Images Using Template Matching and Invariant Features

Road traffic monitoring is an imperative topic widely discussed among researchers.Systems used to monitor traffic frequently rely on cameras mounted on bridges or roadsides.However,aerial images provide the flexibility to use mobile platforms to detect the location and motion of the vehicle over a larger area.To this end,different models have shown the ability to recognize and track vehicles.However,these methods are not mature enough to produce accurate results in complex road scenes.Therefore,this paper presents an algorithm that combines state-of-the-art techniques for identifying and tracking vehicles in conjunction with image bursts.The extracted frames were converted to grayscale,followed by the application of a georeferencing algorithm to embed coordinate information into the images.The masking technique eliminated irrelevant data and reduced the computational cost of the overall monitoring system.Next,Sobel edge detection combined with Canny edge detection and Hough line transform has been applied for noise reduction.After preprocessing,the blob detection algorithm helped detect the vehicles.Vehicles of varying sizes have been detected by implementing a dynamic thresholding scheme.Detection was done on the first image of every burst.Then,to track vehicles,the model of each vehicle was made to find its matches in the succeeding images using the template matching algorithm.To further improve the tracking accuracy by incorporating motion information,Scale Invariant Feature Transform(SIFT)features have been used to find the best possible match among multiple matches.An accuracy rate of 87%for detection and 80%accuracy for tracking in the A1 Motorway Netherland dataset has been achieved.For the Vehicle Aerial Imaging from Drone(VAID)dataset,an accuracy rate of 86%for detection and 78%accuracy for tracking has been achieved.

Can propensity score matching replace randomized controlled trials?

Randomized controlled trials(RCTs)have long been recognized as the gold standard for establishing causal relationships in clinical research.Despite that,various limitations of RCTs prevent its widespread implementation,ranging from the ethicality of withholding potentially-lifesaving treatment from a group to relatively poor external validity due to stringent inclusion criteria,amongst others.However,with the introduction of propensity score matching(PSM)as a retrospective statistical tool,new frontiers in establishing causation in clinical research were opened up.PSM predicts treatment effects using observational data from existing sources such as registries or electronic health records,to create a matched sample of participants who received or did not receive the intervention based on their propensity scores,which takes into account characteristics such as age,gender and comorbidities.Given its retrospective nature and its use of observational data from existing sources,PSM circumvents the aforementioned ethical issues faced by RCTs.Majority of RCTs exclude elderly,pregnant women and young children;thus,evidence of therapy efficacy is rarely proven by robust clinical research for this population.On the other hand,by matching study patient characteristics to that of the population of interest,including the elderly,pregnant women and young children,PSM allows for generalization of results to the wider population and hence greatly increases the external validity.Instead of replacing RCTs with PSM,the synergistic integration of PSM into RCTs stands to provide better research outcomes with both methods complementing each other.For example,in an RCT investigating the impact of mannitol on outcomes among participants of the Intensive Blood Pressure Reduction in Acute Cerebral Hemorrhage Trial,the baseline characteristics of comorbidities and current medications between treatment and control arms were significantly different despite the randomization protocol.Therefore,PSM was incorporated in its analysis to create samples from the treatment and control arms that were matched in terms of these baseline characteristics,thus providing a fairer comparison for the impact of mannitol.This literature review reports the applications,advantages,and considerations of using PSM with RCTs,illustrating its utility in refining randomization,improving external validity,and accounting for non-compliance to protocol.Future research should consider integrating the use of PSM in RCTs to better generalize outcomes to target populations for clinical practice and thereby benefit a wider range of patients,while maintaining the robustness of randomization offered by RCTs.

A Study of the TPS Based Beam-Matching Concept for Medical Linear Accelerators at a Tertiary Hospital

The flexibility in radiotherapy can be improved if patients can be moved between any one of the department’s medical linear accelerators (LINACs) without the need to change anything in the patient’s treatment plan. For this to be possible, the dosimetric characteristics of the various accelerators must be the same, or nearly the same. The purpose of this work is to describe further and compare measurements and parameters after the initial vendor-recommended beam matching of the five LINACs. Deviations related to dose calculations and to beam matched accelerators may compromise treatment accuracy. The safest and most practical way to ensure that all accelerators are within clinical acceptable accuracy is to include TPS calculations in the LINACs matching evaluation. Treatment planning system (TPS) was used to create three photons plans with different field sizes 3 × 3 cm, 10 × 10 cm and 25 × 25 cm at a depth of 4.5 cm in Perspex. Calculated TPS plans were sent to Mosaiq to be delivered by five LINACs. TPS plans were compared with five LINACs measurements data using Gamma analyses of 2% and 2 mm. The results suggest that for four out of the five LINACs, there was generally good agreement, less than a 2% deviation between the planned dose distribution and the measured dose distribution. However, one specific LINAC named “Asterix” exhibited a deviation of 2.121% from the planned dose. The results show that all of the LINACs’ performance were within the acceptable deviation and delivering radiation dose consistently and accurately.

Loop Closure Detection via Locality Preserving Matching With Global Consensus

A critical component of visual simultaneous localization and mapping is loop closure detection(LCD),an operation judging whether a robot has come to a pre-visited area.Concretely,given a query image(i.e.,the latest view observed by the robot),it proceeds by first exploring images with similar semantic information,followed by solving the relative relationship between candidate pairs in the 3D space.In this work,a novel appearance-based LCD system is proposed.Specifically,candidate frame selection is conducted via the combination of Superfeatures and aggregated selective match kernel(ASMK).We incorporate an incremental strategy into the vanilla ASMK to make it applied in the LCD task.It is demonstrated that this setting is memory-wise efficient and can achieve remarkable performance.To dig up consistent geometry between image pairs during loop closure verification,we propose a simple yet surprisingly effective feature matching algorithm,termed locality preserving matching with global consensus(LPM-GC).The major objective of LPM-GC is to retain the local neighborhood information of true feature correspondences between candidate pairs,where a global constraint is further designed to effectively remove false correspondences in challenging sceneries,e.g.,containing numerous repetitive structures.Meanwhile,we derive a closed-form solution that enables our approach to provide reliable correspondences within only a few milliseconds.The performance of the proposed approach has been experimentally evaluated on ten publicly available and challenging datasets.Results show that our method can achieve better performance over the state-of-the-art in both feature matching and LCD tasks.We have released our code of LPM-GC at https://github.com/jiayi-ma/LPM-GC.

Laparoscopic liver resection for hepatocellular carcinoma complicated with significant portal hypertension:A propensity score-matched survival analysis

Background: Significant portal hypertension(SPH) is a relative contraindication for patients with resectable hepatocellular carcinoma(HCC). However, increasing evidence indicates that liver resection is feasible for HCC patients with SPH. Methods: HCC patients with cirrhosis who underwent laparoscopic liver resection(LLR) in two centers from January 2013 to April 2018 were included. Surgical and survival outcomes were analyzed to explore potential prognostic factors. Propensity score matching(PSM) analysis was performed to minimize bias. Results: A total of 165 patients were divided into two groups based on the presence(SPH, n = 76) or absence(non-SPH, n = 89) of SPH. Patients in the SPH group had longer operative time, more blood loss, and more advanced TNM stage than patients in the non-SPH group( P < 0.05). However, there were no significant differences in the postoperative 90-day mortality rate( n = 0), overall postoperative complications(47.4% vs. 41.6%, P = 0.455), Clavien-Dindo classification( P = 0.347), conversion to open surgery(9.2% vs. 6.7%, P = 0.557), or length of hospitalization(16 vs. 15 days, P = 0.203) between the SPH and non-SPH groups before PSM. Similar results were obtained after PSM. The 1-, 3-, and 5-year overall survival(OS) and recurrence-free survival rates in the SPH group were not significantly different from those in the non-SPH group both before and after PSM(log-rank P > 0.05). After PSM, alpha-fetoprotein(AFP) ≥ 400 μg/L [hazard ratio(HR) = 4.71, 95% confidence interval(CI): 2.69-8.25], ascites(HR = 2.18, 95% CI: 1.30-3.66), American Society of Anesthesiologists(ASA) classification(Ⅲ vs. Ⅱ)(HR = 2.13, 95% CI: 1.11-4.07) and tumor diameter > 5 cm(HR = 3.91, 95% CI: 2.02-7.56) independently predicted worse OS. Conclusions: LLR for patients with HCC complicated with SPH appears feasible at the price of increasing operative time and blood loss. AFP, ascites, ASA classification and tumor diameter may predict the prognosis of HCC complicated with SPH after LLR.

Robotic versus laparoscopic distal pancreatectomy for pancreatic ductal adenocarcinoma: A propensity score-matched analysis

Background: Minimally invasive surgery is becoming increasingly popular in the field of pancreatic surgery. However, there are few studies of robotic distal pancreatectomy(RDP) for pancreatic ductal adenocarcinoma(PDAC). This study aimed to investigate the efficacy and feasibility of RDP for PDAC. Methods: Patients who underwent RDP or laparoscopic distal pancreatectomy(LDP) for PDAC between January 2015 and September 2020 were reviewed. Propensity score matching analyses were performed. Results: Of the 335 patients included in the study, 24 underwent RDP and 311 underwent LDP. A total of 21 RDP patients were matched 1:1 with LDP patients. RDP was associated with longer operative time(209.7 vs. 163.2 min;P = 0.003), lower open conversion rate(0% vs. 4.8%;P < 0.001), higher cost(15 722 vs. 12 699 dollars;P = 0.003), and a higher rate of achievement of an R0 resection margin(90.5% vs. 61.9%;P = 0.042). However, postoperative pancreatic fistula grade B or C showed no significant intergroup difference(9.5% vs. 9.5%). The median disease-free survival(34.5 vs. 17.3 months;P = 0.588) and overall survival(37.7 vs. 21.9 months;P = 0.171) were comparable between the groups. Conclusions: RDP is associated with longer operative time, a higher cost of surgery, and a higher likelihood of achieving R0 margins than LDP.

Two-Sided Stable Matching Decision-Making Method Considering Matching Intention under a Hesitant Fuzzy Environment

In this paper,a stable two-sided matching(TSM)method considering the matching intention of agents under a hesitant fuzzy environment is proposed.The method uses a hesitant fuzzy element(HFE)as its basis.First,the HFE preference matrix is transformed into the normalized HFE preference matrix.On this basis,the distance and the projection of the normalized HFEs on positive and negative ideal solutions are calculated.Then,the normalized HFEs are transformed into agent satisfactions.Considering the stable matching constraints,a multiobjective programming model with the objective of maximizing the satisfactions of two-sided agents is constructed.Based on the agent satisfaction matrix,the matching intention matrix of two-sided agents is built.According to the agent satisfaction matrix and matching intention matrix,the comprehensive satisfaction matrix is set up.Furthermore,the multiobjective programming model based on satisfactions is transformed into a multiobjective programming model based on comprehensive satisfactions.Using the G-S algorithm,the multiobjective programming model based on comprehensive satisfactions is solved,and then the best TSM scheme is obtained.Finally,a terminal distribution example is used to verify the feasibility and effectiveness of the proposed method.

Improved HardNet and Stricter Outlier Filtering to Guide Reliable Matching

As the fundamental problem in the computer vision area,image matching has wide applications in pose estimation,3D reconstruction,image retrieval,etc.Suffering from the influence of external factors,the process of image matching using classical local detectors,e.g.,scale-invariant feature transform(SIFT),and the outlier filtering approaches,e.g.,Random sample consensus(RANSAC),show high computation speed and pool robustness under changing illumination and viewpoints conditions,while image matching approaches with deep learning strategy(such as HardNet,OANet)display reliable achievements in large-scale datasets with challenging scenes.However,the past learning-based approaches are limited to the distinction and quality of the dataset and the training strategy in the image-matching approaches.As an extension of the previous conference paper,this paper proposes an accurate and robust image matching approach using fewer training data in an end-to-end manner,which could be used to estimate the pose error This research first proposes a novel dataset cleaning and construction strategy to eliminate the noise and improve the training efficiency;Secondly,a novel loss named quadratic hinge triplet loss(QHT)is proposed to gather more effective and stable feature matching;Thirdly,in the outlier filtering process,the stricter OANet and bundle adjustment are applied for judging samples by adding the epipolar distance constraint and triangulation constraint to generate more outstanding matches;Finally,to recall the matching pairs,dynamic guided matching is used and then submit the inliers after the PyRANSAC process.Multiple evaluation metrics are used and reported in the 1st place in the Track1 of CVPR Image-Matching Challenge Workshop.The results show that the proposed method has advanced performance in large-scale and challenging Phototourism benchmark.

Catheter ablation versus medical therapy for atrial fibrillation with prior stroke history:a prospective propensity score-matched cohort study

BACKGROUND Patients with atrial fibrillation(AF)and prior stroke history have a high risk of cardiovascular events despite anticoagulation therapy.It is unclear whether catheter ablation(CA)has further benefits in these patients.METHODS AF patients with a previous history of stroke or systemic embolism(SE)from the prospective Chinese Atrial Fibrillation Registry study between August 2011 and December 2020 were included in the analysis.Patients were matched in a 1:1 ratio to CA or medical treatment(MT)based on propensity score.The primary outcome was a composite of all-cause death or ischemic stroke(IS)/SE.RESULTS During a total of 4.1±2.3 years of follow-up,the primary outcome occurred in 111 patients in the CA group(3.3 per 100 person-years)and in 229 patients in the MT group(5.7 per 100 person-years).The CA group had a lower risk of the primary outcome compared to the MT group[hazard ratio(HR)=0.59,95%CI:0.47–0.74,P<0.001].There was a significant decreasing risk of all-cause mortality(HR=0.43,95%CI:0.31–0.61,P<0.001),IS/SE(HR=0.73,95%CI:0.54–0.97,P=0.033),cardiovascular mortality(HR=0.32,95%CI:0.19–0.54,P<0.001)and AF recurrence(HR=0.33,95%CI:0.30–0.37,P<0.001)in the CA group compared to that in the MT group.Sensitivity analysis generated consistent results when adjusting for time-dependent usage of anticoagulants.CONCLUSIONS In AF patients with a prior stroke history,CA was associated with a lower combined risk of all-cause death or IS/SE.Further clinical trials are warranted to confirm the benefits of CA in these patients.

Exact Graph Pattern Matching:Applications,Progress and Prospects

Graph pattern matching(GPM)can be used to mine the key information in graphs.Exact GPM is one of the most commonly used methods among all the GPM-related methods,which aims to exactly find all subgraphs for a given query graph in a data graph.The exact GPM has been widely used in biological data analyses,social network analyses and other fields.In this paper,the applications of the exact GPM were first introduced,and the research progress of the exact GPM was summarized.Then,the related algorithms were introduced in detail,and the experiments on the state-of-the-art exact GPM algorithms were conducted to compare their performance.Based on the experimental results,the applicable scenarios of the algorithms were pointed out.New research opportunities in this area were proposed.

Different roles of surfaces’ interaction on lattice mismatched/matched surfaces in facilitating ice nucleation

The freezing of water is one of the most common processes in nature and affects many aspects of human activity. Ice nucleation is a crucial part of the freezing process and usually occurs on material surfaces. There is still a lack of clear physical pictures about the central question how various features of material surfaces affect their capability in facilitating ice nucleation. Via molecular dynamics simulations, here we show that the detailed features of surfaces, such as atomic arrangements, lattice parameters, hydrophobicity, and function forms of surfaces’ interaction to water molecules, generally affect the ice nucleation through the average adsorption energy per unit-area surfaces to individual water molecules, when the lattice of surfaces mismatches that of ice. However, for the surfaces whose lattice matches ice, even the detailed function form of the surfaces’ interaction to water molecules can largely regulate the icing ability of these surfaces. This study provides new insights into understanding the diverse relationship between various microscopic features of different material surfaces and their nucleation efficacy.

Experimental investigation on the enhanced oil recovery efficiency of polymeric surfactant: Matching relationship with core and emulsification ability

The polymeric surfactant can be used as an efficient agent for enhanced oil recovery(EOR)because of its large bulk viscosity and good interfacial activity.However,there is a sparse understanding of its matching relationship with reservoirs and emulsification occurrence conditions,which may affect its migration and EOR efficiency.One intermolecular association molecule polymeric surfactant(IAM)was synthesized by micellar polymerization and characterized with 1 H NMR,FTIR,and TGA.The matching relationship between IAM and reservoirs was evaluated by comparing the viscosity retention rate of effluent in the core flow experiments.Moreover,the effect of the matching relationship on EOR in the heterogeneous reservoir was clarified with parallel core displacement experiments by considering different flow abilities of IAM in the high-permeability layer.The occurrence conditions of in-situ emulsification of IAM were evaluated via oil-water co-injection experiments under the different injection rates and oil-water ratios.Microscopic visualization displacement was carried out to compare the micro EOR mechanisms of different chemical systems.The results show that IAM features thickening,shearing resistance,viscoelasticity,thermal stability,and interfacial activity.The matching relationship between cores and IAM could be divided as hardly injected,flow limited,and flow smoothly,corresponding to the viscosity retention ratio of<20%,20%-80%,and>80%,respectively.IAM could gain better EOR efficiency(17.69%)when its matching relationship to the high permeability layer was“flow limited”.The defined mixture capillary number shows that only when it is greater than 1×10^(3),the in-situ emulsions can be generated.Compared to HPAM,IAM could reduce IFT and form vortices to more effectively displace film and corner remaining oils by stripping and peeling off crude oil.The formed emulsion accumulated at the pore throat could further increase flow resistance,which benefits swept area enlargement.This work could provide theoretical and data support for the parameters design in the polymeric surfactant practical application.

Soft Tissue Feature Tracking Based on Deep Matching Network

Research in the field ofmedical image is an important part of themedical robot to operate human organs.Amedical robot is the intersection ofmulti-disciplinary research fields,in whichmedical image is an important direction and has achieved fruitful results.In this paper,amethodof soft tissue surface feature tracking basedonadepthmatching network is proposed.This method is described based on the triangular matching algorithm.First,we construct a self-made sample set for training the depth matching network from the first N frames of speckle matching data obtained by the triangle matching algorithm.The depth matching network is pre-trained on the ORL face data set and then trained on the self-made training set.After the training,the speckle matching is carried out in the subsequent frames to obtain the speckle matching matrix between the subsequent frames and the first frame.From this matrix,the inter-frame feature matching results can be obtained.In this way,the inter-frame speckle tracking is completed.On this basis,the results of this method are compared with the matching results based on the convolutional neural network.The experimental results show that the proposed method has higher matching accuracy.In particular,the accuracy of the MNIST handwritten data set has reached more than 90%.

Finite-difference modeling of Maxwell viscoelastic media developed from perfectly matched layer

In numerical simulation of wave propagation,both viscoelastic materials and perfectly matched layers(PMLs)attenuate waves.The wave equations for both the viscoelastic model and the PML contain convolution operators.However,convolution operator is intractable in finite-difference time-domain(FDTD)method.A great deal of progress has been made in using time stepping instead of convolution in FDTD.To incorporate PML into viscoelastic media,more memory variables need to be introduced,which increases the code complexity and computation costs.By modifying the nonsplitting PML formulation,I propose a viscoelastic model,which can be used as a viscoelastic material and/or a PML just by adjusting the parameters.The proposed viscoelastic model is essentially equivalent to a Maxwell model.Compared with existing PML methods,the proposed method requires less memory and its implementation in existing finite-difference codes is much easier.The attenuation and phase velocity of P-and S-waves are frequency independent in the viscoelastic model if the related quality factors(Q)are greater than 10.The numerical examples show that the method is stable for materials with high absorption(Q=1),and for heterogeneous media with large contrast of acoustic impedance and large contrast of viscosity.

Outliers rejection in similar image matching

Background Image matching is crucial in numerous computer vision tasks such as 3D reconstruction and simultaneous visual localization and mapping.The accuracy of the matching significantly impacted subsequent studies.Because of their local similarity,when image pairs contain comparable patterns but feature pairs are positioned differently,incorrect recognition can occur as global motion consistency is disregarded.Methods This study proposes an image-matching filtering algorithm based on global motion consistency.It can be used as a subsequent matching filter for the initial matching results generated by other matching algorithms based on the principle of motion smoothness.A particular matching algorithm can first be used to perform the initial matching;then,the rotation and movement information of the global feature vectors are combined to effectively identify outlier matches.The principle is that if the matching result is accurate,the feature vectors formed by any matched point should have similar rotation angles and moving distances.Thus,global motion direction and global motion distance consistencies were used to reject outliers caused by similar patterns in different locations.Results Four datasets were used to test the effectiveness of the proposed method.Three datasets with similar patterns in different locations were used to test the results for similar images that could easily be incorrectly matched by other algorithms,and one commonly used dataset was used to test the results for the general image-matching problem.The experimental results suggest that the proposed method is more accurate than other state-of-the-art algorithms in identifying mismatches in the initial matching set.Conclusions The proposed outlier rejection matching method can significantly improve the matching accuracy for similar images with locally similar feature pairs in different locations and can provide more accurate matching results for subsequent computer vision tasks.

Multi-Modal Scene Matching Location Algorithm Based on M2Det

In recent years,many visual positioning algorithms have been proposed based on computer vision and they have achieved good results.However,these algorithms have a single function,cannot perceive the environment,and have poor versatility,and there is a certain mismatch phenomenon,which affects the positioning accuracy.Therefore,this paper proposes a location algorithm that combines a target recognition algorithm with a depth feature matching algorithm to solve the problem of unmanned aerial vehicle(UAV)environment perception and multi-modal image-matching fusion location.This algorithm was based on the single-shot object detector based on multi-level feature pyramid network(M2Det)algorithm and replaced the original visual geometry group(VGG)feature extraction network with the ResNet-101 network to improve the feature extraction capability of the network model.By introducing a depth feature matching algorithm,the algorithm shares neural network weights and realizes the design of UAV target recognition and a multi-modal image-matching fusion positioning algorithm.When the reference image and the real-time image were mismatched,the dynamic adaptive proportional constraint and the random sample consensus consistency algorithm(DAPC-RANSAC)were used to optimize the matching results to improve the correct matching efficiency of the target.Using the multi-modal registration data set,the proposed algorithm was compared and analyzed to verify its superiority and feasibility.The results show that the algorithm proposed in this paper can effectively deal with the matching between multi-modal images(visible image–infrared image,infrared image–satellite image,visible image–satellite image),and the contrast,scale,brightness,ambiguity deformation,and other changes had good stability and robustness.Finally,the effectiveness and practicability of the algorithm proposed in this paper were verified in an aerial test scene of an S1000 sixrotor UAV.