基于Dense SIFT特征的无人机影像快速拼接方法

A Fast Mosaic Algorithm of UAV Images based on Dense SIFT Feature Matching

特征匹配是无人机影像拼接过程的关键步骤,针对传统的特征匹配方法在影像拼接过程中获取匹配点少、特征点分布不均匀、匹配耗时长等问题,本文提出一种基于Dense SIFT特征的无人机影像快速拼接算法。首先,利用影像POS信息构建连接矩阵以引导匹配过程;然后在降采样影像上进行影像分块,利用Dense SIFT算子获取初始匹配点,并采用两次NCC方法分别实现降采样影像和原始影像上匹配点的精化;最后,基于共线方程将影像投影至物方面上,完成影像的快速拼接。本文选取2组无人机影像进行拼接实验,将本文算法与SIFT和SURF匹配拼接方法进行对比,结果表明:在影像特征点匹配方面,本文方法获取匹配点数量是SIFT和SURF算法的5倍以上,且匹配点分布更加均匀;在影像拼接结果方面,本文方法不仅能够较快完成影像拼接,而且有效避免了拼接影像中的"重影"现象,保证了较好的拼接质量。

The UAV(Unmanned Aerial Vehicle)photography is a new remote sensing system emerging in recent years.It plays an important role in the rapid emergency response of natural disasters.However,due to the large amount of UAV image data,the traditional method for image matching and mosaic is low accuracy and timeconsuming.Feature matching is one of key steps in UAV image mosaic.Traditional matching algorithms have several problems,including less feature points,feature maldistribution,and time-consuming.To solve these problems,a fast image mosaic algorithm based on Dense SIFT feature matching is proposed.Firstly,the connection matrix is build based on POS(Position and Orientation System)data to conduct the matching process.The UAV images are then down-sampled.Secondly,image segmentation is performed on the downsampled images.Then the Dense SIFT operator is used in overlap area of down-sampled images to obtain the initial matching points which are eliminated through matching by the RANSAC(Random Sample Consensus)algorithm and refined by the NCC algorithm on the original and down-sampled images,respectively.Finally,processed images are projected to the object coordinate system based on collinear equation which is calculated by the bundle adjustment method.By contrast,the SIFT(Scale-Invariant Feature Transform)and SURF(Speeded Up Robust Feature)algorithms and the Pix4Dmapper Photogrammetry software are used to test the quality and efficiency of the Dense SIFT algorithm.Two groups of UAV images mosaic experiment results indicate:(1)The Dense SIFT algorithm can be used to obtain about five times more evenly distributed matching points than the SIFT and SURF algorithm at the same time;(2)The Dense SIFT algorithm can be used to effectively improve the quality of the images mosaic by removing the phenomenon of ghosting;(3)It takes about half the time of Pix4Dmapper software to complete the same image mosaic test using the Dense SIFT algorithm.This indicates that the presented algorithm has a high image mosaic quality and fast processing speed,which can play an important role in the rapid emergency response of natural disasters.