融合深度特征的无人机影像SfM重建

Learned local features for SfM reconstruction of UAV images

可靠特征匹配是无人机影像运动恢复结构(SfM)的重要环节。近年来,深度学习被用于特征提取和匹配,在基准数据集表现优于SIFT等手工特征。但是,公开模型往往采用互联网照片进行训练和测试,鲜有用于无人机影像SfM三维重建的性能评价。利用多组不同特点的无人机数据集,本文对比分析手工特征和深度学习特征在无人机影像特征匹配和SfM三维重建的综合性能。试验结果表明,利用公开的预训练模型,结合手工特征的高精度定位和深度学习的特征描述能力,可实现更准确和完整的特征匹配,并在SfM三维重建中取得与SIFT等手工特征相当,甚至更优的性能。

Reliable feature matching plays an essential role in SfM(structure from motion)for UAV(unmanned aerial vehicle)images.Recently,deep learning-based methods have been used for feature detection and matching,which outperforms traditional handcrafted methods,e.g.,SIFT,on benchmark datasets.However,few studies have reported their performance on UAV images as these models are trained and tested using internet photos.By using UAV datasets with varying features,this study evaluated both handcrafted and learned methods in terms of feature matching and SfM-based image orientation.The experimental results show that even with the pretrained public-available models,more accurate and complete feature matching can be obtained through the combination of high-precision localization of handcrafted detectors and the high representation ability of learned descriptors,which has competitive or better performance in SfM-based image orientation when compared with SIFT-like handcrafted methods.