基于空间联合的红外舰船目标数据增强方法

Data augmentation method of infrared ship target based on spatial association

针对红外舰船目标图像数据少、获取难度高等问题,结合图像的几何变化以及金字塔生成对抗网络的特征拟合,提出一种几何空间与特征空间联合的红外舰船目标图像数据增强方法。首先,利用基于几何空间的几何变换、混合图像及随机擦除等图像变换方法对红外舰船目标图像进行增强;然后,根据红外舰船图像特点,改进金字塔生成对抗网络(SinGAN),在生成器引入In-SE通道间注意力机制模块,增强小感受野特征表达,使其更适合用于红外舰船目标;最后,在数据集层面联合基于几何空间的几何数据变换和基于特征空间的生成对抗网络两种方法,完成对原始数据集的数据增强。结果表明:以YOLOv3、SSD、R-FCN和Faster R-CNN目标检测算法为基准模型,开展红外舰船图像数据增强仿真实验,采用增强数据训练的网络模型的舰船目标检测平均精度(mAP)均提高了10%左右,验证了所提方法在小样本红外舰船图像数据增强方面的可行性,为提高红外舰船目标检测算法提供了数据基础。

In order to solve the problems that lacking of infrared images for ship target and the difficulty of acquiring them, an improved infrared image data augmentation method with geometric space and feature space association for ship target is proposed based on the image geometry changes and feature fitting method with generative adversarial network. Firstly, the IR image of ship target was augmented by image transformation methods such as geometric transformation on geometric space, image hybridization and random erasure;Secondly, the pyramidal generative adversarial network(SinGAN) structure was improved according to the characteristics of the IR ship image, and the In-SE-Net inter-channel attention mechanism module was introduced in the generator to enhance the small sensory field feature representation, making it more suitable for the IR ship target;Finally, at the data set level, geometric data transformation based on geometric space and generative adversarial network based on feature space were combined to complete the data augmentation of the original dataset. Object detection algorithms such as YOLOv3, SSD, R-FCN and Faster R-CNN were used as benchmark models to carry out in infrared ship image data augmentation experiments. The average accuracy(mAP) of object detection were all improved by about 10% trained on the augmented data, which verified the feasibility of the proposed method on small-sample infrared ship image data augmentation. It also provides a data basis for improving object detection algorithm carried of infrared ship.