基于注意力双线性池化的细粒度舰船识别

Weakly Supervised Fine-grained Natural Scene Ship Recognition via Attention Bilinear Pooling

针对当前细粒度图像识别的模型结构复杂且只能学习到单一判别性特征的问题,对一种弱监督学习下基于注意力双线性池化的细粒度舰船识别方法进行研究。该方法首先将通道注意力机制和空间注意力机制与卷积神经网络相结合,在没有监督信息的条件下分别提取图像的深度通道特征和深度空间特征。然后通过双线性池化操作对提取到的深度通道特征和深度空间特征进行特征融合,使得通道特征和空间特征形成关联和交互,从而使网络能够学习到更丰富的图像局部特征。最后再将学习到的局部特征和深度神经网络提取到的全局特征进行拼接,利用全连接层得到最终的图像融合特征用于舰船图像的细粒度分类。针对当前缺少自然场景下的舰船数据集问题,进行了相关舰船图像数据的收集工作,建立了针对自然场景舰船细粒度检测的数据集,并在该数据集上进行了训练和测试,该模型的识别准确率可以达到91.3%。

Aiming at the problem that the current model structure of fine-grained image recognition is complex and can only learn a single discriminant feature,a fine-grained ship recognition method based on attention bilinear pooling under weak supervised learning is studied.Firstly,the channel attention mechanism and spatial attention mechanism are combined with convolution neural network to extract the depth channel features and depth space features of the image without supervision information.Then,the extracted depth channel features and depth spatial features are fused through bilinear pooling operation,so that the channel features and spatial features form association and interaction,making the network can learn more abundant image local features.Finally,the learned local features and the global features extracted by depth neural network are spliced,and the final image fusion features are obtained by using the full connection layer for fine-grained classification of ship images.In view of the current lack of ship data sets in open natural scenes,we collect relevant ship image data and establish a data set for fine-grained ship detection in natural scenes.Through training and testing on the data set,the recognition accuracy of such model reaches 91.3%.