基于复杂纹理特征融合的材料图像分割方法

Material image segmentation method based on complex texture feature fusion

为解决材料图像分割中存在小样本、纹理复杂和数据分布不平衡的问题,抓住材料图像同相像素具有高度相似性的特性,提出一种基于复杂纹理特征融合的材料图像分割方法。在编码阶段,使用全卷积神经网络(FCN)作为基础网络,VGG16作为骨干网络;将改进的FCN的每层的特征图放入设计的级联的特征融合模块(CFF block),融合高低层语义信息;将融合的特征图放入多尺度学习模块(multi-scale block)进一步提取纹理特征。在解码阶段,对特征图施加注意力机制(Attention block),保留关键的特征图;针对材料图像中数据不平衡问题,采用并改进Dice损失,优化分割结果。通过对比实验和消融实验验证该方法的mIoU在多个数据集上均优于经典的深度学习方法。

To solve the problems of small sample,complex texture and unbalanced data distribution in material image segmentation,the characteristics of high similarity of pixels in the same phase were grasped,a material image segmentation method based on complex texture feature fusion was proposed.In the coding phase,the convolutional neural network network(FCN)was used as the base network and VGG16 as the backbone network,the feature map of each layer of the improved FCN was put into the designed cascade feature fusion module(CFF block),and the fused feature map was put into the multi-scale block to extract texture features.In the decoding stage,the Attention block was applied to the feature map,and the key feature map was retained.To solve the problem of unbalanced data distribution in material images,Dice loss was adopted and improved to optimize the segmentation results.Results of comparison experiment and ablation experiment show that the mIoU of the proposed method is better than that of classical deep learning methods in many data sets.