基于上下文注意力机制的实时语义分割

Real-Time Image Semantic Segmentation Based on Contextual Attention Mechanism

针对实时语义分割网络提取的特征缺少上下文信息,易造成分割结果出现类内不一致和类间不可区分的问题,文中提出了轻量级的自适应通道注意力模块和空间注意力模块。自适应通道注意力模块使用深度分离卷积对通道层面的特征依赖关系进行建模,自适应地调整通道卷积核大小,强化高层特征的上下文表征能力,加强了分割结果的类内一致性。空间注意力模块使用分组卷积,以较小的计算量获得较大的特征信息流动区域,在空间层面加强特征的上下文联系,增强特征的空间细节信息,加强了分割结果的类间可区分性。在Cityscapes数据集上的测试与分析表明,轻量级上下文注意力机制获得了71.5%的mIoU。

To address the problem that feature extracted by real time semantic segmentation model lacks contextual information,which causese inconsistent segmentation results between and within classes,a lightweight adaptive spatial attention model and channel attention model are proposed in this study.The adaptive channel attention module uses depthwise separable convolution to model the channel-level feature dependencies,adaptively adjusts the channel convolution kernel size,strengthens the contextual representation ability of high-level features,and enhances the intra-class consistency of segmentation results.The spatial attention module uses grouped convolution to obtain a larger flow area of feature information with a small amount of calculation,strengthens the contextual connection of features at the spatial level,enhances the spatial detail information of features,and enhances the inter-class distinguishability of segmentation results.Testing and analysis on the Cityscapes data set show that the lightweight contextual attention mechanism achieves 71.5%mIoU.