针对轻量化网络结构从特征图提取有效语义信息不足,以及语义信息与空间细节信息融合模块设计不合理而导致分割精度降低的问题,本文提出一种结合全局注意力机制的实时语义分割网络(global attention mechanism with real time semantic s...针对轻量化网络结构从特征图提取有效语义信息不足,以及语义信息与空间细节信息融合模块设计不合理而导致分割精度降低的问题,本文提出一种结合全局注意力机制的实时语义分割网络(global attention mechanism with real time semantic segmentation network,GaSeNet)。首先在双分支结构的语义分支中引入全局注意力机制,在通道与空间两个维度引导卷积神经网来关注与分割任务相关的语义类别,以提取更多有效语义信息;其次在空间细节分支设计混合空洞卷积块,在卷积核大小不变的情况下扩大感受野,以获取更多全局空间细节信息,弥补关键特征信息损失。然后重新设计特征融合模块,引入深度聚合金塔池化,将不同尺度的特征图深度融合,从而提高网络的语义分割性能。最后将所提出的方法在CamVid数据集和Vaihingen数据集上进行实验,通过与最新的语义分割方法对比分析可知,GaSeNet在分割精度上分别提高了4.29%、16.06%,实验结果验证了本文方法处理实时语义分割问题的有效性。展开更多
Floating wastes in rivers have specific characteristics such as small scale,low pixel density and complex backgrounds.These characteristics make it prone to false and missed detection during image analysis,thus result...Floating wastes in rivers have specific characteristics such as small scale,low pixel density and complex backgrounds.These characteristics make it prone to false and missed detection during image analysis,thus resulting in a degradation of detection performance.In order to tackle these challenges,a floating waste detection algorithm based on YOLOv7 is proposed,which combines the improved GFPN(Generalized Feature Pyramid Network)and a long-range attention mechanism.Firstly,we import the improved GFPN to replace the Neck of YOLOv7,thus providing more effective information transmission that can scale into deeper networks.Secondly,the convolution-based and hardware-friendly long-range attention mechanism is introduced,allowing the algorithm to rapidly generate an attention map with a global receptive field.Finally,the algorithm adopts the WiseIoU optimization loss function to achieve adaptive gradient gain allocation and alleviate the negative impact of low-quality samples on the gradient.The simulation results reveal that the proposed algorithm has achieved a favorable average accuracy of 86.3%in real-time scene detection tasks.This marks a significant enhancement of approximately 6.3%compared with the baseline,indicating the algorithm's good performance in floating waste detection.展开更多
文摘针对轻量化网络结构从特征图提取有效语义信息不足,以及语义信息与空间细节信息融合模块设计不合理而导致分割精度降低的问题,本文提出一种结合全局注意力机制的实时语义分割网络(global attention mechanism with real time semantic segmentation network,GaSeNet)。首先在双分支结构的语义分支中引入全局注意力机制,在通道与空间两个维度引导卷积神经网来关注与分割任务相关的语义类别,以提取更多有效语义信息;其次在空间细节分支设计混合空洞卷积块,在卷积核大小不变的情况下扩大感受野,以获取更多全局空间细节信息,弥补关键特征信息损失。然后重新设计特征融合模块,引入深度聚合金塔池化,将不同尺度的特征图深度融合,从而提高网络的语义分割性能。最后将所提出的方法在CamVid数据集和Vaihingen数据集上进行实验,通过与最新的语义分割方法对比分析可知,GaSeNet在分割精度上分别提高了4.29%、16.06%,实验结果验证了本文方法处理实时语义分割问题的有效性。
基金Supported by the Science Foundation of the Shaanxi Provincial Department of Science and Technology,General Program-Youth Program(2022JQ-695)the Scientific Research Program Funded by Education Department of Shaanxi Provincial Government(22JK0378)+1 种基金the Talent Program of Weinan Normal University(2021RC20)the Educational Reform Research Project(JG202342)。
文摘Floating wastes in rivers have specific characteristics such as small scale,low pixel density and complex backgrounds.These characteristics make it prone to false and missed detection during image analysis,thus resulting in a degradation of detection performance.In order to tackle these challenges,a floating waste detection algorithm based on YOLOv7 is proposed,which combines the improved GFPN(Generalized Feature Pyramid Network)and a long-range attention mechanism.Firstly,we import the improved GFPN to replace the Neck of YOLOv7,thus providing more effective information transmission that can scale into deeper networks.Secondly,the convolution-based and hardware-friendly long-range attention mechanism is introduced,allowing the algorithm to rapidly generate an attention map with a global receptive field.Finally,the algorithm adopts the WiseIoU optimization loss function to achieve adaptive gradient gain allocation and alleviate the negative impact of low-quality samples on the gradient.The simulation results reveal that the proposed algorithm has achieved a favorable average accuracy of 86.3%in real-time scene detection tasks.This marks a significant enhancement of approximately 6.3%compared with the baseline,indicating the algorithm's good performance in floating waste detection.
