期刊文献+

基于多特征注意力循环网络的显著性检测 被引量:2

Salient Object Detection Using Multi-Scale Features with Attention Recurrent Mechanism
下载PDF
导出
摘要 特征表达是图像显著性检测的关键,现有方法所提取的特征缺乏一定的可辨识性.为此,提出多尺度上下文特征提取机制和注意力循环机制来解决这一问题.多尺度上下文特征提取机制通过空洞卷积增大高层特征的感受野来获取丰富的上下文语义特征,并采用向量聚合策略对特征进行融合.为增强融合特征的可辨识性,利用注意力机制自适应地对卷积特征增加权重以区分每个像素的重要性,使注意力集中于显著性区域,并抑制背景中的干扰信息.在此基础上,采用循环网络能够有效地在空间位置上对卷积特征进行逐步细化,进一步调整了显著性区域及其边缘,从而生成精确的显著图.该方法在5个常用的数据集上与8种相关方法进行了比较.实验结果表明,该方法不仅能够生成更加准确与完整的显著图,而且其MAE和最大F-measure量化性能也有所提升. Feature representation is a key component to salient object detection.However,the features extracted by existing methods lack capability of discrimination for salient object detection.Hence,multi-scale context features extraction mechanism and attention recurrent mechanism are proposed to solve this problem.Specifically,the multi-scale context features extraction mechanism uses atrous convolution,which can expand receptive fields of high-level convolution features to obtain rich context sematic features,and adopts a vector aggregation strategy to fuse these features.In order to enhance the discriminative power of fused features,the proposed method adopts a attention mechanism to distinguish the importance of each pixel by adaptively increasing the weight of convolution features.The attention mechanism can focus on salient regions while suppressing the interference information in the background.Furthermore,a recurrent network is presented to gradually refine the convolution features in spatial position,and adjust salient regions to generate accurate saliency maps.The proposed method is compared with eight state-of-the-art methods on five benchmark datasets.Experimental results show that the method can generate more accurate and complete saliency maps,and achieves good performance in both mean absolute error and maximum F-measure.
作者 卢珊妹 郭强 王任 张彩明 Lu Shanmei;Guo Qiang;Wang Ren;Zhang Caiming(School of Computer Science and Technology,Shandong University of Finance and Economics,Jinan 250014;Shandong Key Laboratory of Digital Media Technology,Jinan 250014;Software College,Shandong University,Jinan 250010)
出处 《计算机辅助设计与图形学学报》 EI CSCD 北大核心 2020年第12期1926-1937,共12页 Journal of Computer-Aided Design & Computer Graphics
基金 国家自然科学基金(61873145,61802229) 山东省自然科学省属高校优秀青年联合基金(ZR2017JL029) 山东省自然科学基金(ZR2018BF007) 山东省高等学校青创科技计划(2019KJN045) 山东省优势学科人才团队。
关键词 空洞卷积 多尺度特征 注意力机制 循环网络 显著性检测 atrous convolution multi-scale feature attention mechanism recurrent network saliency detection
  • 相关文献

参考文献4

二级参考文献52

  • 1Loupias E, Sebe N, Bres S, Jolion J M. Wavelet-based salient points for image retrieval. In: Proceedings of the 2000 IEEEInternational Conference on hnage Processing. Vancouver, British Columbia, Canada: IEEE, 2000, 2:518-521.
  • 2Jian M W, Dong J Y, Ma J. Image retrieval using wavelet- based salient regions. The Imaging Science Journal, 2011, 59(4): 219-2:31.
  • 3Guo C L, Zhang L M. A novel nmlti-resolution spatiotem- poral saliency detection model and its applications in image and video compression. IEEE Transactions on Image Pro- cessing, 2010, 19(1): 185-198.
  • 4Kim W, Kim C. A novel image importance model for content-aware image resizing. In: Proceedings of the 18th IEEE International Conference on Image Processing. Brus- sels, Belguim: IEEE, 2011. 2469-2472.
  • 5Gupta R, Chaudhury S. A scheme for attentional video compression. In: Proceedings of the 4th International Con- ference on Pattern Recognition and Machine Intelligence. Berlin, Heidelberg: Springer-Verlag, 2011. 458-465.
  • 6Itti L. Automatic foveation for video compression using a neurobiological model of visual attention. IEEE Tralsac- tions on Image Processing, 2004, 13(10): 1304-1318.
  • 7Kanan C, Cottrell G. Robust classification of objects, faces, and flowers using natural image statistics. In: Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition. San Francisco, California, USA: IEEE, 2010. 2472-2479.
  • 8Teuber H L. Physiological psychology. Annual Review of Psychology, 1955, 6:267-296.
  • 9Wolfe J M, Horowitz T S. What attributes guide the de- ployment of visual attention and how do they do it'? Nature Reviews Neuroscience, 2004, 5(6): 495-501.
  • 10Desimone R, Duncan J. Neural mechanisms of visual selec- tive attention. Annual Review of Neuroscience, 1995, 18(1 ): 193-222.

共引文献93

同被引文献16

引证文献2

二级引证文献12

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部