期刊文献+

融合显著物体检测的图像显示适配

Image retargeting based on salient object detection
原文传递
导出
摘要 目的图像显著适配旨在自动调节图像尺寸,对图像内容进行非均匀缩放,以便在受限的展示空间内更好地保留显著物体。为了解决显示适配过程中显著物体部分扭曲的问题,提出一种基于显著物体检测的图像显示适配方法。方法本文方法采用显著物体分割结果来替代显著性图,以改进显示适配结果。首先,采用显著性融合和传播的方法生成显著性图;接着,结合输入图像和显著性图,采用自适应三阈值方法实现显著物体分割;然后,以此为基础,生成输入图像的曲边网格表示;最后,通过对不同网格的非均匀缩放,生成符合目标尺寸的适配结果。结果在面向图像显示适配的公开数据集RetargetMe上,将本文方法与现有的10种代表性显示适配方法的结果进行了人工评估和比较。本文方法可以有效地减少显著物体出现部分扭曲的现象,能在48.8%的图像上取得无明显缺陷的适配效果,比现有最好的方法提高了5%。结论基于显著物体检测的图像显示适配方法有助于提高显示适配过程中对显著物体处理的一致性,减少由于显著物体部分扭曲而引起的明显人工处理痕迹,从而达到提升显示适配效果的目的。 Objective Image retargeting aims to automatically adjusl the resolnlion of an image by non-homogeneously scaling image content and displaying it in a limited screen with well-preserved salient objeets. A novel image retargeting method based on salient object detection is proposed to solve the partial distortion problem of salient objects. Method The proposed method utilizes the resuhs of salient object segmentation instead of saliency maps to improve retargeting performance. First, a saliency map is generated using saliency filsion and propagation strategy, which can ohtain the balance between the accacy and completeness of salient regions. Then, based on the inpnt image and saliency map, a saliency cut method with adaptive triple threshohling is adapted to segment salient objects, which can generate the salient objects with accurate boundaries. After this step, the curve-edge grid representation of the input image is constrncted hy finding the eight con- net,ted seams with the maximum energy. Finally, the grids ate non-unifiormlv scaled to satisfy the required size. Result Using manual evaluation, the performance of the proposed method are compared with those of ten typical ,nethods on RetargetMe dataset, a public dataset for image retargeting. Experimental results show that the proposed method can effcetively reduce the partial distortion of salient objects in image retargeting and obtain the retargeting results without obvious artifacts on 48. 8% images, a rate that is 5% better than the best existing image retargeting method. Conclusion The proposed image retargeting methods based on salient object segmentation can improve the consistency of salient object processing, reduce the obvious artifacts caused lay partial distortion of salient objects, and obtain good performaoce in retargeting.
出处 《中国图象图形学报》 CSCD 北大核心 2016年第3期373-381,共9页 Journal of Image and Graphics
基金 国家自然科学基金项目(61321491 61202320) 国家自然科学基金国家重点实验室研究项目(61223003) 国家科技重大专项(2011ZX05032-004-004HZ)~~
关键词 图像显示适配 显著物体检测 显著性图 显著物体分割 image retargeting salient object detection saliency map salient object segmentation
  • 相关文献

参考文献32

  • 1任桐炜,刘焱,武港山.基于区域关系图的图像显示适配技术[J].软件学报,2010,21(9):2237-2249. 被引量:3
  • 2Avidan S, Shamir A. Seam carving for content-aware image resiz- ing [J]. ACM Transactions on graphics, 2007, 26(3). [DOI: 10.1145/1276377. 1276390 ].
  • 3Bao B K, Liu G, Hong R, et al. General subspace learning with corrupted training data via graph embedding [ J ]. IEEE Transac- tions on Image Processing, 2013, 22( 11 ) : 4380-4393. [ DOI: 10.1109/TIP. 2013. 2273665 ].
  • 4Sang J, Xu C, Liu J. User-aware image tag refinement via ternary semantic analysis [ J]. IEEE Transactions on Multimedia, 2012, 14(3) : 883-895. [ DOI: 10.1109/TMM. 2012. 2188782].
  • 5Xu X, Geng W, Ju R, et al. OBSIR: object-based stereo image retrieval [ C ]//Proceedings of IEEE International Conference on Multimedia and Expo. Chengdu: IEEE, 2014: 1-6. [DOI: 10. 1109/ICME. 2014.6890137 ].
  • 6Bao B K, Liu G, Xu C, et al. Inductive robust principal compo- nent analysis [ J ]. IEEE Transactions on Image Processing, 2012, 21 (8) : 3794-3800. [DOI: 10. ll09/TIP. 2012. 2192742].
  • 7Borji A, Tavakoli H R, Sihite D N, et al. Analysis of scores, datasets, and models in visual saliency prediction [ C ]//Proceed- ings of IEEE International Conference on Computer Vision. Syd- ney: IEEE, 2013: 921-928. [DOI: 10. 1109/ICCV. 2013. 118].
  • 8Borji A, Sihite D N, Itti L. Salient object detection: a bench- mark [ C ]// Proceedings of European Conference on Computer Vision, Florence. Berlin: Springer, 2012 : 414-429. [DOI: 10. 1007/978-3-642-33709-3_30].
  • 9Ren T, Liu Y, Wu G. Rapid image retargeting based on curve- edge grid representation [ C ]//Proceedings of IEEE Internation- al Conference on Image Processing. Hong Kong, China: IEEE, 2010: 869-872. f DOI: 10. ll09/ICIP. 2010. 5654031 ].
  • 10Li S, Ju R, Ren T, et al. Saliency cuts based on adaptive triple thresholding [ C ]// Proceedings of IEEE International Confer- enee on Image Processing. Quebec : IEEE, 2015.

二级参考文献19

  • 1Chen LQ,Xie X,Fan X,Ma WY,Zhang HJ,Zhou HQ.A visual attention model for adapting images on small displays.Multimedia Systems,2003,9(4):353-364.[doi:10.1007/s00530-003-0105-4].
  • 2Wang Y,Li HQ,Liu ZK,Chen CW.Attention information based spatial adaptation framework for browsing videos via mobile devices.Advances in Multimedia Information Processing,2006,4621:788-797.[doi:10.1007/11922162_90].
  • 3Deselaers T,Dreuw P,Ney H.Pan,zoom,scan-time-coherent,trained automatic video cropping.In:Ahuja N,Shapiro L,eds.Proc.of the Int'l Conf.on Computer Vision and Pattern Recognition.Anchorage:IEEE Press,2008.1-8.[doi:10.1109/CVPR.2008.4587729].
  • 4Xie X,Liu H,Ma WY,Zhang HJ.Browsing large pictures under limited display sizes.IEEE Trans.on Multimedia,2006,8(4):707-715.[doi:10.1109/TMM.2006.876294].
  • 5Jiang SQ,Liu HY,Zhao Z,Huang QM,Gao W.Generating video sequence from photo image for mobile screens by content analysis.In:Gao W,ed.Proc.of the Int'l Conf.on Multimedia and Expo.Beijing:IEEE Press,2007.1475-1478.[doi:10.1109/ICME.2007.4284940].
  • 6Setlur V,Lechner T,Nienhaus M,Gooch B.Retargeting images and video for preserving information saliency.IEEE Computer Graphics and Applications,2007,27(5):80-88.[doi:10.1109/MCG.2007.133].
  • 7Rubinstein M,Shamir A,Avidan S.Improved seam carving for video retargeting.ACM Trans.on Graphics,2008,27(3):16.[doi:10.1145/1360612.1360615].
  • 8Huang H,Fu TN,Rosin PL,Qi C.Real-Time content-aware image resizing.Science in China Series F:Information Sciences,2009,52(2):172-182.[doi:10.1007/s11432-009-0041-9].
  • 9Wolf L,Guttmann M,Cohen-Or D.Non-Homogeneous content-driven video-retargeting.In:Davis L,Bouthemy P,Ikeuchi K,eds.Proc.of the Int'l Conf.on Computer Vision.Rio de Janeiro:IEEE Press,2007.1-6.[doi:10.1109/ICCV.2007.4409010].
  • 10Ren TW,Liu Y,Wu GS.Image retargeting based on global energy optimization.In:Lin CY,Cox I,eds.Proc.of the Int'l Conf.on Multimedia and Expo.New York:IEEE Press,2009.406-409.[doi:10.1109/ICME.2009.5202520].

共引文献2

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部