期刊文献+
任意字段
题名或关键词
题名
关键词
文摘
作者
第一作者
机构
刊名
分类号
参考文献
作者简介
基金资助
栏目信息

极低码率下的2D-3D人脸视频编解码 被引量：4

2D-3D Facial Video Coding/Decoding at Ultra-low Bit-rate
下载PDF
导出
摘要 针对动态变化背景下的人脸视频编解码问题,该文提出了一种2D-3D混合编解码系统;具体包括:(1)基于多种观测信息,在线外观模型和粒子滤波的人脸三维运动跟踪;(2)结合参数模型与肌肉模型的3D人脸动画合成;(3)基于头发检测和3D头发模型的头发合成;(4)无缝地拼接前景的三维编解码结果和背景的二维编解码结果.在极低码率下,客观实验表明,该系统在编码效率和解码质量上有较好的综合优势.主观实验表明,该系统的解码结果在脸部具有较高的辨识度. For facial video coding/decoding with dynamic background,a 2D/3D mixed system was proposed,it includes：（1）multi-measurements and online appearance models were applied to track 3D facial motion from video in framework of particle filter;（2）3D facial animation was produced combining parameterized model and muscular model;（3）3D hair was synthesized based on hair detection and 3D hair model;（4）3D coding/decoding result of foreground and 2D coding/decoding result of background were stitched seamlessly.At ultra-low bit-rate,the object experiment confirmed the comprehensive advantage between coding efficiency and decoding quality of this system,the between subjects experiment indicated the suitability of subjective face identification by it.
作者 於俊 汪增福
机构地区 中国科学技术大学自动化系
出处 《电子学报》 EI CAS CSCD 北大核心 2013年第1期185-192,共8页 Acta Electronica Sinica
基金 国家自然科学基金(No.60875026 No.60805019) 安徽省科技攻关计划语音专项(No.11010202192) 中国博士后科学基金(No.2012M521248)
关键词 视频编解码 人脸运动跟踪 人脸动画 头发分析与建模 video coding/decoding facial motion tracking facial animation hair analysis and modeling
分类号 TB391.9 [一般工业技术—材料科学与工程]
  • 相关文献

参考文献39

  • 1Liu YC. A virtual teleconferencing system based on face detection and 3D animation in a low bandwidth environment[J].JIST,2010,(04):323-332.
  • 2Forchheimer R. Image coding:from waveforms to animation[J].TASSP,1989,(12):2008-2023.
  • 3B Moghaddam. An automatic system for model based coding of faces[A].UT,Snowbird:IEEE Explore,1995.568-573.
  • 4Chai J X,Xiao J,Hodgins J. Vision-based control of 3D facial animation[A].Switzerland,Aire-la-Ville:ACM DL,2003.193-206.
  • 5Aizawa K,Harashima H,Saito T. Model-based analysis synthesis image coding(MBASIC) system for a person' s face[J].Image Communication Journal,1989,(02):139-152.
  • 6S.Gokturk. A data-driven model for monocular face tracking[A].Vancouver,BC:IEEE Xplore,2001.701-708.
  • 7Wei Zhang. Real Tune feature based 3-D deformable face tracking[A].Berlin,Heidelberg:Springer-Verlag,2008.720-732.
  • 8Q Wang. Real-time bayesian 3-D pose tracking[J].TCSVT,2006,(12):1533-1541.doi:10.1109/TCSVT.2006.885727.
  • 9L Vacchetti. Stable real-time 3D tracking using online and offline information[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2004,(10):1385-1391.
  • 10Wei-Kai Liao. Integrating multiple visual cues for robust 3d face tracking[A].Berlin,Heidelberg:Springer-Verlag,2007.109-123.

二级参考文献34

  • 1吴暾华,周昌乐.快速人脸检测系统的设计与实现[J].计算机应用,2005,25(10):2351-2353. 被引量：9
  • 2李冯,姚莉秀,杨杰,戈新良.复杂背景下的彩色图像人脸检测[J].上海交通大学学报,2006,40(5):778-782. 被引量：7
  • 3Y Yan,Challapali K.A system for the automatic extraction of 3-D facial feature points for face model calibration[A].International Conference on Image Processing[C].Vancouver,BC,Canada:ICIP,2000,2.223-226.
  • 4Pighin F,Hecker J,Lischinski D,et al.Synthesizing realistic facial expressions from photographs[A].Proceeding SIGGRAPH[C].Orlando,FL,USA:SIGGRAPH,1998.75-84.
  • 5Zhang C,Cohen S.3-D face structure extraction and recognition from images using 3-D morphing and distance mapping[J].IEEE Trans on PAMI.2002,11(11):1249-1258.
  • 6Park I K,Zhang H,Vezhnevets V,et al.Image-based photorealistic 3-D face modeling[A].Proceeding of the Sixth International Conference on Automatic Face and Gesture Recognition[C].Seoul,Korea,2004.49-54.
  • 7Zhang L.Estimation of the mouth features using deformable templates[A].International Conference on Image Processing[C].Washington,DC:ICIP,1997.328-331.
  • 8Szeliski R,Lavallee,S.Matching 3-D anatomical surfaces with non-rigid deformation deformations using octree-splines[J].International Journal of Computer Vision.1996,18 (2):171 -186.
  • 9Pighin F,Hecker J,Lischinski D,et al.Synthesizing realistic facial expressions from photographs[OL].http://www.cs.washington.edu/research/graphics/projects/realface/,2004-10-16.
  • 10Kybic J.Elastic image registration using parametric deformation models[D].Swiss Federal Institute of Technology Lausanne,EPFL Thesis no.2439,2001.

共引文献22

同被引文献21

  • 1曾丹,程义民,葛仕明,李杰.人眼3D肌肉控制模型[J].计算机辅助设计与图形学学报,2006,18(11):1710-1716. 被引量：10
  • 2Zeng M, Liang L, Liu X G, et al. Video-driven state-aware fa?cial animation[J]. Computer Animation and Virtual Worlds, 2012,23(3/4): 167-178.
  • 3Guenter B, Grimm C, Wood D, et al. Making faces[C] II Pro?ceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques. New York: ACM Press, 1998: 55-66.
  • 4Zhang L, Snavely N, Curless B, et al. Space-time faces: high resolution capture for modeling and animation[J]. ACM Transactions on Graphics, 2004, 23(3): 548-558.
  • 5Bradley D, Heidrich W, Popa T, et al. High resolution passive facial performance capture[J]. ACM Transactions on Graphics, 2010,29(4): Article No.41.
  • 6Weise T, Bouaziz S, Li H, et al. Realtime performance-based facial animation[J]. ACM Transactions on Graphics, 2011, 30(4): Article No.77.
  • 7Cao C, Weng Y L, Lin S, et al. 3D shape regression for real-time facial animation[J]. ACM Transactions on Graphics, 2013,32(4): Article No.41.
  • 8Saragih J M, Lucey S, Cohn J F. Deformable model fitting by regularized landmark mean-shift[J]. International Journal of Computer Vision, 2011, 91(2): 200-215.
  • 9Chai J X, Xiao J, Hodgins J F. Vision-based control of 3D fa?cial animation[C] II Proceedings of the ACM SIGGRAPHI Eurographics Symposium on Computer Animation. Aire-Ia?Ville: Eurographics Association Press, 2003: 193-206.
  • 10Milborrow S, Nicolls F. Locating facial features with an ex?tended active shape model[M] II Lecture Notes in Computer Science. Heidelberg: Springer, 2008, 5305: 504-513.

引证文献4

二级引证文献16

电子学报
2013年 第1期

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部