期刊文献+

基于运动轨迹分析的3D唇舌肌肉控制模型 被引量:6

Mouth and tongue model controlled by muscles based on motion trail analyzing
下载PDF
导出
摘要 针对可视化语音以及虚拟说话人系统中对唇部和舌部动画的高逼真度要求,提出了一种基于运动轨迹分析的3D唇舌肌肉控制模型。该方法首先根据解剖学原理,建立基于网格和纹理的唇部、舌部模型。然后,根据分析唇部的运动轨迹,将口轮匝肌分解成两部分来联合控制唇部的运动,可以获得各种口型。在舌部的运动模拟中,将它的运动轨迹分解成一些机械运动的组合,通过使用四种肌肉模型来控制这些运动。最终实现了人脸嘴部说话时的各种口型,实现了卷舌、舔嘴等动作。实验结果表明,该方法能逼真地实现出唇部、舌部的运动动画。 The animation of lip-synching in visual voice technology or talking head system is a very important part.This paper presented a new method about controlling the movement of the mouth and tongue’s 3-D(three-dimensional) model.Firstly,it built a tongue model according to the anatomy,and a mouth model based on meshes and texture model.Then,through analyzing the lip’s motion,it used the method of dividing the orbicularis oris into two parts to imitate the lip’s motion trail.In the part of tongue’s motion simulation,according to its trail,divided it into some kinds of mechanical motions’ combination and used four kinds of muscles to control these motions.Finally,it realized mouth’s shape when people talking,and tongue’s movements like rotating up,moving side-to-side and so on.The experiments show that the method can vividly simulate the mouth and the tongue’s motion.
出处 《计算机应用研究》 CSCD 北大核心 2013年第7期2236-2240,共5页 Application Research of Computers
基金 国家自然科学基金资助项目(60902023 61171096) 高等学校博士学科点专项科研基金资助项目(20090184120022 20090184120020) 四川省动漫研究中心2012年度科研项目(DM201204)
关键词 唇部建模 舌部建模 肌肉控制模型 运动轨迹分析 唇舌运动仿真 tongue modeling mouth modeling muscle controlled model motion trail analyzing mouth and tongue motion simulating
  • 相关文献

参考文献13

  • 1TANG Hao,FU Yun,TU Ji-lin. Humanoid audio-visual avatar with emotive text-to-speech synthesis[J].IEEE Transactions on Multimedia,2008,(06):969-981.
  • 2TANG Hao,FU Yun,TU Ji-lin. EAVA:a 3 D emotive audio-visual avatar[A].Washington,DC:IEEE Computer Society,2008.1-6.
  • 3TANG Hao,HU Yu-xiao,FU Yun. Real-time conversion from a single 2D face image to a 3D text-driven emotive audio-visual avatar[A].Piscataway,NJ:IEEE Press,2008.1205-1208.
  • 4FU Yun,LI Ren-xiang,HUANG T S. Real-time multimodal human-avatar interaction[J].IEEE Transactions on Circuits and Systems for Video Technology,2008,(04):467-477.doi:10.1109/TCSVT.2008.918441.
  • 5HOU Jin,WANG Xia,XU Fang. Humanoid personalized avatar through multiple natural language processing[J].World Academy of Science Engineering and Technology,2009.230-235.
  • 6WU Ling,HOU Jin,WANG Xia. Costume design and animation synthesis for personalized avatars[A].Piscataway,NJ:IEEE Press,2010.35-39.
  • 7SCHREER O,ENGLERT R,EISERT P. Real-time vision and speech driven avatars for multimedia applications[J].IEEE Transactions on Multimedia,2008,(03):352-360.doi:10.1109/TMM.2008.917336.
  • 8LIU K,OSTERMANN J. Realistic facial expression synthesis for an image-based talking head[A].Piscataway,NJ:IEEE Press,2011.1-6.
  • 9MENG Qing-mei,WU Wei-guo,ZHONG Su-sheng. Research and experiment of lip coordination with speech for the humanoid head robot-" H&Frobot Ⅲ"[A].Piscataway,NJ:IEEE Press,2008.603-608.
  • 10ZENG Dan,PEI Li. Rheology-based facial animation realistic face model[J].Journal of Shanghai University(English Edition),2009,(06):423-427.doi:10.1007/s11741-009-0601-1.

同被引文献85

  • 1赵梦雄,樊小农,王舒.针刺治疗脑卒中后吞咽障碍临床研究进展[J].实用中医药杂志,2020(5):687-689. 被引量:7
  • 2叶改花,王润春,程文静.加强急诊重症脑卒中患者急救护理环节管理的体会[J].实用心脑肺血管病杂志,2020,28(S01):210-211. 被引量:1
  • 3汪洁.吞咽的生理机制与卒中后吞咽障碍[J].中国卒中杂志,2007,2(3):220-225. 被引量:64
  • 4陈志翔,信琴琴,朱月秀,林姿琼,王琳.虚拟人舌运动可视化在发声中的研究[J].中国康复理论与实践,2013,19(10):993-997. 被引量:3
  • 5BREGLER C,COVELL M, SLANEY M. Video rewrite:driving visual speech with audio[ C ]//Proc of the 24th Annual Conference on Com- puter Graphics and Interactive Techniques. New York: ACM Press, 1997:353-360.
  • 6BRAND M. Voice puppetry[ C]//Proc of the 26th Annual Conference on Computer Graphics and Interactive Techniques. New York: ACM Press, 1999:21-28.
  • 7LIU Jia, YOU Ming-yu, CHEN Chun, et al. Real-time speech-driven animation of expressive talking faces [ J ]. International Journal of General Systems, 2011,40(4): 439-455.
  • 8MORO A, MUMOLO E, NOLICH M. Automatic 3D virtual cloning of a speaking human face[ C ]//Proc of ACM Workshop on Surreal Media and Virtual Cloning. 2010:45-50.
  • 9BAGAI A, GANDHI H, GOYAL R, et al. Lip-reading using neural networks[ J ]. Intemational Journal of Computer Science and Network Security, 2009,9 ( 4 ) : 108-111.
  • 10TERRY L,LIVESCU K,PIERREHUMBERT J B,et al. Audio-visual anticipatory coarticulation modeling by human and machine [ C ]// Proc of the 1 lth Annual Conference on International Speech Conmm- nication Association,2010 : 2682-2685.

引证文献6

二级引证文献18

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部