文本与朗读语音共同驱动的汉语语音与口型匹配方案

Matching Scheme of Chinese Voice and Mouth Shape Driven by Text and Reading Voice

构建一种文本和朗读语音共同驱动的双模态语音与口型匹配控制模型,将文本与语音相结合,弥补单模式驱动中信息量不足的缺点,利用文本拼音提供正确的口型视位和朗读语音为口型视位提供正确的时序,实现对语音和口型动作过程的合理匹配。

This paper constructs a double modal voice and shape matching control model driven by the text and reading voice. With the combination of the double driven mode, the information insufficiency in single driven mode is counteracted and comple- mented. During the disposal of matching, the accurate mouth viseme is calculated with the spelling of text, and the correct time sequence of mouth viseme is given by read-speech. Therefore, the mouth motion for read-speech can be matched suitably and cor- rectly.