基于虚拟人合成技术的中国手语合成方法

A Method to Synthesize Chinese Sign Language Based on Virtual Human Technologies

介绍了一种中国手语合成方法,实现了文本到中国手语的自动翻译,并使用虚拟人合成技术,实现了中国手语的合成与显示,以此帮助聋人与听力正常人之间实现自然交流.在该方法中,首先应用两只数据手套和3个6自由度位置跟踪器,基于运动跟踪的原理,记录真实人体演示每个手语词的运动数据,建立一个初始的手语词运动数据库.然后,应用一种基于控制点的人体运动编辑方法,对每个手语词的运动数据进行编辑与微调,最后得到一个高质量的手语词运动数据库.当给定一个文本句子时,应用人体运动合成方法,对每个手语词的手语运动片段进行拼接合成,最终生成一个完整的手语运动,并基于VRML的人体运动显示方法将合成的运动逼真地显示出来.基于该方法,在PC/Windows/VC6.0环境下实现了一个中国聋人手语合成系统.该系统采集了《中国手语》(含续集)中收录的5 596个手语词,可以合成一般生活与教学用语.经聋校的老师和学生确认,合成手语准确逼真,可以广泛应用于教学、电视、Internet等多种大众媒体,帮助聋人参与其他听力正常人的活动,具有广泛的应用前景和重要的社会意义.

A method to translate Chinese text into Chinese sign language is introduced, and how to present gesture by a 3D virtual human, to help the deaf communicate with the hearing. In this method, an initiate database including all sign words motions is firstly created based on a motion capture method, where two data gloves and three 6-DOF position tractors are used to record the motion of a real person when he or she demonstrates each sign word. Then all motion data can be tuned accurately and easily by modifying the gestures just on some control points. After that, a database that contains motions of all sign words has been built up. Given a sentence of text, the motion of each word can be found in the database, concatenated one by one, and presented smoothly by a virtual presenter who is represented by a VRML virtual human model, then the sentence is translated into Chinese sign language. To help the deaf study, watch TV, and browse Internet, a system that can be used to translate Chinese text into Chinese sign language is developed in the PC/Windows/VC environment, and all most of generating signs by this system are very realistic and smooth as confirmed by a lot of teachers in deaf schools. The database of this system contains motions of all 5 596 Chinese sign words collected by a handbook of Chinese sign language.