摘要
文章介绍了基于Leap Motion手语语音转换的原理以及在实际中如何实现应用,其能够将手语手势翻译成所需语言,并且以语音的形式传递消息,实现为聋哑人"发声"的目的。Leap Motion手语语音转换的硬件部分采用Leap Motion体感控制器,能够实时采集人手指的坐标、加速度、方向等动态手势的运动信息。软件采用Unity 3D三维引擎,提供了开发手势识别的SDK,并给出了一些基本手的模型,在Unity 3D中完成由手势到文字,再到语音的转换。
This paper introduces the principle of sign-language conversion based on Leap Motion and how to implement it in practice. It can translate gestures into the required language and transmit messages in the form of speech, so as to achieve the purpose of "voice" for deaf-mute people. The hardware part of sign-language speech conversion based on Leap Motion uses motion-sensing controller called Leap Motion, which can collect the motion information of the finger’s coordinate, acceleration, direction and other dynamic gestures in real time. The software uses Unity 3D engine, provides an SDK for developing gesture recognition, as well as some basic hand models for converting gestures to text and then to speech in Unity 3D.
作者
姜檬
郭仁春
李俊龙
王志淳
Jiang Meng;Guo Renchun;Li Junlong;Wang Zhichun(Shenyang University of Chemical Technology,Shenyang 110142,China)
出处
《无线互联科技》
2020年第7期67-70,共4页
Wireless Internet Technology
基金
2019年辽宁省大学生创新创业训练计划资助项目,项目编号:201910149053。
