基于移动设备的听障人特定语音识别训练系统

A special speech recognition training system for hearing impaired people based on mobile devices

我国国内听障人士目前达到7 200万,他们普遍存在言语沟通障碍,大多只能依赖特殊教育学校的手语、助听器以及人工耳蜗实现和正常人沟通交流.结合听障者的自身特点设计了特定的语音识别系统,听障者通过点击界面的图标实现发音,用户根据声音信息实现模仿,系统根据检测到的数据进行评测,给出听障者的训练结果,实现了沟通和康复的有机结合.在此系统的基础上,为了提高语音输入的高效性,增加了基于语义的sem算法的文本预测,该算法模型对句子中出现的所有词进行了构建.在特定的语音识别的基础上完成了整体的构架设计,实现了训练模块和语音模块之间的交互.

At present,there are 72 million hearing-impaired people in China,and they generally have speech communication problems.They cannot communicate with normal people in speech communication,and most of them can only rely on special education schools and expensive medical expenses.For hearing-impaired people,auxiliary equipment based on mobile devices is even less.In this paper,a specific speech recognition system was designed in combination with the characteristics of the hearers.The hearers realize the pronunciation by clicking the icon on the interface,the users imitate according to the sound information,and the system evaluates the results according to the detected data,so as to achieve the organic combination of communication and rehabilitation.On the basis of this system,in order to improve the efficiency of speech input,the text prediction of sem algorithm based on semantics was added.Based on the specific speech recognition,the overall architecture design was completed and the interaction between the training module and the speech module was realized.