基于镜像神经系统机制的语音动作康复训练系统设计

Design of cerebral palsy rehabilitation training system based on speech recognition technology to control robotic hand movements

本文主要针对不随意运动型脑瘫患儿,通过人机交互(HCI)的模式结合仿生机械手达到脑瘫康复训练的目的。整体设计中采用了单片机Arduino mega 2560为主控制器,显示屏1602作为数据显示,语音模块采用LD3320语音芯片,LabVIEW作为上位机显示患者需要识别的手势动作图片。当运行开始后,脑瘫患儿通过观看上位机界面上随机切换显示的图片,对应说出图片的内容,利用语音芯片进行语音辨识,识别后的数据在显示屏上显示,并利用串口传送的方式传递给上位机相应数据,系统将进行判断是否正确,并且记录脑瘫患儿做出反应的时间和正确率,机器手接收到语音识别后的正确数据,会做出与上位机显示图片一致的动作手势,达到训练脑瘫患者反应能力、说话能力以及认识各类手势动作的学习能力的目的,较好地实现脑瘫患者的康复训练。

This article is mainly aimed at children with involuntary movement cerebral palsy through the pattern of human-computer interaction combined with bionic robot to achieve the purpose of cerebral palsy rehabilitation training. In the overall design, the single-chip Arduino Mega 2560 is used as the main controller, the display 1 602 is used as the data display, the voice module is the LD3320 voice chip, and the LabVIEW is used as the upper computer to display the gesture motion pictures that the patient needs to recognize. When the operation starts, the child with cerebral palsy randomly switches the displayed picture by watching the upper computer interface, correspondingly speaking the content of the picture. The voice chip is used for voice recognition, the identified data is displayed on the display screen, and the serial port transmission method is used to transimit the corresponding data to the host computer, and the system will judge whether it is correct, and record the time and correct rate of the reaction of the child with cerebral palsy. After receiving the correct data after speech recognition, the robot hand will make an action gesture consistent with the picture displayed by the host computer, and achieve the purpose of training the cerebral palsy patient's reaction ability, speaking ability and learning ability of various gestures, and better help cerebral palsy patients to carry out rehabilitation training.