注意力机制CNN结合肌电特征矩阵的手势识别研究

Investigation of gesture recognition using attention mechanism CNN combined electromyography feature matrix

当前基于卷积神经网络(CNN)的手势识别研究集中于增加网络深度,较少关注改善样本数据分布带来的性能提升。针对此类问题,提出一种量化表面肌电信号(sEMG)特征相关性的肌电特征矩阵(EFM)样本输入有效通道注意力(ECA)机制CNN,用于识别NinaproDB1中52类手势。首先使用时间窗截取低通滤波后的sEMG,计算多种信号时域特征;然后利用笛卡尔积组合并相乘不同特征,对特征相乘值进行归一化后得到EFM。同时,引入ECA机制使网络关注重要的深层特征,从而提升手势分类效果。分别输入sEMG、肌电时域特征和EFM到注意力机制CNN进行手势识别,EFM识别准确率最高,达到了86.39%,高于近年来手势识别研究方法精度。验证了提出方法的有效性,为多类别手势准确分类提供可行新方案。

Current research on gesture recognition based on convolutional neural network(CNN)focuses on increasing the depth of the network,and pays less attention to improve the distribution of sample data which can brought the performance improvement.Aimed at these problems,a kind of electromyography feature matrix(EFM)sample that quantifies the correlation of surface electromyography(sEMG)features is fed into the efficient channel attention(ECA)mechanism CNN,which is used to identify the 52 types gesture in NinaproDB1.Firstly,the time window is used to truncate the low-pass filtered sEMG and calculate various signal time domain features.Then,the cartesian product is used to combine and multiply different features.The EFM is obtained after normalizing the feature multiplication values.At the same time,ECA mechanism is introduced to make the network focus on the important deep features,thereby improving the effect of gesture classification.sEMG,EMG time-domain features and EFM are fed to the attention mechanism CNN respectively for gesture recognition.The recognition accuracy of EFM is the highest and reached 86.39%,which is higher than the accuracy of gesture recognition research methods in recent years.The effectiveness of the proposed method is verified,and a feasible new scheme for accurate multi-category gesture classification is provided.