摘要
手语识别(SLR)技术是打破听障人群与健听人群间交流壁垒的重要技术手段。该文综述了近几年的手语数据集、评价指标以及手语识别方法。首先,系统梳理了手语数据集并分析了手语识别方法的数据集发展方向。其次,详细介绍了手语识别方法的评价指标。然后,根据手语表达内容、手语识别方法所采用的特征分类总结分析了孤立词手语识别方法与连续语句识别方法、仅依靠手部特征的手语识别方法与多特征融合的手语识别方法。最后探讨了手语识别技术面临的挑战及其发展方向。
Sign Language Recognition(SLR)technology is an important technical means to break the communication barrier between hearing-impaired people and healthy people.The sign language datasets,evaluation indicators and sign language recognition methods in recent years are summarized.Firstly,the sign language dataset is systematically summarized and the development trend of the dataset of sign language recognition methods is analyzed.Secondly,the evaluation indicator of sign language recognition method is introduced in detail.Then,according to the content of sign language expression and the features used in sign language recognition methods,isolated word sign language recognition methods and continuous sign language recognition methods,sign language recognition methods relying only on hand features and sign language recognition methods of multi feature fusion are summarized and analyzed.Finally,the challenges and development direction of sign language recognition technology are discussed.
作者
陶唐飞
刘天宇
TAO Tangfei;LIU Tianyu(Key Laboratory of Education Ministry for Modern Design&Rotor-Bearing System,Xi’an 710049,China;School of Mechanical Engineering,Xi’an Jiaotong University,Xi’an 710049,China)
出处
《电子与信息学报》
EI
CSCD
北大核心
2023年第10期3439-3457,共19页
Journal of Electronics & Information Technology
基金
陕西省重点研发计划(2020KWZ-003)。
关键词
手语识别技术
手语数据集
孤立词手语识别
连续手语识别
多特征融合手语识别
Sign language Recognition Technique(SLR)
Sign language dataset
Isolated sign language recognition
Continuous sign language recognition
Multi feature fusion sign language recognition