摘要
手语研究是典型的多领域交叉研究课题,涉及计算机视觉、自然语言处理、跨媒体计算、人机交互等多个方向,主要包括离散手语识别、连续手语翻译和手语视频生成。手语识别与翻译旨在将手语视频转换成文本词汇或语句,而手语生成是根据口语或文本语句合成手语视频。换言之,手语识别翻译与手语生成可视为互逆过程。文中综述了手语研究的最新进展,介绍了研究的背景现状和面临的挑战;回顾了手语识别、翻译和生成任务的典型方法和前沿研究;并结合当前方法中存在的问题,对手语研究的未来发展方向进行了展望。
Sign language research is a typical cross-disciplinary research topic,involving computer vision,natural language processing,cross-media computing and human-computer interaction.Sign language research mainly includes isolated sign language recognition,continuous sign language translation and sign language video generation.Sign language recognition and translation aim to convert sign language videos into textual words or sentences,while sign language generation synthesizes sign videos based on spoken or textual sentences.In other words,sign language translation and generation are inverse processes.This paper reviews the latest progress of sign language research,introduces its background and challenges,reviews typical methods and cutting-edge research on sign language recognition,translation and generation tasks.Combining with the problems in the current methods,the future research direction of hand language is prospected.
作者
郭丹
唐申庚
洪日昌
汪萌
GUO Dan;TANG Shen-geng;HONG Ri-chang;WANG Meng(School of Computer Science and Information Engineering,Hefei University of Technology,Hefei 230601,China;Key Laboratory of Knowledge Engineering with Big Data(Hefei University of Technology),Ministry of Education,Hefei 230601,China;Intelligent Interconnected Systems Laboratory of Anhui Province,Hefei 230601,China)
出处
《计算机科学》
CSCD
北大核心
2021年第3期60-70,共11页
Computer Science
基金
国家重点研发计划(2018YFC0830103)
国家自然科学基金(61876058)
中央高校基本科研业务费专项资金(JZ2020HGTB0020)。
关键词
视频理解
机器翻译
离散手语识别
连续手语翻译
手语视频生成
Video understanding
Machine translation
Isolated sign language recognition
Continuous sign language translation
Sign language video generation
