期刊文献+

人机协作中人的动作终点预测 被引量:3

Human motion end point prediction in human-robot collaboration
下载PDF
导出
摘要 为实现安全高效的人机协作(HRC),需要机器人及时对人的动作做出预测,从而积极主动地辅助人工作。为解决在HRC装配场景中机器人对人的动作终点预测问题,提出了一种基于长短时记忆(LSTM)网络的动作终点预测方法。在训练阶段,用人的动作序列与对应的动作终点组成的样本训练LSTM网络,构建动作序列与动作终点之间的映射。在应用阶段,根据人的动作的初始部分对动作终点提前做出预测。通过在装配场景中,对人抓取工具或零件的动作终点进行预测,验证了所提方法的有效性。在观测到50%的动作片段时,预测准确率达到80%以上。 To realize a safe and effective human-robot collaboration( HRC),it is necessary for the robot to predict human motions in a timely manner,so as to assist human more actively in the cooperative work. In order to solve the problem of human motion prediction in HRC assembly scenario,a motion end point prediction method based on long short-term memory( LSTM) network is proposed. In the training phase,the LSTM network is trained with samples of human motion sequences and corresponding motion end points,and the mapping between motion sequences and motion end points is constructed. In the application phase,the motion end point is predicted in advance based on the initial part of the human motion sequence. The effectiveness of the proposed method is verified by predicting the end points of motion of a human grasping tool or part in an assembly scenario. When 50% of the motion fragments are observed,the accuracy rate of prediction is above80%.
作者 陈友东 刘嘉蕾 胡澜晓 CHEN Youdong;LIU Jialei;HU Lanxiao(School of Mechanical Engineering and Automation,Beihang University,Beijing 100083,China)
出处 《北京航空航天大学学报》 EI CAS CSCD 北大核心 2019年第1期35-43,共9页 Journal of Beijing University of Aeronautics and Astronautics
基金 国家科技支撑计划(2015BAF01B04) 北京市科技计划(D161100003116002)~~
关键词 人机协作(HRC) 终点预测 伸及动作 长短时记忆(LSTM) 意图识别 human-robot collaboration(HRC) end point prediction reaching motion long short-term memory(LSTM) intention recognition
  • 相关文献

参考文献5

二级参考文献184

  • 1Mokhber A,Achard C,Milgram M. Recognition of Human Behavior by Space-Time Silhouette Characterization[J].Pattern Recognition Let-ters,2008,(01):81-89.
  • 2Polat E,Yeasin M,Sharma R. Robust Tracking of Human Body Parts for Collaborative Human Computer Interaction[J].{H}COMPUTER VISION AND IMAGE UNDERSTANDING,2003,(01):44-69.
  • 3Kjellstr?m H,Romero J,Kragic' D. Visual Object-Action Recogni-tion:Inferring Object Affordances from Human Demonstration[J].{H}COMPUTER VISION AND IMAGE UNDERSTANDING,2011,(01):81-90.
  • 4Suma E A,Krum D M,Lange B. Adapting User Interfaces for Gestural Interaction with the Flexible Action and Articulated Skele-ton Toolkit[J].Computers& Graphics,2012,(03):193-201.
  • 5Ayers D,Shah M. Monitoring Human Behavior from Video Taken in an Office Environment[J].{H}IMAGE AND VISION COMPUTING,2001,(12):833-846.
  • 6López M T,Fernández-Caballero A,Fernández M A. Visual Surveillance by Dynamic Visual Attention Method[J].Pattern Recogni-tion,2006,(11):2194-2211.
  • 7Aggarwal J K,Park S. Human Motion:Modeling and Recognition of Actions and Interactions[A].Thessaloniki,Greece,2004.640-647.
  • 8Moeslund T B,Hilton A,Krüger V. A Survey of Advances in Vision-Based Human Motion Capture and Analysis[J].{H}COMPUTER VISION AND IMAGE UNDERSTANDING,2006,(2/3):90-126.
  • 9Poppe R. A Survey on Vision-Based Human Action Recognition[J].{H}IMAGE AND VISION COMPUTING,2010,(06):976-990.
  • 10Weinland D,Ronfard R,Boyer E. A Survey of Vision-Based Meth-ods for Action Representation,Segmentation and Recognition[J].Com-puter Vision and Image Understanding,2011,(02):224-241.

共引文献282

同被引文献40

引证文献3

二级引证文献21

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部