摘要
混合现实技术由于具有良好的沉浸感和交互体验,在高校实践教学领域有着广阔的应用前景。根据人才培养需求,设计并开发了基于混合现实技术的机器人遥操作实验平台。该平台采用Leap Motion检测跟踪操作者手部运动并转换成机器人控制命令,同时由混合现实显示装置获取具有机器人现场场景和虚拟手部动画模型的实时视像反馈,通过机器人书写汉字应用验证了系统的有效性。该平台采用混合现实技术保证了操作的安全性和高效性,增强了人机交互体验,其通用性和综合实践性强,可为机器人工程专业相关实践教学提供创新实验平台。
Due to its good immersion and interactive experience,the mixed reality technology has a broad application prospect in the field of practical teaching in colleges and universities.According to the needs of personnel training,a robot teleoperation experimental platform based on mixed reality technology is designed and developed.The platform uses leap motion to detect and track the hand movement of the operator and convert it into robot control commands.At the same time,real-time video feedback with robot scene and virtual hand animation model is obtained by hybrid reality display device.The effectiveness of the system is verified by the application of robot writing Chinese characters.The platform adopts the mixed reality technology to ensure the safety and efficiency of operation,enhance the human-computer interaction experience,and has strong universality and comprehensive practicality,which can provide an innovative experimental platform for practical teaching of robot engineering.
作者
占宏
梁聪垣
杨辰光
ZHAN Hong;LIANG Congyuan;YANG Chenguang(School of Automation Science and Engineering,South China University of Technology,Guangzhou 510641,China)
出处
《实验技术与管理》
CAS
北大核心
2021年第8期114-117,共4页
Experimental Technology and Management
基金
中央高校基本科研业务费专项资金资助(2019ZD57)
华南理工大学2021年校级教研教改项目(C9213106)
华南理工大学第七批探索性实验项目(C9202240)
华南理工大学2021年学生研究计划(SRP)项目(X202110561738)。
关键词
机器人
混合现实
遥操作
人机交互
robots
mixed reality
teleoperation
human-computer interaction
