人机共融的远程态势智能感知系统

Remote situational intelligent sensing system for human-machine integration

针对人与远程无人设备协同精准配合的迫切需求,以机器人操作系统为基础构建了一种人机共融的远程态势感知系统,并开展了实验与分析。该系统以视觉定位技术为基础,以人机感知共融为切入点,通过实时三维场景重建技术与场景一致性融合方法,将无人设备探测到的环境及目标信息进行三维重构,并通过增强现实设备进行显示,与人的视觉信息进行一致性融合,实现无GPS条件下远程无人设备与人所佩戴的增强现实设备之间的协同定位。实验结果表明,系统在近距离时具有较好的人机协同定位准确度,定位精度随着距离的增加而逐渐降低。所构建的系统使无人设备成为人眼的延伸,在不干扰人员正常行动的情况下实现了穿障碍、跨视距的感知能力,在未来信息化作战中可发挥重要作用。

Aiming at the urgent need for human and remote unmanned devices to cooperate precisely and accurately,a remote situational awareness system of human-machine integration was proposed based on the robot operating system,and experiments and analysis were carried out.Based on visual positioning technology,with the integration of human-machine perception as the breakthrough point,through real-time 3D scene reconstruction technology and scene consistency fusion method,the environment and target information detected by unmanned equipment were 3D reconstructed.The result was consistent and fused with the human visual information,and displayed by the augmented reality device,realizing the coordinated positioning between the remote unmanned device and the augmented reality device worn by the person without GPS.The experimental results show that the system has better performance at close range.The accuracy of human-machine coordinated positioning is gradually reduced as the distance increases.The proposed system makes the unmanned device an extension of the human eye,realizing the ability to penetrate obstacles,and crosses the sight distance without interfering with the normal movement of personnel.It can play an important role in future information operations.