多模可信交互:从多模态信息融合到人-机器人-数字人三位一体式交互模型

Multimodal trustworthy interaction:from multimodal information fusion to a trinitarian human-robot-digital human interaction model

信任在人-机器人-数字人协作中扮演着关键角色,因为它不仅影响了人-机器人-数字人的效率,同时也存在风险和益处.然而,当前的人-机器人-数字人信任研究存在"失衡"现象,即大部分研究集中于"以人为中心"的信任关系而忽略了智能体(机器人和数字人)对人的信任.为了填补人-机器人-数字人信任研究领域的这一空白,在使用多模态信号来建立人-机器人-数字人交互中的适度单向信任基础上,构建跨虚实世界的"三位一体"经历交融共享生态.本文旨在探讨多模态线索和增强现实在建立人-机器人-数字人之间可信关系方面的现有研究、可行性和未来发展方向.最后,本文展望了该模式在社会组织形态及社会事件态势感知和管控中的应用前景,并指出了未来需要解决的问题.本文的研究有助于理解多模态线索和增强现实在人-机器人-数字人交互中的作用,并为"三位一体"趋势的实现提供思路和解决方案.

Trust plays a key role in the intelligent collaboration among humans,robots,and digital humans,as it affects not only the efficiency of their interaction,but also the risks and benefits involved.However,the current research on human-agent trust suffers from an“imbalance”phenomenon;that is,most studies focus on the“human-centered”trust relationship and ignore the trust of intelligent agents(robots and digital humans)towards humans.To fill this gap in the research field of human-robot-digital human trust,we construct a“trinitarian”experience blending and sharing ecology across the virtual and real worlds,based on the use of multimodal signals to establish moderate unidirectional trust in human-robot-digital human interaction.This paper aims to explore the existing research,feasibility,and future development directions of multimodal cues and augmented reality in establishing trustworthy relationships among humans,robots,and digital humans.Finally,this paper envisions the application prospects of this model in social organization and social event situation perception and control,and points out the problems that need to be solved in the future.This paper contributes to the understanding of the role of multimodal cues and augmented reality in human-robot-digital human interaction,and provides ideas and solutions for the realization of the“trinitarian”trend.