基于混合现实技术的超声影像传输系统

Ultrasonic image transmission system based on mixed reality technology

目的:开发一种以头戴式眼镜(Helmet-mounted displays,HMD)为显示方式的混合现实超声影像传输系统(Mixed reality ultrasound in helmet-mounted displays,MRUS-HMD)并探讨其可行性。方法:测试产品技术参数,包括图像分辨率、传输帧率和传输延迟,通过系统可用性量表(System usability scale,SUS)评估产品系统可用性。志愿者被分为初学者组和有经验者组,利用猪肉制作穿刺模型进行MRUS-HMD、传统正视超声和传统斜视超声穿刺实验。收集穿刺时间评价脑力负荷,通过口头会话和半结构化访谈分析用户体验。结果:图像分辨率可达到600×800,传输帧率为30 FPS,传输延迟平均(73.69±14.56)ms。SUS评分为72.33分。初学者组使用MRUS-HMD对比两种传统方式,穿刺时间缩短(MRUS-HMD vs正视P=0.022;MRUS-HMD vs斜视P=0.002),初学者和有经验者使用MRUS-HMD对比传统斜视超声下都可减少脑力负荷(初学者P=0.050;有经验者P=0.012)。结论:初步证明了基于混合现实技术的超声影像传输的可行性,可在部分情况下帮助操作者减少穿刺时间和脑力负荷。

Objective:To develop a mixed reality ultrasound in helmet-mounted displays(MRUS-HMD)with helmet-mounted display(HMD),and explore its feasibility.Methods:The technical parameters of the MRUS-HMD system were evaluated,and its usability was assessed including image resolution,transmission frame rate,and transmission delay,and its usability was assessed by the system usability scale(SUS).Participants were divided into novice and experienced groups.A puncture model was made using pork,and three rounds of puncture experiments were performed:MRUS-HMD,conventional orthoptic ultrasound,and conventional oblique ultrasound.Puncture time and mental workload were evaluated.User experience was analyzed through verbal discussions and semi-structured interviews.Results:The image resolution could reach 600×800,the transmission frame rate was 30 FPS,the transmission delay was(73.69±14.56)ms.The use of MRUS-HMD by novices compared with the two traditional approaches showed a statistically significant reduction in puncture time(MRUS-HMD vs orthophoria P=0.022;MRUS-HMD vs strabismus P=0.002).Both novices and experienced operators demonstrated a decrease in mental workload when using MRUS-HMD compared to the standard strabismus(novices P=0.050;experienced operators P=0.012).Conclusion:This study provides preliminary evidence for the feasibility of ultrasound image transmission based on mixed reality technology.It can help reduce puncture time and cognitive load for operators in some cases.