面向飞行交互任务的三种人机交互方式效率比较研究

A comparative study on the efficiency of three human-computer interaction modes for flight interaction tasks

目的针对飞行任务情境下的多通道人机交互系统,比较手动触控、眼动控制和语音控制三种人机交互模式的交互效率。方法以20名飞行员为对象,基于特定飞行任务情境,分别以三种人机交互模式完成一级(相对简单)和二级(相对复杂)交互实验任务。交互效率指标包括系统的交互时间、响应时间、融合计算时间和错误次数。实验完成后飞行员再进行主观评价,评价内容包括交互模式与任务的适配性、与使用预期的一致性、容错性、有效反馈性和对于该交互模式在未来飞行领域的应用倾向性。结果在飞行任务情境下的交互效率,手动触控、语音控制和眼动控制之间普遍存在显著性差异,但在一级和二级交互任务中的差异性各有不同。综合各级交互实验任务,得到的主要实验结果包括:(1)手动触控的交互时间最短,语音控制的交互时间最长,交互模式的主效应显著(F=18.214,P<0.001,η^(2)=0.565);(2)手动触控的响应时间最短,眼动触控的响应时间最长,交互模式的主效应显著(F=153.085,P<0.001,η^(2)=0.944);(3)手动触控的融合计算时间最短,语音控制的融合计算时间最长,交互模式的主效应显著(F=41.702,P<0.001,η^(2)=0.777);(4)语音控制的错误最少,眼动控制的错误最多,交互模式的主效应显著(χ^(2)=22.845,P<0.001,φ=1.097);(5)飞行员对语音控制的主观评价得分均高于眼动控制,且均具有统计学意义(P<0.001,P<0.01)。结论本研究针对飞行交互任务,通过实验和主观评价相结合的方式,对手动触控、语音控制和眼动控制三种交互模式的交互效率进行了比较研究,交互模式对交互效率有明显影响。手动触控在交互时间效率上有明显优势,语音控制在简单任务的准确性中占优,而眼动控制在时间效率和准确性方面均相对较弱;相比眼动控制,飞行员对语音控制表现出更高的评价和倾向性。研究结果可为多通道交互系统的未来设计、评估与应用提供参考。

Objective To compare the interaction efficiency of three human-machine interaction modes with hand-touch control,eye movement control and voice control,based on a multi-channel human-machine interaction system in flight mission scenarios.Methods 20 pilots took part in the study and completed the first level(relatively simple)and second level(relatively complex)interactive experimental tasks in three human-computer interaction modes based on specific flight mission scenarios.The interaction efficiency indicators included the system's interaction time,response time,fusion calculation time,and number of errors.After the experiment was completed,the pilots conducted a subjective evaluation,which included the suitability of the interaction mode to the task,consistency with expected usage,fault-tolerance,effective feedback,and the tendency of the interaction mode to be applied in future flight fields.Results There were generally significant differences in interaction efficiency between hand-touch control,voice control,and eye movement control in flight mission scenarios,but the differences differed in first-level and second-level interaction tasks.Based on the comprehensive interaction experimental tasks at all levels,the experimental results obtained included:(1)the interaction time of hand-touch control was the shortest,the interaction time of voice control was the longest,and the main effect of the interaction mode was significant(F=18.214,P<0.001,η^(2)=0.565);(2)The response time of hand-touch control was the shortest,while the response time of eye movement control was the longest.The main effect of interaction mode was significant(F=153.085,P<0.001,η^(2)=0.944);(3)The fusion calculation time for hand-touch control was the shortest,while the fusion calculation time for voice control was the longest.The main effect of the interaction mode was significant(F=41.702,P<0.001,η^(2)=0.777);(4)The errors in voice control were the least,while those in eye movement control were the most.The main effect of interaction mode was significant(χ^(2)=22.845,P<0.001,φ=1.097);(5)The subjective evaluation scores of pilots on voice control were higher than those on eye movement control,and all had statistical significance(P<0.001,P<0.01).Conclusions This study focuses on flight interaction tasks and compares the interaction efficiency of three interaction modes of hand-touch control,voice control,and eye movement control,through a combination of experiments and subjective evaluations.The differences in various interaction efficiency indicators among different interaction modes are found,and the interaction modes have a significant impact on interaction efficiency.Hand-touch control has a significant advantage in interaction time efficiency,voice control has an advantage in accuracy for simple tasks,while eye movement control has relatively weak time efficiency and accuracy;Compared to eye movement control,pilots exhibit higher evaluations and tendencies towards voice control.The research results can provide reference for the future design,evaluation,and application of multi-modal interaction systems.