基于任务的多通道整合设计与实例

TASK-BASED MULTIMODAL INTEGRATION DESIGN AND INSTANCE

多通道人机交互技术的研究旨在为计算机用户提供一个方便高效的人机交互环境．本文主要围绕多通道交互系统的核心─—多通道整合问题，提出了基于任务的多通道整合框架，通过中国象棋的多通道交互实例阐述了基于任务的多通道整合思想在多通道交互系统设计中的具体应用．通过分析多通道信息输入流的特点提出了描述多通道输入特征的格模型，并对整合实践中所遇到的一些问题作了讨论．

The research of multimodal human computer interaction technology aims at providing aconvenient and efficient interaction environment for computer users- This paper mainly focuses onthe central problem of a multimodal interactive system-the problem of multimodal integration. Itpresents a task-based multimodal integration framework, and illustrated its application in systemdesign through the analysis of the Chinese Chess multimodal interactive system- This paper analysesthe features of the multimodal input streams and puts forward the lattice model to describe thesefeatures. In addition to that,it also discusses some other problems in the practice of multimodal integration design.