基于Internet的多通道用户界面

Multimodal User Interface for Internet

该文以作者承担的国家自然科学基金项目“基于互联网多通道用户界面的研究”为背景 ,总结了已完成的部分工作 .文中介绍了作者提出的网络多通道界面模型、语音和指点相结合的基于上下文的查询、基于主通道的整合策略 ,并将受限的自然语言 (汉语 )理解技术应用于多通道交互中 .文章给出了两个实例 :汉语语音驱动的多通道文件管理器和网上购物多通道界面的 Active X控件 .结果表明 。

This paper introduces the new conceptions including Network Multimodal User Interface Model, Context based Retrieving based on the Integration of Speech and Mouse pointing, Integration Strategy based on the Principal Modality, Natural Language Understanding Applying to Multimodal Interaction. Two instances of the project are given: one is a Chinese voice driven multimodal file manager, and the other is a multimodal ActiveX control for Internet shopping. The experiment results demonstrate the above techniques conduce to the improvement of naturalness and efficiency of HCI.