基于Internet的多通道用户界面

Multimodal User Interface Based on the Internet

提出了网络多通道界面模型、语音和指点相结合的基于上下文的查询、基于主通道的整合策略,并将受限的自然语言(汉语)理解技术应用于多通道交互中。文章给出了两个实例:汉语语音驱动的多通道文件管理器和网上购物多通道界面的ActiveX控件。结果表明,以上技术有助于提高人机交互的自然性和效率。

This paper first puts forward some new concepts such as network multimodal user interface model, context-based retrieving based on the integration of speech and mouse-pointing, integration strategy based on the principal modality, and application of natural language understanding in multimodal interaction. Then it illustrates with two examples: a Chinese-voice-driven multimodal file manager and a multimodal ActiveX control for Internet-shopping. The results show that these techniques can help to increase the naturalness and the efficiency of human-computer interaction.