开拓面向图象语义的人机对话

EXPLORING HUMAN COMPUTER DIALOGUES ORIENTED TO PICTURE SEMANTICS

建立面对图的对话者形式的人机通信的关键在于怎样使双方的对话行为符合人对图的语义理解和语义运用．文中提出的图的层次语义模型和所采用的关于图的语义的指点引用方式的分类，为此提供了一个基本的概念框架．在此基础上形成的系统建造指导原则认为，应根据任务的需要对图的语义模型中的语义层次和侧重作出取舍，并尽量限于浅层语义，用户的指点引用类型将随之确定．最后，介绍一个按照这一原则设计实现的人机对话系统原型，它实现了针对位图图象的视觉表现语义并采用指点引用的简单查询对话．

The use of pictures in current user interfaces does not provide effective support for human computer dialogues,thereby restricting the communication capability in many cases.The layered model of picture semantics presented in the paper and the classification for the pointing actions adopted here provide a conceptual framework for approaching the problem.The system construction guidelines developed on this basis suggest that choices should be made for the layers and range in the picture semantics model according to the need of user's task and be limited to layers as shallow as possible.A prototype human computer dialogue system constructed in the light of the guidelines is then described,which supports simple inquiry dialogues by using deictic and iconic pointing gestures and the visually presented semantics of a bitmap picture.