一种图像信息资源的语义多维可视化标注方法

Image Annotation with Multidimensional Semantic Visualization

将图像信息资源的用户感性认知与计算机图像语义处理相结合,是解决图像语义鸿沟问题的重要可行途径。本文提出一种图像语义多维可视化标注方法,将图像的多维语义可视化为直角坐标系中的点,采用非线性规划与多目标规划将用户可视化输入的坐标值转换为图像语义向量,通过双向语义可视化处理支持图像多维语义的人机感性交互标注。实验表明,本文方法标注准确性、对用户完成任务的帮助及用户满意度较高,有利于消减图像语义鸿沟。

Combining user perception and semantic processing on a computer of image resources, is an important and feasible way to narrow the ＂semantic gap＂ in it. This paper presents an image annotation method by multidimensional semantic visualization, which visualizes the multidimensional semantics of an image as a point in a Cartesian coordinate system, converts user＇s input on the Cartesian coordinate system to image semantics based on nonlinear programming and multi-objective programming, and supports perceptual human-computer interacting annotation of image semantics by this bidirectional multidimensional semantic visualization. Experiment results state the high accuracy, helpfulness and user satisfaction in image annota- tion, which proves our method＇s conduciveness to narrow semantic gap in image annotation.