基于色彩描述的图像情感语义查询

Emotion-Based Image Semantic Query Through Color Description

针对图像视觉特征、中间层语义和高层情感语义之间的语义鸿沟,以色彩为代表,提出了图像情感语义查询的框架.在该框架下,利用图像色彩分割结果,通过定义描述色彩语义的自然语言词汇,设计了基于模糊隶属函数的图像色彩语义描述方法,并在此基础上定义了一种查询语言,将人类对图像内容理解的经验与图像色彩语义描述联系起来,实现了图像高层情感语义的查询.实验结果表明,该方法为图像语义研究提供了一种可行的、有效的、可扩展的解决方案.

In this paper, an emotion-based image semantic query scheme through color description is proposed, which bridges the semantic gaps among the low-level image features, the middle-level semantic indicators and the high-level emotional semantics. In the proposed scheme, images are first segmented into regions through color clustering. Next, some natural language vocabularies are defined to describe the color semantics. Then, the semantic terms for color description are proposed based on several fuzzy membership functions. Finally, by combining the experience of human being about image content and the color description, a high-level emotion-based image semantic query is accomplished by defining a query language. Experimental results show that the proposed scheme is feasible, effective and extensive for the semantic investigation of images.