基于标注词语义与图像视觉的标签丰富算法

Tagging Enrichment Algorithm Based on Tag Semantic and Image Visual

针对社会化图像初始标注不完备、不准确的问题,提出了一种基于标注词语义与图像视觉信息的社交图像标签丰富算法.该算法融合词频共现和Word Net语义层级两种方式挖掘标签之间的潜在联系,并由此根据已有的标注信息获取候选标签;再综合图像视觉特征和高层语义主题计算图像内容相似度,确定图像间的近邻关系;最后基于近邻图像和候选标签构造了一种新的软近邻投票规则,以刻画候选标签是否真正能描述图像内容.在数据集MIRFlickr-25k上进行实验,系统地比较了不同语义相似度和图像相似度度量方法对实验结果的影响,通过分析实验数据发现,所提出的方法能够有效实现标签丰富,提升标签质量.

In order to solve the problem that user-provided tags are incomplete and inaccurate, an image tagging enrichment algorithm based on tag semantic and image visual is proposed. In this approach,co-occurrence probability and WordNet are both utilized to ex- plore latent tag correlations, for selecting candidate tags for images. Then visual features and high-level semantic are also both consid- ered when calculating image similarity, to determine the neighborhood relationship between images. Finally based on the neighbor ima- ges and the candidate tags, a new neighbor soft-voting strategy is adopted and the tags with high voting score are reserved. Experiments taken on datase MIRFlickr-25k,systematically analyzing the influence of different semantic similarity and image similarity measure- ments, experimental results demonstrate that the proposed method can solve the problem of incomplete tags effectively.