基于视觉词模糊权重的视频语义标注

Video Semantic Annotation Based on Visual Word Fuzzy Weighting

针对视觉词袋模型的量化误差与视觉词含糊性,提出一种基于视觉词模糊权重的视频语义标注方案。该方案在训练样本集的预聚类基础上,逐个聚类训练单类支持向量机OC-SVM。根据样本特征与聚类超球球心的距离函数及聚类超球的空间分布确定视觉词映射及权重,以提高视觉词的表达力、区别力。实验结果表明,基于该方案的视频语义标注精度分别比TF方案和VWA方案提高34%和16%。

This paper proposes a formulation of visual word weighting scheme Fuzzy Weighting Scheme（FWS） aiming at the Bag of Visual Word（BoVW） model vector quantization loss and visual word ambiguity. Based on K-Nearest Neighhors（KNN） pre-clustering results, One-Class Support Vector Machine（OC-SVM） on each clustering samples subset is trained. Visual words corresponding to a single local visual feature vector are determined according to the spatial distribution information of clustering-hyperspheres and fuzzy weights are evaluated according to the distance function between sample feature and center of clustering-hypersphere. FWS is designed to boost the visual word expressiveness and discriminativeness. Experimental results show that the scheme outperforms TF scheme and VWA scheme by 34% and 16% respectively on video semantic annotation precision.