Integrating Color and Spatial Feature for Content-Based Image Retrieval

In this paper, we present a novel and efficient scheme for extracting, indexing and retrieving color images. Our motivation was to reduce the space overhead of partition-based approaches taking advantage of the fact that only a relatively low number of distinct values of a particular visual feature is present in most images. To extract color feature and build indices into our image database we take into consideration factors such as human color perception and perceptual range, and the image is partitioned into a set of regions by using a simple classifying scheme. The compact color feature vector and the spatial color histogram, which are extracted from the seqmented image region, are used for representing the color and spatial information in the image. We have also developed the region-based distance measures to compare the similarity of two images. Extensive tests on a large image collection were conducted to demonstrate the effectiveness of the proposed approach.

Similarity Measures of Satellite Images Using an Adaptive Feature Contrast Model

Similarity measurement is one of key operations to retrieve “desired” images from an image database. As a famous psychological similarity measure approach, the Feature Contrast (FC) model is defined as a linear combination of both common and distinct features. In this paper, an adaptive feature contrast (AdaFC) model is proposed to measure similarity between satellite images for image retrieval. In the AdaFC, an adaptive function is used to model a variable role of distinct features in the similarity measurement. Specifically, given some distinct features in a satellite image, e.g., a COAST image, they might play a significant role when the image is compared with an image including different semantics, e.g., a SEA image, and might be trivial when it is compared with a third image including same semantics, e.g., another COAST image. Experimental results on satellite images show that the proposed model can consistently improve similarity retrieval effectiveness of satellite images including multiple geo-objects, for example COAST images.

A Content-Based Medical Image Retrieval Method Using Relative Difference-Based Similarity Measure

Content-based medical image retrieval(CBMIR)is a technique for retrieving medical images based on automatically derived image features.There are many applications of CBMIR,such as teaching,research,diagnosis and electronic patient records.Several methods are applied to enhance the retrieval performance of CBMIR systems.Developing new and effective similarity measure and features fusion methods are two of the most powerful and effective strategies for improving these systems.This study proposes the relative difference-based similarity measure(RDBSM)for CBMIR.The new measure was first used in the similarity calculation stage for the CBMIR using an unweighted fusion method of traditional color and texture features.Furthermore,the study also proposes a weighted fusion method for medical image features extracted using pre-trained convolutional neural networks(CNNs)models.Our proposed RDBSM has outperformed the standard well-known similarity and distance measures using two popular medical image datasets,Kvasir and PH2,in terms of recall and precision retrieval measures.The effectiveness and quality of our proposed similarity measure are also proved using a significant test and statistical confidence bound.

Content-based Image Retrieval Using Color Histogram

This paper introduces the principles of using color histogram to match images in CBIR. And a prototype CBIR system is designed with color matching function. A new method using 2-dimensional color histogram based on hue and saturation to extract and represent color information of an image is presented. We also improve the Euclidean-distance algorithm by adding Center of Color to it. The experiment shows modifications made to Euclidean-distance signif-icantly elevate the quality and efficiency of retrieval.

Multi-core based parallel computing technique for content-based image retrieval

In this paper, we propose a parallel computing technique for content-based image retrieval （CBIR） system. This technique is mainly used for single node with multi-core processor, which is different from those based on cluster or network computing architecture. Due to its specific applications （such as medical image processing） and the harsh terms of hardware resource requirement, the CBIR system has been prevented from being widely used. With the increasing volume of the image database, the widespread use of multi-core processors, and the requirement of the retrieval accuracy and speed, we need to achieve a retrieval strategy which is based on multi-core processor to make the retrieval faster and more convenient than before. Experimental results demonstrate that this parallel architecture can significantly improve the performance of retrieval system. In addition, we also propose an efficient parallel technique with the combinations of the cluster and the multi-core techniques, which is supposed to gear to the new trend of the cloud computing.

Historical Arabic Images Classification and Retrieval Using Siamese Deep Learning Model

Classifying the visual features in images to retrieve a specific image is a significant problem within the computer vision field especially when dealing with historical faded colored images.Thus,there were lots of efforts trying to automate the classification operation and retrieve similar images accurately.To reach this goal,we developed a VGG19 deep convolutional neural network to extract the visual features from the images automatically.Then,the distances among the extracted features vectors are measured and a similarity score is generated using a Siamese deep neural network.The Siamese model built and trained at first from scratch but,it didn’t generated high evaluation metrices.Thus,we re-built it from VGG19 pre-trained deep learning model to generate higher evaluation metrices.Afterward,three different distance metrics combined with the Sigmoid activation function are experimented looking for the most accurate method formeasuring the similarities among the retrieved images.Reaching that the highest evaluation parameters generated using the Cosine distance metric.Moreover,the Graphics Processing Unit(GPU)utilized to run the code instead of running it on the Central Processing Unit(CPU).This step optimized the execution further since it expedited both the training and the retrieval time efficiently.After extensive experimentation,we reached satisfactory solution recording 0.98 and 0.99 F-score for the classification and for the retrieval,respectively.

采用特征图增强原型的小样本图像分类方法

在基于度量学习的小样本图像分类方法中,由于标注样本的稀缺,仅用支持集样本得到的类原型往往难以代表整个类别的真实分布;同时,同类样本间也可能在多个方面存在较大差异,较大的类内差异可能使样本特征偏离类别中心。针对上述可能严重影响图像分类性能的问题,提出一种采用特征图增强原型的小样本图像分类方法(FMEP)。首先,用余弦相似度从查询集样本特征图中选择部分相似特征加入类原型中,得到更具代表性的特征图增强原型;其次,对相似的查询集样本特征进行聚合,缓解类内差异大导致的问题,使同类样本的特征分布更接近;最后,用在特征空间中与真实类别分布都更接近的特征图增强原型和聚合查询特征进行相似度比较得到更优的分类结果。所提方法在MiniImageNet、TieredImageNet、CUB-200和CIFAR-FS等常用的小样本图像分类数据集上进行了实验,结果表明所提方法获得了比基线模型更优的分类性能,同时也优于同类型的小样本图像分类方法。

基于中心对称特征耦合仿射度量模型的图像匹配方法

针对当下较多图像匹配算法利用距离度量法来实现特征匹配,没考虑图像仿射变换的影响,使得匹配结果准确率不高的问题,提出了中心对称特征耦合仿射度量模型的图像匹配算法。首先,引入Forstner算子,利用像素点的GS梯度特征提取特征点;然后,利用图像的Haar小波信息与中心对称像素点的灰度值,求取特征向量;接着,利用特征点之间的旋转、平移以及缩放的仿射特征,构造仿射度量模型,利用其计算出匹配的特征点对;最后,采用结构相似度(SSIM)函数,计算匹配点对的结构相似性,对匹配点对去伪求真,以求取最优匹配效果。实验结果表明,与当下匹配方法相比,所提算法不仅能更准确地实现图像匹配,而且还能够更好地适应具有仿射变换关系图像之间的匹配。

面向电力生产精细化风险解译的高度相似防护工具智能检测技术研究

电力生产通常面临高低电压、强弱电流等复杂工作环境转换,不同作业场景有严格的防护工具使用标准,因此,研究生产作业过程防护工具的精细辨识对保障人员安全及电网安全意义重大。已有研究可实现安全帽、工作服等基础着装类检测,而实际生产中存在大量形态高度相似的实体防护工具,如绝缘手套与线手套、绝缘杆与验电杆等。为此,该文提出一种基于深度代表性度量学习的相似防护工具智能检测方法。将目标类别特征学习转换为以差异化表达不同目标特征距离为目的的嵌入式空间特征学习,得到表征不同目标的深度代表性特征向量,通过计算未知目标与代表性特征向量的距离进行类别判断,最后以现场图像进行试验验证。试验结果表明:所提方法实现了对形态相似防护工具的特征差异表达和精准辨识,相比于常见目标检测模型具有更优越的辨识性能,从而提高电力生产安全风险辨识的精细化水平。

Robust multi-sensor image matching based on normalized self-similarity region descriptor

Multi-modal image matching is crucial in aerospace applications because it can fully exploit the complementary and valuable information contained in the amount and diversity of remote sensing images.However,it remains a challenging task due to significant non-linear radiometric,geometric differences,and noise across different sensors.To improve the performance of heterologous image matching,this paper proposes a normalized self-similarity region descriptor to extract consistent structural information.We first construct the pointwise self-similarity region descriptor based on the Euclidean distance between adjacent image blocks to reflect the structural properties of multi-modal images.Then,a linear normalization approach is used to form Modality Independent Region Descriptor(MIRD),which can effectively distinguish structural features such as points,lines,corners,and flat between multi-modal images.To further improve the matching accuracy,the included angle cosine similarity metric is adopted to exploit the directional vector information of multi-dimensional feature descriptors.The experimental results show that the proposed MIRD has better matching accuracy and robustness for various multi-modal image matching than the state-of-the-art methods.MIRD can effectively extract consistent geometric structure features and suppress the influence of SAR speckle noise using non-local neighboring image blocks operation,effectively applied to various multi-modal image matching.

一种面向商品检索的多尺度度量学习方法

商品图像检索是一个典型的大规模度量学习任务,其特点在于商品零售平台需要定期上架新类型的商品,且同一类型的商品外观会不时发生变化。已有的工作表明:传统基于单一的度量学习虽然可以将商品检索模型的识别范围扩展到未知商品类别上,但是其性能仍然受限。为此,提出了一种基于多尺度监督信息的深度度量学习商品检索方法。该方法利用商品多个尺度的标签信息训练并使用协同注意力机制对不同尺度的深度特征进行有效融合,提高了深度学习模型挖掘重要信息的能力,从而有效提高了其在细粒度级别下的检索性能。在大规模商品检索数据集上的实验结果表明,该方法在mAP和Rank-1上分别为43.0%和65.9%。相比于传统度量学习方法分别提升了6.4%和7.8%。

基于特征金字塔网络的余弦四元组哈希图像检索方法

为提高哈希图像检索的准确性,设计并提出一种基于特征金字塔网络的余弦四元组哈希图像检索方法,增强生成哈希编码的区分性。提出一种基于特征金字塔网络的特征提取器,提取到包含多层视觉信息和语义信息的图像特征描述符。设计基于余弦度量的四元组排序损失,使哈希码能够保持相似近邻关系;引入分类损失和二进制约束损失,使离散编码包含更多语义信息。实验结果表明,所提模型具有更好的检索性能。

基于SE-Hardnet网络的无人机图像目标匹配算法

针对无人机对目标进行匹配定位过程中,面临图像旋转变化及视角尺寸过小导致的图像特征提取困难等问题,提出了一种融合候选区域检测与SE-Hardnet特征提取网络的无人机目标图像匹配算法。通过Edge Boxes算法检测候选区域,结合SE-Hardnet网络进行特征提取,实现了目标图像的精确匹配。实验结果表明,所提算法在图像发生角度、尺寸变化时,具有更高的匹配正确率和鲁棒性,在近距离条件下图片数据集中的匹配正确率比现阶段图像匹配算法高8%~11%。为无人机目标定位提供了一种可行和有效的手段。

基于综合特征图像检索技术研究

图像数据库应用日益广泛,如何高效、准确地进行图像的检索成为一项重要的研究领域。传统的图像检索主要依赖颜色、纹理、形状、空间关系等单一视觉特征,检索效果往往不够理想。针对这一实际问题,提出一种新的图像检索方法,该方法以综合特征为检索基础,通过获得图像的归一化综合特征,并将其作为图像相似性的衡量依据。实验证明,利用综合特征进行图像检索具有很好的效果。

图像检索中的动态相似性度量方法

为提高图像检索的效率 ,近年来相关反馈机制被引入到了基于内容的图像检索领域 .该文提出了一种新的相关反馈方法——动态相似性度量方法 .该方法建立在目前被广泛采用的图像相似性度量方法的基础上 ,结合了相关反馈图像检索系统的时序特性 ,通过捕获用户的交互信息 ,动态地修正图像的相似性度量公式 ,从而把用户模型嵌入到了图像检索系统 ,在某种程度上使图像检索结果与人的主观感知更加接近 .实验结果表明该方法的性能明显优于其它图像检索系统所采用的方法 .

基于纹理-形状特征的图像检索技术

图像数据库应用日益广泛,如何高效、准确地进行图像的检索成为一项重要的研究领域。传统的图像检索主要依赖颜色、纹理、形状、空间关系等单一视觉特征,检索效果往往不够理想。针对这一实际问题,提出一种新的图像检索方法,通过对图像进行小波变换,获得纹理和形状的综合特征,对综合特征进行归一化处理,并将其作为图像相似性的衡量依据。实验证明基于纹理和形状特征的图像检索具有很好的效果。

基于内容图像检索的聚类算法研究

介绍了基于内容图像检索的系统结构、特征提取等内容,并将数据挖掘的聚类算法与之结合,对各种聚类算法进行了总结,最后提出了一些未来的发展方向。

基于光谱特征的高光谱遥感影像检索

面向海量遥感信息管理中遥感影像检索的需求,以高光谱遥感信息为例对光谱特征应用进行了探讨,提出基于光谱特征的遥感影像检索包括基于点源示例的检索和基于面源示例的检索,检索中的关键问题是光谱特征提取与相似性度量。基于光谱曲线的相似性度量可以采用光谱角和光谱信息散度进行;基于光谱特征的检索可以通过提取反射和吸收光谱、光谱特征匹配的方法进行;而光谱曲线量化指标如中心矩、分维数和信息熵等的效果较差,不适宜应用于检索。

基于内容的图像检索技术研究

随着数字图像在多媒体领域的广泛应用,对基于内容的图像检索技术的需求也不断增加。基于内容的图像检索技术总体上可以分为两部分:图像特征提取、图像特征的索引与匹配。图像特征提取主要解决如何在数学上有效地描述一幅图像。文中分别介绍了颜色、形状和纹理特征提取算法近年来的研究成果。图像特征索引与匹配,主要解决如何根据特征描述判断图像间的相似程度,并准确、快速列出图像库中与检索图像相似的图像,分别介绍了相似度测量方法、聚类与分类技术、相关反馈技术三类技术的主要研究成果。最后对基于内容的图像检索技术的研究难点进行了讨论,对未来可能的研究方向进行了展望。