A Content-Based Medical Image Retrieval Method Using Relative Difference-Based Similarity Measure

Content-based medical image retrieval(CBMIR)is a technique for retrieving medical images based on automatically derived image features.There are many applications of CBMIR,such as teaching,research,diagnosis and electronic patient records.Several methods are applied to enhance the retrieval performance of CBMIR systems.Developing new and effective similarity measure and features fusion methods are two of the most powerful and effective strategies for improving these systems.This study proposes the relative difference-based similarity measure(RDBSM)for CBMIR.The new measure was first used in the similarity calculation stage for the CBMIR using an unweighted fusion method of traditional color and texture features.Furthermore,the study also proposes a weighted fusion method for medical image features extracted using pre-trained convolutional neural networks(CNNs)models.Our proposed RDBSM has outperformed the standard well-known similarity and distance measures using two popular medical image datasets,Kvasir and PH2,in terms of recall and precision retrieval measures.The effectiveness and quality of our proposed similarity measure are also proved using a significant test and statistical confidence bound.

Importance-aware 3D volume visualization for medical content-based image retrieval-a preliminary study

Background A medical content-based image retrieval(CBIR)system is designed to retrieve images from large imaging repositories that are visually similar to a user′s query image.CBIR is widely used in evidence-based diagnosis,teaching,and research.Although the retrieval accuracy has largely improved,there has been limited development toward visualizing important image features that indicate the similarity of retrieved images.Despite the prevalence of 3D volumetric data in medical imaging such as computed tomography(CT),current CBIR systems still rely on 2D cross-sectional views for the visualization of retrieved images.Such 2D visualization requires users to browse through the image stacks to confirm the similarity of the retrieved images and often involves mental reconstruction of 3D information,including the size,shape,and spatial relations of multiple structures.This process is time-consuming and reliant on users'experience.Methods In this study,we proposed an importance-aware 3D volume visualization method.The rendering parameters were automatically optimized to maximize the visibility of important structures that were detected and prioritized in the retrieval process.We then integrated the proposed visualization into a CBIR system,thereby complementing the 2D cross-sectional views for relevance feedback and further analyses.Results Our preliminary results demonstrate that 3D visualization can provide additional information using multimodal positron emission tomography and computed tomography(PETCT)images of a non-small cell lung cancer dataset.

Content-based retrieval based on binary vectors for 2-D medical images

In medical research and clinical diagnosis, automated or computer-assisted classification and retrieval methods are highly desirable to offset the high cost of manual classification and manipulation by medical experts. To facilitate the decision-making in the health-care and the related areas, in this paper, a two-step content-based medical image retrieval algorithm is proposed. Firstly, in the preprocessing step, the image segmentation is performed to distinguish image objects, and on the basis of the ...

An Efficient Content-Based Image Retrieval System Using kNN and Fuzzy Mathematical Algorithm

The implementation of content-based image retrieval(CBIR)mainly depends on two key technologies:image feature extraction and image feature matching.In this paper,we extract the color features based on Global Color Histogram(GCH)and texture features based on Gray Level Co-occurrence Matrix(GLCM).In order to obtain the effective and representative features of the image,we adopt the fuzzy mathematical algorithm in the process of color feature extraction and texture feature extraction respectively.And we combine the fuzzy color feature vector with the fuzzy texture feature vector to form the comprehensive fuzzy feature vector of the image according to a certain way.Image feature matching mainly depends on the similarity between two image feature vectors.In this paper,we propose a novel similarity measure method based on k-Nearest Neighbors(kNN)and fuzzy mathematical algorithm(SBkNNF).Finding out the k nearest neighborhood images of the query image from the image data set according to an appropriate similarity measure method.Using the k similarity values between the query image and its k neighborhood images to constitute the new k-dimensional fuzzy feature vector corresponding to the query image.And using the k similarity values between the retrieved image and the k neighborhood images of the query image to constitute the new k-dimensional fuzzy feature vector corresponding to the retrieved image.Calculating the similarity between the two kdimensional fuzzy feature vector according to a certain fuzzy similarity algorithm to measure the similarity between the query image and the retrieved image.Extensive experiments are carried out on three data sets:WANG data set,Corel-5k data set and Corel-10k data set.The experimental results show that the outperforming retrieval performance of our proposed CBIR system with the other CBIR systems.

Content-based image retrieval applied to BI-RADS tissue classification in screening mammography

AIM:To present a content-based image retrieval(CBIR) system that supports the classification of breast tissue density and can be used in the processing chain to adapt parameters for lesion segmentation and classification.METHODS:Breast density is characterized by image texture using singular value decomposition(SVD) and histograms.Pattern similarity is computed by a support vector machine(SVM) to separate the four BI-RADS tissue categories.The crucial number of remaining singular values is varied(SVD),and linear,radial,and polynomial kernels are investigated(SVM).The system is supported by a large reference database for training and evaluation.Experiments are based on 5-fold cross validation.RESULTS:Adopted from DDSM,MIAS,LLNL,and RWTH datasets,the reference database is composed of over 10000 various mammograms with unified and reliable ground truth.An average precision of 82.14% is obtained using 25 singular values(SVD),polynomial kernel and the one-against-one(SVM).CONCLUSION:Breast density characterization using SVD allied with SVM for image retrieval enable the development of a CBIR system that can effectively aid radiologists in their diagnosis.

New Approach on the Techniques of Content-Based Image Retrieval (CBIR) Using Color, Texture and Shape Features

Digital image collection as rapidly increased along with the development of computer network. Image retrieval system was developed purposely to provide an efficient tool for a set of images from a collection of images in the database that matches the user’s requirements in similarity evaluations such as image content similarity, edge, and color similarity. Retrieving images based on the content which is color, texture, and shape is called content based image retrieval (CBIR). The content is actually the feature of an image and these features are extracted and used as the basis for a similarity check between images. The algorithms used to calculate the similarity between extracted features. There are two kinds of content based image retrieval which are general image retrieval and application specific image retrieval. For the general image retrieval, the goal of the query is to obtain images with the same object as the query. Such CBIR imitates web search engines for images rather than for text. For application specific, the purpose tries to match a query image to a collection of images of a specific type such as fingerprints image and x-ray. In this paper, the general architecture, various functional components, and techniques of CBIR system are discussed. CBIR techniques discussed in this paper are categorized as CBIR using color, CBIR using texture, and CBIR using shape features. This paper also describe about the comparison study about color features, texture features, shape features, and combined features (hybrid techniques) in terms of several parameters. The parameters are precision, recall and response time.

Image Retrieval Based on Vision Transformer and Masked Learning

Deep convolutional neural networks(DCNNs)are widely used in content-based image retrieval(CBIR)because of the advantages in image feature extraction.However,the training of deep neural networks requires a large number of labeled data,which limits the application.Self-supervised learning is a more general approach in unlabeled scenarios.A method of fine-tuning feature extraction networks based on masked learning is proposed.Masked autoencoders(MAE)are used in the fine-tune vision transformer(ViT)model.In addition,the scheme of extracting image descriptors is discussed.The encoder of the MAE uses the ViT to extract global features and performs self-supervised fine-tuning by reconstructing masked area pixels.The method works well on category-level image retrieval datasets with marked improvements in instance-level datasets.For the instance-level datasets Oxford5k and Paris6k,the retrieval accuracy of the base model is improved by 7%and 17%compared to that of the original model,respectively.

Content-Based Lace Image Retrieval System Using a Hierarchical Multifeature Scheme

An android-based lace image retrieval system based on content-based image retrieval (CBIR) technique is presented. This paper applies shape and texture features of lace image in our system and proposes a hierarchical multifeature scheme to facilitate coarseto-fine matching for efficient lace image retrieval in a large database. Experimental results demonstrate the feasibility and effectiveness of the proposed system meet the requirements of realtime.

Content-Based Image Retrieval：Near Tolerance Rough Set Approach

The problem considered in this paper is how to detect the degree of similarity in the content of digital images useful in image retrieval,i.e.,to what extent is the content of a query image similar to content of other images.The solution to this problem results from the detection of subsets that are rough sets contained in covers of digital images determined by perceptual tolerance relations(PTRs).Such relations are defined within the context of perceptual representative spaces that hearken back to work by J.H.Poincare on representative spaces as models of physical continua.Classes determined by a PTR provide content useful in content-based image retrieval(CBIR).In addition,tolerance classes provide a means of determining when subsets of image covers are tolerance rough sets(TRSs).It is the nearness of TRSs present in image tolerance spaces that provide a promising approach to CBIR,especially in cases such as satellite images or aircraft identification where there are subtle differences between pairs of digital images,making it difficult to quantify the similarities between such images.The contribution of this article is the introduction of the nearness of tolerance rough sets as an effective means of measuring digital image similarities and,as a significant consequence,successfully carrying out CBIR.

Colour Features Extraction Techniques and Approaches for Content-Based Image Retrieval (CBIR) System

An image retrieval system was developed purposely to provide an efficient tool for a set of images from a collection of images in the large database that matches the user’s requirements in similarity evaluations such as image content similarity, edge, and colour similarity. Retrieving images based on the contents which are colour, texture, and shape is called content-based image retrieval (CBIR). This paper discusses and describes about the colour features technique for image retrieval systems. Several colour features technique and algorithms produced by the previous researcher are used to calculate the similarity between extracted features. This paper also describes about the specific technique about the colour basis features and combined features (hybrid techniques) between colour and shape features.

Feature Extraction for Effective Content-Based Cloth Image Retrieval in E-Commerce

Cloth image retrieval in E-Commerce is a challenging task. In this paper, we propose an effective approach to solve this problem. Our work chooses three features for retrieval: (1) description (2) category (3) color features. It can handle clothes with multiple colors, complex background, and model disturbances. To evaluate the proposed method, we collect a set of women cloth images from Amazon.com. Results reported here demonstrate the robustness and effectiveness of our retrieval method.

A New Method for Medical Image Retrieval Based on Markov Random Field

The development of medical images acquisition and storage technology has led to the rapid growth of the relevant data.Retrieval of similar medical images can effectively help doctors to diagnose diseases more accurately.But because of the particularity of medical images,traditional contentbased image retrieval(CBIR)method such as bag-of-words(BOW)cannot be applied to medical images.For example,when retrieving a diseased image,we should not only consider the similar characteristics but also need to consider the type of lesion.And for medical images,images with the same lesion may have different image features,similar images may have different types of lesions.In this paper,a Markov random field(MRF)is structured,and an approximate belief propagation algorithm is used to retrieval images.An adjust-ranking step after initial retrieval is incorporated to further improve the retrieval performance.This paper uses the real brain CT images.The experimental results show that the proposed method can significantly improve the retrieval accuracy and has good efficiency.

An Improved Asymmetric Bagging Relevance Feedback Strategy for Medical Image Retrieval

Much attention has been paid to relevant feedback in intelligent computation for social computing, especially in content-based image retrieval which based on WeChat platform for the medical auxiliary. It has a good effect on reducing the semantic gap between high semantics and low semantics of images. There are many kinds of support vector machines (SVM) based relevance feedback methods in image retrieval, but all of them may encounter some problems, such as a small size of sample, an asymmetric positive sample and negative sample as well as a long feedback cycle. To deal with these problems, an improved asymmetric bagging (IAB) relevance feedback algorithm is proposed. Furthermore, we apply a new fuzzy support machine (FSVM) to cooperate with IAB. To solve the over-fitting and real-time problems, we use modified local binary patterns (MLBP) as image features. Finally, experimental results demonstrate that our method performs other methods in terms of improving retrieval precision as well as retrieval efficiency.

Secure Content Based Image Retrieval Scheme Based on Deep Hashing and Searchable Encryption

To solve the problem that the existing ciphertext domain image retrieval system is challenging to balance security,retrieval efficiency,and retrieval accuracy.This research suggests a searchable encryption and deep hashing-based secure image retrieval technique that extracts more expressive image features and constructs a secure,searchable encryption scheme.First,a deep learning framework based on residual network and transfer learn-ing model is designed to extract more representative image deep features.Secondly,the central similarity is used to quantify and construct the deep hash sequence of features.The Paillier homomorphic encryption encrypts the deep hash sequence to build a high-security and low-complexity searchable index.Finally,according to the additive homomorphic property of Paillier homomorphic encryption,a similarity measurement method suitable for com-puting in the retrieval system’s security is ensured by the encrypted domain.The experimental results,which were obtained on Web Image Database from the National University of Singapore(NUS-WIDE),Microsoft Common Objects in Context(MS COCO),and ImageNet data sets,demonstrate the system’s robust security and precise retrieval,the proposed scheme can achieve efficient image retrieval without revealing user privacy.The retrieval accuracy is improved by at least 37%compared to traditional hashing schemes.At the same time,the retrieval time is saved by at least 9.7%compared to the latest deep hashing schemes.

Medical Image Retrieval Based on Multi-Layer Resampling Template

Medical image application in clinical diagnosis and treatment is becoming more and more widely, How to use a large number of images in the image management system and it is a very important issue how to assist doctors to analyze and diagnose. This paper studies the medical image retrieval based on multi-layer resampling template under the thought of the wavelet decomposition, the image retrieval method consists of two retrieval process which is coarse and fine retrieval. Coarse retrieval process is the medical image retrieval process based on the image contour features. Fine retrieval process is the medical image retrieval process based on multi-layer resampling template, a multi-layer sampling operator is employed to extract image resampling images each layer, then these resampling images are retrieved step by step to finish the process from coarse to fine retrieval.

A Fast Image Retrieval Algorithm with Multi-Channel Textural Features in PACS

The paper presents a fast algorithm for image retrieval using multi-channel textural features in medical picture archiving and communication system (PACS). By choosing different linear or nonlinear operators in prediction and update lifting step, the linear or nonlinear M-band wavelet decomposition can be achieved in M-band lifting. It provides the advantages such as fast transform, in-place calculation and integer-integer transform. The set of wavelet moment forms multi-channel textural feature vector related to the texture distribution of each wavelet images. The experimental results of CT image database show that the retrieval approach of multi-channel textural features is effective for image indexing and has lower computational complexity and less memory. It is much easier to implement in hardware and suitable for the applications of real time medical processing system.

Medical Sign Recognition of Lung Nodules Based on Image Retrieval with Semantic Features and Supervised Hashing

符号识别为识别良性、恶意的小瘤是重要的。这份报纸为肺小瘤基于图象检索建议一个新符号识别方法。首先，我们构造提取能有效地表示符号信息的语义特征的一个深学习的框架。第二，我们把高度维的图象特征翻译成紧缩的二进制代码代码与主管部件分析(PCA ) 和监督哈希。第三，我们与介绍适应加权的类似检索类似的肺小瘤图象计算方法。最后，我们认识到小瘤从检索签署结果，它装也为肺损害的诊断提供决定支持。建议方法在公开可得到的数据库上被验证：肺图象数据库协会和图象数据库资源行动(LIDC-IDRI ) 和肺计算了成像签署的断层摄影术(CT )(LISS ) 。试验性的结果表明我们的检索方法实质地改进检索性能当哈希值代码的长度是 48 时，与那些使用相比，传统的 Hamming 距离，和检索精确罐头完成 87.29% 位。根据检索，结果能完成的全部识别率 93.52% 。而且，我们的方法为真实诊断数据也是有效的。

Perceptual tolerance neighborhood-based similarity in content-based image retrieval and classification

Purpose–The purpose of this paper is to demonstrate the effectiveness and advantages of using perceptual tolerance neighbourhoods in tolerance space-based image similarity measures and its application in content-based image classification and retrieval.Design/methodology/approach–The proposed method in this paper is based on a set-theoretic approach,where an image is viewed as a set of local visual elements.The method also includes a tolerance relation that detects the similarity between pairs of elements,if the difference between corresponding feature vectors is less than a threshold 2(0,1).Findings–It is shown that tolerance space-based methods can be successfully used in a complete content-based image retrieval(CBIR)system.Also,it is shown that perceptual tolerance neighbourhoods can replace tolerance classes in CBIR,resulting in more accuracy and less computations.Originality/value–The main contribution of this paper is the introduction of perceptual tolerance neighbourhoods instead of tolerance classes in a new form of the Henry-Peters tolerance-based nearness measure(tNM)and a new neighbourhood-based tolerance-covering nearness measure(tcNM).Moreover,this paper presents a side–by–side comparison of the tolerance space based methods with other published methods on a test dataset of images.

ViTH:面向医学图像检索的视觉Transformer哈希改进算法

对海量的医学图像进行有效检索会给医学诊断和治疗带来极其重要的意义.哈希方法是图像检索领域中的一种主流方法,但在医学图像领域的应用相对较少.针对此,提出一种面向医学图像检索的视觉Transformer哈希改进算法.首先使用视觉Transformer模型作为基础的特征提取模块,其次在Transformer编码器的前、后端分别加入幂均值变换(Power-Mean Transformation,PMT),进一步增强模型的非线性性能,接着在Transformer编码器内部的多头注意力(Multi-Head Attention,MHA)层引入空间金字塔池化(Spatial Pyramid Pooling,SPP)形成多头空间金字塔池化注意力(Multi-Head Spatial Pyramid Pooling Attention,MHSPA)模块,该模块不仅可以提取全局的上下文特征,而且可以提取多尺度的局部上下文特征,并将不同尺度的特征进行融合.最后在输出幂均值变换层之后将提取到的特征分别通过两个多层感知机(Multi-Layer Perceptrons,MLPs),上分支的MLP用来预测图像的类别,下分支的MLP用来学习图像的哈希码.在损失函数部分,充分考虑了成对损失、量化损失、平衡损失以及分类损失来优化整个模型.在医学图像数据集ChestX-ray14和ISIC 2018上的实验结果表明,该研究所提出的算法相比于经典的哈希算法具有更好的检索效果.

An improved SVM model for relevance feedback in remote sensing image retrieval

With the rapid development of satellite remote sensing technology and an ever-increasing number of Earth observation satellites being launched,the global volume of remotely sensed imagery has been growing exponentially.Processing the variety of remotely sensed data has increasingly been complex and difficult.It is also hard to efficiently and intelligently retrieve what users need from a massive database of images.This paper introduces an improved support vector machine(SVM)model,which optimizes the model parameters and selects the feature subset based on the particle swarm optimization(PSO)method and genetic algorithm(GA)for remote sensing image retrieval.The results from an image retrieval experiment show that our method outperforms traditional methods such as GRID,PSO,and GA in terms of consistency and stability.