Importance-aware 3D volume visualization for medical content-based image retrieval-a preliminary study

Background A medical content-based image retrieval(CBIR)system is designed to retrieve images from large imaging repositories that are visually similar to a user′s query image.CBIR is widely used in evidence-based diagnosis,teaching,and research.Although the retrieval accuracy has largely improved,there has been limited development toward visualizing important image features that indicate the similarity of retrieved images.Despite the prevalence of 3D volumetric data in medical imaging such as computed tomography(CT),current CBIR systems still rely on 2D cross-sectional views for the visualization of retrieved images.Such 2D visualization requires users to browse through the image stacks to confirm the similarity of the retrieved images and often involves mental reconstruction of 3D information,including the size,shape,and spatial relations of multiple structures.This process is time-consuming and reliant on users'experience.Methods In this study,we proposed an importance-aware 3D volume visualization method.The rendering parameters were automatically optimized to maximize the visibility of important structures that were detected and prioritized in the retrieval process.We then integrated the proposed visualization into a CBIR system,thereby complementing the 2D cross-sectional views for relevance feedback and further analyses.Results Our preliminary results demonstrate that 3D visualization can provide additional information using multimodal positron emission tomography and computed tomography(PETCT)images of a non-small cell lung cancer dataset.

Colour Features Extraction Techniques and Approaches for Content-Based Image Retrieval (CBIR) System

An image retrieval system was developed purposely to provide an efficient tool for a set of images from a collection of images in the large database that matches the user’s requirements in similarity evaluations such as image content similarity, edge, and colour similarity. Retrieving images based on the contents which are colour, texture, and shape is called content-based image retrieval (CBIR). This paper discusses and describes about the colour features technique for image retrieval systems. Several colour features technique and algorithms produced by the previous researcher are used to calculate the similarity between extracted features. This paper also describes about the specific technique about the colour basis features and combined features (hybrid techniques) between colour and shape features.

CMA:an efficient index algorithmof clustering supporting fast retrieval oflarge image databases

To realize content-hased retrieval of large image databases, it is required to develop an efficient index and retrieval scheme. This paper proposes an index algorithm of clustering called CMA, which supports fast retrieval of large image databases. CMA takes advantages of k-means and self-adaptive algorithms. It is simple and works without any user interactions. There are two main stages in this algorithm. In the first stage, it classifies images in a database into several clusters, and automatically gets the necessary parameters for the next stage-k-means iteration. The CMA algorithm is tested on a large database of more than ten thousand images and compare it with k-means algorithm. Experimental results show that this algorithm is effective in both precision and retrieval time.

A Content-Based Parallel Image Retrieval System on Cluster Architectures

We propose a content-based parallel image retrieval system to achieve high responding ability. Our system is developed on cluster architectures. It has several retrieval. servers to supply the service of content-based image retrieval. It adopts the Browser/Server (B/S) mode. The users could visit our system though web pages. It uses the symmetrical color-spatial features (SCSF) to represent the content of an image. The SCSF is effective and efficient for image matching because it is independent of image distortion such as rotation and flip as well as it increases the matching accuracy. The SCSF was organized by M-tree, which could speedup the searching procedure. Our experiments show that the image matching is quickly and efficiently with the use of SCSF. And with the support of several retrieval servers, the system could respond to many users at mean time. Key words content-based image retrieval - cluster architecture - color-spatial feature - B/S mode - task parallel - WWW - Internet CLC number TP391 Foundation item: Supported by the National Natural Science Foundation of China (60173058)Biography: ZHOU Bing (1975-), male, Ph. D candidate, reseach direction: data mining, content-based image retrieval.

Auto-expanded multi query examples technology in content-based image retrieval

In order to narrow the semantic gap existing in content-based image retrieval （CBIR）,a novel retrieval technology called auto-extended multi query examples （AMQE） is proposed.It expands the single one query image used in traditional image retrieval into multi query examples so as to include more image features related with semantics.Retrieving images for each of the multi query examples and integrating the retrieval results,more relevant images can be obtained.The property of the recall-precision curve of a general retrieval algorithm and the K-means clustering method are used to realize the expansion according to the distance of image features of the initially retrieved images.The experimental results demonstrate that the AMQE technology can greatly improve the recall and precision of the original algorithms.

Content-Based Lace Image Retrieval System Using a Hierarchical Multifeature Scheme

An android-based lace image retrieval system based on content-based image retrieval (CBIR) technique is presented. This paper applies shape and texture features of lace image in our system and proposes a hierarchical multifeature scheme to facilitate coarseto-fine matching for efficient lace image retrieval in a large database. Experimental results demonstrate the feasibility and effectiveness of the proposed system meet the requirements of realtime.

KFL： a clustering algorithm for image database

It is a fairly challenging issue to make image repositories easy to be searched and browsed. This depends on a technique--image clustering. Kernel-based clustering algorithm has been one of the most promising clustering methods in the last few years, beeanse it can handle data with high dimensional complex structure. In this paper, a kernel fuzzy learning （KFL） algorithm is proposed, which takes advantages of the distance kernel trick and the gradient-based fuzzy clustering method to execute the image clustering automatically. Experimental results show that KFL is a more efficient method for image clustering in comparison with recent renorted alternative methods.

Content-based Image Retrieval Using Color Histogram

This paper introduces the principles of using color histogram to match images in CBIR. And a prototype CBIR system is designed with color matching function. A new method using 2-dimensional color histogram based on hue and saturation to extract and represent color information of an image is presented. We also improve the Euclidean-distance algorithm by adding Center of Color to it. The experiment shows modifications made to Euclidean-distance signif-icantly elevate the quality and efficiency of retrieval.

Multi-core based parallel computing technique for content-based image retrieval

In this paper, we propose a parallel computing technique for content-based image retrieval （CBIR） system. This technique is mainly used for single node with multi-core processor, which is different from those based on cluster or network computing architecture. Due to its specific applications （such as medical image processing） and the harsh terms of hardware resource requirement, the CBIR system has been prevented from being widely used. With the increasing volume of the image database, the widespread use of multi-core processors, and the requirement of the retrieval accuracy and speed, we need to achieve a retrieval strategy which is based on multi-core processor to make the retrieval faster and more convenient than before. Experimental results demonstrate that this parallel architecture can significantly improve the performance of retrieval system. In addition, we also propose an efficient parallel technique with the combinations of the cluster and the multi-core techniques, which is supposed to gear to the new trend of the cloud computing.

An Efficient Deep Learning-based Content-based Image Retrieval Framework

The use of massive image databases has increased drastically over the few years due to evolution of multimedia technology.Image retrieval has become one of the vital tools in image processing applications.Content-Based Image Retrieval(CBIR)has been widely used in varied applications.But,the results produced by the usage of a single image feature are not satisfactory.So,multiple image features are used very often for attaining better results.But,fast and effective searching for relevant images from a database becomes a challenging task.In the previous existing system,the CBIR has used the combined feature extraction technique using color auto-correlogram,Rotation-Invariant Uniform Local Binary Patterns(RULBP)and local energy.However,the existing system does not provide significant results in terms of recall and precision.Also,the computational complexity is higher for the existing CBIR systems.In order to handle the above mentioned issues,the Gray Level Co-occurrence Matrix(GLCM)with Deep Learning based Enhanced Convolution Neural Network(DLECNN)is proposed in this work.The proposed system framework includes noise reduction using histogram equalization,feature extraction using GLCM,similarity matching computation using Hierarchal and Fuzzy c-Means(HFCM)algorithm and the image retrieval using DLECNN algorithm.The histogram equalization has been used for computing the image enhancement.This enhanced image has a uniform histogram.Then,the GLCM method has been used to extract the features such as shape,texture,colour,annotations and keywords.The HFCM similarity measure is used for computing the query image vector's similarity index with every database images.For enhancing the performance of this image retrieval approach,the DLECNN algorithm is proposed to retrieve more accurate features of the image.The proposed GLCM+DLECNN algorithm provides better results associated with high accuracy,precision,recall,f-measure and lesser complexity.From the experimental results,it is clearly observed that the proposed system provides efficient image retrieval for the given query image.

2D matrix based indexing with color spectralhistogram for efficient image retrieval

A novel content based image retrieval （CBIR） algorithmusing relevant feedback is presented. The proposed frameworkhas three major contributions： a novel feature descriptor calledcolor spectral histogram （CSH） to measure the similarity betweenimages; two-dimensional matrix based indexing approach proposedfor short-term learning （STL）; and long-term learning （LTL）.In general, image similarities are measured from feature representationwhich includes color quantization, texture, color, shapeand edges. However, CSH can describe the image feature onlywith the histogram. Typically the image retrieval process starts byfinding the similarity between the query image and the imagesin the database; the major computation involved here is that theselection of top ranking images requires a sorting algorithm to beemployed at least with the lower bound of O（n log n）. A 2D matrixbased indexing of images can enormously reduce the searchtime in STL. The same structure is used for LTL with an aim toreduce the amount of log to be maintained. The performance ofthe proposed framework is analyzed and compared with the existingapproaches, the quantified results indicates that the proposedfeature descriptor is more effectual than the existing feature descriptorsthat were originally developed for CBIR. In terms of STL,the proposed 2D matrix based indexing minimizes the computationeffort for retrieving similar images and for LTL, the proposed algorithmtakes minimum log information than the existing approaches.

AN IMAGE RETRIEVAL METHOD BASED ON SPATIAL DISTRIBUTION OF COLOR

Color histogram is now widely used in image retrieval. Color histogram-based image retrieval methods are simple and efficient but without considering the spatial distribution information of the color. To overcome the shortcoming of conventional color histogram-based image retrieval methods, an image retrieval method based on Radon Transform (RT) is proposed. In order to reduce the computational complexity, wavelet decomposition is used to compress image data. Firstly, images are decomposed by Mallat algorithm. The low-frequency components are then projected by RT to generate the spatial color feature. Finally the moment feature matrices which are saved along with original images are obtained. Experimental results show that the RT based retrieval is more accurate and efficient than traditional color histogram-based method in case that there are obvious objects in images. Further more, RT based retrieval runs significantly faster than the traditional color histogram methods.

Content-Based Image Retrieval with Feature Extraction and Rotation Invariance

Over recent years, Convolutional Neural Networks (CNN) has improved performance on practically every image-based task, including Content-Based Image Retrieval (CBIR). Nevertheless, since features of CNN have altered orientation, training a CBIR system to detect and correct the angle is complex. While it is possible to construct rotation-invariant features by hand, retrieval accuracy will be low because hand engineering only creates low-level features, while deep learning methods build high-level and low-level features simultaneously. This paper presents a novel approach that combines a deep learning orientation angle detection model with the CBIR feature extraction model to correct the rotation angle of any image. This offers a unique construction of a rotation-invariant CBIR system that handles the CNN features that are not rotation invariant. This research also proposes a further study on how a rotation-invariant deep CBIR can recover images from the dataset in real-time. The final results of this system show significant improvement as compared to a default CNN feature extraction model without the OAD.

Perceptual tolerance neighborhood-based similarity in content-based image retrieval and classification

Purpose–The purpose of this paper is to demonstrate the effectiveness and advantages of using perceptual tolerance neighbourhoods in tolerance space-based image similarity measures and its application in content-based image classification and retrieval.Design/methodology/approach–The proposed method in this paper is based on a set-theoretic approach,where an image is viewed as a set of local visual elements.The method also includes a tolerance relation that detects the similarity between pairs of elements,if the difference between corresponding feature vectors is less than a threshold 2(0,1).Findings–It is shown that tolerance space-based methods can be successfully used in a complete content-based image retrieval(CBIR)system.Also,it is shown that perceptual tolerance neighbourhoods can replace tolerance classes in CBIR,resulting in more accuracy and less computations.Originality/value–The main contribution of this paper is the introduction of perceptual tolerance neighbourhoods instead of tolerance classes in a new form of the Henry-Peters tolerance-based nearness measure(tNM)and a new neighbourhood-based tolerance-covering nearness measure(tcNM).Moreover,this paper presents a side–by–side comparison of the tolerance space based methods with other published methods on a test dataset of images.

Web-based remote sensing image retrieval using multiscale and multidirectional analysis based on Contourlet and Haralick texture features

Purpose-Extracting suitable features to represent an image based on its content is a very tedious task.Especially in remote sensing we have high-resolution images with a variety of objects on the Earth’s surface.Mahalanobis distance metric is used to measure the similarity between query and database images.The low distance obtained image is indexed at the top as high relevant information to the query.Design/methodology/approach-This paper aims to develop an automatic feature extraction system for remote sensing image data.Haralick texture features based on Contourlet transform are fused with statistical features extracted from the QuadTree(QT)decomposition are developed as feature set to represent the input data.The extracted features will retrieve similar images from the large image datasets using an image-based query through the web-based user interface.Findings-The developed retrieval system performance has been analyzed using precision and recall and F1 score.The proposed feature vector gives better performance with 0.69 precision for the top 50 relevant retrieved results over other existing multiscale-based feature extraction methods.Originality/value-The main contribution of this paper is developing a texture feature vector in a multiscale domain by combining the Haralick texture properties in the Contourlet domain and Statistical features using QT decomposition.The features required to represent the image is 207 which is very less dimension compare to other texture methods.The performance shows superior than the other state of art methods.

基于互信息量均方差提取关键帧的激光视频图像检索研究

为保证激光视频图像检索结果中不存在重复性冗余图像,提出了基于互信息量均方差提取关键帧的激光视频图像检索方法。基于互信息量均方差的关键帧提取方法,以激光视频图像颜色的互信息量均方差最大化,为激光视频图像关键帧的聚类中心设置标准,以此聚类提取不重复的视频图像关键帧;通过基于关键帧的激光视频图像检索方法,将所提取关键帧作为激光视频图像检索的核心判断内容,提取与所需图像关键帧相似度显著的激光视频图像,完成激光视频图像检索。实验结果显示:此方法使用后,提取的激光视频图像关键帧冗余度仅有0.01,激光视频图像检索结果的MAP指标测试值高达0.98,检索结果中不存在重复性冗余图像。

一种用于CBIR系统的主色提取及表示方法

颜色是彩色图像最重要的视觉特征之一，在基于内容的图像检索（ＣＢＩＲ）系统中，都将颜色信息作为重要内容参与匹配和检索．针对图像中起主要视觉作用的是图像的主色这一问题，提出一种基于聚类分析的提取和表示图像主色的方法，给出一种用于聚类算法的停止准则．和等量量化方法相比，用本方法提取的颜色信息，具有特征维数低、颜色表示准的优点．

CBIR关键技术研究

从图像特征提取和图像特征匹配两个关键环节对目前的CBIR技术进行了细致的阐述 ,分析和比较了不同方法的原理及优缺点 ;分类研究了压缩域的图像检索技术 ;

基于主色选择的CBIR检索

基于内容的图像检索 (CBIR)是多媒体检索研究的前沿课题 .利用颜色特征作为索引进行图像检索是最重要的技术 .在提取图像主要颜色特征的基础上 ,进一步提取了相应的主色空间分布信息——主色矩特征 ,作为图像库的索引 .在改进加权二次型相似性度量方法的基础上 ,提出了相应的主色多特征相似性度量方法 .由于用户对图像中不同的主色具有不同的检索要求 ,提出了主色调选择的用户模型 ,用于更精确的图像检索 .实现了 WWW发布方式的 CBIR原型系统 ,实验结果表明加入主色选择使得图像检索的效果更好 .

CBIR技术在电力设备管理系统中的应用研究

本文对基于内容的电力设备图像检索技术进行了初步的研究。根据电力设备图像的特点,将形状特征作为电力设备图像检索中的主要特征抽取,并结合纹理特征,提出了电力设备图像管理系统中的图像检索方法,阐述了形状和纹理特征参数的提取过程,给出了基于内容的电力设备图像检索系统结构。