A Local Binary Pattern-Based Method for Color and Multicomponent Texture Analysis

Local Binary Patterns (LBPs) have been highly used in texture classification for their robustness, their ease of implementation and their low computational cost. Initially designed to deal with gray level images, several methods based on them in the literature have been proposed for images having more than one spectral band. To achieve it, whether assumption using color information or combining spectral band two by two was done. Those methods use micro structures as texture features. In this paper, our goal was to design texture features which are relevant to color and multicomponent texture analysis without any assumption. Based on methods designed for gray scale images, we find the combination of micro and macro structures efficient for multispectral texture analysis. The experimentations were carried out on color images from Outex databases and multicomponent images from red blood cells captured using a multispectral microscope equipped with 13 LEDs ranging from 375 nm to 940 nm. In all achieved experimentations, our proposal presents the best classification scores compared to common multicomponent LBP methods. 99.81%, 100.00%, 99.07% and 97.67% are maximum scores obtained with our strategy respectively applied to images subject to rotation, blur, illumination variation and the multicomponent ones.

An Improved Real-Time Face Recognition System at Low Resolution Based on Local Binary Pattern Histogram Algorithm and CLAHE

This research presents an improved real-time face recognition system at a low resolution of 15 pixels with pose and emotion and resolution variations. We have designed our datasets named LRD200 and LRD100, which have been used for training and classification. The face detection part uses the Viola-Jones algorithm, and the face recognition part receives the face image from the face detection part to process it using the Local Binary Pattern Histogram (LBPH) algorithm with preprocessing using contrast limited adaptive histogram equalization (CLAHE) and face alignment. The face database in this system can be updated via our custom-built standalone android app and automatic restarting of the training and recognition process with an updated database. Using our proposed algorithm, a real-time face recognition accuracy of 78.40% at 15 px and 98.05% at 45 px have been achieved using the LRD200 database containing 200 images per person. With 100 images per person in the database (LRD100) the achieved accuracies are 60.60% at 15 px and 95% at 45 px respectively. A facial deflection of about 30° on either side from the front face showed an average face recognition precision of 72.25%-81.85%. This face recognition system can be employed for law enforcement purposes, where the surveillance camera captures a low-resolution image because of the distance of a person from the camera. It can also be used as a surveillance system in airports, bus stations, etc., to reduce the risk of possible criminal threats.

Classification of Gastric Lesions Using Gabor Block Local Binary Patterns

The identification of cancer tissues in Gastroenterology imaging poses novel challenges to the computer vision community in designing generic decision support systems.This generic nature demands the image descriptors to be invariant to illumination gradients,scaling,homogeneous illumination,and rotation.In this article,we devise a novel feature extraction methodology,which explores the effectiveness of Gabor filters coupled with Block Local Binary Patterns in designing such descriptors.We effectively exploit the illumination invariance properties of Block Local Binary Patterns and the inherent capability of convolutional neural networks to construct novel rotation,scale and illumination invariant features.The invariance characteristics of the proposed Gabor Block Local Binary Patterns(GBLBP)are demonstrated using a publicly available texture dataset.We use the proposed feature extraction methodology to extract texture features from Chromoendoscopy(CH)images for the classification of cancer lesions.The proposed feature set is later used in conjuncture with convolutional neural networks to classify the CH images.The proposed convolutional neural network is a shallow network comprising of fewer parameters in contrast to other state-of-the-art networks exhibiting millions of parameters required for effective training.The obtained results reveal that the proposed GBLBP performs favorably to several other state-of-the-art methods including both hand crafted and convolutional neural networks-based features.

Remote Sensing Image Retrieval Based on 3D-Local Ternary Pattern(LTP)Features and Non-subsampled Shearlet Transform(NSST)Domain Statistical Features

With the increasing popularity of high-resolution remote sensing images,the remote sensing image retrieval(RSIR)has always been a topic of major issue.A combined,global non-subsampled shearlet transform(NSST)-domain statistical features(NSSTds)and local three dimensional local ternary pattern(3D-LTP)features,is proposed for high-resolution remote sensing images.We model the NSST image coefficients of detail subbands using 2-state laplacian mixture(LM)distribution and its three parameters are estimated using Expectation-Maximization(EM)algorithm.We also calculate the statistical parameters such as subband kurtosis and skewness from detail subbands along with mean and standard deviation calculated from approximation subband,and concatenate all of them with the 2-state LM parameters to describe the global features of the image.The various properties of NSST such as multiscale,localization and flexible directional sensitivity make it a suitable choice to provide an effective approximation of an image.In order to extract the dense local features,a new 3D-LTP is proposed where dimension reduction is performed via selection of‘uniform’patterns.The 3D-LTP is calculated from spatial RGB planes of the input image.The proposed inter-channel 3D-LTP not only exploits the local texture information but the color information is captured too.Finally,a fused feature representation(NSSTds-3DLTP)is proposed using new global(NSSTds)and local(3D-LTP)features to enhance the discriminativeness of features.The retrieval performance of proposed NSSTds-3DLTP features are tested on three challenging remote sensing image datasets such as WHU-RS19,Aerial Image Dataset(AID)and PatternNet in terms of mean average precision(MAP),average normalized modified retrieval rank(ANMRR)and precision-recall(P-R)graph.The experimental results are encouraging and the NSSTds-3DLTP features leads to superior retrieval performance compared to many well known existing descriptors such as Gabor RGB,Granulometry,local binary pattern(LBP),Fisher vector(FV),vector of locally aggregated descriptors(VLAD)and median robust extended local binary pattern(MRELBP).For WHU-RS19 dataset,in terms of{MAP,ANMRR},the NSSTds-3DLTP improves upon Gabor RGB,Granulometry,LBP,FV,VLAD and MRELBP descriptors by{41.93%,20.87%},{92.30%,32.68%},{86.14%,31.97%},{18.18%,15.22%},{8.96%,19.60%}and{15.60%,13.26%},respectively.For AID,in terms of{MAP,ANMRR},the NSSTds-3DLTP improves upon Gabor RGB,Granulometry,LBP,FV,VLAD and MRELBP descriptors by{152.60%,22.06%},{226.65%,25.08%},{185.03%,23.33%},{80.06%,12.16%},{50.58%,10.49%}and{62.34%,3.24%},respectively.For PatternNet,the NSSTds-3DLTP respectively improves upon Gabor RGB,Granulometry,LBP,FV,VLAD and MRELBP descriptors by{32.79%,10.34%},{141.30%,24.72%},{17.47%,10.34%},{83.20%,19.07%},{21.56%,3.60%},and{19.30%,0.48%}in terms of{MAP,ANMRR}.The moderate dimensionality of simple NSSTds-3DLTP allows the system to run in real-time.

Android Malware Detection Using Local Binary Pattern and Principal Component Analysis

Nowadays,analysis methods based on big data have been widely used in malicious software detection.Since Android has become the dominator of smartphone operating system market,the number of Android malicious applications are increasing rapidly as well,which attracts attention of malware attackers and researchers alike.Due to the endless evolution of the malware,it is critical to apply the analysis methods based on machine learning to detect malwares and stop them from leakaging our privacy information.In this paper,we propose a novel Android malware detection method based on binary texture feature recognition by Local Binary Pattern and Principal Component Analysis,which can visualize malware and detect malware accurately.Also,our method analyzes malware binary directly without any decompiler,sandbox or virtual machines,which avoid time and resource consumption caused by decompiler or monitor in this process.Experimentation on 5127 benigns and 5560 malwares shows that we obtain a detection accuracy of 90%.

Local Binary Patterns and Its Variants for Finger Knuckle Print Recognition in Multi-Resolution Domain

Finger Knuckle Print biometric plays a vital role in establishing security for real-time environments. The success of human authentication depends on high speed and accuracy. This paper proposed an integrated approach of personal authentication using texture based Finger Knuckle Print (FKP) recognition in multiresolution domain. FKP images are rich in texture patterns. Recently, many texture patterns are proposed for biometric feature extraction. Hence, it is essential to review whether Local Binary Patterns or its variants perform well for FKP recognition. In this paper, Local Directional Pattern (LDP), Local Derivative Ternary Pattern (LDTP) and Local Texture Description Framework based Modified Local Directional Pattern (LTDF_MLDN) based feature extraction in multiresolution domain are experimented with Nearest Neighbor and Extreme Learning Machine (ELM) Classifier for FKP recognition. Experiments were conducted on PolYU database. The result shows that LDTP in Contourlet domain achieves a promising performance. It also proves that Soft classifier performs better than the hard classifier.

Retrieval of High Resolution Satellite Images Using Texture Features

In this research, a content-based image retrieval （CBIR） system for high resolution satellite images has been developed by using texture features. The proposed approach uses the local binary pattern （LBP） texture feature and a block based scheme. The query and database images are divided into equally sized blocks, from which LBP histograms are extracted. The block histograms are then compared by using the Chi-square distance. Experimental results show that the LBP representation provides a powerful tool for high resolution satellite images （HRSI） retrieval.

基于Local Jet变换空间纹理特征的肺结节分类方法

为了在纹理特征下改善肺结节良、恶性的模式识别,提出一种基于local jet变换空间的纹理特征提取方法。首先利用二维高斯函数的前三阶偏微分函数将结节原图像变换到local jet纹理图像空间,然后利用纹理描述子在该空间提取特征参数。以灰度值的前四阶矩和基于灰度共生矩阵的特征参数作为纹理描述子,分别提取结节原图像和变换后纹理图像的特征参数,以BP神经网络作为分类器,对同一纹理描述子下的2个不同图像空间的经核主成分分析优化后的特征参数集进行结节良、恶性分类。以157个肺结节(51个良性,106个恶性)作为实验数据进行对比实验,结果显示:两种纹理描述子基于local jet变换空间提取的特征参数分别获得82.69%和86.54%的分类正确率,较原图像空间提高6%~8%,同时AUC值提高约10%。实验结果表明,基于local jet变换空间提取的纹理特征可以有效地改善肺结节良、恶性的模式识别。

Multi-Level Fusion in Ultrasound for Cancer Detection Based on Uniform LBP Features

Collective improvement in the acceptable or desirable accuracy level of breast cancer image-related pattern recognition using various schemes remains challenging.Despite the combination of multiple schemes to achieve superior ultrasound image pattern recognition by reducing the speckle noise,an enhanced technique is not achieved.The purpose of this study is to introduce a features-based fusion scheme based on enhancement uniform-Local Binary Pattern(LBP)and filtered noise reduction.To surmount the above limitations and achieve the aim of the study,a new descriptor that enhances the LBP features based on the new threshold has been proposed.This paper proposes a multi-level fusion scheme for the auto-classification of the static ultrasound images of breast cancer,which was attained in two stages.First,several images were generated from a single image using the pre-processing method.Themedian andWiener filterswere utilized to lessen the speckle noise and enhance the ultrasound image texture.This strategy allowed the extraction of a powerful feature by reducing the overlap between the benign and malignant image classes.Second,the fusion mechanism allowed the production of diverse features from different filtered images.The feasibility of using the LBP-based texture feature to categorize the ultrasound images was demonstrated.The effectiveness of the proposed scheme is tested on 250 ultrasound images comprising 100 and 150 benign and malignant images,respectively.The proposed method achieved very high accuracy(98%),sensitivity(98%),and specificity(99%).As a result,the fusion process that can help achieve a powerful decision based on different features produced from different filtered images improved the results of the new descriptor of LBP features in terms of accuracy,sensitivity,and specificity.

Hierarchical particle filter tracking algorithm based on multi-feature fusion

A hierarchical particle filter（HPF） framework based on multi-feature fusion is proposed.The proposed HPF effectively uses different feature information to avoid the tracking failure based on the single feature in a complicated environment.In this approach,the Harris algorithm is introduced to detect the corner points of the object,and the corner matching algorithm based on singular value decomposition is used to compute the firstorder weights and make particles centralize in the high likelihood area.Then the local binary pattern（LBP） operator is used to build the observation model of the target based on the color and texture features,by which the second-order weights of particles and the accurate location of the target can be obtained.Moreover,a backstepping controller is proposed to complete the whole tracking system.Simulations and experiments are carried out,and the results show that the HPF algorithm with the backstepping controller achieves stable and accurate tracking with good robustness in complex environments.

An automated detection of glaucoma using histogram features

Glaucoma is a chronic and progressive optic neurodegenerative disease leading to vision deterioration and in most cases produce increased pressure within the eye. This is due to the backup of fluid in the eye; it causes damage to the optic nerve. Hence, early detection diagnosis and treatment of an eye help to prevent the loss of vision. In this paper, a novel method is proposed for the early detection of glaucoma using a combination of magnitude and phase features from the digital fundus images. Local binary patterns(LBP) and Daugman’s algorithm are used to perform the feature set extraction.The histogram features are computed for both the magnitude and phase components. The Euclidean distance between the feature vectors are analyzed to predict glaucoma. The performance of the proposed method is compared with the higher order spectra(HOS)features in terms of sensitivity, specificity, classification accuracy and execution time. The proposed system results 95.45% output for sensitivity, specificity and classification. Also, the execution time for the proposed method takes lesser time than the existing method which is based on HOS features. Hence, the proposed system is accurate, reliable and robust than the existing approach to predict the glaucoma features.

Product Image Classification Based on Fusion Features

Two key challenges raised by a product images classification system are classification precision and classification time. In some categories, classification precision of the latest techniques, in the product images classification system, is still low. In this paper, we propose a local texture descriptor termed fan refined local binary pattern, which captures more detailed information by integrating the spatial distribution into the local binary pattern feature. We compare our approach with different methods on a subset of product images on Amazon/e Bay and parts of PI100 and experimental results have demonstrated that our proposed approach is superior to the current existing methods. The highest classification precision is increased by 21% and the average classification time is reduced by 2/3.

Enhanced Feature Fusion Segmentation for Tumor Detection Using Intelligent Techniques

In thefield of diagnosis of medical images the challenge lies in tracking and identifying the defective cells and the extent of the defective region within the complex structure of a brain cavity.Locating the defective cells precisely during the diagnosis phase helps tofight the greatest exterminator of mankind.Early detec-tion of these defective cells requires an accurate computer-aided diagnostic system(CAD)that supports early treatment and promotes survival rates of patients.An ear-lier version of CAD systems relies greatly on the expertise of radiologist and it con-sumed more time to identify the defective region.The manuscript takes the efficacy of coalescing features like intensity,shape,and texture of the magnetic resonance image(MRI).In the Enhanced Feature Fusion Segmentation based classification method(EEFS)the image is enhanced and segmented to extract the prominent fea-tures.To bring out the desired effect the EEFS method uses Enhanced Local Binary Pattern(EnLBP),Partisan Gray Level Co-occurrence Matrix Histogram of Oriented Gradients(PGLCMHOG),and iGrab cut method to segment image.These prominent features along with deep features are coalesced to provide a single-dimensional fea-ture vector that is effectively used for prediction.The coalesced vector is used with the existing classifiers to compare the results of these classifiers with that of the gen-erated vector.The generated vector provides promising results with commendably less computatio nal time for pre-processing and classification of MR medical images.

一种基于LC-BoVW模型的建筑垃圾物料识别算法

针对建筑垃圾物料的种类多、形貌易混淆等问题,构建了一种基于局部约束的视觉词袋(local constraint-bag of visual words,LC-BoVW)模型的建筑垃圾物料识别算法。首先,对建筑垃圾物料图像分块,分别提取局部颜色特征和局部二值模式特征;考虑到图像分块特征的局部相似特性,构建LC-BoVW模型分别对目标图像的显著特征进行统计。然后,基于信息融合思想对特征统计量进行融合,形成图像的判别性特征并输入到分类器中进行物料的精确识别。最后,利用自建的5类建筑垃圾物料图像数据集进行实验,实验结果表明,所提算法能够快速有效地实现建筑垃圾物料识别,平均识别准确率可达到97.92%。

基于多频特征和纹理增强的轻量化图像超分辨率重建

现有基于卷积神经网络主要关注图像重构的精度,忽略了过度参数化、特征提取不充分以及计算资源浪费等问题。针对上述问题,提出了一种轻量级多频率特征提取网络(MFEN),设计了轻量化晶格信息交互结构,利用通道分割和多模式卷积组合减少参数量;通过分离图像的低频、中频以及高频率信息后进行特征异构提取,提高网络的表达能力和特征区分性,使其更注重纹理细节特征的复原,并合理分配计算资源。此外,在网络内部融合局部二值模式(LBP)算法用于增强网络对纹理感知的敏感度,旨在进一步提高网络对细节的提取能力。经验证,该方法在复杂度和性能之间取得了良好的权衡,即实现轻量有效提取图像特征的同时重建出高分辨率图像。在Set5数据集上的2倍放大实验结果最终表明,相比较于基于卷积神经网络的图像超分辨率经典算法(SRCNN)和较新算法(MADNet),所提方法的峰值信噪比(PSNR)分别提升了1.31 dB和0.12 dB,参数量相比MADNet减少了55%。

Face recognition by decision fusion of two-dimensional linear discriminant analysis and local binary pattern

To investigate the robustness of face recognition algorithms under the complicated variations of illumination, facial expression and posture, the advantages and disadvantages of seven typical algorithms on extracting global and local features are studied through the experiments respectively on the Olivetti Research Laboratory database and the other three databases （the three subsets of illumination, expression and posture that are constructed by selecting images from several existing face databases）. By taking the above experimental results into consideration, two schemes of face recognition which are based on the decision fusion of the twodimensional linear discriminant analysis （2DLDA） and local binary pattern （LBP） are proposed in this paper to heighten the recognition rates. In addition, partitioning a face nonuniformly for its LBP histograms is conducted to improve the performance. Our experimental results have shown the complementarities of the two kinds of features, the 2DLDA and LBP, and have verified the effectiveness of the proposed fusion algorithms.

Foliar fungal disease classification in banana plants using elliptical local binary pattern on multiresolution dual tree complex wavelet transform domain

The fungal diseases in banana cause major yield losses for millions of farmers around the globe.Early detection of these diseases helps the farmers to devise successful management strategies.The characteristic leaf blade discoloration pattern at the earlier stages of infection could be used to understand the onset of each disease.This paper demonstrates a methodology for classification of three important foliar diseases in banana,using local texture features.The disease affected regions are identified using image enhancement and color segmentation.Segmented images are converted to transform domain using three image transforms(DWT,DTCWT and Ranklet transform).Feature vector is extracted from transform domain images using LBP and its variants(ELBP,MeanELBP and MedianELBP).These texture based features are applied to five popular image classifiers and comparative performance analysis is done using ten-fold cross validation procedure.Experimental results showed best classification performance for ELBP features extracted from DTCWT domain(accuracy 95.4%,precision 93.2%,sensitivity 93.0%,Fscore 93.0%and specificity 96.4%).Compared with traditional methods of feature extraction,this novel method of fusing DTCWT with ELBP features has attained high degree of accuracy in precisely detecting and classifying fungal diseases in banana at an early stage.

基于信息熵的二维局部二值模式静脉识别

基于现有LBP算法及其变体无法提取图像高维特征的问题,提出一种基于信息熵的二维局部二值模式识别算法。此方法首先利用统一局部二值模式(ULBP)对图像进行低维特征的提取,随后将图像信息熵与统一局部二值模式图谱进行结合获取熵值加权的统一局部二值模式图谱(EULBP),并利用滑动窗口实现对局部区域内模式间共现特征信息的统计,以其结果作为图像特征表达。并以直方图交叉距离为基础构建模式分类器,验证其识别性能。实验结果表明,在SDUMLA⁃HMT数据集以及马来西亚理工大学指静脉数据集(FV⁃USM)中,提出的算法能取得99.94%和98.84%的平均识别率。

局部二值模式方法研究与展望

针对当前局部二值模式(Local binary pattern,LBP)方法表现出的理论和实际应用价值,系统综述了在纹理分析和分类、人脸分析和识别以及其他检测与应用中的各种LBP方法.首先,简要概述了LBP方法的原理,主要分析了LBP方法中的阈值操作并介绍了统一模式和旋转不变性模式.其次,分别对纹理分析和分类中的LBP方法、人脸分析和识别中的LBP方法以及其他检测与应用中的LBP方法等三个方面进行了详细的梳理和评述.最后,分析了LBP方法在应用中依旧存在的重要问题并指出了未来的研究方向.

面向语音情感识别的语谱图特征提取算法

为研究信号相关性在语音情感识别中的作用,提出了一种面向语音情感识别的语谱图特征提取算法.首先,对语谱图进行处理,得到归一化后的语谱图灰度图像;然后,计算不同尺度、不同方向的Gabor图谱,并采用局部二值模式提取Gabor图谱的纹理特征;最后,将不同尺度、不同方向Gabor图谱提取到的局部二值模式特征进行级联,作为一种新的语音情感特征进行情感识别.柏林库(EMO-DB)及FAU Ai Bo库上的实验结果表明:与已有的韵律、频域、音质特征相比,所提特征的识别率提升3%以上;与声学特征融合后,所提特征的识别率较早期声学特征至少提高5%.因此,利用这种新的语音情感特征可以有效识别不同种类的情感语音.