Classification of Gastric Lesions Using Gabor Block Local Binary Patterns

The identification of cancer tissues in Gastroenterology imaging poses novel challenges to the computer vision community in designing generic decision support systems.This generic nature demands the image descriptors to be invariant to illumination gradients,scaling,homogeneous illumination,and rotation.In this article,we devise a novel feature extraction methodology,which explores the effectiveness of Gabor filters coupled with Block Local Binary Patterns in designing such descriptors.We effectively exploit the illumination invariance properties of Block Local Binary Patterns and the inherent capability of convolutional neural networks to construct novel rotation,scale and illumination invariant features.The invariance characteristics of the proposed Gabor Block Local Binary Patterns(GBLBP)are demonstrated using a publicly available texture dataset.We use the proposed feature extraction methodology to extract texture features from Chromoendoscopy(CH)images for the classification of cancer lesions.The proposed feature set is later used in conjuncture with convolutional neural networks to classify the CH images.The proposed convolutional neural network is a shallow network comprising of fewer parameters in contrast to other state-of-the-art networks exhibiting millions of parameters required for effective training.The obtained results reveal that the proposed GBLBP performs favorably to several other state-of-the-art methods including both hand crafted and convolutional neural networks-based features.

Vehicle detection algorithm based on codebook and local binary patterns algorithms

Detecting the moving vehicles in jittering traffic scenes is a very difficult problem because of the complex environment.Only by the color features of the pixel or only by the texture features of image cannot establish a suitable background model for the moving vehicles. In order to solve this problem, the Gaussian pyramid layered algorithm is proposed, combining with the advantages of the Codebook algorithm and the Local binary patterns(LBP) algorithm. Firstly, the image pyramid is established to eliminate the noises generated by the camera shake. Then, codebook model and LBP model are constructed on the low-resolution level and the high-resolution level of Gaussian pyramid, respectively. At last, the final test results are obtained through a set of operations according to the spatial relations of pixels. The experimental results show that this algorithm can not only eliminate the noises effectively, but also save the calculating time with high detection sensitivity and high detection accuracy.

Defocus Blur Segmentation Using Local Binary Patterns with Adaptive Threshold

Enormousmethods have been proposed for the detection and segmentation of blur and non-blur regions of the images.Due to the limited available information about blur type,scenario and the level of blurriness,detection and segmentation is a challenging task.Hence,the performance of the blur measure operator is an essential factor and needs improvement to attain perfection.In this paper,we propose an effective blur measure based on local binary pattern(LBP)with adaptive threshold for blur detection.The sharpness metric developed based on LBP used a fixed threshold irrespective of the type and level of blur,that may not be suitable for images with variations in imaging conditions,blur amount and type.Contrarily,the proposed measure uses an adaptive threshold for each input image based on the image and blur properties to generate improved sharpness metric.The adaptive threshold is computed based on the model learned through support vector machine(SVM).The performance of the proposed method is evaluated using two different datasets and is compared with five state-of-the-art methods.Comparative analysis reveals that the proposed method performs significantly better qualitatively and quantitatively against all of the compared methods.

Local Binary Patterns and Its Variants for Finger Knuckle Print Recognition in Multi-Resolution Domain

Finger Knuckle Print biometric plays a vital role in establishing security for real-time environments. The success of human authentication depends on high speed and accuracy. This paper proposed an integrated approach of personal authentication using texture based Finger Knuckle Print (FKP) recognition in multiresolution domain. FKP images are rich in texture patterns. Recently, many texture patterns are proposed for biometric feature extraction. Hence, it is essential to review whether Local Binary Patterns or its variants perform well for FKP recognition. In this paper, Local Directional Pattern (LDP), Local Derivative Ternary Pattern (LDTP) and Local Texture Description Framework based Modified Local Directional Pattern (LTDF_MLDN) based feature extraction in multiresolution domain are experimented with Nearest Neighbor and Extreme Learning Machine (ELM) Classifier for FKP recognition. Experiments were conducted on PolYU database. The result shows that LDTP in Contourlet domain achieves a promising performance. It also proves that Soft classifier performs better than the hard classifier.

Local binary pattern-based reversible data hiding

A novel local binary pattern-based reversible data hiding(LBP-RDH)technique has been suggested to maintain a fair symmetry between the perceptual transparency and hiding capacity.During embedding,the image is divided into various 3×3 blocks.Then,using the LBP-based image descriptor,the LBP codes for each block are computed.Next,the obtained LBP codes are XORed with the embedding bits and are concealed in the respective blocks using the proposed pixel readjustment process.Further,each cover image(CI)pixel produces two different stego-image pixels.Likewise,during extraction,the CI pixels are restored without the loss of a single bit of information.The outcome of the proposed technique with respect to perceptual transparency measures,such as peak signal-to-noise ratio and structural similarity index,is found to be superior to that of some of the recent and state-of-the-art techniques.In addition,the proposed technique has shown excellent resilience to various stego-attacks,such as pixel difference histogram as well as regular and singular analysis.Besides,the out-off boundary pixel problem,which endures in most of the contemporary data hiding techniques,has been successfully addressed.

A Novel Tracking-by-Detection Method with Local Binary Pattern and Kalman Filter

Tracking-Learning-Detection( TLD) is an adaptive tracking algorithm,which tracks by learning the appearance of the object as the video progresses and shows a good performance in long-term tracking task.But our experiments show that under some scenarios,such as non-uniform illumination changing,serious occlusion,or motion-blurred,it may fails to track the object. In this paper,to surmount some of these shortages,especially for the non-uniform illumination changing,and give full play to the performance of the tracking-learning-detection framework, we integrate the local binary pattern( LBP) with the cascade classifiers,and define a new classifier named ULBP( Uniform Local Binary Pattern) classifiers. When the object appearance has rich texture features,the ULBP classifier will work instead of the nearest neighbor classifier in TLD algorithm,and a recognition module is designed to choose the suitable classifier between the original nearest neighbor( NN) classifier and the ULBP classifier. To further decrease the computing load of the proposed tracking approach,Kalman filter is applied to predict the searching range of the tracking object.A comprehensive study has been conducted to confirm the effectiveness of the proposed algorithm (TLD _ULBP),and different multi-property datasets were used. The quantitative evaluations show a significant improvement over the original TLD,especially in various lighting case.

An Improved Real-Time Face Recognition System at Low Resolution Based on Local Binary Pattern Histogram Algorithm and CLAHE

This research presents an improved real-time face recognition system at a low resolution of 15 pixels with pose and emotion and resolution variations. We have designed our datasets named LRD200 and LRD100, which have been used for training and classification. The face detection part uses the Viola-Jones algorithm, and the face recognition part receives the face image from the face detection part to process it using the Local Binary Pattern Histogram (LBPH) algorithm with preprocessing using contrast limited adaptive histogram equalization (CLAHE) and face alignment. The face database in this system can be updated via our custom-built standalone android app and automatic restarting of the training and recognition process with an updated database. Using our proposed algorithm, a real-time face recognition accuracy of 78.40% at 15 px and 98.05% at 45 px have been achieved using the LRD200 database containing 200 images per person. With 100 images per person in the database (LRD100) the achieved accuracies are 60.60% at 15 px and 95% at 45 px respectively. A facial deflection of about 30° on either side from the front face showed an average face recognition precision of 72.25%-81.85%. This face recognition system can be employed for law enforcement purposes, where the surveillance camera captures a low-resolution image because of the distance of a person from the camera. It can also be used as a surveillance system in airports, bus stations, etc., to reduce the risk of possible criminal threats.

Novel similarity measures for face representation based on local binary pattern

The successful face recognition based on local binary pattern(LBP)relies on the effective extraction of LBP features and the inferring of similarity between the extracted features.In this paper,we focus on the latter and propose two novel similarity measures for the local matching methods and the holistic matching methods respectively.One is Earth Mover's Distance with Hamming and Lp ground distance(EMD-HammingLp),which is a cross-bin dissimilarity measure for LBP histograms.The other is IMage Hamming Distance(IMHD),which is a dissimilarity measure for the whole LBP images.Experiments on FERET database show that the proposed two similarity measures outperform the state-of-the-art Chi-square similarity measure for extraction of LBP features.

A Local Binary Pattern-Based Method for Color and Multicomponent Texture Analysis

Local Binary Patterns (LBPs) have been highly used in texture classification for their robustness, their ease of implementation and their low computational cost. Initially designed to deal with gray level images, several methods based on them in the literature have been proposed for images having more than one spectral band. To achieve it, whether assumption using color information or combining spectral band two by two was done. Those methods use micro structures as texture features. In this paper, our goal was to design texture features which are relevant to color and multicomponent texture analysis without any assumption. Based on methods designed for gray scale images, we find the combination of micro and macro structures efficient for multispectral texture analysis. The experimentations were carried out on color images from Outex databases and multicomponent images from red blood cells captured using a multispectral microscope equipped with 13 LEDs ranging from 375 nm to 940 nm. In all achieved experimentations, our proposal presents the best classification scores compared to common multicomponent LBP methods. 99.81%, 100.00%, 99.07% and 97.67% are maximum scores obtained with our strategy respectively applied to images subject to rotation, blur, illumination variation and the multicomponent ones.

Android Malware Detection Using Local Binary Pattern and Principal Component Analysis

Nowadays,analysis methods based on big data have been widely used in malicious software detection.Since Android has become the dominator of smartphone operating system market,the number of Android malicious applications are increasing rapidly as well,which attracts attention of malware attackers and researchers alike.Due to the endless evolution of the malware,it is critical to apply the analysis methods based on machine learning to detect malwares and stop them from leakaging our privacy information.In this paper,we propose a novel Android malware detection method based on binary texture feature recognition by Local Binary Pattern and Principal Component Analysis,which can visualize malware and detect malware accurately.Also,our method analyzes malware binary directly without any decompiler,sandbox or virtual machines,which avoid time and resource consumption caused by decompiler or monitor in this process.Experimentation on 5127 benigns and 5560 malwares shows that we obtain a detection accuracy of 90%.

Palmprint Recognition Based on Statistical Local Binary Orientation Code

A novel coding based method named as local binary orientation code （LBOCode） for palmprint recognition is proposed. The palmprint image is firstly convolved with a bank of Gabor filters, and then the orientation information is attained with a winner-take-all rule. Subsequently, the resulting orientation mapping array is operated by uniform local binary pattern. Accordingly, LBOCode image is achieved which contains palmprint orientation information in pixel level. Further we divide the LBOCode image into several equal-size and nonoverlapping regions, and extract the statistical code histogram from each region independently, which builds a global description of palmprint in regional level. In matching stage, the matching score between two palmprints is achieved by calculating the two spatial enhanced histograms＇ dissimilarity, which brings the benefit of computational simplicity. Experimental results demonstrate that the proposed method achieves more promising recognition performance compared with that of several state-of-the-art methods.

基于多频特征和纹理增强的轻量化图像超分辨率重建

现有基于卷积神经网络主要关注图像重构的精度,忽略了过度参数化、特征提取不充分以及计算资源浪费等问题。针对上述问题,提出了一种轻量级多频率特征提取网络(MFEN),设计了轻量化晶格信息交互结构,利用通道分割和多模式卷积组合减少参数量;通过分离图像的低频、中频以及高频率信息后进行特征异构提取,提高网络的表达能力和特征区分性,使其更注重纹理细节特征的复原,并合理分配计算资源。此外,在网络内部融合局部二值模式(LBP)算法用于增强网络对纹理感知的敏感度,旨在进一步提高网络对细节的提取能力。经验证,该方法在复杂度和性能之间取得了良好的权衡,即实现轻量有效提取图像特征的同时重建出高分辨率图像。在Set5数据集上的2倍放大实验结果最终表明,相比较于基于卷积神经网络的图像超分辨率经典算法(SRCNN)和较新算法(MADNet),所提方法的峰值信噪比(PSNR)分别提升了1.31 dB和0.12 dB,参数量相比MADNet减少了55%。

基于局部二值模式及其变形的场景分类综合实验设计与实践

以学生为中心,兴趣为导向,解决问题为目标,采取基于问题的教学方法,以基于局部二值模式及其变形特征的场景分类为例,设计与教学大纲紧密结合、有效支撑课程目标的综合实验。在教师的主导下,学生以团队协作方式完成综合实验,串联计算机视觉与图像处理课程的重点知识,训练分析问题、解决问题的能力,切身感受解决问题的过程,提升实践与创业创新能力。

基于LBP和注意力机制的改进VGG网络的人脸表情识别方法

为了提高训练速度和人脸表情识别效果,提出一种基于局部二值模式(Local Binary Pattern,LBP)和注意力机制的改进视觉几何群网络(Visual Geometry Group Network,VGG网络)的人脸表情识别方法。首先,通过LBP获取数据集的纹理特征。其次,利用全局平均池化层代替全连接层,并在基准模型卷积层后和全局平均池化层前引入注意力模块,创建新网络模型NEW-VGG;通过对NEW-VGG做消融实验,验证模型改进的正确性。最后,融合LBP+NEW-VGG模型对CK+和Fer2013两种数据集进行10倍交叉验证,取得了97.98%和76.75%的识别率。实验结果表明,该方法不仅能加快网络训练迭代速度,增强人脸表情识别效果,还具有较强的鲁棒性。

基于特征提取和图像分类的螺旋网疵点自动检测

为了解决当前螺旋网人工疵点检测效率低、误检率高等问题,提出了一种基于分类思想的螺旋网疵点检测方法。对螺旋网图像提取多模式多尺度的LBP特征,充分表征螺旋网图像的信息,通过构建支持向量机(Support vector machine,SVM)分类器实现螺旋网疵点自动检测。结果表明:对于螺旋网疵点图像的局部二值模式(Local binary pattern,LBP)特征,采样半径为2,采样点个数为8时的均匀模式LBP的分类准确率优于其他模式和尺度的LBP,达到了100%,检测速度为0.48 s/张。通过对比不同的特征提取方法和分类器,验证了该文方法对于螺旋网疵点自动检测的适用性,可以实现纺织企业中螺旋网的自动化检测。

基于机器学习的电弧行为识别与特征分析

电弧熔丝增材制造过程中电弧行为是影响零件成形精度及质量的关键因素之一,针对电弧熔丝增材制造过程中电弧无振荡、摇摆振荡以及圆周振荡3种电弧状态的监测图像,提出一种基于局部二值模式(local binary pattern,LBP)与GoogLeNet神经网络结合识别电弧模式的新方法.结果表明,通过局部二值模式获取电弧形态图像中的纹理特征,然后建立GoogLeNet神经网络模型,相比于直接对原始图像进行神经网络的训练,该方法可有效识别电弧长度、宽度以及左右最大倾角随堆积层数的变化规律,从而精准判别电弧所属状态.针对常规存在熔池、熔滴以及复杂背景等因素干扰的电弧形态图像,该方法处理后可获得更清晰的电弧边缘轮廓,更有利于将熔池、熔滴和电弧的形态边界进行划分,最终的状态识别准确率可达99.50%,为电弧熔丝增材制造过程中的电弧状态监测提供理论参考.

中国象棋自动打谱方法研究

针对现存象棋打谱方式繁琐、成本较高的问题,提出了一种基于机器视觉的象棋自动打谱方法。对图像进行预处理后,首先结合二值化与连通区域搜索进行人手遮挡检测,随后采用Hough圆检测、字符矩阵等方法对棋子进行定位,接着将棋子分为红黑两方,并利用局部二进制模式直方图(local binary pattern histogram,LBPH)算法实现棋种识别,最后通过动态识别棋子移动路径,根据行棋规则生成着法。选取50局象棋比赛录像进行测试,结果表明,该方法在识别准确率达到99%的前提下,1 s内可对5帧图像进行处理与识别,且对50个视频识别得到的棋谱正确率均为100%,可以完全满足各类型对局的打谱需求。

基于信息熵的二维局部二值模式静脉识别

基于现有LBP算法及其变体无法提取图像高维特征的问题,提出一种基于信息熵的二维局部二值模式识别算法。此方法首先利用统一局部二值模式(ULBP)对图像进行低维特征的提取,随后将图像信息熵与统一局部二值模式图谱进行结合获取熵值加权的统一局部二值模式图谱(EULBP),并利用滑动窗口实现对局部区域内模式间共现特征信息的统计,以其结果作为图像特征表达。并以直方图交叉距离为基础构建模式分类器,验证其识别性能。实验结果表明,在SDUMLA⁃HMT数据集以及马来西亚理工大学指静脉数据集(FV⁃USM)中,提出的算法能取得99.94%和98.84%的平均识别率。

Exploiting global and local features for image retrieval

Two lines of image representation based on multiple features fusion demonstrate excellent performance in image retrieval.However,there are some problems in both of them:1)the methods defining directly texture in color space put more emphasis on color than texture feature;2)the methods extract several features respectively and combine them into a vector,in which bad features may lead to worse performance after combining directly good and bad features.To address the problems above,a novel hybrid framework for color image retrieval through combination of local and global features achieves higher retrieval precision.The bag-of-visual words(BoW)models and color intensity-based local difference patterns(CILDP)are exploited to capture local and global features of an image.The proposed fusion framework combines the ranking results of BoW and CILDP through graph-based density method.The performance of our proposed framework in terms of average precision on Corel-1K database is86.26%,and it improves the average precision by approximately6.68%and12.53%over CILDP and BoW,respectively.Extensive experiments on different databases demonstrate the effectiveness of the proposed framework for image retrieval.

球形全景核线约束的颜色不变量综合特征快速匹配方法

针对目前立体全景模型量测应用中特征匹配自动化程度偏低的问题,提出一种基于立体球形全景约束的颜色不变量综合特征快速匹配方法.首先,通过核线约束,使全景影像匹配的搜索范围从二维限制到一维带状缓冲区域;然后利用颜色不变量相关系数进一步确定精细搜索范围;最后,基于颜色不变量及旋转不变纹理特征构建综合匹配测度模型,以实现全景特征匹配.通过实地拍摄的全景图像,与灰度匹配法、SIFT,SURF以及CSIFT进行比较分析.实验结果表明,该方法匹配准确率提高了近10%,可消减球形全景特征的误匹配,有效地解决影像匹配时同名像点自动寻找与几何信息快速解算,为全景量测模型二次采样、量测及深度图的生成奠定基础.