Local binary pattern-based reversible data hiding

A novel local binary pattern-based reversible data hiding(LBP-RDH)technique has been suggested to maintain a fair symmetry between the perceptual transparency and hiding capacity.During embedding,the image is divided into various 3×3 blocks.Then,using the LBP-based image descriptor,the LBP codes for each block are computed.Next,the obtained LBP codes are XORed with the embedding bits and are concealed in the respective blocks using the proposed pixel readjustment process.Further,each cover image(CI)pixel produces two different stego-image pixels.Likewise,during extraction,the CI pixels are restored without the loss of a single bit of information.The outcome of the proposed technique with respect to perceptual transparency measures,such as peak signal-to-noise ratio and structural similarity index,is found to be superior to that of some of the recent and state-of-the-art techniques.In addition,the proposed technique has shown excellent resilience to various stego-attacks,such as pixel difference histogram as well as regular and singular analysis.Besides,the out-off boundary pixel problem,which endures in most of the contemporary data hiding techniques,has been successfully addressed.

Vehicle detection algorithm based on codebook and local binary patterns algorithms

Detecting the moving vehicles in jittering traffic scenes is a very difficult problem because of the complex environment.Only by the color features of the pixel or only by the texture features of image cannot establish a suitable background model for the moving vehicles. In order to solve this problem, the Gaussian pyramid layered algorithm is proposed, combining with the advantages of the Codebook algorithm and the Local binary patterns(LBP) algorithm. Firstly, the image pyramid is established to eliminate the noises generated by the camera shake. Then, codebook model and LBP model are constructed on the low-resolution level and the high-resolution level of Gaussian pyramid, respectively. At last, the final test results are obtained through a set of operations according to the spatial relations of pixels. The experimental results show that this algorithm can not only eliminate the noises effectively, but also save the calculating time with high detection sensitivity and high detection accuracy.

Discrete Plane Segmentation and Estimation from a Point Cloud Using Local Geometric Patterns

This paper presents a method for segmenting a 3D point cloud into planar surfaces using recently obtained discretegeometry results. In discrete geometry, a discrete plane is defined as a set of grid points lying between two parallel planes with a small distance, called thickness. In contrast to the continuous case, there exist a finite number of local geometric patterns （LGPs） appearing on discrete planes. Moreover, such an LGP does not possess the unique normal vector but a set of normal vectors. By using those LGP properties, we first reject non-linear points from a point cloud, and then classify non-rejected points whose LGPs have common normal vectors into a planar-surface-point set. From each segmented point set, we also estimate the values of parameters of a discrete plane by minimizing its thickness.

Defocus Blur Segmentation Using Local Binary Patterns with Adaptive Threshold

Enormousmethods have been proposed for the detection and segmentation of blur and non-blur regions of the images.Due to the limited available information about blur type,scenario and the level of blurriness,detection and segmentation is a challenging task.Hence,the performance of the blur measure operator is an essential factor and needs improvement to attain perfection.In this paper,we propose an effective blur measure based on local binary pattern(LBP)with adaptive threshold for blur detection.The sharpness metric developed based on LBP used a fixed threshold irrespective of the type and level of blur,that may not be suitable for images with variations in imaging conditions,blur amount and type.Contrarily,the proposed measure uses an adaptive threshold for each input image based on the image and blur properties to generate improved sharpness metric.The adaptive threshold is computed based on the model learned through support vector machine(SVM).The performance of the proposed method is evaluated using two different datasets and is compared with five state-of-the-art methods.Comparative analysis reveals that the proposed method performs significantly better qualitatively and quantitatively against all of the compared methods.

A Novel Tracking-by-Detection Method with Local Binary Pattern and Kalman Filter

Tracking-Learning-Detection( TLD) is an adaptive tracking algorithm,which tracks by learning the appearance of the object as the video progresses and shows a good performance in long-term tracking task.But our experiments show that under some scenarios,such as non-uniform illumination changing,serious occlusion,or motion-blurred,it may fails to track the object. In this paper,to surmount some of these shortages,especially for the non-uniform illumination changing,and give full play to the performance of the tracking-learning-detection framework, we integrate the local binary pattern( LBP) with the cascade classifiers,and define a new classifier named ULBP( Uniform Local Binary Pattern) classifiers. When the object appearance has rich texture features,the ULBP classifier will work instead of the nearest neighbor classifier in TLD algorithm,and a recognition module is designed to choose the suitable classifier between the original nearest neighbor( NN) classifier and the ULBP classifier. To further decrease the computing load of the proposed tracking approach,Kalman filter is applied to predict the searching range of the tracking object.A comprehensive study has been conducted to confirm the effectiveness of the proposed algorithm (TLD _ULBP),and different multi-property datasets were used. The quantitative evaluations show a significant improvement over the original TLD,especially in various lighting case.

Changes of local agricultural landscape patterns induced by land consolidation in hilly and mountainous Southwestern China

Land consolidation (LC), as a type of human disturbance, improves land production efficiency and changes landscape distribution through land parcel reallocation. The objective of this study was to comparatively analyze the changes of landscape patches before and after a land consolidation project (LCP) and the effects of land levelling, irrigation and drainage work and road engineering on the landscape structure. FRAGSTAT3.3 and buffer zone analysis were used to investigate those changes. The results suggest that the heterogeneity of landscape depressed, and tended to simplification after LC. Dry land was the most highly variable land use pattern, and the change of forestland was least due to its locations at a gradient larger than 25°. LC resulted in a more rational use of land, and could be an important step in promoting rural development in depressed and fragmented agricultural areas through unused land exploitation, small-patch combination, irrigation and water conservancy, and road construction. Land levelling leveled off the gradient field surface and decreased the slope. The fragmentized patches were much more incorporated with increasing slope. On the other hand, the ridge of a field became longer so that the length of field surface and area of patch were increased. Land levelling regulated, simplified and combined patches, so that the complexity degree was reduced. It is found that the buffer distance of 35 m was a turning point of human disturbance by irrigation and drainage systems, and patches presented flaky distribution when the buffer distance was smaller than 35 m. Meanwhile, the distance range between 25 m to 50 m was an impressible area for road engineering, which was sensitive to human actions, and the changes of all landscape metrics were larger than those in other buffer zones. In general, LC not only reallocated fragmented parcels, but also improved agricultural conditions.

An Improved Real-Time Face Recognition System at Low Resolution Based on Local Binary Pattern Histogram Algorithm and CLAHE

This research presents an improved real-time face recognition system at a low resolution of 15 pixels with pose and emotion and resolution variations. We have designed our datasets named LRD200 and LRD100, which have been used for training and classification. The face detection part uses the Viola-Jones algorithm, and the face recognition part receives the face image from the face detection part to process it using the Local Binary Pattern Histogram (LBPH) algorithm with preprocessing using contrast limited adaptive histogram equalization (CLAHE) and face alignment. The face database in this system can be updated via our custom-built standalone android app and automatic restarting of the training and recognition process with an updated database. Using our proposed algorithm, a real-time face recognition accuracy of 78.40% at 15 px and 98.05% at 45 px have been achieved using the LRD200 database containing 200 images per person. With 100 images per person in the database (LRD100) the achieved accuracies are 60.60% at 15 px and 95% at 45 px respectively. A facial deflection of about 30° on either side from the front face showed an average face recognition precision of 72.25%-81.85%. This face recognition system can be employed for law enforcement purposes, where the surveillance camera captures a low-resolution image because of the distance of a person from the camera. It can also be used as a surveillance system in airports, bus stations, etc., to reduce the risk of possible criminal threats.

Local-Tetra-Patterns for Face Recognition Encoded on Spatial Pyramid Matching

Face recognition is a big challenge in the research field with a lot of problems like misalignment,illumination changes,pose variations,occlusion,and expressions.Providing a single solution to solve all these problems at a time is a challenging task.We have put some effort to provide a solution to solving all these issues by introducing a face recognition model based on local tetra patterns and spatial pyramid matching.The technique is based on a procedure where the input image is passed through an algorithm that extracts local features by using spatial pyramid matching andmax-pooling.Finally,the input image is recognized using a robust kernel representation method using extracted features.The qualitative and quantitative analysis of the proposed method is carried on benchmark image datasets.Experimental results showed that the proposed method performs better in terms of standard performance evaluation parameters as compared to state-of-the-art methods on AR,ORL,LFW,and FERET face recognition datasets.

Novel similarity measures for face representation based on local binary pattern

The successful face recognition based on local binary pattern(LBP)relies on the effective extraction of LBP features and the inferring of similarity between the extracted features.In this paper,we focus on the latter and propose two novel similarity measures for the local matching methods and the holistic matching methods respectively.One is Earth Mover's Distance with Hamming and Lp ground distance(EMD-HammingLp),which is a cross-bin dissimilarity measure for LBP histograms.The other is IMage Hamming Distance(IMHD),which is a dissimilarity measure for the whole LBP images.Experiments on FERET database show that the proposed two similarity measures outperform the state-of-the-art Chi-square similarity measure for extraction of LBP features.

Classification of Gastric Lesions Using Gabor Block Local Binary Patterns

The identification of cancer tissues in Gastroenterology imaging poses novel challenges to the computer vision community in designing generic decision support systems.This generic nature demands the image descriptors to be invariant to illumination gradients,scaling,homogeneous illumination,and rotation.In this article,we devise a novel feature extraction methodology,which explores the effectiveness of Gabor filters coupled with Block Local Binary Patterns in designing such descriptors.We effectively exploit the illumination invariance properties of Block Local Binary Patterns and the inherent capability of convolutional neural networks to construct novel rotation,scale and illumination invariant features.The invariance characteristics of the proposed Gabor Block Local Binary Patterns(GBLBP)are demonstrated using a publicly available texture dataset.We use the proposed feature extraction methodology to extract texture features from Chromoendoscopy(CH)images for the classification of cancer lesions.The proposed feature set is later used in conjuncture with convolutional neural networks to classify the CH images.The proposed convolutional neural network is a shallow network comprising of fewer parameters in contrast to other state-of-the-art networks exhibiting millions of parameters required for effective training.The obtained results reveal that the proposed GBLBP performs favorably to several other state-of-the-art methods including both hand crafted and convolutional neural networks-based features.

Remote Sensing Image Retrieval Based on 3D-Local Ternary Pattern(LTP)Features and Non-subsampled Shearlet Transform(NSST)Domain Statistical Features

With the increasing popularity of high-resolution remote sensing images,the remote sensing image retrieval(RSIR)has always been a topic of major issue.A combined,global non-subsampled shearlet transform(NSST)-domain statistical features(NSSTds)and local three dimensional local ternary pattern(3D-LTP)features,is proposed for high-resolution remote sensing images.We model the NSST image coefficients of detail subbands using 2-state laplacian mixture(LM)distribution and its three parameters are estimated using Expectation-Maximization(EM)algorithm.We also calculate the statistical parameters such as subband kurtosis and skewness from detail subbands along with mean and standard deviation calculated from approximation subband,and concatenate all of them with the 2-state LM parameters to describe the global features of the image.The various properties of NSST such as multiscale,localization and flexible directional sensitivity make it a suitable choice to provide an effective approximation of an image.In order to extract the dense local features,a new 3D-LTP is proposed where dimension reduction is performed via selection of‘uniform’patterns.The 3D-LTP is calculated from spatial RGB planes of the input image.The proposed inter-channel 3D-LTP not only exploits the local texture information but the color information is captured too.Finally,a fused feature representation(NSSTds-3DLTP)is proposed using new global(NSSTds)and local(3D-LTP)features to enhance the discriminativeness of features.The retrieval performance of proposed NSSTds-3DLTP features are tested on three challenging remote sensing image datasets such as WHU-RS19,Aerial Image Dataset(AID)and PatternNet in terms of mean average precision(MAP),average normalized modified retrieval rank(ANMRR)and precision-recall(P-R)graph.The experimental results are encouraging and the NSSTds-3DLTP features leads to superior retrieval performance compared to many well known existing descriptors such as Gabor RGB,Granulometry,local binary pattern(LBP),Fisher vector(FV),vector of locally aggregated descriptors(VLAD)and median robust extended local binary pattern(MRELBP).For WHU-RS19 dataset,in terms of{MAP,ANMRR},the NSSTds-3DLTP improves upon Gabor RGB,Granulometry,LBP,FV,VLAD and MRELBP descriptors by{41.93%,20.87%},{92.30%,32.68%},{86.14%,31.97%},{18.18%,15.22%},{8.96%,19.60%}and{15.60%,13.26%},respectively.For AID,in terms of{MAP,ANMRR},the NSSTds-3DLTP improves upon Gabor RGB,Granulometry,LBP,FV,VLAD and MRELBP descriptors by{152.60%,22.06%},{226.65%,25.08%},{185.03%,23.33%},{80.06%,12.16%},{50.58%,10.49%}and{62.34%,3.24%},respectively.For PatternNet,the NSSTds-3DLTP respectively improves upon Gabor RGB,Granulometry,LBP,FV,VLAD and MRELBP descriptors by{32.79%,10.34%},{141.30%,24.72%},{17.47%,10.34%},{83.20%,19.07%},{21.56%,3.60%},and{19.30%,0.48%}in terms of{MAP,ANMRR}.The moderate dimensionality of simple NSSTds-3DLTP allows the system to run in real-time.

A Local Binary Pattern-Based Method for Color and Multicomponent Texture Analysis

Local Binary Patterns (LBPs) have been highly used in texture classification for their robustness, their ease of implementation and their low computational cost. Initially designed to deal with gray level images, several methods based on them in the literature have been proposed for images having more than one spectral band. To achieve it, whether assumption using color information or combining spectral band two by two was done. Those methods use micro structures as texture features. In this paper, our goal was to design texture features which are relevant to color and multicomponent texture analysis without any assumption. Based on methods designed for gray scale images, we find the combination of micro and macro structures efficient for multispectral texture analysis. The experimentations were carried out on color images from Outex databases and multicomponent images from red blood cells captured using a multispectral microscope equipped with 13 LEDs ranging from 375 nm to 940 nm. In all achieved experimentations, our proposal presents the best classification scores compared to common multicomponent LBP methods. 99.81%, 100.00%, 99.07% and 97.67% are maximum scores obtained with our strategy respectively applied to images subject to rotation, blur, illumination variation and the multicomponent ones.

Local Binary Patterns and Its Variants for Finger Knuckle Print Recognition in Multi-Resolution Domain

Finger Knuckle Print biometric plays a vital role in establishing security for real-time environments. The success of human authentication depends on high speed and accuracy. This paper proposed an integrated approach of personal authentication using texture based Finger Knuckle Print (FKP) recognition in multiresolution domain. FKP images are rich in texture patterns. Recently, many texture patterns are proposed for biometric feature extraction. Hence, it is essential to review whether Local Binary Patterns or its variants perform well for FKP recognition. In this paper, Local Directional Pattern (LDP), Local Derivative Ternary Pattern (LDTP) and Local Texture Description Framework based Modified Local Directional Pattern (LTDF_MLDN) based feature extraction in multiresolution domain are experimented with Nearest Neighbor and Extreme Learning Machine (ELM) Classifier for FKP recognition. Experiments were conducted on PolYU database. The result shows that LDTP in Contourlet domain achieves a promising performance. It also proves that Soft classifier performs better than the hard classifier.

Automated detection and identification of white-backed planthoppers in paddy fields using image processing

A survey of the population densities of rice planthoppers is important for forecasting decisions and efficient control. Tra- ditional manual surveying of rice planthoppers is time-consuming, fatiguing, and subjective. A new three-layer detection method was proposed to detect and identify white-backed planthoppers （WBPHs, Sogatella furcifera （Horvath）） and their developmental stages using image processing. In the first two detection layers, we used an AdaBoost classifier that was trained on a histogram of oriented gradient （HOG） features and a support vector machine （SVM） classifier that was trained on Gabor and Local Binary Pattern （LBP） features to detect WBPHs and remove impurities. We achieved a detection rate of 85.6% and a false detection rate of 10.2%. In the third detection layer, a SVM classifier that was trained on the HOG features was used to identify the different developmental stages of the WBPHs, and we achieved an identification rate of 73.1%, a false identification rate of 23.3%, and a 5.6% false detection rate for the images without WBPHs. The proposed three-layer detection method is feasible and effective for the identification of different developmental stages of planthoppers on rice plants in paddy fields.

Local Flow Regime Transition Criteria of Gas-Liquid Two-phase Flow in Vertical Upward Tube with a Horizontal Rod

The upward multiphase cross flow and heat transfer in the vertical tube may occur in oil production and chemical facilities. In this study, the local flow patterns of an upward gas-water two phase cross flow in a vertical tube with a horizontal rod have been investigated with an optical probe and the digital high speed video system. The local flow patterns are defined as the bubble, slug, churn and annular flow patterns. Optical probe signals are ana- lyzed in terms of probability density function, and it is proved that the local flow patterns can be recognized by this method. The transition mechanisms between the different flow patterns have been analyzed and the corresponding transitional models are proposed. Finally, local flow pattern maps of the upward gas-water two-phase flow in the vertical tube with a horizontal rod are constructed.

Classification of traditional Chinese medicine constitution based on facial features in color images

Objective:To explore the possible correlation between traditional Chinese medicine(TCM)constitution and facial features in color images and to improve the accuracy of automated constitution classification.Methods:Color images were taken of 5150 individuals of different professions.Automated face detection and key point positioning were performed on the collected images,which were then transformed into a standard size.The relationship between facial features and TCM constitution based on the red,green,blue(RGB)pixel and the local binary pattern(LBP)texture features was explored.Results:The overall accuracy rate and robustness of TCM constitution classification based on RGB features were low.Classification results of the phlegm-dampness,damp-heat,blood stasis,and balance constitutions achieved high accuracy rates.Classification accuracy rate using the LBP texture feature was higher than that of the RGB feature,with the best accuracy observed for the balance constitution.Conclusion:Application of computer image acquisition and processing of facial features may serve as an adjunct to the TCM diagnostic method of inspection.

Face Recognition on Partial and Holistic LBP Features

An algorithm for face description and recognition based on multi-resolution with multi-scale local binary pattern （multi-LBP） features is proposed. The facial image pyramid is constructed and each facial image is divided into various regions from which partial and holistic local binary patter （LBP） histograms are extracted. All LBP features of each image are concatenated to a single LBP eigenvector with different resolutions. The dimensionaUty of LBP features is then reduced by a local margin alignment （LMA） algorithm based on manifold, which can preserve the between-class variance. Support vector machine （SVM） is applied to classify facial images. Extensive experiments on ORL and CMU face databases clearly show the superiority of the proposed scheme over some existed algorithms, especially on the robustness of the method against different facial expressions and postures of the subjects.

Exploiting global and local features for image retrieval

Two lines of image representation based on multiple features fusion demonstrate excellent performance in image retrieval.However,there are some problems in both of them:1)the methods defining directly texture in color space put more emphasis on color than texture feature;2)the methods extract several features respectively and combine them into a vector,in which bad features may lead to worse performance after combining directly good and bad features.To address the problems above,a novel hybrid framework for color image retrieval through combination of local and global features achieves higher retrieval precision.The bag-of-visual words(BoW)models and color intensity-based local difference patterns(CILDP)are exploited to capture local and global features of an image.The proposed fusion framework combines the ranking results of BoW and CILDP through graph-based density method.The performance of our proposed framework in terms of average precision on Corel-1K database is86.26%,and it improves the average precision by approximately6.68%and12.53%over CILDP and BoW,respectively.Extensive experiments on different databases demonstrate the effectiveness of the proposed framework for image retrieval.

Facial Expression Recognition Based on the Q-shift DT-CWT and Rotation Invariant LBP

In this paper, a novel method based on dual-tree complex wavelet transform(DT-CWT) and rotation invariant local binary pattern(LBP) for facial expression recognition is proposed. The quarter sample shift (Q-shift) DT-CWT can provide a group delay of 1/4 of a sample period, and satisfy the usual 2-band filter bank constraints of no aliasing and perfect reconstruction. To resolve illumination variation in expression verification, low-frequency coefficients produced by DT-CWT are set zeroes, high-frequency coefficients are used for reconstructing the image, and basic LBP histogram is mapped on the reconstructed image by means of histogram specification. LBP is capable of encoding texture and shape information of the preprocessed images. The histogram graphs built from multi-scale rotation invariant LBPs are combined to serve as feature for further recognition. Template matching is adopted to classify facial expressions for its simplicity. The experimental results show that the proposed approach has good performance in efficiency and accuracy.

An Efficient Detection Approach of Content Aware Image Resizing

Content aware image resizing(CAIR)is an excellent technology used widely for image retarget.It can also be used to tamper with images and bring the trust crisis of image content to the public.Once an image is processed by CAIR,the correlation of local neighborhood pixels will be destructive.Although local binary patterns(LBP)can effectively describe the local texture,it however cannot describe the magnitude information of local neighborhood pixels and is also vulnerable to noise.Therefore,to deal with the detection of CAIR,a novel forensic method based on improved local ternary patterns(ILTP)feature and gradient energy feature(GEF)is proposed in this paper.Firstly,the adaptive threshold of the original local ternary patterns(LTP)operator is improved,and the ILTP operator is used to describe the change of correlation among local neighborhood pixels caused by CAIR.Secondly,the histogram features of ILTP and the gradient energy features are extracted from the candidate image for CAIR forgery detection.Then,the ILTP features and the gradient energy features are concatenated into the combined features,and the combined features are used to train classifier.Finally support vector machine(SVM)is exploited as a classifier to be trained and tested by the above features in order to distinguish whether an image is subjected to CAIR or not.The candidate images are extracted from uncompressed color image database(UCID),then the training and testing sets are created.The experimental results with many test images show that the proposed method can detect CAIR tampering effectively,and that its performance is improved compared with other methods.It can achieve a better performance than the state-of-the-art approaches.