Feature Fusion Multi-View Hashing Based on Random Kernel Canonical Correlation Analysis

Hashing technology has the advantages of reducing data storage and improving the efficiency of the learning system,making it more and more widely used in image retrieval.Multi-view data describes image information more comprehensively than traditional methods using a single-view.How to use hashing to combine multi-view data for image retrieval is still a challenge.In this paper,a multi-view fusion hashing method based on RKCCA(Random Kernel Canonical Correlation Analysis)is proposed.In order to describe image content more accurately,we use deep learning dense convolutional network feature DenseNet to construct multi-view by combining GIST feature or BoW_SIFT(Bag-of-Words model+SIFT feature)feature.This algorithm uses RKCCA method to fuse multi-view features to construct association features and apply them to image retrieval.The algorithm generates binary hash code with minimal distortion error by designing quantization regularization terms.A large number of experiments on benchmark datasets show that this method is superior to other multi-view hashing methods.

A deep kernel method for lithofacies identification using conventional well logs

How to fit a properly nonlinear classification model from conventional well logs to lithofacies is a key problem for machine learning methods.Kernel methods(e.g.,KFD,SVM,MSVM)are effective attempts to solve this issue due to abilities of handling nonlinear features by kernel functions.Deep mining of log features indicating lithofacies still needs to be improved for kernel methods.Hence,this work employs deep neural networks to enhance the kernel principal component analysis(KPCA)method and proposes a deep kernel method(DKM)for lithofacies identification using well logs.DKM includes a feature extractor and a classifier.The feature extractor consists of a series of KPCA models arranged according to residual network structure.A gradient-free optimization method is introduced to automatically optimize parameters and structure in DKM,which can avoid complex tuning of parameters in models.To test the validation of the proposed DKM for lithofacies identification,an open-sourced dataset with seven con-ventional logs(GR,CAL,AC,DEN,CNL,LLD,and LLS)and lithofacies labels from the Daniudi Gas Field in China is used.There are eight lithofacies,namely clastic rocks(pebbly,coarse,medium,and fine sand-stone,siltstone,mudstone),coal,and carbonate rocks.The comparisons between DKM and three commonly used kernel methods(KFD,SVM,MSVM)show that(1)DKM(85.7%)outperforms SVM(77%),KFD(79.5%),and MSVM(82.8%)in accuracy of lithofacies identification;(2)DKM is about twice faster than the multi-kernel method(MSVM)with good accuracy.The blind well test in Well D13 indicates that compared with the other three methods DKM improves about 24%in accuracy,35%in precision,41%in recall,and 40%in F1 score,respectively.In general,DKM is an effective method for complex lithofacies identification.This work also discussed the optimal structure and classifier for DKM.Experimental re-sults show that(m_(1),m_(2),O)is the optimal model structure and linear svM is the optimal classifier.(m_(1),m_(2),O)means there are m KPCAs,and then m2 residual units.A workflow to determine an optimal classifier in DKM for lithofacies identification is proposed,too.

Comparison of Kernel Entropy Component Analysis with Several Dimensionality Reduction Methods

Dimensionality reduction techniques play an important role in data mining. Kernel entropy component analysis( KECA) is a newly developed method for data transformation and dimensionality reduction. This paper conducted a comparative study of KECA with other five dimensionality reduction methods,principal component analysis( PCA),kernel PCA( KPCA),locally linear embedding( LLE),laplacian eigenmaps( LAE) and diffusion maps( DM). Three quality assessment criteria, local continuity meta-criterion( LCMC),trustworthiness and continuity measure(T&C),and mean relative rank error( MRRE) are applied as direct performance indexes to assess those dimensionality reduction methods. Moreover,the clustering accuracy is used as an indirect performance index to evaluate the quality of the representative data gotten by those methods. The comparisons are performed on six datasets and the results are analyzed by Friedman test with the corresponding post-hoc tests. The results indicate that KECA shows an excellent performance in both quality assessment criteria and clustering accuracy assessing.

Kernel Factor Analysis Algorithm with Varimax

Kernal factor analysis （KFA） with vafimax was proposed by using Mercer kernel function which can map the data in the original space to a high-dimensional feature space, and was compared with the kernel principle component analysis （KPCA）. The results show that the best error rate in handwritten digit recognition by kernel factor analysis with vadmax （4.2%） was superior to KPCA （4.4%）. The KFA with varimax could more accurately image handwritten digit recognition.

Application of Particle Swarm Optimization to Fault Condition Recognition Based on Kernel Principal Component Analysis

Panicle swarm optimization （PSO） is an optimization algorithm based on the swarm intelligent principle. In this paper the modified PSO is applied to a kernel principal component analysis （ KPCA ） for an optimal kernel function parameter. We first comprehensively considered within-class scatter and between-class scatter of the sample features. Then, the fitness function of an optimized kernel function parameter is constructed, and the particle swarm optimization algorithm with adaptive acceleration （CPSO） is applied to optimizing it. It is used for gearbox condi- tion recognition, and the result is compared with the recognized results based on principal component analysis （PCA）. The results show that KPCA optimized by CPSO can effectively recognize fault conditions of the gearbox by reducing bind set-up of the kernel function parameter, and its results of fault recognition outperform those of PCA. We draw the conclusion that KPCA based on CPSO has an advantage in nonlinear feature extraction of mechanical failure, and is helpful for fault condition recognition of complicated machines.

Multi-state Information Dimension Reduction Based on Particle Swarm Optimization-Kernel Independent Component Analysis

The precision of the kernel independent component analysis( KICA) algorithm depends on the type and parameter values of kernel function. Therefore,it's of great significance to study the choice method of KICA's kernel parameters for improving its feature dimension reduction result. In this paper, a fitness function was established by use of the ideal of Fisher discrimination function firstly. Then the global optimal solution of fitness function was searched by particle swarm optimization( PSO) algorithm and a multi-state information dimension reduction algorithm based on PSO-KICA was established. Finally,the validity of this algorithm to enhance the precision of feature dimension reduction has been proven.

Theoretical convergence analysis of complex Gaussian kernel LMS algorithm

With the vigorous expansion of nonlinear adaptive filtering with real-valued kernel functions,its counterpart complex kernel adaptive filtering algorithms were also sequentially proposed to solve the complex-valued nonlinear problems arising in almost all real-world applications.This paper firstly presents two schemes of the complex Gaussian kernel-based adaptive filtering algorithms to illustrate their respective characteristics.Then the theoretical convergence behavior of the complex Gaussian kernel least mean square（LMS） algorithm is studied by using the fixed dictionary strategy.The simulation results demonstrate that the theoretical curves predicted by the derived analytical models consistently coincide with the Monte Carlo simulation results in both transient and steady-state stages for two introduced complex Gaussian kernel LMS algonthms using non-circular complex data.The analytical models are able to be regard as a theoretical tool evaluating ability and allow to compare with mean square error（MSE） performance among of complex kernel LMS（KLMS） methods according to the specified kernel bandwidth and the length of dictionary.

Improved Reliability Analysis Method Based on the Failure Assessment Diagram

With the uncertainties related to operating conditions,in-service non-destructive testing（NDT） measurements and material properties considered in the structural integrity assessment,probabilistic analysis based on the failure assessment diagram（FAD） approach has recently become an important concern.However,the point density revealing the probabilistic distribution characteristics of the assessment points is usually ignored.To obtain more detailed and direct knowledge from the reliability analysis,an improved probabilistic fracture mechanics（PFM） assessment method is proposed.By integrating 2D kernel density estimation（KDE） technology into the traditional probabilistic assessment,the probabilistic density of the randomly distributed assessment points is visualized in the assessment diagram.Moreover,a modified interval sensitivity analysis is implemented and compared with probabilistic sensitivity analysis.The improved reliability analysis method is applied to the assessment of a high pressure pipe containing an axial internal semi-elliptical surface crack.The results indicate that these two methods can give consistent sensitivities of input parameters,but the interval sensitivity analysis is computationally more efficient.Meanwhile,the point density distribution and its contour are plotted in the FAD,thereby better revealing the characteristics of PFM assessment.This study provides a powerful tool for the reliability analysis of critical structures.

Air Traffic Operation Complexity Analysis Based on Metrics System

In order to quantitatively analyze air traffic operation complexity,multidimensional metrics were selected based on the operational characteristics of traffic flow.The kernel principal component analysis method was utilized to reduce the dimensionality of metrics,therefore to extract crucial information in the metrics.The hierarchical clustering method was used to analyze the complexity of different airspace.Fourteen sectors of Guangzhou Area Control Center were taken as samples.The operation complexity of traffic situation in each sector was calculated based on real flight radar data.Clustering analysis verified the feasibility and rationality of the method,and provided a reference for airspace operation and management.

Color Estimation for Thermal Infrared Imagery Based on Kernel PCA and Sparse Representation

Adding colors to monochrome thermal infrared images can help observers understand the scenery better. A nonlinear color estimation method for single-band thermal infrared imagery based on kernel principal component analysis (KPCA) and sparse representation was proposed. Nonlinear features of infrared image were extracted using KPCA. The relationship between image features and chromatic values was learned using sparse representation and a color estimation model was obtained. The thermal infrared images can be rendered automatically using the color estimation model. The experimental results show that the proposed method can render infrared image with an accurate color appearance. The proposed idea can also be used in other color estimation problem.

Forest fire smoke recognition based on convolutional neural network

Traditional fire smoke detection methods mostly rely on manual algorithm extraction and sensor detection;however,these methods are slow and expensive to achieve discrimination.We proposed an improved convolutional neural network(CNN)to achieve fast analysis.The improved CNN can be used to liberate manpower.The network does not require complicated manual feature extraction to identify forest fire smoke.First,to alleviate the computational pressure and speed up the discrimination efficiency,kernel principal component analysis was performed on the experimental data set.To improve the robustness of the CNN and to avoid overfitting,optimization strategies were applied in multi-convolution kernels and batch normalization to improve loss functions.The experimental analysis shows that the CNN proposed in this study can learn the feature information automatically for smoke images in the early stages of fire automatically with a high recognition rate.As a result,the improved CNN enriches the theory of smoke discrimination in the early stages of a forest fire.

Robust Recommendation Algorithm Based on Kernel Principal Component Analysis and Fuzzy C-means Clustering

The existing recommendation algorithms have lower robustness in facing of shilling attacks. Considering this problem, we present a robust recommendation algorithm based on kernel principal component analysis and fuzzy c-means clustering. Firstly, we use kernel principal component analysis method to reduce the dimensionality of the original rating matrix, which can extract the effective features of users and items. Then, according to the dimension-reduced rating matrix and the high correlation characteristic between attack profiles, we use fuzzy c-means clustering method to cluster user profiles, which can realize the effective separation of genuine profiles and attack profiles. Finally, we construct an indicator function based on the attack detection results to decrease the influence of attack profiles on the recommendation, and incorporate it into the matrix factorization technology to design the corresponding robust recommendation algorithm. Experiment results indicate that the proposed algorithm is superior to the existing methods in both recommendation accuracy and robustness.

Fault detection for centrifugal chillers using a Kernel Entropy Component Analysis (KECA) method

Fault detection is beneficial for chiller routine operation management in building automation systems.Considering the limitations of traditional principal component analysis(PCA)algorithm for chiller fault detection,a so-called kernel entropy component analysis(KECA)method has been developed and the development results are reported in this paper.Unlike traditional PCA,in KECA,the feature extraction or dimensionality reduction is implemented in a new space,called kernel feature space.The new space is nonlinearly related to the input space.The data set in the kernel feature space is projected onto a principal component subspace constructed by the feature space principal axes determined by the maximum Rényi entropy rather than the top eigenvalues.The proposed KECA is more suitable to deal with nonlinear process without Gaussian assumption.Using the available experimental data from ASHRAE RP-1043,seven typical chiller faults were tested by the proposed KECA method,and the results were compared to that of PCA.Two statistics,i.e.T2 and squared prediction error(SPE),were employed for fault detection monitoring.The fault detection results showed that the proposed KECA method had a better performance in terms of a higher detection accuracy in comparison to the traditional PCA.For the seven typical faults,the fault detection ratios were over 55%,even at their corresponding least severity level when using the proposed KECA based chiller fault detection method.

Cycle temporal algorithm-based multivariate statistical methods for fault diagnosis in chemical processes

Multivariate statistical process monitoring methods are often used in chemical process fault diagnosis.In this article,(I)the cycle temporal algorithm(CTA)combined with the dynamic kernel principal component analysis(DKPCA)and the multiway dynamic kernel principal component analysis(MDKPCA)fault detection algorithms are proposed,which are used for continuous and batch process fault detections,respectively.In addition,(II)a fault variable identification model based on reconstructed-based contribution(RBC)model that paves the way for determining the cause of the fault are proposed.The proposed fault diagnosis model was applied to Tennessee Eastman(TE)process and penicillin fermentation process for fault diagnosis.And compare with other fault diagnosis methods.The results show that the proposed method has better detection effects than other methods.Finally,the reconstruction-based contribution(RBC)model method is used to accurately locate the root cause of the fault and determine the fault path.

Condition Identification Based on Vibration Measurements for Free Spanning Submarine Pipelines

Free spanning pipelines are suspended between two points on an uneven seaffoor. The variations of structural conditions, such as the changes in soil property, flow velocity, axial force and span length etc., directly affect working performance of the whole submarine pipeline system. But until now few researches have focused on condition identification for free span （CIFS）. A method to identify the operational conditions of free spanning submarine pipelines based on vibration measurements is proposed in this paper. Firstly, the ill-posedness of CIFS is analyzed in detail. Secondly, the framework for CIFS based on the nonlinear kernel discriminant analysis （KDA） is established. Thirdly, the internal structural characteristics of natural frequencies, normalized frequencies and frequency change ratios are studied. And then the condition feature vector for CIFS is extracted by use of the vibration measurements. Finally, the validity of the proposed approach is evaluated by a case study. The results demonstrate that the proposed approach can effectively identify each condition of free span when condition variation occurs even if under measurement noise. It is concluded that the proposed method is a promising tool for CIFS in real applications.

Forecasting Model of Photovoltaic Power Based on KPCA-MCS-DCNN

Accurate photovoltaic(PV)power prediction can effectively help the power sector to make rational energy planning and dispatching decisions,promote PV consumption,make full use of renewable energy and alleviate energy problems.To address this research objective,this paper proposes a prediction model based on kernel principal component analysis(KPCA),modified cuckoo search algorithm(MCS)and deep convolutional neural networks(DCNN).Firstly,KPCA is utilized to reduce the dimension of the feature,which aims to reduce the redundant input vectors.Then using MCS to optimize the parameters of DCNN.Finally,the photovoltaic power forecasting method of KPCA-MCS-DCNN is established.In order to verify the prediction performance of the proposed model,this paper selects a photovoltaic power station in China for example analysis.The results show that the new hybrid KPCA-MCS-DCNN model has higher prediction accuracy and better robustness.

Adaptive multiblock kernel principal component analysis for monitoring complex industrial processes

Multiblock kernel principal component analysis (MBKPCA) has been proposed to isolate the faults and avoid the high computation cost. However, MBKPCA is not available for dynamic processes. To solve this problem, recursive MBKPCA is proposed for monitoring large scale processes. In this paper, we present a new recursive MBKPCA (RMBKPCA) algorithm, where the adaptive technique is adopted for dynamic characteristics. The proposed algorithm reduces the high computation cost, and is suitable for online model updating in the feature space. The proposed algorithm was applied to an industrial process for adaptive monitoring and found to efficiently capture the time-varying and nonlinear relationship in the process variables.

Method and practice of deep favorable shale reservoirs prediction based on machine learning

A set of methods for predicting the favorable reservoir of deep shale gas based on machine learning is proposed through research of parameter correlation feature analysis principle, intelligent prediction method based on convolution neural network(CNN), and integrated fusion characterization method based on kernel principal component analysis(KPCA) nonlinear dimension reduction principle.(1) High-dimensional correlation characteristics of core and logging data are analyzed based on the Pearson correlation coefficient.(2) The nonlinear dimension reduction method of KPCA is used to characterize complex high-dimensional data to efficiently and accurately understand the core and logging response laws to favorable reservoirs.(3) CNN and logging data are used to train and verify the model similar to the underground reservoir.(4) CNN and seismic data are used to intelligently predict favorable reservoir parameters such as organic carbon content, gas content, brittleness and in-situ stress to effectively solve the problem of nonlinear and complex feature extraction in reservoir prediction.(5) KPCA is used to eliminate complex redundant information, mine big data characteristics of favorable reservoirs, and integrate and characterize various parameters to comprehensively evaluate reservoirs. This method has been used to predict the spatial distribution of favorable shale reservoirs in the Ordovician Wufeng Formation to the Silurian Longmaxi Formation of the Weirong shale gas field in the Sichuan Basin, SW China. The predicted results are highly consistent with the actual core, logging and productivity data, proving that this method can provide effective support for the exploration and development of deep shale gas.

Multi-view recognition of fruit packing boxes based on features clustering angle

In order to realize the intelligent mechanization of the last process of the fruit industry chains,the identification of fruit packing boxes is researched.A multi-view database is established to describe the omnidirectional attitudes of the fruit packing boxes.In order to reduce the data redundancy caused by multi-view acquisition,a new binary multi-view kernel principal component analysis network(BMKPCANet) is built,and a multi-view recognition method of fruit packing boxes is proposed based on the BMKPCANet and support vector machine(SVM).The experimental results show that the recognition accuracy of proposed BMKPCANet is 12.82% higher than PCANet and3.51% higher than KPCANet on average.The time consumption of proposed BMKPCANet is 7.74%lower than PCANet and 29.01% lower than KPCANet on average.This work has laid a theoretical foundation for multi-view recognition of 3 D objects and has a good practical application value.

GIS-based spatial analysis of urban traffic accidents： Case study in Mashhad, Iran

There is a growing concern in traffic accident rate in recent years. Using Mashhad city （Iran second populous city） traffic accident records as case study, this paper applied the combi- nation of geo-information technology and spatial-statistical analysis to bring out the influence of spatial factors in their formation. The aim of the study is to examine 4 clustering analyses to have a better understanding of traffic accidents patterns in complex urban network. In order to deploy the clustering technique in urban roads, 9331 point features for inner city traffic accidents during 12 months have been registered according to their x and y location in geographic information system （GIS）. The mentioned areas were analyzed by kernel density estimation （KDE） using ARCMAP and two other analyses using SANET 4th edition software so that the results of network analysis can be compared with traditional KDE method. In addi- tion, this research introduces five classifications for determining the eventfulness of the under study area based on standard deviation and to make priority in creating security in the area. The nearest neighbor and K-function output analysis consist of four curves and regarding the fact that for all fatal, injury and property damage only crashes, the observed value curve is above the 5% confidence interval. Accidents in the study region are more clustered than ex- pected by random chance. The importance of this study is to use GIS as a management system for accident analysis by combination of spatial-statistical methods.