Improved Logistic Regression Algorithm Based on Kernel Density Estimation for Multi-Classification with Non-Equilibrium Samples

Logistic regression is often used to solve linear binary classification problems such as machine vision,speech recognition,and handwriting recognition.However,it usually fails to solve certain nonlinear multi-classification problem,such as problem with non-equilibrium samples.Many scholars have proposed some methods,such as neural network,least square support vector machine,AdaBoost meta-algorithm,etc.These methods essentially belong to machine learning categories.In this work,based on the probability theory and statistical principle,we propose an improved logistic regression algorithm based on kernel density estimation for solving nonlinear multi-classification.We have compared our approach with other methods using non-equilibrium samples,the results show that our approach guarantees sample integrity and achieves superior classification.

Classifier for centrality determination with zero-degree calorimeter at the cooling-storage-ring external-target experiment

The zero-degree calorimeter(ZDC)plays a crucial role toward determining the centrality in the Cooling-Storage-Ring External-target Experiment(CEE)at the Heavy Ion Research Facility in Lanzhou.A boosted decision tree(BDT)multi-classification algorithm was employed to classify the centrality of the collision events based on the raw features from ZDC such as the number of fired channels and deposited energy.The data from simulated^(238)U+^(238)U collisions at 500 MeV∕u,generated by the IQMD event generator and subsequently modeled using the GEANT4 package,were employed to train and test the BDT model.The results showed the high accuracy of the multi-classification model adopted in ZDC for centrality determination,which is robust against variations in different factors of detector geometry and response.This study demon-strates the good performance of CEE-ZDC in determining the centrality in nucleus-nucleus collisions.

Deep Learning with a Novel Concoction Loss Function for Identification of Ophthalmic Disease

As ocular computer-aided diagnostic(CAD)tools become more widely accessible,many researchers are developing deep learning(DL)methods to aid in ocular disease(OHD)diagnosis.Common eye diseases like cataracts(CATR),glaucoma(GLU),and age-related macular degeneration(AMD)are the focus of this study,which uses DL to examine their identification.Data imbalance and outliers are widespread in fundus images,which can make it difficult to apply manyDL algorithms to accomplish this analytical assignment.The creation of efficient and reliable DL algorithms is seen to be the key to further enhancing detection performance.Using the analysis of images of the color of the retinal fundus,this study offers a DL model that is combined with a one-of-a-kind concoction loss function(CLF)for the automated identification of OHD.This study presents a combination of focal loss(FL)and correntropy-induced loss functions(CILF)in the proposed DL model to improve the recognition performance of classifiers for biomedical data.This is done because of the good generalization and robustness of these two types of losses in addressing complex datasets with class imbalance and outliers.The classification performance of the DL model with our proposed loss function is compared to that of the baseline models using accuracy(ACU),recall(REC),specificity(SPF),Kappa,and area under the receiver operating characteristic curve(AUC)as the evaluation metrics.The testing shows that the method is reliable and efficient.

基于KPCA和SVM的火箭发动机试验台故障诊断方法

为了解决液体火箭发动机试验台的故障诊断问题,提出了一种基于核主元分析(KPCA)特征提取和支持向量多分类机(SVM)的故障诊断方法,该方法首先利用核主元分析对试验台标准故障样本进行特征提取,通过特征分析,建立适合于试验台故障状态识别的层次多分类支持向量机,并对其进行训练,然后将试验数据在主元上投影,输入到训练好的支持向量多分类器,对试验台故障状态进行识别.该方法充分利用了核主元分析强大的非线性特征提取能力和支持向量分类机良好的小样本泛化特性,解决了试验台故障诊断中的小样本、非线性模式识别问题.对试验台的试验结果表明,该方法是有效的、可行的.

一种基于有监督局部决策分层支持向量机的异常检测方法

该文针对包含多种攻击模式的高维特征空间中的异常检测问题,提出了一种基于有监督局部决策的分层支持向量机(HSVM)异常检测方法。通过HSVM的二叉树结构实现复杂异常检测问题的分而治之,即在每个中间节点上,通过信息增益准则构建有监督学习所需的训练信号,监督局部决策;在每个嵌入中间节点的二分类支持向量机(SVM)的训练过程中,以局部决策边界对特征的敏感度为依据,选择入侵检测的局部最优特征子集。实验结果表明,该文提出的异常检测方法能够在训练信号的局部决策监督下构建具有良好稳定性的检测学习模型,并能以更精简的特征信息实现检测精确率和检测效率的提高。

一种基于多分类语义分析和个性化的语义检索方法

为了进一步提升语义检索的精度和改善用户体验,提出了一种基于多分类语义分析和个性化的语义检索方法.首先,利用改进的多分类语义分析方法实现目标文档的向量化,并建立词向量库;然后,利用支持向量机对文档进行分类,并结合文档类别生成标签索引.在检索时,根据词向量库的引导,使用用户历史检索记录和个人信息优化检索结果.实验结果显示,基于该方法的系统的检索精度、平均DCG和nDCG指标值分别达到0.7,7.267和0.890,较基于Lucene方法和Yahoo Directory方法所得结果的均值分别高出31%,36%和19%.在时间复杂度上,每次检索的平均耗时为0.669 s,较Lucene方法仅增加了0.326 s.由此可见,该方法提高了检索的精度和综合相关度,且额外的时间消耗较少.

Improved particle swarm optimization algorithm for fuzzy multi-class SVM

An improved particle swarm optimization（PSO） algorithm is proposed to train the fuzzy support vector machine（FSVM） for pattern multi-classification.In the improved algorithm,the particles studies not only from itself and the best one but also from the mean value of some other particles.In addition,adaptive mutation was introduced to reduce the rate of premature convergence.The experimental results on the synthetic aperture radar（SAR） target recognition of moving and stationary target acquisition and recognition（MSTAR） dataset and character recognition of MNIST database show that the improved algorithm is feasible and effective for fuzzy multi-class SVM training.

Multi-Purpose Forensics of Image Manipulations Using Residual-Based Feature

The multi-purpose forensics is an important tool for forge image detection.In this paper,we propose a universal feature set for the multi-purpose forensics which is capable of simultaneously identifying several typical image manipulations,including spatial low-pass Gaussian blurring,median filtering,re-sampling,and JPEG compression.To eliminate the influences caused by diverse image contents on the effectiveness and robustness of the feature,a residual group which contains several high-pass filtered residuals is introduced.The partial correlation coefficient is exploited from the residual group to purely measure neighborhood correlations in a linear way.Besides that,we also combine autoregressive coefficient and transition probability to form the proposed composite feature which is used to measure how manipulations change the neighborhood relationships in both linear and non-linear way.After a series of dimension reductions,the proposed feature set can accelerate the training and testing for the multi-purpose forensics.The proposed feature set is then fed into a multi-classifier to train a multi-purpose detector.Experimental results show that the proposed detector can identify several typical image manipulations,and is superior to the complicated deep CNN-based methods in terms of detection accuracy and time efficiency for JPEG compressed image with low resolution.

Hypersphere support vector machines based on generalized multiplicative updates

This paper proposes a novel hypersphere support vector machines （HSVMs） based on generalized multiplicative updates. This algorithm can obtain the boundary of hypersphere containing one class of samples by the description of the training samples from one class and use this boundary to classify the test samples. The generalized multiplicative updates are applied to solving boundary optimization progranmning. Multiplicative updates available are suited for nonnegative quadratic convex programming. The generalized multiplicative updates are derived to box and sum constrained quadratic programming in this paper. They provide an extremely straightforward way to implement support vector machines （SVMs） where all variables are updated in parallel. The generalized multiplicative updates converge monotonically to the solution of the maximum margin hyperplane. The experiments show the superiority of our new algorithm.

Does the Financial Status of Company Affect the Bond Credit Rating?--Empirical Evidence from China's Shanghai and Shenzhen Stock Exchanges

This article takes the companies that publicly issued corporate bonds on the Shanghai and Shenzhen Stock Exchanges from 2006 to 2018 as the research objects selecting six aspects that comprehensively reflect the 17 financial variables in 6 aspects:profitability,operating ability,bond repayment ability,development ability,cash flow and market value of the company.Principal component analysis method and factor analysis method are used to extract the principal factors of these financial indicator variables.That is how an ordered multi-classification Logistic regression model is constructed to test the impact of the Shanghai and Shenzhen Stock Exchanges’financial status on the corporate bond credit rating.It turns out that the financial status of the Shanghai and Shenzhen Stock Exchanges have an important impact on the credit rating of corporate bonds.The financial status has a greater impact on corporate bonds with credit ratings of A-and AA-,while it has a smaller impact on corporate bonds with credit ratings above AA.The results of this article can help individual and institutional investors prevent risks from investing.

最大间隔最小体积球形支持向量机

结合支持向量机(SVM)类间最大分类间隔和支持向量数据描述(SVDD)类内最小描述体积思想,提出一种新的学习机器模型——最大间隔最小体积球形支持向量机(MMHSVM).模型建立两个大小不一的同心超球,将正负类样本分别映射到小超球内和大超球外,模型目标函数最大化两超球间隔,实现正负类类间间隔的最大化和各类类内体积的最小化,提高了模型的分类能力.理论分析和实验结果表明该算法是有效的.

无溶剂高频振荡法合成β-烯胺酮(酯)的研究

以伯胺和1,3-二羰化合物为原料,在高频振荡(HSVM)条件下采用无催化剂、无溶剂的新方法缩合一步合成18个β-烯胺酮(酯)类化合物,收率60.8%～96.5%.新方法具有反应条件温和、操作简单、产率高以及环境友好等优点.所得化合物的结构用核磁共振、气相质谱联用的方法进行了表征.

A knowledge matching approach based on multiclassification radial basis function neural network for knowledge push system

We present an exploratory study to improve the performance of a knowledge push system in product design. We focus on the domain of knowledge matching, where traditional matching algorithms need repeated calculations that result in a long response time and where accuracy needs to be improved. The goal of our approach is to meet designers’ knowledge demands with a quick response and quality service in the knowledge push system. To improve the previous work, two methods are investigated to augment the limited training set in practical operations,namely, oscillating the feature weight and revising the case feature in the case feature vectors. In addition, we propose a multi-classification radial basis function neural network that can match the knowledge from the knowledge base once and ensure the accuracy of pushing results. We apply our approach using the training set in the design of guides by computer numerical control machine tools for training and testing, and the results demonstrate the benefit of the augmented training set. Moreover, experimental results reveal that our approach outperforms other matching approaches.

Solvent and catalyst free azo-Michael addition under high-speed vibration milling

Under the high-speed vibration milling conditions,the solvent and catalyst-free azo-Michael addition of chalcone derivatives and amines was found to proceed efficiently in excellent yields at ambient temperature in short reaction time.In most cases,conventional side reactions were avoided and thus quantitative yields were achieved.The influences of the vibration frequency and reaction time on the azo-Michael addition were investigated.

Analyzing Electricity Consumption via Data Mining

This paper proposes a model to analyze the massive data of electricity.Feature subset is determined by the correla-tion-based feature selection and the data-driven methods.The attribute season can be classified successfully through five classi-fiers using the selected feature subset,and the best model can be determined further.The effects on analyzing electricity consump-tion of the other three attributes,including months,businesses,and meters,can be estimated using the chosen model.The data used for the project is provided by Beijing Power Supply Bureau.We use WEKA as the machine learning tool.The models we built are promising for electricity scheduling and power theft detection.

A multi-class large margin classifier

Currently there are two approaches for a multi-class support vector classifier(SVC). One is to construct and combine several binary classifiers while the other is to directly consider all classes of data in one optimization formulation. For a K-class problem(K>2),the first approach has to construct at least K classifiers,and the second approach has to solve a much larger op-timization problem proportional to K by the algorithms developed so far. In this paper,following the second approach,we present a novel multi-class large margin classifier(MLMC). This new machine can solve K-class problems in one optimization formula-tion without increasing the size of the quadratic programming(QP) problem proportional to K. This property allows us to construct just one classifier with as few variables in the QP problem as possible to classify multi-class data,and we can gain the advantage of speed from it especially when K is large. Our experiments indicate that MLMC almost works as well as(sometimes better than) many other multi-class SVCs for some benchmark data classification problems,and obtains a reasonable performance in face recognition application on the AR face database.