Differentially Private Support Vector Machines with Knowledge Aggregation

With the widespread data collection and processing,privacy-preserving machine learning has become increasingly important in addressing privacy risks related to individuals.Support vector machine(SVM)is one of the most elementary learning models of machine learning.Privacy issues surrounding SVM classifier training have attracted increasing attention.In this paper,we investigate Differential Privacy-compliant Federated Machine Learning with Dimensionality Reduction,called FedDPDR-DPML,which greatly improves data utility while providing strong privacy guarantees.Considering in distributed learning scenarios,multiple participants usually hold unbalanced or small amounts of data.Therefore,FedDPDR-DPML enables multiple participants to collaboratively learn a global model based on weighted model averaging and knowledge aggregation and then the server distributes the global model to each participant to improve local data utility.Aiming at high-dimensional data,we adopt differential privacy in both the principal component analysis(PCA)-based dimensionality reduction phase and SVM classifiers training phase,which improves model accuracy while achieving strict differential privacy protection.Besides,we train Differential privacy(DP)-compliant SVM classifiers by adding noise to the objective function itself,thus leading to better data utility.Extensive experiments on three high-dimensional datasets demonstrate that FedDPDR-DPML can achieve high accuracy while ensuring strong privacy protection.

Performance Analysis of Support Vector Machine (SVM) on Challenging Datasets for Forest Fire Detection

This article delves into the analysis of performance and utilization of Support Vector Machines (SVMs) for the critical task of forest fire detection using image datasets. With the increasing threat of forest fires to ecosystems and human settlements, the need for rapid and accurate detection systems is of utmost importance. SVMs, renowned for their strong classification capabilities, exhibit proficiency in recognizing patterns associated with fire within images. By training on labeled data, SVMs acquire the ability to identify distinctive attributes associated with fire, such as flames, smoke, or alterations in the visual characteristics of the forest area. The document thoroughly examines the use of SVMs, covering crucial elements like data preprocessing, feature extraction, and model training. It rigorously evaluates parameters such as accuracy, efficiency, and practical applicability. The knowledge gained from this study aids in the development of efficient forest fire detection systems, enabling prompt responses and improving disaster management. Moreover, the correlation between SVM accuracy and the difficulties presented by high-dimensional datasets is carefully investigated, demonstrated through a revealing case study. The relationship between accuracy scores and the different resolutions used for resizing the training datasets has also been discussed in this article. These comprehensive studies result in a definitive overview of the difficulties faced and the potential sectors requiring further improvement and focus.

Improved Twin Support Vector Machine Algorithm and Applications in Classification Problems

The distribution of data has a significant impact on the results of classification.When the distribution of one class is insignificant compared to the distribution of another class,data imbalance occurs.This will result in rising outlier values and noise.Therefore,the speed and performance of classification could be greatly affected.Given the above problems,this paper starts with the motivation and mathematical representing of classification,puts forward a new classification method based on the relationship between different classification formulations.Combined with the vector characteristics of the actual problem and the choice of matrix characteristics,we firstly analyze the orderly regression to introduce slack variables to solve the constraint problem of the lone point.Then we introduce the fuzzy factors to solve the problem of the gap between the isolated points on the basis of the support vector machine.We introduce the cost control to solve the problem of sample skew.Finally,based on the bi-boundary support vector machine,a twostep weight setting twin classifier is constructed.This can help to identify multitasks with feature-selected patterns without the need for additional optimizers,which solves the problem of large-scale classification that can’t deal effectively with the very low category distribution gap.

Comparison of debris flow susceptibility assessment methods:support vector machine,particle swarm optimization,and feature selection techniques

The selection of important factors in machine learning-based susceptibility assessments is crucial to obtain reliable susceptibility results.In this study,metaheuristic optimization and feature selection techniques were applied to identify the most important input parameters for mapping debris flow susceptibility in the southern mountain area of Chengde City in Hebei Province,China,by using machine learning algorithms.In total,133 historical debris flow records and 16 related factors were selected.The support vector machine(SVM)was first used as the base classifier,and then a hybrid model was introduced by a two-step process.First,the particle swarm optimization(PSO)algorithm was employed to select the SVM model hyperparameters.Second,two feature selection algorithms,namely principal component analysis(PCA)and PSO,were integrated into the PSO-based SVM model,which generated the PCA-PSO-SVM and FS-PSO-SVM models,respectively.Three statistical metrics(accuracy,recall,and specificity)and the area under the receiver operating characteristic curve(AUC)were employed to evaluate and validate the performance of the models.The results indicated that the feature selection-based models exhibited the best performance,followed by the PSO-based SVM and SVM models.Moreover,the performance of the FS-PSO-SVM model was better than that of the PCA-PSO-SVM model,showing the highest AUC,accuracy,recall,and specificity values in both the training and testing processes.It was found that the selection of optimal features is crucial to improving the reliability of debris flow susceptibility assessment results.Moreover,the PSO algorithm was found to be not only an effective tool for hyperparameter optimization,but also a useful feature selection algorithm to improve prediction accuracies of debris flow susceptibility by using machine learning algorithms.The high and very high debris flow susceptibility zone appropriately covers 38.01%of the study area,where debris flow may occur under intensive human activities and heavy rainfall events.

Enhanced Steganalysis for Color Images Using Curvelet Features and Support Vector Machine

Algorithms for steganography are methods of hiding data transfers in media files.Several machine learning architectures have been presented recently to improve stego image identification performance by using spatial information,and these methods have made it feasible to handle a wide range of problems associated with image analysis.Images with little information or low payload are used by information embedding methods,but the goal of all contemporary research is to employ high-payload images for classification.To address the need for both low-and high-payload images,this work provides a machine-learning approach to steganography image classification that uses Curvelet transformation to efficiently extract characteristics from both type of images.Support Vector Machine(SVM),a commonplace classification technique,has been employed to determine whether the image is a stego or cover.The Wavelet Obtained Weights(WOW),Spatial Universal Wavelet Relative Distortion(S-UNIWARD),Highly Undetectable Steganography(HUGO),and Minimizing the Power of Optimal Detector(MiPOD)steganography techniques are used in a variety of experimental scenarios to evaluate the performance of the proposedmethod.Using WOW at several payloads,the proposed approach proves its classification accuracy of 98.60%.It exhibits its superiority over SOTA methods.

HHO optimized support vector machine classifier for traditional Chinese medicine syndrome differentiation of diabetic retinopathy

AIM:To develop a classifier for traditional Chinese medicine(TCM)syndrome differentiation of diabetic retinopathy(DR),using optimized machine learning algorithms,which can provide the basis for TCM objective and intelligent syndrome differentiation.METHODS:Collated data on real-world DR cases were collected.A variety of machine learning methods were used to construct TCM syndrome classification model,and the best performance was selected as the basic model.Genetic Algorithm(GA)was used for feature selection to obtain the optimal feature combination.Harris Hawk Optimization(HHO)was used for parameter optimization,and a classification model based on feature selection and parameter optimization was constructed.The performance of the model was compared with other optimization algorithms.The models were evaluated with accuracy,precision,recall,and F1 score as indicators.RESULTS:Data on 970 cases that met screening requirements were collected.Support Vector Machine(SVM)was the best basic classification model.The accuracy rate of the model was 82.05%,the precision rate was 82.34%,the recall rate was 81.81%,and the F1 value was 81.76%.After GA screening,the optimal feature combination contained 37 feature values,which was consistent with TCM clinical practice.The model based on optimal combination and SVM(GA_SVM)had an accuracy improvement of 1.92%compared to the basic classifier.SVM model based on HHO and GA optimization(HHO_GA_SVM)had the best performance and convergence speed compared with other optimization algorithms.Compared with the basic classification model,the accuracy was improved by 3.51%.CONCLUSION:HHO and GA optimization can improve the model performance of SVM in TCM syndrome differentiation of DR.It provides a new method and research idea for TCM intelligent assisted syndrome differentiation.

Support Vector Machines Networks to Hybrid Neuro-Genetic SVMs in Portfolio Selection

Corporate net value is efficiently described on its stock price, offering investors a chance to include a potentially surplus value to the net worth of the overall investment portfolio. Financial analysis of corporations extracted from the accounting statements is constantly demanded to support decisions making of portfolio managers. Econometrics and Artificial Intelligence methods aim to extract hidden information from complex accounting and financial data. Support Vector Machines hybrids optimized in their components by Genetic Algorithms provide effective results in corporate financial analysis.

Support Vector Machines(SVM)-Markov Chain Prediction Model of Mining Water Inflow

This study was conducted to establish a Support Vector Machines(SVM)-Markov Chain prediction model for prediction of mining water inflow. According to the raw data sequence, the Support Vector Machines(SVM) model was built, and then revised by means of a Markov state change probability matrix. Through dividing the state and analyzing absolute errors and relative errors and other indexes of the measured value and the fitted value of SVM, the prediction results were improved. Finally,the model was used to calculate relative errors. Through predicting and analyzing mining water inflow, the prediction results of the model were satisfactory. The results of this study enlarge the application scope of the Support Vector Machines(SVM) prediction model and provide a new method for scientific forecasting water inflow in coal mining.

采用改进遗传算法优化LS-SVM逆系统的外转子无铁心无轴承永磁同步发电机解耦控制

为了实现外转子无铁心无轴承永磁同步发电机(outer rotor coreless bearingless permanent magnet synchronous generator,ORC-BPMSG)的精确控制,提出一种基于改进遗传算法(improved genetic algorithm,IGA)优化最小二乘支持向量机(least square support vector machine,LS-SVM)逆系统的解耦控制策略。首先,基于ORC-BPMSG的结构及工作原理,推导其数学模型,并分析其可逆性。其次,建立LS-SVM回归方程,并采用IGA优化LS-SVM的性能参数,从而训练得到逆系统。然后,将逆系统与原系统串接,形成伪线性系统,实现了ORC-BPMSG的线性化和解耦。最后,将提出的控制方法与传统LS-SVM逆系统控制方法进行对比仿真和实验。仿真和实验结果表明:所提出的控制策略可以较好地实现ORC-BPMSG输出电压和悬浮力、以及悬浮力之间的解耦控制。

不平衡数据下基于SVM增量学习的指挥信息系统状态监控方法

针对指挥信息系统历史状态样本有限的特点,基于支持向量机(support vector machines,SVM)设计了一种面向不平衡数据的SVM增量学习方法。针对系统正常/异常状态样本不平衡的情况,首先利用支持向量生成一部分新样本,然后通过分带的思想逐带产生分布更加均匀的新样本以调节原样本集的不平衡比。针对系统监控实时性要求高且在运行过程中会有新样本不断加入的特点,采用增量学习的方式对分类模型进行持续更新,在放松KKT(Karush-Kuhn-Tucker)更新触发条件的基础上,通过定义样本重要度并引入保留率和遗忘率的方式减少了增量学习过程中所需训练的样本数量。为了验证算法的有效性和优越性,实验部分在真实系统中获得的数据集以及UCI数据集中3类6组不平衡数据集中与现有的算法进行了对比。结果表明,所提算法能够有效实现对不平衡数据的增量学习,从而满足指挥信息系统状态监控的需求。

基于改进CNN-SVM的井下钻头磨损状态评估研究

现有钻头磨损评估方法中,存在人工特征提取过程可能无法完全提取正确分类所需的信号动态特征,及需要对各个统计量进行大量计算等问题。为此,提出了一种新的基于改进卷积神经网络支持向量机(CNN-SVM)的钻头磨损程度评估算法。该算法将采集的近钻头原始振动数据导入CNN-Softmax模型,通过训练好的CNN模型从近钻头数据中提取主要的特征参数,将提取的稀疏特征向量输入SVM并进行故障分类,利用遗传算法实现SVM参数的优化选择,最后应用t分布随机邻域法近邻嵌入,使其故障特征学习过程可视化,以评估其特征提取能力。采用该算法对钻头磨损的现场试验数据进行了分析。分析结果表明:基于改进CNN-SVM的井下钻头磨损状态评估算法准确率高达98.33%。所得结论可为实现钻头磨损状态的进一步监测提供理论支撑。

基于IAOA-SVM模型结构时变可靠性研究

目的为有效解决使用传统代理模型进行结构时变可靠性研究中存在流程复杂、计算效率低等问题。方法提出以改进算术优化算法(Improved Arithmetic Optimization Algorithm,IAOA)优化支持向量机模型(Support Vector Machine,SVM)进行时变可靠性研究的方法,结合IAOA-SVM模型和极值理论,以某塔式起重机回转支承为研究对象,对其进行动态确定性分析获取样本数据,建立IAOA-SVM可靠性模型,采用蒙特卡洛法求解得到其可靠度结果,并与EKM和ERSM算法对比分析其仿真精度和效率。结果当回转支承径向变形许用值为0.278×10^(-3)m时,采用蒙特卡洛法求解得到其可靠度为99.68%,IAOA-SVM模型相比EKM和ERSM方法仿真效率有所提升,建模精度分别提高了10.42%和9.23%。结论IAOA-SVM方法在建模和仿真精度与效率方面具有较明显的优势,IAOA-SVM方法为求解机构时变可靠度难题提供了一种新的解决思路。

基于VMD和GA-SVM的矿井地震自适应噪声压制方法

煤矿井下地震信号往往呈现出复杂的波场特性且伴随着大量噪音干扰,导致地震信号的初至拾取精度降低,从而影响地震数据的反演与解释。针对复杂干扰环境下采集的低信噪比地震信号,提出了基于变分模态分解(VMD)和遗传算法优化支持向量机(GA-SVM)的地震噪声压制与初至提取方法,以提高煤矿井下复杂噪声条件下的地震信号质量。采用变分模态分解对含噪地震信号进行自适应分解,得到数个的变分模态分量(IMF);对VMD分解得到的IMF分量进行特征提取,将提取所得的信号特征作为信号有效性判别的依据;利用遗传算法对支持向量机模型进行优化,得到最优的惩罚因子c与核函数参数g;利用优化后的支持向量机模型对IMF分量进行有效性判别并将有效分量重构成高信噪比信号;通过对人工加噪的地震信号应用噪声压制算法,煤矿井下常见的不同类型噪声被有效地压制,验证了算法的可行性;对矿井巷道实采的地震记录进行噪声压制处理,有效地压制了数据中的干扰噪声,极大程度地提高了地震记录的信噪比,使初至拾取得更加准确。结果表明,基于VMD和GA-SVM的地震噪声压制方法可以很好地提取含噪地震记录中的有效信号,提高初至拾取精度,在矿井复杂干扰条件下具有显著的应用潜力,对解决矿井复杂干扰条件下的地震勘探问题有重要意义。

基于SVM算法的虚假航迹识别

针对云雨杂波和主被动干扰导致多雷达传感器产生虚假目标航迹的问题,利用支持向量机(SVM)算法的自主学习能力,通过构建基于数据驱动的判别模型进行虚假航迹识别。针对航迹起始得到的目标潜在航迹,利用人工智能数据驱动、自学习的特点,设计了SVM算法。通过对已标记真假的目标航迹样本进行离线学习,形成虚假航迹识别的SVM分类器,实现了基于数据驱动的判别模型代替先验知识规则约束的固定模型,并在工程应用中,利用SVM分类器在线识别虚假航迹,完成实时剔除。通过实测雷达数据实验验证,该算法的目标虚假航迹准确率高达95%以上,完全满足实际的工程应用需求。相比基于阈值或规则进行硬性判断的传统虚假航迹识别方法,所提出的算法不仅提高了准确率,还具有较高的实时性,能够适应复杂多变的杂波环境,在实际应用中具有更强的适应性和实用性。因此,提出的基于SVM算法的虚假航迹识别方法对于密集杂波场景下的虚假航迹剔除问题具有显著的实际应用价值。

基于DBN和BES-LSSVM的矿用压风机异常状态识别方法

针对矿用压风机这类分布式系统的异常类别复杂、识别精度低等问题,提出了一种基于深度置信网络(DBN)和最小二乘支持向量机(LSSVM)的异常状态识别方法。首先,分析压风机组成系统及其运行机理,确定常见的异常状态类型;其次,采用DBN无监督学习方式充分挖掘监测数据中异常特征并快速提取;然后,利用秃鹰搜索算法(BES)优化LSSVM的超参数,构建最优的BES-LSSVM分类模型;最后,将DBN提取的异常特征作为BES-LSSVM模型的输入,对矿用压风机异常状态进行识别。试验验证与对比分析结果表明,相较于GA,PSO,GWO算法,BES算法的求解精度和收敛速度均有所提高,同时DBN-BES-LSSVM模型在测试集上平均识别精度达到94.65%,较PCA-LSSVM模型、DBN模型和DBN-LSSVM模型的识别精度分别提高了10.53%,5.84%和3.76%,验证了DBN-BES-LSSVM模型在矿用压风机异常特征提取以及特征识别方面的优越性。

结合SVM与XGBoost的链式多路径覆盖测试用例生成

机器学习方法可很好地与软件测试相结合,增强测试效果,但少有学者将其运用于测试数据生成方面.为进一步提高测试数据生成效率,提出一种结合SVM(support vector machine)和XGBoost(extreme gradient boosting)的链式模型,并基于此模型借助遗传算法实现多路径测试数据生成.首先,利用一定样本训练若干个用于预测路径节点状态的子模型(SVM和XGBoost),通过子模型的预测精度值筛选最优子模型,并根据路径节点顺序将其依次链接,形成一个链式模型C-SVMXGBoost(chained SVM and XGBoost).在利用遗传算法生成测试用例时,使用训练好的链式模型代替插桩法获取测试数据覆盖路径(预测路径),寻找预测路径与目标路径相似的路径集,对存在相似路径集的预测路径进行插桩验证,获取精确路径,计算适应度值.在交叉变异过程中引入样本集中路径层级深度较大的优秀测试用例进行重用,生成覆盖目标路径的测试数据.最后,保留进化生成中产生的适应度较高的个体,更新链式模型C-SVMXGBoost,进一步提高测试效率.实验表明,C-SVMXGBoost较其他各对比链式模型更适合解决路径预测问题,可提高测试效率.并且通过与已有经典方法相比,所提方法在覆盖率上提高可达15%,平均进化代数也有所降低,在较大规模程序上其降低百分比可达65%.

基于RF-SFLA-SVM的装配式建筑高空作业工人不安全行为预警

为有效预警装配式建筑高空作业工人不安全行为的发生趋势或状态,增强对装配式建筑工人不安全行为(PBWUBs)的管控,采用随机森林(RF)-混合蛙跳算法(SFLA)-支持向量机(SVM)模型,开展工人不安全行为预警研究。首先,采用SHEL模型分析处于高空作业危险中的PBWUBs的影响因素,并通过RF确定关键预警指标;然后,采用SFLA对SVM的参数进行寻优改进;最后,利用RF-SFLA-SVM预警高空作业PBWUBs,提出应对措施,并与其他预警模型对比。研究结果表明:基于RF-SFLA-SVM预警高空作业PBWUBs,准确率最高,为91.67%,与其他模型的预警性能相比,最高提升14%。研究结果可为高空作业PBWUBs的防控提供参考。

基于CBAM-CGRU-SVM的Android恶意软件检测方法

随着Android恶意软件的种类和数量不断增多,检测恶意软件以保护系统安全和用户隐私变得越来越重要。针对传统的恶意软件检测模型分类准确率较低的问题,提出一种基于卷积神经网络(CNN)、门控循环单元(GRU)和支持向量机(SVM)的模型CBAM-CGRU-SVM。首先,在CNN中添加卷积块注意力模块(CBAM)以学习更多恶意软件的关键特征;其次,利用GRU进一步提取特征;最后,为了解决图像分类时模型泛化能力不足的问题,使用SVM代替softmax激活函数作为模型的分类函数。实验使用了Malimg公开数据集,该数据集将恶意软件数据图像化作为模型输入。实验结果表明,CBAM-CGRU-SVM模型分类准确率达到94.73%,能够更有效地对恶意软件家族进行分类。

基于多特征提取与灰狼算法优化SVM的车内异响识别方法

传统的异响识别方法对测试设备要求较高且易受实验员经验差异影响。针对这种情况,提出一种基于多特征提取与灰狼算法优化支持向量机(Support Vector Machine,SVM)的车内异响识别方法。该方法以采集实验获得的6种车内常见异响作为研究对象,提取短时能量、小波变换优化的梅尔频率倒谱系数(DWT-MFCC)及其一阶差分组成混合特征参数,将灰狼优化算法应用于SVM的参数寻优中,建立异响识别模型并进行识别分类,同时探究选用不同维度的特征或不同算法对识别效果的影响。结果表明,所提取的25维混合特征能有效传达异响信息,该方法在收敛速度与识别准确率方面优势明显,能更好地实现车内异响的识别。

基于VMD-LILGWO-LSSVM短期风电功率预测

目的为了减小风电功率并入国家电网时产生的频率波动,提高风电功率预测精度,方法提出一种结合变分模态分解(VMD)、改进灰狼算法(LILGWO)和最小二乘支持向量机(LSSVM)的风电功率短期预测方法。首先通过VMD方法将风电功率序列分解重构成3个复杂程度性不同的模态分量,降低风电功率的波动性;其次使用LSSVM挖掘各分量的特征信息,对各分量分别进行预测,针对LSSVM模型中重要参数的选取对预测精度影响较大问题,引入LILGWO对参数进行寻优;最后将各分量预测结果叠加重构,得到最终预测风电功率。结果以宁夏回族自治区某地区风电站实际数据为例,对未来三天分别进行预测取平均值,本文方法的预测平均绝对误差(mean absolute error,MAE)为2.7068 kW,均方根误差(root mean square error,RMSE)为2.0211,拟合程度决定系数(R-Square,R^(2))为0.9769,与对比方法3~6相比,RMSE分别降低了40.93%,25.21%,14.7%,6.24%;MAE分别降低了42.34%,28.04%,16.97%,7.77%;R^(2)分别提升了4.21%,1.78%,0.82%,0.28%。预测时长方面,BP和LSSVM平均训练时间分别是10,138 s,虽然LSSVM预测时间较长但效果最好,采用PSO、GWO、LILGWO对LSSVM进行寻优后训练时间分别平均缩短了39,44,58 s。结论仿真验证了所提方法在短期风电功率预测方面的有效性。