θ-PSO: a new strategy of particle swarm optimization

Particle swarm optimization (PSO) is an efficient, robust and simple optimization algorithm. Most studies are mainly concentrated on better understanding of the standard PSO control parameters, such as acceleration coefficients, etc. In this paper, a more simple strategy of PSO algorithm called θ-PSO is proposed. In θ-PSO, an increment of phase angle vector replaces the increment of velocity vector and the positions are decided by the mapping of phase angles. Benchmark testing of nonlinear func- tions is described and the results show that the performance of θ-PSO is much more effective than that of the standard PSO.

A State-Migration Particle Swarm Optimizer for Adaptive Latent Factor Analysis of High-Dimensional and Incomplete Data

High-dimensional and incomplete(HDI) matrices are primarily generated in all kinds of big-data-related practical applications. A latent factor analysis(LFA) model is capable of conducting efficient representation learning to an HDI matrix,whose hyper-parameter adaptation can be implemented through a particle swarm optimizer(PSO) to meet scalable requirements.However, conventional PSO is limited by its premature issues,which leads to the accuracy loss of a resultant LFA model. To address this thorny issue, this study merges the information of each particle's state migration into its evolution process following the principle of a generalized momentum method for improving its search ability, thereby building a state-migration particle swarm optimizer(SPSO), whose theoretical convergence is rigorously proved in this study. It is then incorporated into an LFA model for implementing efficient hyper-parameter adaptation without accuracy loss. Experiments on six HDI matrices indicate that an SPSO-incorporated LFA model outperforms state-of-the-art LFA models in terms of prediction accuracy for missing data of an HDI matrix with competitive computational efficiency.Hence, SPSO's use ensures efficient and reliable hyper-parameter adaptation in an LFA model, thus ensuring practicality and accurate representation learning for HDI matrices.

Hybrid distributed feature selection using particle swarm optimization-mutual information

Feature selection(FS)is a data preprocessing step in machine learning(ML)that selects a subset of relevant and informative features from a large feature pool.FS helps ML models improve their predictive accuracy at lower computational costs.Moreover,FS can handle the model overfitting problem on a high-dimensional dataset.A major problem with the filter and wrapper FS methods is that they consume a significant amount of time during FS on high-dimensional datasets.The proposed“HDFS(PSO-MI):hybrid distribute feature selection using particle swarm optimization-mutual information(PSO-MI)”,is a PSO-based hybrid method that can overcome the problem mentioned above.This method hybridizes the filter and wrapper techniques in a distributed manner.A new combiner is also introduced to merge the effective features selected from multiple data distributions.The effectiveness of the proposed HDFS(PSO-MI)method is evaluated using five ML classifiers,i.e.,logistic regression(LR),k-NN,support vector machine(SVM),decision tree(DT),and random forest(RF),on various datasets in terms of accuracy and Matthew’s correlation coefficient(MCC).From the experimental analysis,we observed that HDFS(PSO-MI)method yielded more than 98%,95%,92%,90%,and 85%accuracy for the unbalanced,kidney disease,emotions,wafer manufacturing,and breast cancer datasets,respectively.Our method shows promising results comapred to other methods,such as mutual information,gain ratio,Spearman correlation,analysis of variance(ANOVA),Pearson correlation,and an ensemble feature selection with ranking method(EFSRank).

Optimization of Fairhurst-Cook Model for 2-D Wing Cracks Using Ant Colony Optimization (ACO), Particle Swarm Intelligence (PSO), and Genetic Algorithm (GA)

The common failure mechanism for brittle rocks is known to be axial splitting which happens parallel to the direction of maximum compression. One of the mechanisms proposed for modelling of axial splitting is the sliding crack or so called, “wing crack” model. Fairhurst-Cook model explains this specific type of failure which starts by a pre-crack and finally breaks the rock by propagating 2-D cracks under uniaxial compression. In this paper, optimization of this model has been considered and the process has been done by a complete sensitivity analysis on the main parameters of the model and excluding the trends of their changes and also their limits and “peak points”. Later on this paper, three artificial intelligence algorithms including Particle Swarm Intelligence (PSO), Ant Colony Optimization (ACO) and genetic algorithm (GA) has been used and compared in order to achieve optimized sets of parameters resulting in near-maximum or near-minimum amounts of wedging forces creating a wing crack.

Driving fatigue fusion detection based on T-S fuzzy neural network evolved by subtractive clustering and particle swarm optimization

In order to improve the accuracy and reliability of the driving fatigue detection based on a single feature, a new detection algorithm based on multiple features is proposed. Two direct driver＇s facial features reflecting fatigue and one indirect vehicle behavior feature indicating fatigue are considered. Meanwhile, T-S fuzzy neural network（TSFNN）is adopted to recognize the driving fatigue of drivers. For the structure identification of the TSFNN, subtractive clustering（SC） is used to confirm the fuzzy rules and their correlative parameters. Moreover, the particle swarm optimization （PSO）algorithm is improved to train the TSFNN. Simulation results and experiments on vehicles show that the proposed algorithm can effectively improve the convergence speed and the recognition accuracy of the TSFNN, as well as enhance the correct rate of driving fatigue detection.

Dynamic compensation for sensors based on particle swarm optimization and realization on LabVIEW

In shock wave＇s pressure testing,a dynamic compensation digital filter is designed based on particle swarm optimization （PSO） algorithm.Dynamic calibration experiment and simulation are conducted for the pressure sensor.PSO algorithm is applied on Matlab platform to achieve optimization according to input and output data of the sensor as well as the reference model,and the global optimal values got by optimization become the parameters of the compensator.Finally,the dynamic compensation filter is established on LabVIEW platform.The experimental results show that the data after processing with the compensation filter truly reflects the input signal.

基于粗糙集理论与PCA-APSO-SVM的沥青路面使用性能预测

针对传统沥青路面使用性能预测精度较低的问题,建立了基于粗糙集理论(rough set,RS)与主成分分析法(principal compoent analysis,PCA)-自适应粒子群算法(adaptive particle swarm optimization,APSO)-支持向量机(support vector machine,SVM)的沥青路面使用性能预测模型。基于沥青路面的时序指标与影响因素指标,建立了11个初始预测指标(包括前3年的路面使用性能、当量轴次、路龄、养护性质、坑槽率、修补率、年降水量、平均气温、日照时数);通过RS属性约减筛选出9个核心指标;利用PCA提取4个主成分,得到了基于4个主成分的数据集;将APSO引入到SVM中,对数据集进行训练,并优化了SVM模型参数;建立了路面使用性能的PCA-APSO-SVM预测模型,并以G6京藏高速甘肃境内某段道路为例,对路面使用性能进行预测。研究结果表明:PCA-APSO-SVM模型预测精度较PCA-PSO-SVM、APSO-SVM、PSO-SVM有较大提高,预测结果与实际情况更加符合,能为路面养护决策提供相关参考。

基于PSO−ELM的综采工作面液压支架姿态监测方法

针对基于惯性测量单元的液压支架姿态解算方法会产生累计误差、校正结果不准确的问题,提出一种基于粒子群优化(PSO)−极限学习机(ELM)的综采工作面液压支架姿态监测方法。以液压支架顶梁俯仰角为监测对象,采用倾角传感器和陀螺仪采集液压支架顶梁支护姿态实时信息,对采集到的数据进行预处理,将处理后的数据输入PSO−ELM误差补偿模型中,得到解算误差预测值;同时通过卡尔曼滤波融合进行液压支架姿态解算,得到解算值;再用误差预测值对解算值进行误差补偿,从而求得更加准确的顶梁支护姿态数据。该方法只考虑加速度和角速度数据与解算误差的关系,不依赖具体的物理模型,可有效降低姿态解算累计误差。实验结果表明:液压支架顶梁俯仰角平均绝对误差由补偿前的1.4208°减少到0.0580°,且误差曲线具有良好的收敛性,验证了所提方法可持续稳定地监测液压支架的支护姿态。

一种基于PSO-ELM的低渗透砂岩水淹层测井识别方法

水淹层测井识别对油田开发方案部署及提高采收率有着重要意义。新疆陆梁油田作业区某区块油层水淹类型主要为污水水淹,测井响应特征复杂多变,传统识别图版方法难以对水淹层有效识别。文中基于测井、地质、试油等资料,在水淹层测井响应特征分析基础上,提出了一种利用改进粒子群优化算法(Particle Swarm Optimization,PSO)及极限学习机(Extreme Learning Machine,ELM)的水淹层识别方法。首先,利用相关系数优选6个主控因素:RD,RS,GR,SP,DEN,AC。其次,采用改进粒子群算法对极限学习机模型进行参数寻优;最后,利用优化后的模型对研究区水淹层进行预测。结果表明,利用PSO-ELM模型识别水淹层,识别符合率达到91.7%,应用效果优于ELM模型及传统识别图版,为水淹层测井识别提供了新思路。

Hybrid optimization algorithm based on chaos,cloud and particle swarm optimization algorithm

As for the drop of particle diversity and the slow convergent speed of particle in the late evolution period when particle swarm optimization（PSO） is applied to solve high-dimensional multi-modal functions,a hybrid optimization algorithm based on the cat mapping,the cloud model and PSO is proposed.While the PSO algorithm evolves a certain of generations,this algorithm applies the cat mapping to implement global disturbance of the poorer individuals,and employs the cloud model to execute local search of the better individuals;accordingly,the obtained best individuals form a new swarm.For this new swarm,the evolution operation is maintained with the PSO algorithm,using the parameter of pop distr to balance the global and local search capacity of the algorithm,as well as,adopting the parameter of mix gen to control mixing times of the algorithm.The comparative analysis is carried out on the basis of 4 functions and other algorithms.It indicates that this algorithm shows faster convergent speed and better solving precision for solving functions particularly those high-dimensional multi-modal functions.Finally,the suggested values are proposed for parameters pop distr and mix gen applied to different dimension functions via the comparative analysis of parameters.

Surrogate-Assisted Particle Swarm Optimization Algorithm With Pareto Active Learning for Expensive Multi-Objective Optimization

For multi-objective optimization problems, particle swarm optimization(PSO) algorithm generally needs a large number of fitness evaluations to obtain the Pareto optimal solutions. However, it will become substantially time-consuming when handling computationally expensive fitness functions. In order to save the computational cost, a surrogate-assisted PSO with Pareto active learning is proposed. In real physical space(the objective functions are computationally expensive), PSO is used as an optimizer, and its optimization results are used to construct the surrogate models. In virtual space, objective functions are replaced by the cheaper surrogate models, PSO is viewed as a sampler to produce the candidate solutions. To enhance the quality of candidate solutions, a hybrid mutation sampling method based on the simulated evolution is proposed, which combines the advantage of fast convergence of PSO and implements mutation to increase diversity. Furthermore, ε-Pareto active learning(ε-PAL)method is employed to pre-select candidate solutions to guide PSO in the real physical space. However, little work has considered the method of determining parameter ε. Therefore, a greedy search method is presented to determine the value ofεwhere the number of active sampling is employed as the evaluation criteria of classification cost. Experimental studies involving application on a number of benchmark test problems and parameter determination for multi-input multi-output least squares support vector machines(MLSSVM) are given, in which the results demonstrate promising performance of the proposed algorithm compared with other representative multi-objective particle swarm optimization(MOPSO) algorithms.

A Predator-prey Particle Swarm Optimization Approach to Multiple UCAV Air Combat Modeled by Dynamic Game Theory

Dynamic game theory has received considerable attention as a promising technique for formulating control actions for agents in an extended complex enterprise that involves an adversary. At each decision making step, each side seeks the best scheme with the purpose of maximizing its own objective function. In this paper, a game theoretic approach based on predatorprey particle swarm optimization (PP-PSO) is presented, and the dynamic task assignment problem for multiple unmanned combat aerial vehicles (UCAVs) in military operation is decomposed and modeled as a two-player game at each decision stage. The optimal assignment scheme of each stage is regarded as a mixed Nash equilibrium, which can be solved by using the PP-PSO. The effectiveness of our proposed methodology is verified by a typical example of an air military operation that involves two opposing forces: the attacking force Red and the defense force Blue. © 2014 Chinese Association of Automation.

Forecasting of Software Reliability Using Neighborhood Fuzzy Particle Swarm Optimization Based Novel Neural Network

This paper proposes an artificial neural network(ANN) based software reliability model trained by novel particle swarm optimization(PSO) algorithm for enhanced forecasting of the reliability of software. The proposed ANN is developed considering the fault generation phenomenon during software testing with the fault complexity of different levels. We demonstrate the proposed model considering three types of faults residing in the software. We propose a neighborhood based fuzzy PSO algorithm for competent learning of the proposed ANN using software failure data. Fitting and prediction performances of the neighborhood fuzzy PSO based proposed neural network model are compared with the standard PSO based proposed neural network model and existing ANN based software reliability models in the literature through three real software failure data sets. We also compare the performance of the proposed PSO algorithm with the standard PSO algorithm through learning of the proposed ANN. Statistical analysis shows that the neighborhood fuzzy PSO based proposed neural network model has comparatively better fitting and predictive ability than the standard PSO based proposed neural network model and other ANN based software reliability models. Faster release of software is achievable by applying the proposed PSO based neural network model during the testing period.

Improved particle swarm optimization algorithm for fuzzy multi-class SVM

An improved particle swarm optimization（PSO） algorithm is proposed to train the fuzzy support vector machine（FSVM） for pattern multi-classification.In the improved algorithm,the particles studies not only from itself and the best one but also from the mean value of some other particles.In addition,adaptive mutation was introduced to reduce the rate of premature convergence.The experimental results on the synthetic aperture radar（SAR） target recognition of moving and stationary target acquisition and recognition（MSTAR） dataset and character recognition of MNIST database show that the improved algorithm is feasible and effective for fuzzy multi-class SVM training.

Sensors deployment optimization in multi-dimensional space based on improved particle swarm optimization algorithm

Sensors deployment optimization has become one of the most attractive fields in recent years. However, most of the previous work focused on the deployment problem in 2D space.Compared to the traditional form, sensors deployment in multidimensional space has greater research significance and practical potential to satisfy the detecting needs in complex environment.Aiming at solving this issue, a multi-dimensional space sensor network model is established, and the radar system is selected as an example. Considering the possible working mode of the radar system(e.g., searching and tracking), two distinctive deployment models are proposed based on maximum coverage area and maximum target detection probability in the attack direction respectively. The latter one is usually ignored in the previous literature.For uncovering the optimal deployment of the sensor network, the particle swarm optimization(PSO) algorithm is improved using the proposed weights determination scheme, in which the linear decreasing, the pooling strategy and the cloud theory are combined for weights updating. Experimental results illustrate the effectiveness of the proposed method.

Particle swarm optimization-based algorithm of a symplectic method for robotic dynamics and control

Multibody system dynamics provides a strong tool for the estimation of dynamic performances and the optimization of multisystem robot design. It can be described with differential algebraic equations(DAEs). In this paper, a particle swarm optimization(PSO) method is introduced to solve and control a symplectic multibody system for the first time. It is first combined with the symplectic method to solve problems in uncontrolled and controlled robotic arm systems. It is shown that the results conserve the energy and keep the constraints of the chaotic motion, which demonstrates the efficiency, accuracy, and time-saving ability of the method. To make the system move along the pre-planned path, which is a functional extremum problem, a double-PSO-based instantaneous optimal control is introduced. Examples are performed to test the effectiveness of the double-PSO-based instantaneous optimal control. The results show that the method has high accuracy, a fast convergence speed, and a wide range of applications.All the above verify the immense potential applications of the PSO method in multibody system dynamics.

Improved Oustaloup approximation of fractional-order operators using adaptive chaotic particle swarm optimization

A rational approximation method of the fractional-order derivative and integral operators is proposed. The turning fre- quency points are fixed in each frequency interval in the standard Oustaloup approximation. In the improved Oustaloup method, the turning frequency points are determined by the adaptive chaotic particle swarm optimization （PSO）. The average velocity is proposed to reduce the iterations of the PSO. The chaotic search scheme is combined to reduce the opportunity of the premature phenomenon. Two fitness functions are given to minimize the zero-pole and amplitude-phase frequency errors for the underlying optimization problems. Some numerical examples are compared to demonstrate the effectiveness and accuracy of this proposed rational approximation method.

基于PSO-Elman神经网络的井底风温预测模型

目前井下风温预测大多采用BP神经网络,但其预测精度受学习样本数量的影响,且容易陷入局部最优,Elman神经网络具备局部记忆能力,提高了网络的稳定性和动态适应能力,但仍然存在收敛速度过慢、易陷入局部最优的问题。针对上述问题,采用粒子群优化(PSO)算法对Elman神经网络的权值和阈值进行优化,建立了基于PSO-Elman神经网络的井底风温预测模型。分析得出入风相对湿度、入风温度、地面大气压力和井筒深度是井底风温的主要影响因素,因此将其作为模型的输入数据,模型的输出数据为井底风温。在相同样本数据集下的实验结果表明:Elman模型迭代90次后收敛,PSO-Elman模型迭代41次后收敛,说明PSO-Elman模型收敛速度更快;与BP神经网络模型、支持向量回归模型和Elman模型相比,PSO-Elman模型的预测误差较低,平均绝对误差、均方误差(MSE)、平均绝对百分比误差分别为0.376 0℃,0.278 3,1.95%,决定系数R^(2)为0.992 4,非常接近1,表明预测模型具有良好的预测效果。实例验证结果表明,PSO-Elman模型的相对误差范围为-4.69%~1.27%,绝对误差范围为-1.06~0.29℃,MSE为0.26,整体预测精度可满足井下实际需要。

Solving resource availability cost problem in project scheduling by pseudo particle swarm optimization

This paper considers a project scheduling problem with the objective of minimizing resource availability costs appealed to finish al activities before the deadline. There are finish-start type precedence relations among the activities which require some kinds of renewable resources. We predigest the process of sol-ving the resource availability cost problem （RACP） by using start time of each activity to code the schedule. Then, a novel heuris-tic algorithm is proposed to make the process of looking for the best solution efficiently. And then pseudo particle swarm optimiza-tion （PPSO） combined with PSO and path relinking procedure is presented to solve the RACP. Final y, comparative computational experiments are designed and the computational results show that the proposed method is very effective to solve RACP.

Optimal choice of parameters for particle swarm optimization

The constriction factor method (CFM) is a new variation of the basic particle swarm optimization (PSO), which has relatively better convergent nature. The effects of the major parameters on CFM were systematically investigated based on some benchmark functions. The constriction factor, velocity constraint, and population size all have significant impact on the per- formance of CFM for PSO. The constriction factor and velocity constraint have optimal values in practical application, and im- proper choice of these factors will lead to bad results. Increasing population size can improve the solution quality, although the computing time will be longer. The characteristics of CFM parameters are described and guidelines for determining parameter values are given in this paper.