Combinations of Estimation of Distribution Algorithms and Other Techniques

This paper summaries our recent work on combining estimation of distribution algorithms （EDA） and other techniques for solving hard search and optimization problems： a） guided mutation, an offspring generator in which the ideas from EDAs and genetic algorithms are combined together, we have shown that an evolutionary algorithm with guided mutation outperforms the best GA for the maximum clique problem, b） evolutionary algorithms refining a heuristic, we advocate a strategy for solving a hard optimization problem with complicated data structure, and c） combination of two different local search techniques and EDA for numerical global optimization problems, its basic idea is that not all the new generated points are needed to be improved by an expensive local search.

Archimedean copula estimation of distribution algorithm based on artificial bee colony algorithm

The artificial bee colony （ABC） algorithm is a com- petitive stochastic population-based optimization algorithm. How- ever, the ABC algorithm does not use the social information and lacks the knowledge of the problem structure, which leads to in- sufficiency in both convergent speed and searching precision. Archimedean copula estimation of distribution algorithm （ACEDA） is a relatively simple, time-economic and multivariate correlated EDA. This paper proposes a novel hybrid algorithm based on the ABC algorithm and ACEDA called Archimedean copula estima- tion of distribution based on the artificial bee colony （ACABC） algorithm. The hybrid algorithm utilizes ACEDA to estimate the distribution model and then uses the information to help artificial bees to search more efficiently in the search space. Six bench- mark functions are introduced to assess the performance of the ACABC algorithm on numerical function optimization. Experimen- tal results show that the ACABC algorithm converges much faster with greater precision compared with the ABC algorithm, ACEDA and the global best （gbest）-guided ABC （GABC） algorithm in most of the experiments.

An improved estimation of distribution algorithm for multi-compartment electric vehicle routing problem

The multi-compartment electric vehicle routing problem(EVRP)with soft time window and multiple charging types(MCEVRP-STW&MCT)is studied,in which electric multi-compartment vehicles that are environmentally friendly but need to be recharged in course of transport process,are employed.A mathematical model for this optimization problem is established with the objective of minimizing the function composed of vehicle cost,distribution cost,time window penalty cost and charging service cost.To solve the problem,an estimation of the distribution algorithm based on Lévy flight(EDA-LF)is proposed to perform a local search at each iteration to prevent the algorithm from falling into local optimum.Experimental results demonstrate that the EDA-LF algorithm can find better solutions and has stronger robustness than the basic EDA algorithm.In addition,when comparing with existing algorithms,the result shows that the EDA-LF can often get better solutions in a relatively short time when solving medium and large-scale instances.Further experiments show that using electric multi-compartment vehicles to deliver incompatible products can produce better results than using traditional fuel vehicles.

A novel hybrid estimation of distribution algorithm for solving hybrid flowshop scheduling problem with unrelated parallel machine

The hybrid flow shop scheduling problem with unrelated parallel machine is a typical NP-hard combinatorial optimization problem, and it exists widely in chemical, manufacturing and pharmaceutical industry. In this work, a novel mathematic model for the hybrid flow shop scheduling problem with unrelated parallel machine(HFSPUPM) was proposed. Additionally, an effective hybrid estimation of distribution algorithm was proposed to solve the HFSPUPM, taking advantage of the features in the mathematic model. In the optimization algorithm, a new individual representation method was adopted. The(EDA) structure was used for global search while the teaching learning based optimization(TLBO) strategy was used for local search. Based on the structure of the HFSPUPM, this work presents a series of discrete operations. Simulation results show the effectiveness of the proposed hybrid algorithm compared with other algorithms.

Gaussian process assisted coevolutionary estimation of distribution algorithm for computationally expensive problems

In order to reduce the computation of complex problems, a new surrogate-assisted estimation of distribution algorithm with Gaussian process was proposed. Coevolution was used in dual populations which evolved in parallel. The search space was projected into multiple subspaces and searched by sub-populations. Also, the whole space was exploited by the other population which exchanges information with the sub-populations. In order to make the evolutionary course efficient, multivariate Gaussian model and Gaussian mixture model were used in both populations separately to estimate the distribution of individuals and reproduce new generations. For the surrogate model, Gaussian process was combined with the algorithm which predicted variance of the predictions. The results on six benchmark functions show that the new algorithm performs better than other surrogate-model based algorithms and the computation complexity is only 10% of the original estimation of distribution algorithm.

Improved Estimation of Distribution Algorithm for Solving Unrelated Parallel Machine Scheduling Problem

Scheduling problem is a well-known combinatorial optimization problem.An effective improved estimation of distribution algorithm(IEDA) was proposed for minimizing the makespan of the unrelated parallel machine scheduling problem(UPMSP).Mathematical description was given for the UPMSP.The IEDA which was combined with variable neighborhood search(IEDA_VNS) was proposed to solve the UPMSP in order to improve local search ability.A new encoding method was designed for representing the feasible solutions of the UPMSP.More knowledge of the UPMSP were taken consideration in IEDA_ VNS for probability matrix which was based the processing time matrix.The simulation results show that the proposed IEDA_VNS can solve the problem effectively.

Estimation of Distribution Algorithm with Multivariate <i>T</i>-Copulas for Multi-Objective Optimization

Estimation of distribution algorithms are a class of evolutionary optimization algorithms based on probability distribution model. In this article, a Pareto-based multi-objective estimation of distribution algorithm with multivariate T-copulas is proposed. The algorithm employs Pareto-based approach and multivariate T-copulas to construct probability distribution model. To estimate joint distribution of the selected solutions, the correlation matrix of T-copula is firstly estimated by estimating Kendall’s tau and using the relationship of Kendall’s tau and correlation matrix. After the correlation matrix is estimated, the degree of freedom of T-copula is estimated by using the maximum likelihood method. Afterwards, the Monte Carte simulation is used to generate new individuals. An archive with maximum capacity is used to maintain the non-dominated solutions. The Pareto optimal solutions are selected from the archive on the basis of the diversity of the solutions, and the crowding-distance measure is used for the diversity measurement. The archive gets updated with the inclusion of the non-dominated solutions from the combined population and current archive, and the archive which exceeds the maximum capacity is cut using the diversity consideration. The proposed algorithm is applied to some well-known benchmark. The relative experimental results show that the algorithm has better performance and is effective.

An effective estimation of distribution algorithm for parallel litho machine scheduling with reticle constraints

In order to improve the scheduling efficiency of photolithography,bottleneck process of wafer fabrications in the semiconductor industry,an effective estimation of distribution algorithm is proposed for scheduling problems of parallel litho machines with reticle constraints,where multiple reticles are available for each reticle type.First,the scheduling problem domain of parallel litho machines is described with reticle constraints and mathematical programming formulations are put forward with the objective of minimizing total weighted completion time.Second,estimation of distribution algorithm is developed with a decoding scheme specially designed to deal with the reticle constraints.Third,an insert-based local search with the first move strategy is introduced to enhance the local exploitation ability of the algorithm.Finally,simulation experiments and analysis demonstrate the effectiveness of the proposed algorithm.

A unified Minorization-Maximization approach for estimation of general mixture models

The mixed distribution model is often used to extract information from heteroge-neous data and perform modeling analysis.When the density function of mixed distribution is complicated or the variable dimension is high,it usually brings challenges to the parameter es-timation of the mixed distribution model.The application of MM algorithm can avoid complex expectation calculations,and can also solve the problem of high-dimensional optimization by decomposing the objective function.In this paper,MM algorithm is applied to the parameter estimation problem of mixed distribution model.The method of assembly and decomposition is used to construct the substitute function with separable parameters,which avoids the problems of complex expectation calculations and the inversion of high-dimensional matrices.

2-D distributed pose estimation of multi-agent systems using bearing measurements

This article studies distributed pose(orientation and position)estimation of leader–follower multi-agent systems over𝜅-layer graphs in 2-D plane.Only the leaders have access to their orientations and positions,while the followers can measure the relative bearings or(angular and linear)velocities in their unknown local coordinate frames.For the orientation estimation,the local relative bearings are used to obtain the relative orientations among the agents,based on which a distributed orientation estimation algorithm is proposed for each follower to estimate its orientation.For the position estimation,the local relative bearings are used to obtain the position constraints among the agents,and a distributed position estimation algorithm is proposed for each follower to estimate its position by solving its position constraints.Both the orientation and position estimation errors converge to zero asymptotically.A simulation example is given to verify the theoretical results.

Optimization by Estimation of Distribution with DEUM Framework Based on Markov Random Fields

This paper presents a Markov random field （MRP） approach to estimating and sampling the probability distribution in populations of solutions. The approach is used to define a class of algorithms under the general heading distribution estimation using Markov random fields （DEUM）. DEUM is a subclass of estimation of distribution algorithms （EDAs） where interaction between solution variables is represented as an undirected graph and the joint probability of a solution is factorized as a Gibbs distribution derived from the structure of the graph. The focus of this paper will be on describing the three main characteristics of DEUM framework, which distinguishes it from the traditional EDA. They are： 1） use of MRF models, 2） fitness modeling approach to estimating the parameter of the model and 3） Monte Carlo approach to sampling from the model.

Dynamic threshold for SPWVD parameter estimation based on Otsu algorithm

Time-frequency-based methods are proven to be effective for parameter estimation of linear frequency modulation （LFM） signals. The smoothed pseudo Winger-Ville distribution （SPWVD） is used for the parameter estimation of multi-LFM signals, and a method of the SPWVD binarization by a dynamic threshold based on the Otsu algorithm is proposed. The proposed method is effective in the demand for the estimation of different parameters and the unknown signal-to-noise ratio （SNR） circumstance. The performance of this method is confirmed by numerical simulation.

State simulation of water distribution networks based on DFP algorithm

The improved weighted-least-square model was used for state simulation of water distribution networks. And DFP algorithm was applied to get the model solution. In order to fit DFP algorithm,the initial model was transformed into a non-constrained optimization problem using mass conservation. Then,through one dimensional optimization and scale matrix establishment,the feasible direction of iteration was obtained,and the values of state variables could be calculated. After several iterations,the optimal estimates of state variables were worked out and state simulation of water distribution networks was achieved as a result. A program of DFP algorithm is developed with Delphi 7 for verification. By running on a designed network,which is composed of 55 nodes,94 pipes and 40 loops,it is proved that DFP algorithm can quickly get the convergence. After 36 iterations,the root mean square of all nodal head errors is reduced by 90.84% from 5.57 to 0.51 m,and the maximum error is only 1.30 m. Compared to Marquardt algorithm,the procedure of DFP algorithm is more stable,and the initial values have less influences on calculation accuracy. Therefore,DFP algorithm can be used for real-time simulation of water distribution networks.

超启发式三维EDA求解绿色双边装配线平衡问题

针对绿色机器人的第Ⅰ类双边装配线平衡问题(green robotic two-sided assembly line balancing problem of type-Ⅰ, GRTALBP-Ⅰ),建立问题模型并提出一种超启发式三维分布估计算法(hyperheuristic three dimensional estimation of distribution algorithm, HH3DEDA)进行求解。在HH3DEDA中,结合问题特征,设计基于工序选择因子的组合编码,进而设计高低分层结构的HH3DEDA。在高层,采用三维概率矩阵学习优质高层个体中块结构及其分布信息,后通过采样该矩阵以生成新的高层个体,其中高层个体由结合问题特点设计的12种启发式操作的排列构成;在低层,将高层每个个体所确定启发式操作排列作为一种新的启发式算法对GRTALBP-Ⅰ解空间执行较深入搜索。同时,引入机器人开关机节能策略,进一步提升所获取非支配解的质量。通过仿真对比实验,验证了所提算法的有效性。

Statistical Inference for the Parameter of Rayleigh Distribution Based on Progressively Type-I Interval Censored Sample

In this paper, the estimation of parameters based on a progressively type-I interval censored sample from a Rayleigh distribution is studied. Different methods of estimation are discussed. They include mid-point approximation estima- tor, the maximum likelihood estimator, moment estimator, Bayes estimator, sampling adjustment moment estimator, sampling adjustment maximum likelihood estimator and estimator based on percentile. The estimation procedures are discussed in details and compared via Monte Carlo simulations in terms of their biases.

混合EDA求解绿色机器人U型装配线平衡问题

针对带序相关约束的绿色机器人第2类U型装配线问题(GRSDUALBP-2),建立了以同时最小化节拍时间和能耗为优化目标的数学模型,并提出一种混合分布估计算法(HEDA)进行求解。首先,在算法编码解码阶段考虑工序与机器人分配的协同优化,设计一种操作分配规则以提高解码效率;然后,在算法优化阶段采用基于概率模型的分布估计算法(EDA),以有效积累和学习优质解信息,并设计3种邻域策略以进一步提高算法局部搜索性能;最后,通过仿真实验与算法对比,验证了HEDA是求解GRSDUALBP-2的有效算法。

混合三维EDA求解带二维装载约束的车辆配送与分布式生产集成调度问题

针对一类广泛存在的带二维装载约束的车辆配送与分布式生产集成调度问题(VD2LDPISP),本文建立问题模型,并提出混合三维分布估计算法(H3DEDA)进行求解.首先,结合问题各阶段特性,采用各阶段成本均衡策略设计新颖的解码规则,对编码个体进行分阶段解码,可确定较高质量的解码个体.其次,采用三维分布估计算法(3DEDA)学习和积累种群中优质编码个体的块结构及其位置信息,再通过采样3DEDA中的概率模型生成新的编码个体,从而提高算法全局搜索发现解空间中优质解区域的能力.然后,设计高低分层的超启发式局部搜索(HHLS)来增强算法的局部寻优能力.HHLS的低层问题域包含分别针对编码个体、配送阶段解码子个体和生产阶段解码子个体的共16种有效邻域操作,其高层策略域采用概率模型学习优质邻域操作排列的结构信息,进而通过采样该模型来直接控制新邻域操作排列的生成,有利于对不同优质区域进行深入搜索.最后,在不同规模测试问题上的算法比较,验证了所提H3DEDA的有效性.

Adaptive Multisensor Tracking Fusion Algorithm for Air－borne Distributed Passive Sensor Network

Single passive sensor tracking algorithms have four disadvantages: bad stability, longdynamic time, big bias and sensitive to initial conditions. So the corresponding fusion algorithm results in bad performance. A new error analysis method for two passive sensor tracking system is presented and the error equations are deduced in detail. Based on the equations, we carry out theoretical computation and Monte Carlo computer simulation. The results show the correctness of our error computation equations. With the error equations, we present multiple 'two station'fusion algorithm using adaptive pseudo measurement equations. This greatly enhances the tracking performance and makes the algorithm convergent very fast and not sensitive to initial conditions.Simulation results prove the correctness of our new algorithm.

Large-Scale Estimation of Distribution Algorithms with Adaptive Heavy Tailed Random Pro jection Ensembles

We present new variants of Estimation of Distribution Algorithms (EDA) for large-scale continuous optimisation that extend and enhance a recently proposed random projection (RP) ensemble based approach. The main novelty here is to depart from the theory of RPs that require (sub-)Gaussian random matrices for norm-preservation, and instead for the purposes of high-dimensional search we propose to employ random matrices with independent and identically distributed entries drawn from a t-distribution. We analytically show that the implicitly resulting high-dimensional covariance of the search distribution is enlarged as a result. Moreover, the extent of this enlargement is controlled by a single parameter, the degree of freedom. For this reason, in the context of optimisation, such heavy tailed random matrices turn out to be preferable over the previously employed (sub-)Gaussians. Based on this observation, we then propose novel covariance adaptation schemes that are able to adapt the degree of freedom parameter during the search, and give rise to a flexible approach to balance exploration versus exploitation. We perform a thorough experimental study on high-dimensional benchmark functions, and provide statistical analyses that demonstrate the state-of-the-art performance of our approach when compared with existing alternatives in problems with 1000 search variables.

Inference and Properties of Mixture Two Extreme Lower Bound Distributions

In this paper, we discuss the mixture model of two extreme lower bound distributions. First, some properties we obtain of the model with hazard function are discussed. In addition, the estimates of the unknown parameters via the EM algorithm are obtained. The performance of the findings in the paper is showed by demonstrating some numerical illustrations through Monte Carlo simulation.