Enhancing Evolutionary Algorithms With Pattern Mining for Sparse Large-Scale Multi-Objective Optimization Problems

Sparse large-scale multi-objective optimization problems(SLMOPs)are common in science and engineering.However,the large-scale problem represents the high dimensionality of the decision space,requiring algorithms to traverse vast expanse with limited computational resources.Furthermore,in the context of sparse,most variables in Pareto optimal solutions are zero,making it difficult for algorithms to identify non-zero variables efficiently.This paper is dedicated to addressing the challenges posed by SLMOPs.To start,we introduce innovative objective functions customized to mine maximum and minimum candidate sets.This substantial enhancement dramatically improves the efficacy of frequent pattern mining.In this way,selecting candidate sets is no longer based on the quantity of nonzero variables they contain but on a higher proportion of nonzero variables within specific dimensions.Additionally,we unveil a novel approach to association rule mining,which delves into the intricate relationships between non-zero variables.This novel methodology aids in identifying sparse distributions that can potentially expedite reductions in the objective function value.We extensively tested our algorithm across eight benchmark problems and four real-world SLMOPs.The results demonstrate that our approach achieves competitive solutions across various challenges.

A Two-Layer Encoding Learning Swarm Optimizer Based on Frequent Itemsets for Sparse Large-Scale Multi-Objective Optimization

Traditional large-scale multi-objective optimization algorithms(LSMOEAs)encounter difficulties when dealing with sparse large-scale multi-objective optimization problems(SLM-OPs)where most decision variables are zero.As a result,many algorithms use a two-layer encoding approach to optimize binary variable Mask and real variable Dec separately.Nevertheless,existing optimizers often focus on locating non-zero variable posi-tions to optimize the binary variables Mask.However,approxi-mating the sparse distribution of real Pareto optimal solutions does not necessarily mean that the objective function is optimized.In data mining,it is common to mine frequent itemsets appear-ing together in a dataset to reveal the correlation between data.Inspired by this,we propose a novel two-layer encoding learning swarm optimizer based on frequent itemsets(TELSO)to address these SLMOPs.TELSO mined the frequent terms of multiple particles with better target values to find mask combinations that can obtain better objective values for fast convergence.Experi-mental results on five real-world problems and eight benchmark sets demonstrate that TELSO outperforms existing state-of-the-art sparse large-scale multi-objective evolutionary algorithms(SLMOEAs)in terms of performance and convergence speed.

A Disturbance Localization Method for Power System Based on Group Sparse Representation and Entropy Weight Method

This paper addresses the problem of complex and challenging disturbance localization in the current power system operation environment by proposing a disturbance localization method for power systems based on group sparse representation and entropy weight method.Three different electrical quantities are selected as observations in the compressed sensing algorithm.The entropy weighting method is employed to calculate the weights of different observations based on their relative disturbance levels.Subsequently,by leveraging the topological information of the power system and pre-designing an overcomplete dictionary of disturbances based on the corresponding system parameter variations caused by disturbances,an improved Joint Generalized Orthogonal Matching Pursuit(J-GOMP)algorithm is utilized for reconstruction.The reconstructed sparse vectors are divided into three parts.If at least two parts have consistent node identifiers,the node is identified as the disturbance node.If the node identifiers in all three parts are inconsistent,further analysis is conducted considering the weights to determine the disturbance node.Simulation results based on the IEEE 39-bus system model demonstrate that the proposed method,utilizing electrical quantity information from only 8 measurement points,effectively locates disturbance positions and is applicable to various disturbance types with strong noise resistance.

线性测量误差回归模型下Sparse Group Lasso方法研究

双重稀疏结构的线性回归模型是一种描述解释变量组间和组内同时具有稀疏性的统计模型,我们常用Sparse Group Lasso对此模型进行变量选择.然而在很多应用中,解释变量很难做到精确测量,从而我们在应用Sparse Group Lasso方法时需要考虑测量误差的影响.针对这一问题,本文提出了一种具有双重稀疏结构的线性测量误差回归模型的Sparse Group Lasso变量选择方法(MESGL).该方法先利用半正定投影算子对观测数据的误差进行修正,然后借助ADMM算法对修正后的数据进行恢复,最后利用Sparse Group Lasso方法进行变量选择和参数估计.在一些正则条件下,我们建立了参数估计量的非渐近Oracle不等式,并且通过随机模拟分析验证了MESGL方法在变量选择和参数估计上取得的良好效果.

Sparse Planar Retrodirective Antenna Array Using Improved Adaptive Genetic Algorithm

An improved adaptive genetic algorithm is presented in this paper. It primarily includes two modified methods： one is novel adaptive probabilities of crossover and mutation, the other is truncated selection approach. This algorithm has been validated to be superior to the simple genetic algorithm （SGA） by a complicated binary testing function. Then the proposed algorithm is applied to optimizing the planar retrodirective array to reduce the cost of the hardware. The fitness function is discussed in the optimization example. After optimization, the sparse planar retrodirective antenna array keeps excellent retrodirectivity, while the array architecture has been simplified by 34%. The optimized antenna array can replace uniform full array effectively. Results show that this work will gain more engineering benefits in practice.

A SPARSE MATRIX TECHNIQUE FOR SIMULATING SEMICONDUCTOR DEVICES AND ITS ALGORITHMS

A novel sparse matrix technique for the numerical analysis of semiconductor devicesand its algorithms are presented.Storage scheme and calculation procedure of the sparse matrixare described in detail.The sparse matrix technique in the device simulation can decrease storagegreatly with less CPU time and its implementation is very easy.Some algorithms and calculationexamples to show the time and space characteristics of the sparse matrix are given.

Sparse reconstruction for fluorescence molecular tomography via a fast iterative algorithm

Fluorescence molecular tomography(FMT)is a fast-developing optical imaging modalitythat has great potential in early diagnosis of disease and drugs development.However,recon-struction algorithms have to address a highly ill-posed problem to fulfll 3D reconstruction inFMT.In this contribution,we propose an efficient iterative algorithm to solve the large-scalereconstruction problem,in which the sparsity of fluorescent targets is taken as useful a prioriinformation in designing the reconstruction algorithm.In the implementation,a fast sparseapproximation scheme combined with a stage-wise learning strategy enable the algorithm to dealwith the ill-posed inverse problem at reduced computational costs.We validate the proposed fastiterative method with numerical simulation on a digital mouse model.Experimental results demonstrate that our method is robust for different finite element meshes and different Poissonnoise levels.

Jointly-check iterative decoding algorithm for quantum sparse graph codes

For quantum sparse graph codes with stabilizer formalism, the unavoidable girth-four cycles in their Tanner graphs greatly degrade the iterative decoding performance with standard belief-propagation （BP） algorithm. In this paper, we present a jointly-check iterative algorithm suitable for decoding quantum sparse graph codes efficiently. Numerical simulations show that this modified method outperforms standard BP algorithm with an obvious performance improvement.

New regularization method and iteratively reweighted algorithm for sparse vector recovery

Motivated by the study of regularization for sparse problems,we propose a new regularization method for sparse vector recovery.We derive sufficient conditions on the well-posedness of the new regularization,and design an iterative algorithm,namely the iteratively reweighted algorithm(IR-algorithm),for efficiently computing the sparse solutions to the proposed regularization model.The convergence of the IR-algorithm and the setting of the regularization parameters are analyzed at length.Finally,we present numerical examples to illustrate the features of the new regularization and algorithm.

Fast Sparse Multipath Channel Estimation with Smooth L0 Algorithm for Broadband Wireless Communication Systems

Broadband wireless channels are often time dispersive and become strongly frequency selective in delay spread domain. Commonly, these channels are composed of a few dominant coefficients and a large part of coefficients are approximately zero or under noise floor. To exploit sparsity of multi-path channels (MPCs), there are various methods have been proposed. They are, namely, greedy algorithms, iterative algorithms, and convex program. The former two algorithms are easy to be implemented but not stable;on the other hand, the last method is stable but difficult to be implemented as practical channel estimation problems be-cause of computational complexity. In this paper, we introduce a novel channel estimation strategy using smooth L0 (SL0) algorithm which combines stable and low complexity. Computer simulations confirm the effectiveness of the introduced algorithm. We also give various simulations to verify the sensing training signal method.

Research on Parking Path Planing Based on A-Star Algorithm

The issue of finding available parking spaces and mitigating conges-tion during parking is a persistent challenge for numerous car owners in urban areas.In this paper,we propose a novel method based on the A-star algorithm to calculate the optimal parking path to address this issue.We integrate a road impedance function into the conventional A-star algorithm to compute path duration and adopt a fusion function composed of path length and duration as the weight matrix for the A-star algorithm to achieve optimal path planning.Furthermore,we conduct simulations using parking lot modeling to validate the effectiveness of our approach,which can provide car drivers with a reliable optimal parking navigation route,reduce their parking costs,and enhance their parking experience.

A Local Sparse Screening Identification Algorithm with Applications

Extracting nonlinear governing equations from noisy data is a central challenge in the analysis of complicated nonlinear behaviors.Despite researchers follow the sparse identification nonlinear dynamics algorithm(SINDy)rule to restore nonlinear equations,there also exist obstacles.One is the excessive dependence on empirical parameters,which increases the difficulty of data pre-processing.Another one is the coexistence of multiple coefficient vectors,which causes the optimal solution to be drowned in multiple solutions.The third one is the composition of basic function,which is exclusively applicable to specific equations.In this article,a local sparse screening identification algorithm(LSSI)is proposed to identify nonlinear systems.First,we present the k-neighbor parameter to replace all empirical parameters in data filtering.Second,we combine the mean error screening method with the SINDy algorithm to select the optimal one from multiple solutions.Third,the time variable t is introduced to expand the scope of the SINDy algorithm.Finally,the LSSI algorithm is applied to recover a classic ODE and a bi-stable energy harvester system.The results show that the new algorithm improves the ability of noise immunity and optimal parameters identification provides a desired foundation for nonlinear analyses.

Numerical Studies of the Generalized <i>l</i>₁Greedy Algorithm for Sparse Signals

The generalized l1 greedy algorithm was recently introduced and used to reconstruct medical images in computerized tomography in the compressed sensing framework via total variation minimization. Experimental results showed that this algorithm is superior to the reweighted l1-minimization and l1 greedy algorithms in reconstructing these medical images. In this paper the effectiveness of the generalized l1 greedy algorithm in finding random sparse signals from underdetermined linear systems is investigated. A series of numerical experiments demonstrate that the generalized l1 greedy algorithm is superior to the reweighted l1-minimization and l1 greedy algorithms in the successful recovery of randomly generated Gaussian sparse signals from data generated by Gaussian random matrices. In particular, the generalized l1 greedy algorithm performs extraordinarily well in recovering random sparse signals with nonzero small entries. The stability of the generalized l1 greedy algorithm with respect to its parameters and the impact of noise on the recovery of Gaussian sparse signals are also studied.

The Pre-processing Parallel Algorithm of A Sparse Linear Equation Group

The solution of linear equation group can be applied to the oil exploration, the structure vibration analysis, the computational fluid dynamics, and other fields. When we make the in-depth analysis of some large or very large complicated structures, we must use the parallel algorithm with the aid of high-performance computers to solve complex problems. This paper introduces the implementation process having the parallel with sparse linear equations from the perspective of sparse linear equation group.

Stability and performance analysis of the compressed Kalman filter algorithm for sparse stochastic systems

This paper considers the problem of estimating unknown sparse time-varying signals for stochastic dynamic systems.To deal with the challenges of extensive sparsity,we resort to the compressed sensing method and propose a compressed Kalman filter(KF)algorithm.Our algorithm first compresses the original high-dimensional sparse regression vector via the sensing matrix and then obtains a KF estimate in the compressed low-dimensional space.Subsequently,the original high-dimensional sparse signals can be well recovered by a reconstruction technique.To ensure stability and establish upper bounds on the estimation errors,we introduce a compressed excitation condition without imposing independence or stationarity on the system signal,and therefore suitable for feedback systems.We further present the performance of the compressed KF algorithm.Specifically,we show that the mean square compressed tracking error matrix can be approximately calculated by a linear deterministic difference matrix equation,which can be readily evaluated,analyzed,and optimized.Finally,a numerical example demonstrates that our algorithm outperforms the standard uncompressed KF algorithm and other compressed algorithms for estimating high-dimensional sparse signals.

A stochastic gradient-based two-step sparse identification algorithm for multivariate ARX systems

We consider the sparse identification of multivariate ARX systems, i.e., to recover the zero elements of the unknown parameter matrix. We propose a two-step algorithm, where in the first step the stochastic gradient (SG) algorithm is applied to obtain initial estimates of the unknown parameter matrix and in the second step an optimization criterion is introduced for the sparse identification of multivariate ARX systems. Under mild conditions, we prove that by minimizing the criterion function, the zero elements of the unknown parameter matrix can be recovered with a finite number of observations. The performance of the algorithm is testified through a simulation example.

PERFORMANCE OF SIMPLE-ENCODING IRREGULAR LDPC CODES BASED ON SPARSE GENERATOR MATRIX

A new method for the construction of the high performance systematic irregular low-density paritycheck （LDPC） codes based on the sparse generator matrix （G-LDPC） is introduced. The code can greatly reduce the encoding complexity while maintaining the same decoding complexity as traditional regular LDPC （H-LDPC） codes defined by the sparse parity check matrix. Simulation results show that the performance of the proposed irregular LDPC codes can offer significant gains over traditional LDPC codes in low SNRs with a few decoding iterations over an additive white Gaussian noise （AWGN） channel.

Recursive Dictionary-Based Simultaneous Orthogonal Matching Pursuit for Sparse Unmixing of Hyperspectral Data

The sparse unmixing problem of greedy algorithms still remains a great challenge at finding an optimal subset of endmembers for the observed data from the spectral library,due to the usually high correlation of the spectral library.Under such circumstances,a novel greedy algorithm for sparse unmixing of hyperspectral data is presented,termed the recursive dictionary-based simultaneous orthogonal matching pursuit(RD-SOMP).The algorithm adopts a block-processing strategy to divide the whole hyperspectral image into several blocks.At each iteration of the block,the spectral library is projected into the orthogonal subspace and renormalized,which can reduce the correlation of the spectral library.Then RD-SOMP selects a new endmember with the maximum correlation between the current residual and the orthogonal subspace of the spectral library.The endmembers picked in all the blocks are associated as the endmember sets of the whole hyperspectral data.Finally,the abundances are estimated using the whole hyperspectral data with the obtained endmember sets.It can be proved that RD-SOMP can recover the optimal endmembers from the spectral library under certain conditions.Experimental results demonstrate that the RD-SOMP algorithm outperforms the other algorithms,with a better spectral unmixing accuracy.

INTERPOLATION TECHNIQUE FOR SPARSE DATA BASED ON INFORMATION DIFFUSION PRINCIPLE-ELLIPSE MODEL

Addressing the difficulties of scattered and sparse observational data in ocean science,a new interpolation technique based on information diffusion is proposed in this paper.Based on a fuzzy mapping idea,sparse data samples are diffused and mapped into corresponding fuzzy sets in the form of probability in an interpolation ellipse model.To avoid the shortcoming of normal diffusion function on the asymmetric structure,a kind of asymmetric information diffusion function is developed and a corresponding algorithm-ellipse model for diffusion of asymmetric information is established.Through interpolation experiments and contrast analysis of the sea surface temperature data with ARGO data,the rationality and validity of the ellipse model are assessed.

Sparse Solutions of Mixed Complementarity Problems

In this paper, we consider an extragradient thresholding algorithm for finding the sparse solution of mixed complementarity problems (MCPs). We establish a relaxation l1 regularized projection minimization model for the original problem and design an extragradient thresholding algorithm (ETA) to solve the regularized model. Furthermore, we prove that any cluster point of the sequence generated by ETA is a solution of MCP. Finally, numerical experiments show that the ETA algorithm can effectively solve the l1 regularized projection minimization model and obtain the sparse solution of the mixed complementarity problem.