A cautious projection BFGS method is proposed for solving nonconvex unconstrained optimization problems.The global convergence of this method as well as a stronger general convergence result can be proven without a gr...A cautious projection BFGS method is proposed for solving nonconvex unconstrained optimization problems.The global convergence of this method as well as a stronger general convergence result can be proven without a gradient Lipschitz continuity assumption,which is more in line with the actual problems than the existing modified BFGS methods and the traditional BFGS method.Under some additional conditions,the method presented has a superlinear convergence rate,which can be regarded as an extension and supplement of BFGS-type methods with the projection technique.Finally,the effectiveness and application prospects of the proposed method are verified by numerical experiments.展开更多
Selection, crossover, and mutation are three main operators of the canonical genetic algorithm (CGA). This paper presents a new approach to the genetic algorithm. This new approach applies only to mutation and selecti...Selection, crossover, and mutation are three main operators of the canonical genetic algorithm (CGA). This paper presents a new approach to the genetic algorithm. This new approach applies only to mutation and selection operators. The paper proves that the search process of the non-crossover genetic algorithm (NCGA) is an ergodic homogeneous Markov chain. The proof of its convergence to global optimum is presented. Some nonlinear multi-modal optimization problems are applied to test the efficacy of the NCGA. NP-hard traveling salesman problem (TSP) is cited here as the benchmark problem to test the efficiency of the algorithm. The simulation result shows that NCGA achieves much faster convergence speed than CGA in terms of CPU time. The convergence speed per epoch of NCGA is also faster than that of CGA.展开更多
This paper explores the convergence of a class of optimally conditioned self scaling variable metric (OCSSVM) methods for unconstrained optimization. We show that this class of methods with Wolfe line search are glob...This paper explores the convergence of a class of optimally conditioned self scaling variable metric (OCSSVM) methods for unconstrained optimization. We show that this class of methods with Wolfe line search are globally convergent for general convex functions.展开更多
A new smoothing method is proposed. The smoothing process adapts to image characteristics and is good at preserving local image structures. More importantly, in the theory under the conditions weaker than those in the...A new smoothing method is proposed. The smoothing process adapts to image characteristics and is good at preserving local image structures. More importantly, in the theory under the conditions weaker than those in the original Kaanov method an approximal sequence of solutions to the variational problems can be constructed and the global convergence can be proved. And the conditions in the papers of Schno¨rr(1994) and Heers, et al (2001) are discussed. Numerical solutions of the model are given.展开更多
This paper presents a trust region two phase model algorithm for solving the equality and bound constrained nonlinear optimization problem. A concept of substationary point is given. Under suitable assumptions,the gl...This paper presents a trust region two phase model algorithm for solving the equality and bound constrained nonlinear optimization problem. A concept of substationary point is given. Under suitable assumptions,the global convergence of this algorithm is proved without assuming the linear independence of the gradient of active constraints. A numerical example is also presented.展开更多
Some papers on stochastic adaptive control schemes have established convergence algorithm using a least-squares parameters. With the popular application of GPC, global convergence has become a key problem in automatic...Some papers on stochastic adaptive control schemes have established convergence algorithm using a least-squares parameters. With the popular application of GPC, global convergence has become a key problem in automatic control theory. However, now global convergence of GPC has not been established for algorithms in computing a least squares iteration. A generalized model of adaptive generalized predictive control is presented. The global convergebce is also given on the basis of estimating the parameters of GPC by least squares algorithm.展开更多
A trust region algorithm for equality constrained optimization is given in this paper.The algorithm does not enforce strict monotonicity of the merit function for every iteration.Global convergence of the algorithm i...A trust region algorithm for equality constrained optimization is given in this paper.The algorithm does not enforce strict monotonicity of the merit function for every iteration.Global convergence of the algorithm is proved under the same conditions of usual trust region method.展开更多
An adaptive genetic algorithm with diversity-guided mutation, which combines adaptive probabilities of crossover and mutation was proposed. By means of homogeneous finite Markov chains, it is proved that adaptive gene...An adaptive genetic algorithm with diversity-guided mutation, which combines adaptive probabilities of crossover and mutation was proposed. By means of homogeneous finite Markov chains, it is proved that adaptive genetic algorithm with diversity-guided mutation and genetic algorithm with diversity-guided mutation converge to the global optimum if they maintain the best solutions, and the convergence of adaptive genetic algorithms with adaptive probabilities of crossover and mutation was studied. The performances of the above algorithms in optimizing several unimodal and multimodal functions were compared. The results show that for multimodal functions the average convergence generation of the adaptive genetic algorithm with diversity-guided mutation is about 900 less than that of (adaptive) genetic algorithm with adaptive probabilities and genetic algorithm with diversity-guided mutation, and the adaptive genetic algorithm with diversity-guided mutation does not lead to premature convergence. It is also shown that the better balance between overcoming premature convergence and quickening convergence speed can be gotten.展开更多
A global fast convergent integrated guidance and control design approach is proposed. A disturbance observer is utilized to estimate the uncertainties of integrated guidance and control model in finite time. According...A global fast convergent integrated guidance and control design approach is proposed. A disturbance observer is utilized to estimate the uncertainties of integrated guidance and control model in finite time. According to the multiple sliding-mode surface control, the independent nonsingular terminal sliding functions are presented in each step, and all the sliding-mode surfaces run parallel. These presented sliding-mode surfaces keep zero value from a certain time, and the system states converge quickly in sliding phase. Therefore, the system response speed is increased. The proposed method offers the global convergent time analytically, which is useful to optimize the transient performance of system. Simulation results are used to verify the proposed method.展开更多
The computational uncertainty principle in nonlinear ordinary differential equations makes the numerical solution of the long-term behavior of nonlinear atmospheric equations have no meaning. The main reason is that, ...The computational uncertainty principle in nonlinear ordinary differential equations makes the numerical solution of the long-term behavior of nonlinear atmospheric equations have no meaning. The main reason is that, in the error analysis theory of present-day computational mathematics, the non-linear process between truncation error and rounding error is treated as a linear operation. In this paper, based on the operator equations of large-scale atmospheric movement, the above limitation is overcome by using the notion of cell mapping. Through studying the global asymptotic characteristics of the numerical pattern of the large-scale atmospheric equations, the definitions of the global convergence and an appropriate discrete algorithm of the numerical pattern are put forward. Three determinant theorems about the global convergence of the numerical pattern are presented, which provide the theoretical basis for constructing the globally convergent numerical pattern. Further, it is pointed out that only a globally convergent numerical pattern can improve the veracity of climatic prediction.展开更多
A trust-region algorithm is presented for a nonlinear optimization problem of equality-constraints. The characterization of the algorithm is using inexact gradient information. Global convergence results are demonstra...A trust-region algorithm is presented for a nonlinear optimization problem of equality-constraints. The characterization of the algorithm is using inexact gradient information. Global convergence results are demonstrated where the gradient values are obeyed a simple relative error condition.展开更多
Angle rigid multi-agent formations can simultaneously undergo translational,rotational,and scaling maneuvering,therefore combining the maneuvering capabilities of both distance and bearing rigid formations.However,man...Angle rigid multi-agent formations can simultaneously undergo translational,rotational,and scaling maneuvering,therefore combining the maneuvering capabilities of both distance and bearing rigid formations.However,maneuvering angle rigid formations in 2D or 3D with global convergence guarantees is shown to be a challenging problem in the existing literature even when relative position measurements are available.Motivated by angle-induced linear equations in 2D triangles and 3D tetrahedra,this paper aims to solve this challenging problem in both 2D and3D under a leader-follower framework.For the 2D case where the leaders have constant velocities,by using local relative position and velocity measurements,a formation maneuvering law is designed for the followers governed by double-integrator dynamics.When the leaders have time-varying velocities,a sliding mode formation maneuvering law is proposed by using the same measurements.For the 3D case,to establish an angle-induced linear equation for each tetrahedron,we assume that all the followers'coordinate frames share a common Z direction.Then,a formation maneuvering law is proposed for the followers to globally maneuver Z-weakly angle rigid formations in 3D.The extension to Lagrangian agent dynamics and the construction of the desired rigid formations by using the minimum number of angle constraints are also discussed.Simulation examples are provided to validate the effectiveness of the proposed algorithms.展开更多
In this paper, a new class of three term memory gradient method with non-monotone line search technique for unconstrained optimization is presented. Global convergence properties of the new methods are discussed. Comb...In this paper, a new class of three term memory gradient method with non-monotone line search technique for unconstrained optimization is presented. Global convergence properties of the new methods are discussed. Combining the quasi-Newton method with the new method, the former is modified to have global convergence property. Numerical results show that the new algorithm is efficient.展开更多
We discuss the global stabilization procedure which renders a general class of feedback nonlinear systems exponential convergent, Our stabilizer consists of a nested saturation function, which is a nonlinear combinati...We discuss the global stabilization procedure which renders a general class of feedback nonlinear systems exponential convergent, Our stabilizer consists of a nested saturation function, which is a nonlinear combination of saturation functions. Here we prove the exponential convergence of the stabilizer for the first time and give numerical examples to illustrate the efficiency of the result given above,展开更多
Some sufficient conditions for the global exponential stability and lower bounds on the rate of exponential convergence of the cellular neural networks with delay (DCNNs) are obtained by means of a method based on del...Some sufficient conditions for the global exponential stability and lower bounds on the rate of exponential convergence of the cellular neural networks with delay (DCNNs) are obtained by means of a method based on delay differential inequality. The method, which does not make use of any Lyapunov functional, is simple and valid for the stability analysis of neural networks with delay. Some previously established results in this paper are shown to be special casses of the presented result.展开更多
In this paper, we extend a descent algorithm without line search for solving unconstrained optimization problems. Under mild conditions, its global convergence is established. Further, we generalize the search directi...In this paper, we extend a descent algorithm without line search for solving unconstrained optimization problems. Under mild conditions, its global convergence is established. Further, we generalize the search direction to more general form, and also obtain the global convergence of corresponding algorithm. The numerical results illustrate that the new algorithm is effective.展开更多
基金supported by the Guangxi Science and Technology base and Talent Project(AD22080047)the National Natural Science Foundation of Guangxi Province(2023GXNFSBA 026063)+1 种基金the Innovation Funds of Chinese University(2021BCF03001)the special foundation for Guangxi Ba Gui Scholars.
文摘A cautious projection BFGS method is proposed for solving nonconvex unconstrained optimization problems.The global convergence of this method as well as a stronger general convergence result can be proven without a gradient Lipschitz continuity assumption,which is more in line with the actual problems than the existing modified BFGS methods and the traditional BFGS method.Under some additional conditions,the method presented has a superlinear convergence rate,which can be regarded as an extension and supplement of BFGS-type methods with the projection technique.Finally,the effectiveness and application prospects of the proposed method are verified by numerical experiments.
文摘Selection, crossover, and mutation are three main operators of the canonical genetic algorithm (CGA). This paper presents a new approach to the genetic algorithm. This new approach applies only to mutation and selection operators. The paper proves that the search process of the non-crossover genetic algorithm (NCGA) is an ergodic homogeneous Markov chain. The proof of its convergence to global optimum is presented. Some nonlinear multi-modal optimization problems are applied to test the efficacy of the NCGA. NP-hard traveling salesman problem (TSP) is cited here as the benchmark problem to test the efficiency of the algorithm. The simulation result shows that NCGA achieves much faster convergence speed than CGA in terms of CPU time. The convergence speed per epoch of NCGA is also faster than that of CGA.
文摘This paper explores the convergence of a class of optimally conditioned self scaling variable metric (OCSSVM) methods for unconstrained optimization. We show that this class of methods with Wolfe line search are globally convergent for general convex functions.
基金the National Natural Science Foundation of China( 1 9871 0 77)
文摘A new smoothing method is proposed. The smoothing process adapts to image characteristics and is good at preserving local image structures. More importantly, in the theory under the conditions weaker than those in the original Kaanov method an approximal sequence of solutions to the variational problems can be constructed and the global convergence can be proved. And the conditions in the papers of Schno¨rr(1994) and Heers, et al (2001) are discussed. Numerical solutions of the model are given.
文摘This paper presents a trust region two phase model algorithm for solving the equality and bound constrained nonlinear optimization problem. A concept of substationary point is given. Under suitable assumptions,the global convergence of this algorithm is proved without assuming the linear independence of the gradient of active constraints. A numerical example is also presented.
基金This project was supported by the National Natural Science Foundation of China (60174021) Tianjin Advanced School Science and Technology Development Foundation (01 - 20403) .
文摘Some papers on stochastic adaptive control schemes have established convergence algorithm using a least-squares parameters. With the popular application of GPC, global convergence has become a key problem in automatic control theory. However, now global convergence of GPC has not been established for algorithms in computing a least squares iteration. A generalized model of adaptive generalized predictive control is presented. The global convergebce is also given on the basis of estimating the parameters of GPC by least squares algorithm.
文摘A trust region algorithm for equality constrained optimization is given in this paper.The algorithm does not enforce strict monotonicity of the merit function for every iteration.Global convergence of the algorithm is proved under the same conditions of usual trust region method.
文摘An adaptive genetic algorithm with diversity-guided mutation, which combines adaptive probabilities of crossover and mutation was proposed. By means of homogeneous finite Markov chains, it is proved that adaptive genetic algorithm with diversity-guided mutation and genetic algorithm with diversity-guided mutation converge to the global optimum if they maintain the best solutions, and the convergence of adaptive genetic algorithms with adaptive probabilities of crossover and mutation was studied. The performances of the above algorithms in optimizing several unimodal and multimodal functions were compared. The results show that for multimodal functions the average convergence generation of the adaptive genetic algorithm with diversity-guided mutation is about 900 less than that of (adaptive) genetic algorithm with adaptive probabilities and genetic algorithm with diversity-guided mutation, and the adaptive genetic algorithm with diversity-guided mutation does not lead to premature convergence. It is also shown that the better balance between overcoming premature convergence and quickening convergence speed can be gotten.
基金Project(61673386)supported by the National Natural Science Foundation of ChinaProject(2018QNJJ006)supported by the High-Tech Institute of Xi’an,China
文摘A global fast convergent integrated guidance and control design approach is proposed. A disturbance observer is utilized to estimate the uncertainties of integrated guidance and control model in finite time. According to the multiple sliding-mode surface control, the independent nonsingular terminal sliding functions are presented in each step, and all the sliding-mode surfaces run parallel. These presented sliding-mode surfaces keep zero value from a certain time, and the system states converge quickly in sliding phase. Therefore, the system response speed is increased. The proposed method offers the global convergent time analytically, which is useful to optimize the transient performance of system. Simulation results are used to verify the proposed method.
文摘The computational uncertainty principle in nonlinear ordinary differential equations makes the numerical solution of the long-term behavior of nonlinear atmospheric equations have no meaning. The main reason is that, in the error analysis theory of present-day computational mathematics, the non-linear process between truncation error and rounding error is treated as a linear operation. In this paper, based on the operator equations of large-scale atmospheric movement, the above limitation is overcome by using the notion of cell mapping. Through studying the global asymptotic characteristics of the numerical pattern of the large-scale atmospheric equations, the definitions of the global convergence and an appropriate discrete algorithm of the numerical pattern are put forward. Three determinant theorems about the global convergence of the numerical pattern are presented, which provide the theoretical basis for constructing the globally convergent numerical pattern. Further, it is pointed out that only a globally convergent numerical pattern can improve the veracity of climatic prediction.
文摘A trust-region algorithm is presented for a nonlinear optimization problem of equality-constraints. The characterization of the algorithm is using inexact gradient information. Global convergence results are demonstrated where the gradient values are obeyed a simple relative error condition.
基金supported by National Natural Science Foundation of China(62173118)supported by the Ramon y Cajal(RYC2020-030090-I)from the Spanish Ministry of Science。
文摘Angle rigid multi-agent formations can simultaneously undergo translational,rotational,and scaling maneuvering,therefore combining the maneuvering capabilities of both distance and bearing rigid formations.However,maneuvering angle rigid formations in 2D or 3D with global convergence guarantees is shown to be a challenging problem in the existing literature even when relative position measurements are available.Motivated by angle-induced linear equations in 2D triangles and 3D tetrahedra,this paper aims to solve this challenging problem in both 2D and3D under a leader-follower framework.For the 2D case where the leaders have constant velocities,by using local relative position and velocity measurements,a formation maneuvering law is designed for the followers governed by double-integrator dynamics.When the leaders have time-varying velocities,a sliding mode formation maneuvering law is proposed by using the same measurements.For the 3D case,to establish an angle-induced linear equation for each tetrahedron,we assume that all the followers'coordinate frames share a common Z direction.Then,a formation maneuvering law is proposed for the followers to globally maneuver Z-weakly angle rigid formations in 3D.The extension to Lagrangian agent dynamics and the construction of the desired rigid formations by using the minimum number of angle constraints are also discussed.Simulation examples are provided to validate the effectiveness of the proposed algorithms.
文摘In this paper, a new class of three term memory gradient method with non-monotone line search technique for unconstrained optimization is presented. Global convergence properties of the new methods are discussed. Combining the quasi-Newton method with the new method, the former is modified to have global convergence property. Numerical results show that the new algorithm is efficient.
文摘We discuss the global stabilization procedure which renders a general class of feedback nonlinear systems exponential convergent, Our stabilizer consists of a nested saturation function, which is a nonlinear combination of saturation functions. Here we prove the exponential convergence of the stabilizer for the first time and give numerical examples to illustrate the efficiency of the result given above,
文摘Some sufficient conditions for the global exponential stability and lower bounds on the rate of exponential convergence of the cellular neural networks with delay (DCNNs) are obtained by means of a method based on delay differential inequality. The method, which does not make use of any Lyapunov functional, is simple and valid for the stability analysis of neural networks with delay. Some previously established results in this paper are shown to be special casses of the presented result.
文摘In this paper, we extend a descent algorithm without line search for solving unconstrained optimization problems. Under mild conditions, its global convergence is established. Further, we generalize the search direction to more general form, and also obtain the global convergence of corresponding algorithm. The numerical results illustrate that the new algorithm is effective.