A new algorithm for the solution of quadratic programming problemsis put forward in terms of the mixed energy theory and is furtherused for the incremental solution of elastic-plastic trussstructures. The method propo...A new algorithm for the solution of quadratic programming problemsis put forward in terms of the mixed energy theory and is furtherused for the incremental solution of elastic-plastic trussstructures. The method proposed is different from the traditionalone, for which the unknown variables are selected just in one classsuch as displacements or stresses. The present method selects thevariables in the mixed form with both displacement and stress. As themethod is established in the hybrid space, the information found inthe previous incremental step can be used for the solution of thepresent step, making the algorithm highly effi- cient in thenumerical solution process of quadratic programming problems. Theresults obtained in the exm- ples of the elastic-plastic solution ofthe truss structures verify what has been predicted in thetheoretical anal- ysis.展开更多
At present,projection neural network(PNN)with bounded time delay has been widely used for solving convex quadratic programming problem(QPP).However,there is little research concerning PNN with unbounded time delay.In ...At present,projection neural network(PNN)with bounded time delay has been widely used for solving convex quadratic programming problem(QPP).However,there is little research concerning PNN with unbounded time delay.In this paper,we propose the proportional delayed PNN to solve QPP with equality constraints.By utilizing homeo morphism mapping principle,we prove the proportional delayed PNN exists with unique equilibrium point which is the optimal solution of QPP.Simultaneously,delay-dependent criteria about global exponential stability(GES)and global polynomial stability(GPS)are also acquired by applying the method of variation of constants and inequality techniques.On the other hand,when proportional delay factor q is equal to 1,the proportional delayed PNN becomes the one without time delay which still can be utilized for solving QPP.But in most situations,q is not equal to 1,and time delay is unpredictable and may be unbounded in the actual neural network,which causes instability of system.Therefore,it is necessary to consider proportional delayed PNN.A numerical example demonstrates that,compared with the proportional delayed Lagrange neural network,the proportional delayed PNN is faster in terms of convergence rate.The possible reason is that appropriate parameters make the model converge to the equilibrium point along the direction of gradient descent.展开更多
A quadratic bilevel programming problem is transformed into a single level complementarity slackness problem by applying Karush-Kuhn-Tucker(KKT) conditions.To cope with the complementarity constraints,a binary encod...A quadratic bilevel programming problem is transformed into a single level complementarity slackness problem by applying Karush-Kuhn-Tucker(KKT) conditions.To cope with the complementarity constraints,a binary encoding scheme is adopted for KKT multipliers,and then the complementarity slackness problem is simplified to successive quadratic programming problems,which can be solved by many algorithms available.Based on 0-1 binary encoding,an orthogonal genetic algorithm,in which the orthogonal experimental design with both two-level orthogonal array and factor analysis is used as crossover operator,is proposed.Numerical experiments on 10 benchmark examples show that the orthogonal genetic algorithm can find global optimal solutions of quadratic bilevel programming problems with high accuracy in a small number of iterations.展开更多
Presents a regular splitting and potential reduction method for solving a quadratic programming problem with box constraints. Discussion on the regular splitting and potential reduction algorithm; Complexity analysis ...Presents a regular splitting and potential reduction method for solving a quadratic programming problem with box constraints. Discussion on the regular splitting and potential reduction algorithm; Complexity analysis of the algorithm; Analysis of the complexity bound on obtaining an approximate solution.展开更多
A matrix splitting method is presented for minimizing a quadratic programming (QP) problem, and a general algorithm is designed to solve the QP problem and generates a sequence of iterative points. We prove that the s...A matrix splitting method is presented for minimizing a quadratic programming (QP) problem, and a general algorithm is designed to solve the QP problem and generates a sequence of iterative points. We prove that the sequence generated by the algorithm converges to the optimal solution and has an R-linear rate of convergence if the QP problem is strictly convex and nondegenerate, and that every accumulation point of the sequence generated by the general algorithm is a KKT point of the original problem under the hypothesis that the value of the objective function is bounded below on the constrained region, and that the sequence converges to a KKT point if the problem is nondegenerate and the constrained region is bounded.展开更多
The paper presents a technique for solving the binary linear programming model in polynomial time. The general binary linear programming problem is transformed into a convex quadratic programming problem. The convex q...The paper presents a technique for solving the binary linear programming model in polynomial time. The general binary linear programming problem is transformed into a convex quadratic programming problem. The convex quadratic programming problem is then solved by interior point algorithms. This settles one of the open problems of whether P = NP or not. The worst case complexity of interior point algorithms for the convex quadratic problem is polynomial. It can also be shown that every liner integer problem can be converted into binary linear problem.展开更多
Support vector machine has become an increasingly popular tool for machine learning tasks involving classification, regression or novelty detection. Training a support vector machine requires the solution of a very la...Support vector machine has become an increasingly popular tool for machine learning tasks involving classification, regression or novelty detection. Training a support vector machine requires the solution of a very large quadratic programming problem. Traditional optimization methods cannot be directly applied due to memory restrictions. Up to now, several approaches exist for circumventing the above shortcomings and work well. Another learning algorithm, particle swarm optimization, for training SVM is introduted. The method is tested on UCI datasets.展开更多
In this paper, based on the second-order Taylor series expansion and the difference of convex functions algo- rithm for quadratic problems with box constraints (the DCA for QB), a new method is proposed to solve the...In this paper, based on the second-order Taylor series expansion and the difference of convex functions algo- rithm for quadratic problems with box constraints (the DCA for QB), a new method is proposed to solve the static response problem of structures with fairly large uncertainties in interval parameters. Although current methods are effective for solving the static response problem of structures with interval parameters with small uncertainties, these methods may fail to estimate the region of the static response of uncertain structures if the uncertainties in the parameters are fairly large. To resolve this problem, first, the general expression of the static response of structures in terms of structural parameters is derived based on the second-order Taylor series expansion. Then the problem of determining the bounds of the static response of uncertain structures is transformed into a series of quadratic problems with box constraints. These quadratic problems with box constraints can be solved using the DCA approach effectively. The numerical examples are given to illustrate the accuracy and the efficiency of the proposed method when comparing with other existing methods.展开更多
Currently there are two approaches for a multi-class support vector classifier(SVC). One is to construct and combine several binary classifiers while the other is to directly consider all classes of data in one optimi...Currently there are two approaches for a multi-class support vector classifier(SVC). One is to construct and combine several binary classifiers while the other is to directly consider all classes of data in one optimization formulation. For a K-class problem(K>2),the first approach has to construct at least K classifiers,and the second approach has to solve a much larger op-timization problem proportional to K by the algorithms developed so far. In this paper,following the second approach,we present a novel multi-class large margin classifier(MLMC). This new machine can solve K-class problems in one optimization formula-tion without increasing the size of the quadratic programming(QP) problem proportional to K. This property allows us to construct just one classifier with as few variables in the QP problem as possible to classify multi-class data,and we can gain the advantage of speed from it especially when K is large. Our experiments indicate that MLMC almost works as well as(sometimes better than) many other multi-class SVCs for some benchmark data classification problems,and obtains a reasonable performance in face recognition application on the AR face database.展开更多
基金the National Natural Science Foundation of China(No.50178916,No.19732020 and No.19872016)the National Key Basic lteseareh Special Foundation(No.G1999032805)+1 种基金the Special Funds for Major State Basic Researeh Projectsthe Foundation for University Key Teachers by the Ministry of Education of China
文摘A new algorithm for the solution of quadratic programming problemsis put forward in terms of the mixed energy theory and is furtherused for the incremental solution of elastic-plastic trussstructures. The method proposed is different from the traditionalone, for which the unknown variables are selected just in one classsuch as displacements or stresses. The present method selects thevariables in the mixed form with both displacement and stress. As themethod is established in the hybrid space, the information found inthe previous incremental step can be used for the solution of thepresent step, making the algorithm highly effi- cient in thenumerical solution process of quadratic programming problems. Theresults obtained in the exm- ples of the elastic-plastic solution ofthe truss structures verify what has been predicted in thetheoretical anal- ysis.
基金supported by the Natural Science Foundation of Tianjin(No.18JCYBJC85800)the Innovative Talents Cultivation of Young Middle Aged Backbone Teachers of Tianjin(No.135205GC38)+1 种基金Tianjin Normal University Undergraduate Teaching Quality and Teaching Reform Research Project(No.B201006505)University Student Innovation Project(No.202110065004).
文摘At present,projection neural network(PNN)with bounded time delay has been widely used for solving convex quadratic programming problem(QPP).However,there is little research concerning PNN with unbounded time delay.In this paper,we propose the proportional delayed PNN to solve QPP with equality constraints.By utilizing homeo morphism mapping principle,we prove the proportional delayed PNN exists with unique equilibrium point which is the optimal solution of QPP.Simultaneously,delay-dependent criteria about global exponential stability(GES)and global polynomial stability(GPS)are also acquired by applying the method of variation of constants and inequality techniques.On the other hand,when proportional delay factor q is equal to 1,the proportional delayed PNN becomes the one without time delay which still can be utilized for solving QPP.But in most situations,q is not equal to 1,and time delay is unpredictable and may be unbounded in the actual neural network,which causes instability of system.Therefore,it is necessary to consider proportional delayed PNN.A numerical example demonstrates that,compared with the proportional delayed Lagrange neural network,the proportional delayed PNN is faster in terms of convergence rate.The possible reason is that appropriate parameters make the model converge to the equilibrium point along the direction of gradient descent.
基金supported by the National Natural Science Foundation of China (60873099)
文摘A quadratic bilevel programming problem is transformed into a single level complementarity slackness problem by applying Karush-Kuhn-Tucker(KKT) conditions.To cope with the complementarity constraints,a binary encoding scheme is adopted for KKT multipliers,and then the complementarity slackness problem is simplified to successive quadratic programming problems,which can be solved by many algorithms available.Based on 0-1 binary encoding,an orthogonal genetic algorithm,in which the orthogonal experimental design with both two-level orthogonal array and factor analysis is used as crossover operator,is proposed.Numerical experiments on 10 benchmark examples show that the orthogonal genetic algorithm can find global optimal solutions of quadratic bilevel programming problems with high accuracy in a small number of iterations.
基金This research supported partially by The National Natural Science Foundation of China-19771079 and 19601035State Key Laboratory of Scientific and Engineering Computing.
文摘Presents a regular splitting and potential reduction method for solving a quadratic programming problem with box constraints. Discussion on the regular splitting and potential reduction algorithm; Complexity analysis of the algorithm; Analysis of the complexity bound on obtaining an approximate solution.
基金the National Natural Science Foundation of China (No.19771079)and State Key Laboratory of Scientific and Engineering Computing
文摘A matrix splitting method is presented for minimizing a quadratic programming (QP) problem, and a general algorithm is designed to solve the QP problem and generates a sequence of iterative points. We prove that the sequence generated by the algorithm converges to the optimal solution and has an R-linear rate of convergence if the QP problem is strictly convex and nondegenerate, and that every accumulation point of the sequence generated by the general algorithm is a KKT point of the original problem under the hypothesis that the value of the objective function is bounded below on the constrained region, and that the sequence converges to a KKT point if the problem is nondegenerate and the constrained region is bounded.
文摘The paper presents a technique for solving the binary linear programming model in polynomial time. The general binary linear programming problem is transformed into a convex quadratic programming problem. The convex quadratic programming problem is then solved by interior point algorithms. This settles one of the open problems of whether P = NP or not. The worst case complexity of interior point algorithms for the convex quadratic problem is polynomial. It can also be shown that every liner integer problem can be converted into binary linear problem.
文摘Support vector machine has become an increasingly popular tool for machine learning tasks involving classification, regression or novelty detection. Training a support vector machine requires the solution of a very large quadratic programming problem. Traditional optimization methods cannot be directly applied due to memory restrictions. Up to now, several approaches exist for circumventing the above shortcomings and work well. Another learning algorithm, particle swarm optimization, for training SVM is introduted. The method is tested on UCI datasets.
基金supported by the National Natural Science Foundation of China (Grants 11002013, 11372025)the Defense Industrial Technology Development Program (Grants A0820132001, JCKY2013601B)+1 种基金the Aeronautical Science Foundation of China (Grant 2012ZA51010)111 Project (Grant B07009) for support
文摘In this paper, based on the second-order Taylor series expansion and the difference of convex functions algo- rithm for quadratic problems with box constraints (the DCA for QB), a new method is proposed to solve the static response problem of structures with fairly large uncertainties in interval parameters. Although current methods are effective for solving the static response problem of structures with interval parameters with small uncertainties, these methods may fail to estimate the region of the static response of uncertain structures if the uncertainties in the parameters are fairly large. To resolve this problem, first, the general expression of the static response of structures in terms of structural parameters is derived based on the second-order Taylor series expansion. Then the problem of determining the bounds of the static response of uncertain structures is transformed into a series of quadratic problems with box constraints. These quadratic problems with box constraints can be solved using the DCA approach effectively. The numerical examples are given to illustrate the accuracy and the efficiency of the proposed method when comparing with other existing methods.
基金supported by the National Natural Science Foundation of China (No. 60675049)the National Creative Research Groups Science Foundation of China (No. 60721062)the Natural Science Foundation of Zhejiang Province, China (No. Y106414)
文摘Currently there are two approaches for a multi-class support vector classifier(SVC). One is to construct and combine several binary classifiers while the other is to directly consider all classes of data in one optimization formulation. For a K-class problem(K>2),the first approach has to construct at least K classifiers,and the second approach has to solve a much larger op-timization problem proportional to K by the algorithms developed so far. In this paper,following the second approach,we present a novel multi-class large margin classifier(MLMC). This new machine can solve K-class problems in one optimization formula-tion without increasing the size of the quadratic programming(QP) problem proportional to K. This property allows us to construct just one classifier with as few variables in the QP problem as possible to classify multi-class data,and we can gain the advantage of speed from it especially when K is large. Our experiments indicate that MLMC almost works as well as(sometimes better than) many other multi-class SVCs for some benchmark data classification problems,and obtains a reasonable performance in face recognition application on the AR face database.