Accelerated Matrix Recovery via Random Projection Based on Inexact Augmented Lagrange Multiplier Method

In this paper, a unified matrix recovery model was proposed for diverse corrupted matrices. Resulting from the separable structure of the proposed model, the convex optimization problem can be solved efficiently by adopting an inexact augmented Lagrange multiplier (IALM) method. Additionally, a random projection accelerated technique (IALM+RP) was adopted to improve the success rate. From the preliminary numerical comparisons, it was indicated that for the standard robust principal component analysis (PCA) problem, IALM+RP was at least two to six times faster than IALM with an insignificant reduction in accuracy; and for the outlier pursuit (OP) problem, IALM+RP was at least 6.9 times faster, even up to 8.3 times faster when the size of matrix was 2 000×2 000.

GLOBAL CONVERGENCE OF A TRUST REGION ALGORITHM USING INEXACT GRADIENT FOR EQUALITY-CONSTRAINED OPTIMIZATION

A trust-region algorithm is presented for a nonlinear optimization problem of equality-constraints. The characterization of the algorithm is using inexact gradient information. Global convergence results are demonstrated where the gradient values are obeyed a simple relative error condition.

ON SOME RESULTS ABOUT INEXACT LINEAR PROGRAMMING

In this paper we point out that some theorems about the inexact programming in [2]are false and give the modified statement.

CONVERGENCE OF INEXACT CONIC NEWTON METHODS

A conic Newton method is attractive because it converges to a local minimizzer rapidly from any sufficiently good initial guess. However, it may be expensive to solve the conic Newton equation at each iterate. In this paper we consider an inexact conic Newton method, which solves the couic Newton equation oldy approximately and in sonm unspecified manner. Furthermore, we show that such method is locally convergent and characterizes the order of convergence in terms of the rate of convergence of the relative residuals.

Inexact Newton method via Lanczos decomposed technique for solving box-constrained nonlinear systems

This paper proposes an inexact Newton method via the Lanczos decomposed technique for solving the box-constrained nonlinear systems. An iterative direction is obtained by solving an affine scaling quadratic model with the Lanczos decomposed technique. By using the interior backtracking line search technique, an acceptable trial step length is found along this direction. The global convergence and the fast local convergence rate of the proposed algorithm are established under some reasonable conditions. Furthermore, the results of the numerical experiments show the effectiveness of the pro- posed algorithm.

LOCAL CONVERGENCE OF INEXACT NEWTON-LIKE METHOD UNDER WEAK LIPSCHITZ CONDITIONS

The paper develops the local convergence of Inexact Newton-Like Method(INLM)for approximating solutions of nonlinear equations in Banach space setting.We employ weak Lipschitz and center-weak Lipschitz conditions to perform the error analysis.The obtained results compare favorably with earlier ones such as[7,13,14,18,19].A numerical example is also provided.

An Interval Probability-based Inexact Two-stage Stochastic Model for Regional Electricity Supply and GHG Mitigation Management under Uncertainty

In this study, an interval probability-based inexact two-stage stochastic (IP-ITSP) model is developed for environmental pollutants control and greenhouse gas (GHG) emissions reduction management in regional energy system under uncertainties. In the IP-ITSP model, methods of interval probability, interval-parameter programming (IPP) and two-stage stochastic programming (TSP) are introduced into an integer programming framework;the developed model can tackle uncertainties described in terms of interval values and interval probability distributions. The developed model is applied to a case of planning GHG -emission mitigation in a regional electricity system, demonstrating that IP-ITSP is applicable to reflecting complexities of multi-uncertainty, and capable of addressing the problem of GHG-emission reduction. 4 scenarios corresponding to different GHG -emission mitigation levels are examined;the results indicates that the model could help decision makers identify desired GHG mitigation policies under various economic costs and environmental requirements.

An Inexact Restoration Package for Bilevel Programming Problems

Bilevel programming problems are a class of optimization problems with hierarchical structure where one of the con-straints is also an optimization problem. Inexact restoration methods were introduced for solving nonlinear programming problems a few years ago. They generate a sequence of, generally, infeasible iterates with intermediate iterations that consist of inexactly restored points. In this paper we present a software environment for solving bilevel program-ming problems using an inexact restoration technique without replacing the lower level problem by its KKT optimality conditions. With this strategy we maintain the minimization structure of the lower level problem and avoid spurious solutions. The environment is a user-friendly set of Fortran 90 modules which is easily and highly configurable. It is prepared to use two well-tested minimization solvers and different formulations in one of the minimization subproblems. We validate our implementation using a set of test problems from the literature, comparing different formulations and the use of the minimization solvers.

An Innovative Genetic Algorithms-Based Inexact Non-Linear Programming Problem Solving Method

In this paper, an innovative Genetic Algorithms (GA)-based inexact non-linear programming (GAINLP) problem solving approach has been proposed for solving non-linear programming optimization problems with inexact information (inexact non-linear operation programming). GAINLP was developed based on a GA-based inexact quadratic solving method. The Genetic Algorithm Solver of the Global Optimization Toolbox (GASGOT) developed by MATLABTM was adopted as the implementation environment of this study. GAINLP was applied to a municipality solid waste management case. The results from different scenarios indicated that the proposed GA-based heuristic optimization approach was able to generate a solution for a complicated nonlinear problem, which also involved uncertainty.

ADAPTIVE REGULARIZED QUASI-NEWTON METHOD USING INEXACT FIRST-ORDER INFORMATION

Classical quasi-Newton methods are widely used to solve nonlinear problems in which the first-order information is exact.In some practical problems,we can only obtain approximate values of the objective function and its gradient.It is necessary to design optimization algorithms that can utilize inexact first-order information.In this paper,we propose an adaptive regularized quasi-Newton method to solve such problems.Under some mild conditions,we prove the global convergence and establish the convergence rate of the adaptive regularized quasi-Newton method.Detailed implementations of our method,including the subspace technique to reduce the amount of computation,are presented.Encouraging numerical results demonstrate that the adaptive regularized quasi-Newton method is a promising method,which can utilize the inexact first-order information effectively.

AN INEXACT PROXIMAL DC ALGORITHM FOR THE LARGE-SCALE CARDINALITY CONSTRAINED MEAN-VARIANCE MODEL IN SPARSE PORTFOLIO SELECTION

Optimization problem of cardinality constrained mean-variance(CCMV)model for sparse portfolio selection is considered.To overcome the difficulties caused by cardinality constraint,an exact penalty approach is employed,then CCMV problem is transferred into a difference-of-convex-functions(DC)problem.By exploiting the DC structure of the gained problem and the superlinear convergence of semismooth Newton(ssN)method,an inexact proximal DC algorithm with sieving strategy based on a majorized ssN method(siPDCA-mssN)is proposed.For solving the inner problems of siPDCA-mssN from dual,the second-order information is wisely incorporated and an efficient mssN method is employed.The global convergence of the sequence generated by siPDCA-mssN is proved.To solve large-scale CCMV problem,a decomposed siPDCA-mssN(DsiPDCA-mssN)is introduced.To demonstrate the efficiency of proposed algorithms,siPDCA-mssN and DsiPDCA-mssN are compared with the penalty proximal alternating linearized minimization method and the CPLEX(12.9)solver by performing numerical experiments on realword market data and large-scale simulated data.The numerical results demonstrate that siPDCA-mssN and DsiPDCA-mssN outperform the other methods from computation time and optimal value.The out-of-sample experiments results display that the solutions of CCMV model are better than those of other portfolio selection models in terms of Sharp ratio and sparsity.

The convergence properties of infeasible inexact proximal alternating linearized minimization

The proximal alternating linearized minimization(PALM)method suits well for solving blockstructured optimization problems,which are ubiquitous in real applications.In the cases where subproblems do not have closed-form solutions,e.g.,due to complex constraints,infeasible subsolvers are indispensable,giving rise to an infeasible inexact PALM(PALM-I).Numerous efforts have been devoted to analyzing the feasible PALM,while little attention has been paid to the PALM-I.The usage of the PALM-I thus lacks a theoretical guarantee.The essential difficulty of analysis consists in the objective value nonmonotonicity induced by the infeasibility.We study in the present work the convergence properties of the PALM-I.In particular,we construct a surrogate sequence to surmount the nonmonotonicity issue and devise an implementable inexact criterion.Based upon these,we manage to establish the stationarity of any accumulation point,and moreover,show the iterate convergence and the asymptotic convergence rates under the assumption of the Lojasiewicz property.The prominent advantages of the PALM-I on CPU time are illustrated via numerical experiments on problems arising from quantum physics and 3-dimensional anisotropic frictional contact.

An Efficient Inexact Newton-CG Algorithm for the Smallest Enclosing Ball Problem of Large Dimensions

In this paper,we consider the problem of computing the smallest enclosing ball(SEB)of a set of m balls in Rn,where the product mn is large.We first approximate the non-differentiable SEB problem by its log-exponential aggregation function and then propose a computationally efficient inexact Newton-CG algorithm for the smoothing approximation problem by exploiting its special(approximate)sparsity structure.The key difference between the proposed inexact Newton-CG algorithm and the classical Newton-CG algorithm is that the gradient and the Hessian-vector product are inexactly computed in the proposed algorithm,which makes it capable of solving the large-scale SEB problem.We give an adaptive criterion of inexactly computing the gradient/Hessian and establish global convergence of the proposed algorithm.We illustrate the efficiency of the proposed algorithm by using the classical Newton-CG algorithm as well as the algorithm from Zhou et al.(Comput Optim Appl 30:147–160,2005)as benchmarks.

An Adaptive Spectral Conjugate Gradient Method with Restart Strategy

As a generalization of the two-term conjugate gradient method(CGM),the spectral CGM is one of the effective methods for solving unconstrained optimization.In this paper,we enhance the JJSL conjugate parameter,initially proposed by Jiang et al.(Computational and Applied Mathematics,2021,40:174),through the utilization of a convex combination technique.And this improvement allows for an adaptive search direction by integrating a newly constructed spectral gradient-type restart strategy.Then,we develop a new spectral CGM by employing an inexact line search to determine the step size.With the application of the weak Wolfe line search,we establish the sufficient descent property of the proposed search direction.Moreover,under general assumptions,including the employment of the strong Wolfe line search for step size calculation,we demonstrate the global convergence of our new algorithm.Finally,the given unconstrained optimization test results show that the new algorithm is effective.

不确定风电接入下计及煤电机组深调和储能的电力系统分布鲁棒优化日前调度方法

随着新能源装机规模和占比的不断扩大,未来新型电力系统对灵活调节能力的需求逐步攀升。目前,我国仍以煤炭为主要能源,电源结构仍以煤电机组为主。在新能源大规模并网条件下,煤电逐步由传统的基础保障性电源向系统调节性电源转变,更多地承担系统调峰和备用等任务,以促进新能源的消纳。因此,充分发挥煤电机组的灵活调节能力对于电力系统的安全稳定经济运行至关重要。该文在考虑风电不确定性的基础上建立了计及煤电机组深调和储能的电力系统两阶段分布鲁棒优化模型。模型第一阶段考虑基础场景下系统的调度计划,包括煤电机组的启停和储能的充放电计划,第二阶段在第一阶段决策已知的情况下优化不确定概率分布下的成本期望,从而得到最恶劣场景下的概率分布。模型采用非精确列和约束生成(inexact column-and-constraint generation,i-C&CG)算法迭代求解。最后,采用改进的IEEE-39节点和IEEE-300节点系统验证了模型对风电消纳的促进作用以及i-C&CG算法对模型求解的加速效果。

ON SEMILOCAL CONVERGENCE OF INEXACT NEWTON METHODS

Inexact Newton methods are constructed by combining Newton＇s method with another iterative method that is used to solve the Newton equations inexactly. In this paper, we establish two semilocal convergence theorems for the inexact Newton methods. When these two theorems are specified to Newton＇s method, we obtain a different Newton-Kantorovich theorem about Newton＇s method. When the iterative method for solving the Newton equations is specified to be the splitting method, we get two estimates about the iteration steps for the special inexact Newton methods.

An Inexact Affine Scaling Levenberg-Marquardt Method Under Local Error Bound Conditions

We propose an inexact affine scaling Levenberg-Marquardt method for solving bound-constrained semismooth equations under the local error bound assumption which is much weaker than the standard nonsingularity condition. The affine scaling Levenberg-Marquardt equation is based on a minimization of the squared Euclidean norm of linearized model adding a quadratic affine scaling matrix to find a solution which belongs to the bounded constraints on variable. The global convergence and the superlinear convergence rate are proved.Numerical results show that the new algorithm is efficient.

A smoothing inexact Newton method for P0 nonlinear complementarity problem

We first propose a new class of smoothing functions for the non- linear complementarity function which contains the well-known Chen-Harker- Kanzow-Smale smoothing function and Huang-Han-Chen smoothing function as special cases, and then present a smoothing inexact Newton algorithm for the P0 nonlinear complementarity problem. The global convergence and local superlinear convergence are established. Preliminary numerical results indicate the feasibility and efficiency of the algorithm.

水平线性互补问题的一种非精确光滑牛顿算法

为了提高求解水平线性互补问题的效率,本文利用一种光滑函数,将水平线性互补问题转化为与之等价的光滑方程组,采用非精确牛顿法求解该方程组,得到了水平线性互补问题的一种非精确光滑牛顿算法.在适当的条件下证明了该算法的适定性和局部二阶收敛性,数值实验表明该算法稳定有效.