摘要
In 1994, O’leary and Yeremin extended the quasi-Newton method for minimizing a collection of functions with a common Hessian matrix to the block version,and discussed some algebraic properties of this block quasi-Newton method. In thispaper, we derive compact representations of the block BFGS’s updating matrices.These representations allow us to efficiently implement limited memory methods,e.g., the limited memory BFGS method, for minimizing a collection of functionswith a common Hessian matrix. The method relieves the requirement for the storage counts and has the savings in the operation counts, in particular, for large scaleproblems. The numerical experiments for the multiple unconstrained optimizationproblems show that the method works efficiently. Compared with O’Leary’s multiple version of BFGS method, our multiple version of the limited memory BFGSmethod is more efficient in the total operation counts and the storage counts.
In 1994, O'leary and Yeremin extended the quasi-Newton method for minimizing a collection of functions with a common Hessian matrix to the block version,and discussed some algebraic properties of this block quasi-Newton method. In thispaper, we derive compact representations of the block BFGS's updating matrices.These representations allow us to efficiently implement limited memory methods,e.g., the limited memory BFGS method, for minimizing a collection of functionswith a common Hessian matrix. The method relieves the requirement for the storage counts and has the savings in the operation counts, in particular, for large scaleproblems. The numerical experiments for the multiple unconstrained optimizationproblems show that the method works efficiently. Compared with O'Leary's multiple version of BFGS method, our multiple version of the limited memory BFGSmethod is more efficient in the total operation counts and the storage counts.
出处
《计算数学》
CSCD
北大核心
1999年第4期417-428,共12页
Mathematica Numerica Sinica
基金
国家自然科学基金!19971057
上海市高校科技发展基金
关键词
BFGS算法
成组型算法
有记忆算法
拟牛顿法
Minimization of function, BFGS's method, block method,limited memory method