期刊文献+

A Globally Convergent Polak-Ribiere-Polyak Conjugate Gradient Method with Armijo-Type Line Search 被引量:11

A Globally Convergent Polak-Ribiere-Polyak Conjugate Gradient Method with Armijo-Type Line Search
下载PDF
导出
摘要 In this paper, we propose a globally convergent Polak-Ribiere-Polyak (PRP) conjugate gradient method for nonconvex minimization of differentiable functions by employing an Armijo-type line search which is simpler and less demanding than those defined in [4,10]. A favorite property of this method is that we can choose the initial stepsize as the one-dimensional minimizer of a quadratic modelΦ(t):= f(xk)+tgkTdk+(1/2) t2dkTQkdk, where Qk is a positive definite matrix that carries some second order information of the objective function f. So, this line search may make the stepsize tk more easily accepted. Preliminary numerical results show that this method is efficient. In this paper, we propose a globally convergent Polak-Ribière-Polyak (PRP) conjugate gradient method for nonconvex minimization of differentiable functions by employing an Armijo-type line search which is simpler and less demanding than those defined in [4,10]. A favorite property of this method is that we can choose the initial stepsize as the one-dimensional minimizer of a quadratic model Φ(t) := f(xk) + tg^T kdk + 1/2t^2 dk^T kQkdk, where Qk is a positive definite matrix that carries some second order information of the objective function f. So, this line search may make the stepsize tk more easily accepted. Preliminary numerical results show that this method is efficient.
基金 This work is supported by the Chinese NSF grants 60475042 Guangxi NSF grants 0542043the Foundation of Advanced Research Center of Zhongshan University and Hong Kong
关键词 非约束最优化 共轭梯度法 整体收敛 可微函数 Unconstrained optimization conjugate gradient method nonconvex minimization global convergence.
  • 相关文献

参考文献13

  • 1Yu-Hong DAIState Key Laboratory of Scientific and Engineering Computing, Institute of Computational Mathematics, Academy of Mathematics and System Sciences, Chinese Academy of Sciences, Beijing 100080, China.Conjugate Gradient Methods with Armijo-type Line Searches[J].Acta Mathematicae Applicatae Sinica,2002,18(1):123-130. 被引量:12
  • 2L. Grippo,S. Lucidi.A globally convergent version of the Polak-Ribière conjugate gradient method[J].Mathematical Programming.1997(3)
  • 3Y. Liu,C. Storey.Efficient generalized conjugate gradient algorithms, part 1: Theory[J].Journal of Optimization Theory and Applications.1991(1)
  • 4Han J,,Liu G,Sun D,Yin H.Two fundamental convergence theorems for nonlinear conjugate gradient methods and their applications[].Acta Mathematicae Applicatae Sinica.2001
  • 5Qi H,,Han J,Liu G.A modification of Hestenes-Stiefel conjugate gradient method[].Chinese Annals of Mathematics.1996
  • 6Zoutendijk G.Nonlinear programming computational methods[].Integer and Nonlinear Programming.1970
  • 7Hestenes M R,,Stiefel E.Method of conjugate gradient for solving linear equations[].J Res Natl Bur Stan.1952
  • 8Fletcher R,,Reeves C.Function minimization by conjugate gradients[].Computer Journal.1964
  • 9More J J,,Garbow B S,Hillstrome K E.Testing unconstrained optimization software[].ACM T Math Software.1981
  • 10Grippo L,,Lucidi S.Convergence conditions, line search algorithms and trust region implementations for the Polak-Ribiere conjugate gradient method[].Optim Method Softw.2005

二级参考文献19

  • 1戴彧虹.Further insight into the convergence of the Fletcher-Reeves method[J].Science China Mathematics,1999,42(9):905-916. 被引量:16
  • 2戴或虹,袁亚湘.广义Wolfe线搜索下Fletcher-Reeves方法的收敛性[J].高等学校计算数学学报,1996,18(2):142-148. 被引量:26
  • 3戴或虹,袁亚湘.共轭下降法的全局收敛性[J].数学进展,1996,25(6):552-562. 被引量:31
  • 4Yuhong Dai.Further insight into the convergence of the Fletcher-Reeves method[J].Science in China Series A: Mathematics.1999(9)
  • 5L. Grippo,S. Lucidi.A globally convergent version of the Polak-Ribière conjugate gradient method[J].Mathematical Programming.1997(3)
  • 6D. Touati-Ahmed,C. Storey.Efficient hybrid conjugate gradient techniques[J].Journal of Optimization Theory and Applications.1990(2)
  • 7Dong C. Liu,Jorge Nocedal.On the limited memory BFGS method for large scale optimization[J].Mathematical Programming (-).1989(1-3)
  • 8Armijo L.Minimization of functions having Lipschitz continuous first partial derivatives[].Pacific Journal of Mathematics.1966
  • 9Dai Y H,Han J Y,Liu G H,et al.Convergence properties of nonlinear conjugate gradient methods[].SIAM Journal on Optimization.1999
  • 10Dai Y H,Yuan Y.Convergence properties of the Fletcher-Reeves method[].IMA Journal of Numerical Analysis.1996

共引文献11

同被引文献72

引证文献11

二级引证文献11

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部