Abstract
To guarantee global convergence of the standard (unmodified) PRP nonlinear conjugate gradient method for unconstrained optimization, the exact line search or some Armijo type line searches which force the PRP method to generate descent directions have been adopted. In this short note, we propose a non-descent PRP method in another way. We prove that the unmodified PRP method converges globally even for nonconvex minimization by the use of an approximate descent inexact line search.
Similar content being viewed by others
References
Dai, Y.: Nonlinear conjugate gradient methods. Wiley Encyclopedia of Operations Research and Management Science (2011)
Dai Y.: Conjugate gradient methods with Armijo-type line searches. Acta Math. Appl. Sin. -Engl. Ser. 18, 123–130 (2002)
Dai Y., Yuan Y.: Nonlinear conjugate gradient methods. Shanghai Science and Technology Publisher, Shanghai (2000)
Gilbert J.C., Nocedal J.: Global convergence properties of conjugate gradient methods for optimization. SIAM J. Optim. 2, 21–42 (1992)
Grippo L., Lucidi S.: A globally convergent version of the Polak-Ribière conjugate gradient method. Math. Program. 78, 375–391 (1997)
Hager W.W., Zhang H.: A survey of nonlinear conjugate gradient methods. Pac. J. Optim. 2, 35–58 (2006)
Li D., Fukushima M.: A globally and superlinearly convergent Gauss-Newton-based BFGS method for symmetric nonlinear equations. SIAM J. Numer. Anal. 37, 152–172 (1999)
Polak E., Ribière G.: Note sur la convergence de méthodes de directions conjuguées. Rev. Fr. Inform. Rech. Oper. 16, 35–43 (1969)
Polyak B.T.: The conjugate gradient method in extreme problems. USSR Comput. Math. Math. Phys. 9, 94–112 (1969)
Zhang L., Zhou W., Li D.: A descent modified Polak–Ribière–Polyak conjugate gradient method and its global convergence. IMA J. Numer. Anal. 26, 629–640 (2006)
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by the NSF foundation (10901026) of China, The Open Fund Project of Key Research Institute of Philosophies and Social Sciences in Hunan Universities and the Key Project of the Scientific Research Fund of the Hunan Provincial Education Department.
Rights and permissions
About this article
Cite this article
Zhou, W. A short note on the global convergence of the unmodified PRP method. Optim Lett 7, 1367–1372 (2013). https://doi.org/10.1007/s11590-012-0511-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11590-012-0511-7