一种 WYL 型谱共轭梯度法的全局收敛性

Abstract

Abstract:

In order to solve large scale unconstrained optimization problems, this paper combines the WYL conjugate gradient method with the spectral conjugate gradient method to give a WYL type spectral conjugate gradient method. Without relying on any line search, the search directions generated by the method satisfy the sufficient descent condition. Compared with the convergence of the WYL conjugate gradient method, the spectral WYL conjugate gradient method extends the range of values of the parameter$\sigma$in the line search. Finally, the corresponding numerical results show that the method is effective.

Key words: Unconstrained optimization, Spectral conjugate gradient method, Strong Wolfe line search, Global convergence

CLC Number:

O221

Cai Yu, Zhou Guanghui. Global Convergence of a WYL Type Spectral Conjugate Gradient Method[J].Acta mathematica scientia,Series A, 2024, 44(1): 173-184.

Trendmd

Figures/Tables 7

References 24

[1]	Fletcher R, Reeves C. Function minimization by conjugate gradients. Journal of Computing, 1964, 7(2): 149-154 doi: 10.1093/comjnl/7.2.149
[2]	Dai Y H, Yuan Y X. A nonlinear conjugate gradient with a strong global convergence property. SIAM Journal Optimization, 1999, 10(1): 177-182 doi: 10.1137/S1052623497318992
[3]	Polak E, Ribière G. Note surla convergence de directions conjugeèes. Rev Francaise Informat Recherche Operationele, 1969, 3(16): 35-43
[4]	Polyak B T. The conjugate gradient method in extreme problems. USSR Computational Mathematic and Mathematical Physics, 1969, 9(4): 94-112
[5]	Hestenes M R, Stiefel E. Methods of conjugate gradients for solving linear systems. Journal of Research of National Bureau of Standards, 1952, 49(6): 409-436 doi: 10.6028/jres.049.044
[6]	Dai Y H, Liao L Z. New conjugacy conditions and related nonlinear conjugate gradient methods. Applied Mathematics and Optimization, 2001, 43(1): 87-101 doi: 10.1007/s002450010019
[7]	Hager W W, Zhang H C. A new conjugate gradient method with guaranteed descent and efficient line search. SIAM Journal on Optimization, 2005, 16(1): 170-192 doi: 10.1137/030601880
[8]	Liu J K, Feng Y M, Zou L M. Some three-term conjugate gradient methods with the inexact line search condition. Calcolo, 2018, 55(2): 1-16 doi: 10.1007/s10092-018-0244-9
[9]	Djordjević S S. New hybrid conjugate gradient method as a convex combination of LS and FR methods. Acta Mathematica Scientia, 2019, 39B(1): 214-228
[10]	Yuan G, Lu J, Wang Z. The PRP conjugate gradient algorithm with a modified WWP line search and its application in the image restoration problems. Applied Numerical Mathematics, 2020, 152: 1-11
[11]	马国栋. 强 Wolfe 线搜索下的修正 PRP 和 HS 共轭梯度法. 数学物理学报, 2021, 41A(3): 837-847
	Ma G D. Improved PRP and HS conjugate gradient methods with the strong wolfe line search. Acta Math Sci, 2021, 41A(3): 837-847
[12]	Jiang X, Liao W, Yin J, et al. A new family of hybrid three-term conjugate gradient methods with applications in image restoration. Numerical Algorithms, 2022, 91(1): 161-191 doi: 10.1007/s11075-022-01258-2
[13]	Liu Y, Zhu Z, Zhang B. Two sufficient descent three-term conjugate gradient methods for unconstrained optimization problems with applications in compressive sensing. Journal of Applied Mathematics and Computing, 2022, 68(1): 1787-1816 doi: 10.1007/s12190-021-01589-8
[14]	Babaie-Kafaki S, Mirhoseini N, Aminifard Z. A descent extension of a modified Polak-Ribière-Polyak method with application in image restoration problem. Optimization Letters, 2023, 17(2): 351-367 doi: 10.1007/s11590-022-01878-6
[15]	Powell M J D. Restart procedure of the conjugate gradient method. Math Program, 1977, 2(1): 241-254
[16]	Powell M J D. Convergence properties of algorithms for nonlinear optimization. SIAM Review, 1986, 28(2): 487-500 doi: 10.1137/1028154
[17]	Gilbert J C, Nocedal J. Global convergence properties of conjugate gradient methods for optimization. SIAM J Optimization, 1992, 2(1): 21-42 doi: 10.1137/0802003
[18]	Wei Z X, Yao S W, Liu L Y. The convergence properties of some new conjugate gradient methods. Applied Mathematics and Computation, 2006, 183(2): 1341-1350 doi: 10.1016/j.amc.2006.05.150
[19]	Birgin E G, Martinez J M. A spectral conjugate gradient method for unconstrained optimization. Applied Mathematicals and Optimization, 2001, 43(2): 117-128
[20]	Zhang L, Zhou W J. Two descent hybrid conjugate gradient methods for optimization. Journal of Computation and Applied Mathematics, 2008, 216(1): 251-264
[21]	Zoutendijk G. Nolinear programming computational methods// Abadie J. Integer and Nonlinear Programming. Amsterdam: North-Holland, 1970(1): 37-86
[22]	戴彧虹, 袁亚湘. 非线性共轭梯度法. 上海: 上海科学技术出版社, 2000
	Dai Y H, Yuan Y X. Nonlinear Conjugate Gradient Method. Shanghai: Shanghai Science and Technology Press, 2000
[23]	Andrei N. An unconstrained optimization test functions collection. Advanced Modeling and Optimization, 2008, 10(1): 147-161
[24]	Dolan E D, Moré J J. Benchmarking optimization software with performance profiles. Mathematical Programming, 2002, 91(2): 201-213 doi: 10.1007/s101070100263

Global Convergence of a WYL Type Spectral Conjugate Gradient Method

RichHTML

PDF (PC)

Abstract

Cite this article

share this article

Figures/Tables 7

References 24

Related Articles 15

Metrics

Comments

Recommended 10

[1]	Jian Jinbao,Lin Hui,Ma Guodong. A Splitting Sequence Quadratic Programming Algorithm for the Large-Scale Nonconvex Nonseparable Optimization Problems [J]. Acta mathematica scientia,Series A, 2023, 43(4): 1284-1296.
[2]	Liu Pengjie, Wu Yanqiang, Shao Feng, Zhang Yan, Shao Hu. Two Extended HS-type Conjugate Gradient Methods with Restart Directions [J]. Acta mathematica scientia,Series A, 2023, 43(2): 570-580.
[3]	Ning Zhang,Jinkui Liu. Spectral LS-type Projection Algorithm for Solving Nonlinear Pseudo-Monotone Equations [J]. Acta mathematica scientia,Series A, 2022, 42(6): 1886-1897.
[4]	Tingwei Pan,Suxiang He. The Greedy Simplex Algorithm for Double Sparsity Constrained Optimization Problems [J]. Acta mathematica scientia,Series A, 2022, 42(3): 920-933.
[5]	Gonglin Yuan,Yulun Wu,Hongtruong Pham. A Modified HS-DY-Type Method with Nonmonotone Line Search for Image Restoration and Unconstrained Optimization Problems [J]. Acta mathematica scientia,Series A, 2022, 42(2): 605-620.
[6]	Xianzhen Jiang,Wei Liao,Jinbao Jian,Xiaodi Wu. An Improved PRP Type Spectral Conjugate Gradient Method with Restart Steps [J]. Acta mathematica scientia,Series A, 2022, 42(1): 216-227.
[7]	Zhibin Zhu,Yuanhang Geng. A Modified Three-Term WYL Conjugate Gradient Method [J]. Acta mathematica scientia,Series A, 2021, 41(6): 1871-1879.
[8]	Guodong Ma. Improved PRP and HS Conjugate Gradient Methods with the Strong Wolfe Line Search [J]. Acta mathematica scientia,Series A, 2021, 41(3): 837-847.
[9]	Xiaoni Chi,Rong Zeng,Sanyang Liu,Zhibin Zhu. A Regularized Nonmonotone Inexact Smoothing Newton Algorithm for Weighted Symmetric Cone Complementarity Problems [J]. Acta mathematica scientia,Series A, 2021, 41(2): 507-522.
[10]	Guodong Ma. A Strongly Convergent Generalized Gradient Projection Method for Minimax Optimization with General Constraints [J]. Acta mathematica scientia,Series A, 2020, 40(3): 641-649.
[11]	Xiangli Li,Juanjuan Shi,Xiaoliang Dong. A Class of Modified Non-Monotonic Spectral Conjugate Gradient Method and Applications to Non-Negative Matrix Factorization [J]. Acta mathematica scientia,Series A, 2018, 38(5): 954-962.
[12]	HU Chao-Ming, WAN Zhong, WANG Xu. A New Nonmonotone Spectral Conjugate Gradient Algorithm [J]. Acta mathematica scientia,Series A, 2013, 33(1): 78-88.
[13]	TANG Jing-Yong, HE Guo-Ping. A One-step Smoothing Newton Method for Second-order Cone Programming [J]. Acta mathematica scientia,Series A, 2012, 32(4): 768-778.
[14]	SUN Qing-Ying, DONG Jie-Hong, SANG Zhao-Yang. A New Trust Region Algorithm with Simple Quadratic Models and Line Search [J]. Acta mathematica scientia,Series A, 2010, 30(6): 1562-1574.
[15]	Zhang Li; Zhou Weijun. On the Global Convergence of the Hager-Zhang Conjugate Gradient Method with Armijo Line Search [J]. Acta mathematica scientia,Series A, 2008, 28(5): 840-845.