An extended delayed weighted gradient algorithm for solving strongly convex optimization problems

R. Andreani, H. Oviedo, M. Raydan, L. D. Secchin

Resultado de la investigación: Contribución a una revistaArtículorevisión exhaustiva

Resumen

The recently developed delayed weighted gradient method (DWGM) is competitive with the well-known conjugate gradient (CG) method for the minimization of strictly convex quadratic functions. As well as the CG method, DWGM has some key optimality and orthogonality properties that justify its practical performance. The main difference with the CG method is that, instead of minimizing the objective function on the entire explored subspace, DWGM minimizes the 2-norm of the gradient vector on the same subspace. The main purpose of this study is to extend DWGM for solving strongly convex nonquadratic minimization problems while keeping a low computational cost per iteration. We incorporate the scheme into a tolerant line search globalization strategy, and we show that it exhibits q-linear convergence to the unique global solution. We compare the proposed extended DWGM with state-of-the-art methods for large-scale unconstrained minimization problems. We use some well-known strongly convex test problems, but also solve some regularized logistic regression problems that appear in machine learning. Our numerical results illustrate that the proposed scheme is promising and exhibits a fast convergence behavior. Moreover, we show through numerical experiments on CUTEst problems that the proposed extended DWGM can be very effective in accelerating the convergence of a well-established Barzilai–Borwein-type method when the iterates get close to minimizers of non-convex functions.

Idioma originalInglés
Número de artículo114525
PublicaciónJournal of Computational and Applied Mathematics
Volumen416
DOI
EstadoPublicada - 15 dic. 2022
Publicado de forma externa

Huella

Profundice en los temas de investigación de 'An extended delayed weighted gradient algorithm for solving strongly convex optimization problems'. En conjunto forman una huella única.

Citar esto