secretaire-inma@uclouvain.be +32 10 47 80 36
Home > Publications > Accelerated Line-search and Trust-region Methods
2009 • Journal Article

Accelerated Line-search and Trust-region Methods

Authors:
Absil, Pierre-Antoine , Gallivan, Kyle A.
Published in:
SIAM Journal on Numerical Analysis

Volume: 47 • Number: 2 • Pages: 997-1018

In numerical optimization, line-search and trust-region methods are two important classes of descent schemes, with well-understood global convergence properties. We say that these methods are "accelerated" when the conventional iterate is replaced by any point that produces at least as much of a decrease in the cost function as a fixed fraction of the decrease produced by the conventional iterate. A detailed convergence analysis reveals that global convergence properties of line-search and trust-region methods still hold when the methods are accelerated. The analysis is performed in the general context of optimization on manifolds, of which optimization in R-n is a particular case. This general convergence analysis sheds new light on the behavior of several existing algorithms.

Related Resources