2019 • Journal Article
A generic online acceleration scheme for optimization algorithms via relaxation and inertia
Authors:
Iutzeler, F.,
Hendrickx, Julien
Published in:
Optimization Methods and Software
Volume: 34 • Number: 2 • Pages: 383-405
We propose generic acceleration schemes for a wide class of optimization and iterative schemes based on relaxation and inertia. In particular, we introduce methods that automatically tunes the acceleration coefficients online, and establish their convergence. This is made possible by considering the class of fixed-points iterations over averaged operators which encompass gradient methods, ADMM, primal dual algorithms, an so on.
