Long Chen
UC Irvine
3:45 PM
127 Hayes-Healy
Colloquium Tea will be held at 3:15 pm in 154 Hurley Hall
From ODE Solvers to Accelerated Optimization Methods
Convergence analysis of accelerated first-order methods for convex optimization problems are presented from the point of view of ordinary differential equation (ODE) solvers. We first take another look at the acceleration phenomenon via A-stability theory for ODE solvers and present an explanation by transformation of spectrum to the complex plane. After that, we present the Lyapunov framework for dynamical system and introduce the strong Lyapunov condition. Many existing continuous convex optimization models, such as gradient flow, heavy ball system, Nesterov accelerated gradient flow, and dynamical inertial Newton system etc, are addressed and analyzed in this framework. Finally we extend the acceleration to a class of non-linear saddle point problems.
This is a joint work with Hao Luo and Jingrong Wei.
View Poster