ACMS Colloquium: Long Chen, UC Irvine


Location: 127 Hayes-Healy Center

Screen Shot 2023 03 06 At 11

Long Chen

UC Irvine

3:45 PM
127 Hayes-Healy
Colloquium Tea will be held at 3:15 pm in 154 Hurley Hall

From ODE Solvers to Accelerated Optimization Methods

Convergence analysis of accelerated first-order methods for convex optimization problems are presented from the point of view of ordinary differential equation (ODE) solvers. We first take another look at the acceleration phenomenon via A-stability theory for ODE solvers and present an explanation by transformation of spectrum to the complex plane. After that, we present the Lyapunov framework for dynamical system and introduce the strong Lyapunov condition. Many existing continuous convex optimization models, such as gradient flow, heavy ball system, Nesterov accelerated gradient flow, and dynamical inertial Newton system etc, are addressed and analyzed in this framework. Finally we extend the acceleration to a class of non-linear saddle point problems.

This is a joint work with Hao Luo and Jingrong Wei.

View Poster