On the stability of gradient descent with second order dynamics for time-varying cost functions

This repository reproduces figures from the paper: On the Stability of Gradient Descent with Second Order Dynamics for Time‑Varying Cost Functions, TMLR 2025. (link: https://openreview.net/forum?id=HlzjI2fn2T)

Environment Setup

We suggest using conda to setup the environment and packages

conda create -n opt_env python=3.10 matplotlib numpy tqdm \
    pytorch torchvision torchaudio -c pytorch -c conda-forge
    
conda activate opt_env