Mean--Fluctuation Dynamics at the Edge of Stability.

arXiv:2606.05326v2 Announce Type: replace-cross Abstract: We study the dynamics of gradient descent in the Edge of Stability regime, where the learning rate is large enough to induce persistent oscillations in the trajectory, which has been linked to better ge