Adam at the Edge of Stability: Adaptive Feedback, Provable Oscillation, and Gradient Reversal.

arXiv:2608.20638v2 Announce Type: replace-cross Abstract: The edge-of-stability (EoS) phenomenon of full-batch Adam has been widely observed, yet its underlying dynamical mechanism remains poorly understood. In this paper, we identify Adam's second-moment adap