Skip to content
Research

Why $\beta_1 = \beta_2$ Is Dynamically Special in Adam.

arXiv:2601.21739v3 Announce Type: replace-cross Abstract: Adam has been at the core of large-scale training for almost a decade, yet the role of its two momentum parameters remains poorly understood. Recent work shows that tying $\beta_{1}=\beta_{2}$ can prese

arXiv cs.AIResearch source·