Why $\beta_1 = \beta_2$ Is Dynamically Special in Adam.
arXiv:2601.21739v3 Announce Type: replace-cross Abstract: Adam has been at the core of large-scale training for almost a decade, yet the role of its two momentum parameters remains poorly understood. Recent work shows that tying $\beta_{1}=\beta_{2}$ can prese
arXiv cs.AIResearch source·