The Hidden Ratio in Adam: Stable Structure, Compression, and Sign Dynamics.

arXiv:2609.35392v1 Announce Type: cross Abstract: Adam is the default optimizer for training modern deep neural networks, yet its adaptive behavior remains poorly understood due to the complex interaction between its first- and second-moment exponential moving