Skip to content
Research

Anon: Extrapolating Adaptivity Beyond SGD and Adam.

arXiv:2605.02317v3 Announce Type: replace Abstract: Adaptive optimizers such as Adam and non-adaptive methods like SGD exhibit distinct generalization capabilities across different architectures. Prior tunable optimizers attempt to bridge this gap by strictly

arXiv cs.AIResearch source·