Provable Benefit of SignGD: A Minimal Model Under Heavy-Tailed Class Imbalance.

arXiv:2512.00763v2 Announce Type: replace-cross Abstract: Adaptive and non-Euclidean optimizers often outperform Euclidean methods such as stochastic gradient descent (SGD) in language modeling by a large margin. Existing theory usually explains this gap by as