Skip to content
Research

DGA-Muon: Decoupled Geometry-Aligned Adaptive Scaling for Muon.

arXiv:2610.06578v2 Announce Type: replace Abstract: While NorMuon has achieved strong empirical performance in pretraining, its underlying adaptive mechanism remains largely heuristic and poorly understood. In this work, we provide the first systematic theoret

arXiv cs.AIResearch source·