Skip to content
Research

Does Muon Need Fine-Grained Spectral Shaping?

arXiv:2610.07497v1 Announce Type: new Abstract: Muon combines current and past gradients into matrix momentum. For $M=U\Sigma V^\top$, the idealized polar update $Q=UV^\top$ gives every singular direction the same weight. We refer to this as the flat profile.

arXiv cs.AIResearch source·