Skip to content
Research

Convergence guarantees for Muon: New parameter regimes and generalizations.

arXiv:2609.30546v1 Announce Type: cross Abstract: In this paper, we establish the first asymptotic convergence guarantees for the Muon algorithm through a more accurate proxy for the Newton-Schultz iteration than the typical matrix sign function. We prove that

arXiv cs.AIResearch source·