From SGD to Muon: Adaptive Optimization via Schatten-p Norms.

arXiv:2605.19781v3 Announce Type: replace Abstract: Modern optimizers, like Muon, impose matrix-wise geometry constraints on their updates. These matrix-wise constraints can be unified under Linear Minimization Oracle (LMO) theory. However, all current methods