Taming Softmax at the Limits of Muon: A Unified Approach through Hilbert Geometry

arXiv:2610.17588v1 Announce Type: cross Abstract: Muon controls weight updates through the RMS movement of a linear layer's output.

← Back to all developments · Signals are a development reported by more than one source. See the methodology.