Subspace Crystallization in Grokking: Rank Compression Tracks the Phase Transition.

arXiv:2610.35112v1 Announce Type: cross Abstract: Grokking describes understanding something deeply and intuitively. In neural networks, it is the phenomenon where a network generalizes long after memorizing its training data. This delay has been linked to a f