Scaling and Renormalization in Neural Networks: An Effective Renormalization-Group Description of Grokking.

arXiv:2610.36113v1 Announce Type: cross Abstract: Grokking is a delayed transition from memorization to generalization in deep neural networks (NNs). We examine whether scaling and renormalization group (RG) theories can describe this dynamics, establishing a