A "feature ODE" describing the learning behavior of shallow MLPs on simple functions.

arXiv:2610.25652v1 Announce Type: cross Abstract: We study the gradient flow training dynamics of two-layer multi-layer perceptrons (MLPs) on anisotropic Gaussian data. Even in this simple setting, solving the dynamics in full is notoriously difficult, so we t