Percolation Dynamics in Optimization: Variance Cascades and Nested Symmetry.
arXiv:2609.02373v2 Announce Type: replace-cross Abstract: We study the dynamics of Stochastic Gradient Descent (SGD), which is known to steer deep neural networks toward invariant sets that correspond to simpler subnetworks. How this steering unfolds over time
arXiv cs.AIResearch source·