Skip to content
Research

Percolation Dynamics in Optimization: Variance Cascades and Nested Symmetry.

arXiv:2609.02373v2 Announce Type: replace-cross Abstract: We study the dynamics of Stochastic Gradient Descent (SGD), which is known to steer deep neural networks toward invariant sets that correspond to simpler subnetworks. How this steering unfolds over time

arXiv cs.AIResearch source·