Break Step: Recursive Training Resonates with Replayed Sampling Noise.
arXiv:2609.11149v3 Announce Type: replace-cross Abstract: How fast does a language model degrade when trained on its own outputs? Theory traces it to gradually accumulating errors, while experiments report repeated phrases within ten generations. Under a fixed
arXiv cs.AIResearch source·