Scaling Laws for Collapse in Asynchronous GRPO.

arXiv:2607.01083v3 Announce Type: replace-cross Abstract: Asynchronous reinforcement learning improves the throughput of large language model post-training by decoupling rollout generation from policy optimization, but introduces a mismatch between the behavio