Asynchronous LLM Post-Training: Group-Mass Capping and Convergence Analysis.

arXiv:2610.01896v1 Announce Type: cross Abstract: Asynchronous reinforcement learning (RL) improves the efficiency of large language model post-training but introduces stale rollouts generated by earlier policies. Theoretical understanding of how this stalenes