ReSPO: Reshaped Sequence Policy Optimization for Gradient Starvation in Off-Policy Learning.

arXiv:2609.35433v1 Announce Type: cross Abstract: Reinforcement learning from verifiable rewards (RLVR) frequently reuses rollouts across multiple policy updates, increasing the mismatch between the current policy and the data-generating policy. We identify a