Learn from the Gap: Differential-Aware Advantage Pruning with Adaptive Rollout Sampling for GRPO.

arXiv:2609.36932v3 Announce Type: replace Abstract: Recently, Group Relative Policy Optimization (GRPO) and its variants have been developed for policy optimization and demonstrated notable performance gains. However, these methods usually incur substantial co