Bayes-Adaptive MDPs for Rollout Allocation to Enhance GRPO Training.

arXiv:2610.37429v1 Announce Type: cross Abstract: Group Relative Policy Optimization (GRPO) has demonstrated strong performance in LLM post-training. However, it allocates a uniform rollout budget to every training question, ignoring variations in question dif