Verifier Errors in RLVR: Reward Hacking, Limits of Feedback, and Selective Control.
arXiv:2609.35677v1 Announce Type: new Abstract: In reinforcement learning with verifiable rewards (RLVR), imperfect verifiers can reward incorrect responses, creating opportunities for reward hacking. Using gradient flow with a fixed verifier, we characterize
arXiv cs.AIResearch source·