Audit Where Hacks Pay: Budgeted Strong-Verifier Audits Against Reward Hacking in GRPO.

arXiv:2610.35716v1 Announce Type: cross Abstract: Reinforcement learning with verifiable rewards trains on cheap checks, such as unit tests, that a policy can learn to game, while a stronger check is too expensive to run on every rollout. We study how to spend