Mitigating Reward Hacking in Preference Reward Models with Evolving Penalties.

arXiv:2610.26496v2 Announce Type: replace-cross Abstract: Reinforcement learning for language models has moved from preference reward models to verifiable rewards, which sustain much longer optimization. Preference models are prone to reward hacking: the polic