A Cheap Verifier is Good Enough: LLM Post-training is Robust to Erroneous Rewards.

arXiv:2609.33467v1 Announce Type: cross Abstract: When post-training large language models on tasks with semi-verifiable rewards, there are many factors (training steps, base model size, training order, data quality, verifier accuracy, etc.) that practitioners