Your Language Model is Its Own Critic: Reinforcement Learning with Value Estimation from Actor's Internal States.

arXiv:2605.07579v4 Announce Type: replace-cross Abstract: Reinforcement learning with verifiable rewards (RLVR) for Large Reasoning Models rests on variance reduction, which requires both a reliable baseline and high prompt diversity within each training batch