Trust the Critic More.

arXiv:2609.39247v2 Announce Type: replace-cross Abstract: Standard language model RL algorithms credit every token of a long rollout with the same advantage determined by the terminal reward. Actor-critic methods can provide finer-grained credit assignment, bu