Expected Reasoning-Step Return Unifies On-Policy Learning from Rewards and Teachers.

arXiv:2609.32674v1 Announce Type: new Abstract: On-policy reasoning models can learn from task rewards or teacher signals, but these sources differ in form and can favor conflicting updates, leaving unclear which should guide a given reasoning action. We intro