Counterfactual Rollout Replay: Forkable Environments as Free Process Rewards for Software Engineering Agents.

arXiv:2609.33875v3 Announce Type: replace-cross Abstract: Outcome-only reinforcement learning gives software engineering (SWE) agents a terminal success signal but little direct guidance about intermediate decisions. We introduce Counterfactual Rollout Replay