Projected Distillation: On Learning to Solve Hard Problems from Close, Correct Targets.

arXiv:2610.27467v1 Announce Type: cross Abstract: On-policy learning is central to post-training: training on a model's own generations limits distribution shift and helps preserve existing capabilities. On hard problems, however, on-policy RL provides no rewa