Instruct, Not Answer: Using Instruction Privileges in On-Policy Context Distillation.

arXiv:2609.32201v2 Announce Type: replace Abstract: On-Policy Context Distillation (OPCD) has recently emerged as a powerful technique for transferring context to student models and for self-improvement. In OPCD, the teacher is conditioned on privileged inform