Visual Contrastive Self-Distillation.

arXiv:2607.21556v2 Announce Type: replace-cross Abstract: On-policy self-distillation (OPSD) removes the external teacher required by on-policy distillation (OPD), but still needs asymmetric information between teacher and student so that the self-teacher prov