On-policy self-distillation (OPSD) trains a large language model using supervision from a teacher instantiated from the same model as the student.
← Back to all developments · Signals are a development reported by more than one source. See the methodology.