Dual-Vocabulary Language Model for Cross-Tokenizer Distillation.

arXiv:2609.33816v1 Announce Type: new Abstract: On-policy distillation (OPD) bridges teacher supervision and student behavior, but different teacher-student tokenizers introduce misalignment in both input tokenization (#1) and output logits (#2). Existing appr