Distilling Directional Verification.
arXiv:2610.00997v1 Announce Type: cross Abstract: Knowledge distillation aims to transfer the factual knowledge of large language models to smaller models for efficient deployment. Yet a teacher may recall a relation in one direction while failing to generate
arXiv cs.AIResearch source·