SoFT: Soft Targets for Generalizable LLM Fine-Tuning.

arXiv:2609.32493v2 Announce Type: replace-cross Abstract: Distillation enables student language models to acquire new capabilities from expert teachers. However, integrating knowledge from multi-teacher, multi-domain demonstrations into a single student remain