Learning from imperfect teachers for low-resource acoustic generalization.

arXiv:2610.05256v1 Announce Type: new Abstract: Knowledge distillation (KD) improves low-resource acoustic learning by enriching one-hot supervision with the softened predictive distribution of a fixed teacher network. However, a teacher trained with limited o