COFFEQA: Counterfactual-Guided Few-Shot Distillation for LLM Question Answering.

arXiv:2610.12837v1 Announce Type: cross Abstract: Knowledge distillation aims to train a smaller student model to mimic a larger teacher model for resource-constrained environments. However, the process of distillation is typically data-intensive and computati