Robust Failure, Conservative Repair: Textual Knowledge Distillation from Cross-Model Failures.

arXiv:2609.25400v1 Announce Type: new Abstract: Failure-based textual knowledge distillation aims to discover gaps in a model's knowledge by examining its task errors. The distilled knowledge can be useful for the reasoning of both this model ("source model")