The Devil is in the Spectrum Bias: Spectrum-Balanced Feature Matching for Robust Representation Distillation.

arXiv:2609.34106v1 Announce Type: cross Abstract: Large visual foundation models have demonstrated remarkable transferability across a wide range of downstream tasks. To deploy such models efficiently, feature matching has become a popular knowledge distillati