Data-Aware Model Merging in the Essential Subspace for Multi-Task Knowledge Aggregation.

arXiv:2606.19164v4 Announce Type: replace-cross Abstract: Model merging enables training-free multi-task learning by aggregating knowledge from models fine-tuned from a shared checkpoint, but their task updates can interfere. Using proxy data, we find that tas