Foundation-Preserving Optimization in Generalized Eigenspace.

arXiv:2606.00132v2 Announce Type: replace-cross Abstract: While finetuning effectively adapts foundation models to specialized downstream tasks, it can degrade nontarget capabilities acquired during pretraining. Existing forgetting aware methods typically seek