Concept-Guided Fine-Tuning: Steering ViTs away from Spurious Correlations to Improve Robustness.

arXiv:2603.08309v3 Announce Type: replace-cross Abstract: Vision Transformers (ViTs) often degrade under distribution shifts because they rely on spurious correlations, such as background cues, rather than semantically meaningful features. Existing regularizat