Large Pretraining Datasets Don't Guarantee Robustness after Fine-Tuning in Image Classification.

arXiv:2410.21582v4 Announce Type: replace-cross Abstract: Large-scale pretrained models are widely leveraged as foundations for learning new specialized tasks via fine-tuning, with the goal of maintaining the general performance of the model while allowing it