Skip to content
Research

Growing to See: Efficient Pretraining of Self-Supervised Vision Transformers.

arXiv:2610.16817v1 Announce Type: cross Abstract: Progressive depth growth builds large networks by starting with shallow models and inserting layers during training. Recent advances in large language models have renewed interest in this longstanding approach,

arXiv cs.AIResearch source·