Freeze, Don't Clone: Fine-Tuning with Expressive Policies Without Retaining Offline Data.

arXiv:2610.36247v1 Announce Type: cross Abstract: Offline-to-online reinforcement learning uses offline pretraining to accelerate subsequent online learning. While many methods assume the offline dataset remains available throughout fine-tuning, there are many