Stochastic Pruning of the DPO Computation Graph: 1.4x Faster Training and Lower Peak Memory.

arXiv:2610.29538v1 Announce Type: cross Abstract: Direct preference optimization (DPO) incurs training costs in output scoring, sequence execution, and backpropagation, so reducing supervision alone does not necessarily save computation. We introduce a unified