Efficient Best-of-N policy evaluation for inference-time alignment.

arXiv:2610.09250v1 Announce Type: cross Abstract: Best-of-N (BoN) is a common inference-time alignment method that selects the highest-scoring response among N samples from a reference model. Evaluating BoN policies from logged data is challenging under sample