PrefPI: Preference-Guided Steering into Out-of-Distribution Behaviors.

arXiv:2609.40165v1 Announce Type: cross Abstract: We present PrefPI (Preference-Guided Policy Iteration), an iterative framework for steering pretrained generative robot policies using only relative preferences over self-generated trajectories. Unlike prior pr