Doubly Robust Alignment for Large Language Models.

arXiv:2506.01183v3 Announce Type: replace-cross Abstract: This paper studies reinforcement learning from human feedback (RLHF) for aligning large language models with human preferences. While RLHF has demonstrated promising results, many algorithms are highly