Relative Density Ratio Optimization for Stable and Statistically Consistent Model Alignment.

arXiv:2604.04410v2 Announce Type: replace-cross Abstract: Aligning language models with human preferences is essential for ensuring their safety and reliability. Although most existing approaches assume specific human preference models such as the Bradley-Terr