How RLHF Amplifies Sycophancy.

arXiv:2602.01002v2 Announce Type: replace Abstract: Large language models often exhibit increased sycophantic behavior after preference-based post-training, showing a stronger tendency to affirm a user's stated or implied belief even when this conflicts with f