Rank-Aware Differentially Private Release of Listwise Preferences for LLM Alignment.

arXiv:2610.37682v1 Announce Type: cross Abstract: Listwise preference feedback offers richer supervision for large language model (LLMs) alignment than pairwise comparisons, but a full ranking also reveals more sensitive user preferences. Existing privacy-pres