TY - RPRT TI - Differentially Private Preference Data Synthesis for Large Language Model Alignment AU - Fengyu Gao AU - Jing Yang PY - 2026 UR - https://arxiv.org/abs/2605.30808 ID - 2605.30808 ER -