TY - RPRT TI - Provably Convergent Primal-Dual DPO for Constrained LLM Alignment AU - Yihan Du AU - Seo Taek Kong AU - R. Srikant PY - 2026 UR - https://arxiv.org/abs/2510.05703 ID - 2510.05703 ER -