TY - RPRT TI - Many Preferences, Few Policies: Compact Portfolios for Multi-Objective LLM Alignment AU - Cheol Woo Kim AU - Jai Moondra AU - Roozbeh Nahavandi AU - Andrew Perrault AU - Milind Tambe AU - Swati Gupta PY - 2026 UR - https://arxiv.org/abs/2604.04144 ID - 2604.04144 ER -