TY - RPRT TI - Misaligned by Reward: Socially Undesirable Preferences in LLMs AU - Gayane Ghazaryan AU - Esra Dönmez PY - 2026 UR - https://arxiv.org/abs/2605.05003 ID - 2605.05003 ER -