TY - RPRT TI - A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity AU - Andrew Lee AU - Xiaoyan Bai AU - Itamar Pres AU - Martin Wattenberg AU - Jonathan K. Kummerfeld AU - Rada Mihalcea PY - 2024 UR - https://arxiv.org/abs/2401.01967 ID - 2401.01967 ER -