TY - RPRT TI - A Markov Chain Approach to Preference Alignment AU - Takuya Koriyama AU - Tengyuan Liang PY - 2026 UR - https://arxiv.org/abs/2606.22652 ID - 2606.22652 ER -