TY - RPRT TI - Convergence of Two-Timescale Markovian Stochastic Approximations with Applications in Reinforcement Learning AU - Vagul Mahadevan AU - Claire Chen AU - Shuze Daniel Liu AU - Shangtong Zhang PY - 2026 UR - https://arxiv.org/abs/2605.31172 ID - 2605.31172 ER -