arXiv · 2611.10759
A Bayesian oriented exploration and reinforcement learning in continuous-time mean-variance portfolio optimization
Abstract
We propose a new reinforcement learning (RL) framework for the continuous-time mean-variance portfolio optimization with unknown market parameters. To better reflect the impact of improved information of the unknown drift on the degree of exploration, we consider a novel randomization based on continuous-time stochastic filtering. Specifically, we construct a continuous-time analog to Thompson Sampling by treating the unknown drift as a random draw from a generalized sampling distribution parameterized by the filter's posterior mean and variance. The new learning objective measures the tradeoff between the wealth performance and the weighted KL divergence between the policy and the true Bayesian posterior, which transforms the classical feedback control into an information guided stochastic policy. As a result, the degree of exploration endogenously depends on the Reward-Biased Maximum Likelihood Estimation that decays with the shrinking filter's variance. This allows us to devise an efficient model-based learning algorithm in the mean-variance portfolio optimization with theoretical guarantee and superior learning performance.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Kexin Chen, Xiang Yu, Shanshan Zhao. 2026-11-07. A Bayesian oriented exploration and reinforcement learning in continuous-time mean-variance portfolio optimization. https://searcharxiv.com/abs/2611.10759
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.