Searcharxiv⌕ Search

arXiv subjects

Marco Fuhrman

Publications and source records attributed to Marco Fuhrman.

24 records · Page 2Linked to original sources
arXiv2013

Stochastic maximum principle for optimal control of SPDEs

We prove a version of the maximum principle, in the sense of Pontryagin, for the optimal control of a stochastic partial differential equation driven by a finite dimensional Wiener process. The equation is formulated in a semi-abstract form that allows direct applications to a large class of controlled stochastic parabolic equations. We allow for a diffusion coefficient dependent on the control parameter, and the space of control actions is general, so that in particular we need to introduce two adjoint processes. The second adjoint process takes values in a suitable space of operators on $L^4$.

math.OC↗
arXiv2012

Backward stochastic differential equations and optimal control of marked point processes

We study a class of backward stochastic differential equations (BSDEs) driven by a random measure or, equivalently, by a marked point process. Under appropriate assumptions we prove well-posedness and continuous dependence of the solution on the data. We next address optimal control problems for point processes of general non-markovian type and show that BSDEs can be used to prove existence of an optimal control and to represent the value function. Finally we introduce a Hamilton-Jacobi-Bellman equation, also stochastic and of backward type, for this class of control problems: when the state space is finite or countable we show that it admits a unique solution which identifies the (random) value function and can be represented by means of the BSDEs introduced above.

math.PR↗
arXiv2010

Filtering of continuous-time Markov chains with noise-free observation and applications

Let X be a continuous-time Markov chain in a finite set I, let h be a mapping of I onto another set, and let Y be defined by Y_t=h(X_t), (for t nonnegative). We address the filtering problem for X in terms of the observation Y, which is not directly affected by noise. We write down explicit equations for the filtering process and show that this is a Markov process with the Feller property. We also prove that it is a piecewise-deterministic Markov process in the sense of Davis, and we identify its characteristics explicitly. We finally solve an optimal stopping problem for X with partial observation, i.e. where the moment of stopping is required to be a stopping time with respect to the natural filtration of Y.

math.PR↗
arXiv2008

Stochastic equations with delay: optimal control via BSDEs and regular solutions of Hamilton-Jacobi-Bellman equations

We consider an Ito stochastic differential equation with delay, driven by brownian motion, whose solution, by an appropriate reformulation, defines a Markov process $X$ with values in a space of continuous functions $\mathbf C$, with generator $\mathcal L$. We then consider a backward stochastic differential equation depending on $X$, with unknown processes $(Y,Z)$, and we study properties of the resulting system, in particular we identify the process $Z$ as a deterministic functional of $X$. We next prove that the forward-backward system provides a suitable solution to a class of parabolic partial differential equations on the space $\mathbf C$ driven by $\mathcal L$, and we apply this result to prove a characterization of the fair price and the hedging strategy for a financial market with memory effects. We also include applications to optimal stochastic control of differential equation with delay: in particular we characterize optimal controls as feedback laws in terms the process $X$.

math.PR↗
arXiv2007

Ergodic BSDEs and Optimal Ergodic Control in Banach Spaces

In this paper we introduce a new kind of Backward Stochastic Differential Equations, called ergodic BSDEs, which arise naturally in the study of optimal ergodic control. We study the existence, uniqueness and regularity of solution to ergodic BSDEs. Then we apply these results to the optimal ergodic control of a Banach valued stochastic state equation. We also establish the link between the ergodic BSDEs and the associated Hamilton-Jacobi-Bellman equation. Applications are given to ergodic control of stochastic partial differential equations.

math.PR↗