SearcharxivSearch

arXiv subjects

Alessandro Calvia

Publications and source records attributed to Alessandro Calvia.

12 recordsLinked to original sources

Optimal Policy Characterization for a Class of Multi-Dimensional Ergodic Singular Stochastic Control Problems

In ergodic singular stochastic control problems, a decision-maker can instantaneously adjust the evolution of a state variable using a control of bounded variation, with the goal of minimizing a long-term average cost functional. The cost of control is proportional to the magnitude of adjustments. This paper characterizes the optimal policy and the value in a class of multi-dimensional ergodic singular stochastic control problems. These problems involve a linearly controlled one-dimensional stochastic differential equation, whose coefficients, along with the cost functional to be optimized, depend on a multi-dimensional uncontrolled process Y. We first provide general verification theorems providing an optimal control in terms of a Skorokhod reflection at Y-dependent free boundaries, which emerge from the analysis of an auxiliary Dynkin game. We then fully solve two two-dimensional optimal inventory management problems. To the best of our knowledge, this is the first paper to establish a connection between multi-dimensional ergodic singular stochastic control and optimal stopping, and to exploit this connection to achieve a complete solution in a genuinely two-dimensional setting.

math.OC

Short-rate models with stochastic discontinuities: a PDE approach

With the reform of interest rate benchmarks, interbank offered rates (IBORs) like LIBOR have been replaced by risk-free rates (RFRs), such as the Secured Overnight Financing Rate (SOFR) in the U.S. and the Euro Short-Term Rate (\euro STR) in Europe. These rates exhibit characteristics like jumps and spikes that correspond to specific market events, driven by regulatory and liquidity constraints. To capture these characteristics, this paper considers a general short-rate model that incorporates discontinuities at fixed times with random sizes. Within this framework, we introduce a PDE-based approach for pricing interest rate derivatives and establish, under suitable assumptions, a Feynman-Ka\v{c} representation for the solution. For affine models, we derive (quasi) closed-form solutions, while for the general case, we develop numerical methods to solve the resulting PDEs.

q-fin.MF

Existence and uniqueness results for a mean-field game of optimal investment

We establish the existence and uniqueness of the equilibrium for a stochastic mean-field game of optimal investment. The analysis covers both finite and infinite time horizons, and the mean-field interaction of the representative company with a mass of identical and indistinguishable firms is modeled through the time-dependent price at which the produced good is sold. At equilibrium, this price is given in terms of a nonlinear function of the expected (optimally controlled) production capacity of the representative company at each time. The proof of the existence and uniqueness of the mean-field equilibrium relies on a priori estimates and the study of nonlinear integral equations, but employs different techniques for the finite and infinite horizon cases. Additionally, we investigate the deterministic counterpart of the mean-field game under study.

math.OC

An optimal control problem with state constraints in a spatio-temporal economic growth model on networks

We introduce a spatial economic growth model where space is described as a network of interconnected geographic locations and we study a corresponding finite-dimensional optimal control problem on a graph with state constraints. Economic growth models on networks are motivated by the nature of spatial economic data, which naturally possess a graph-like structure: this fact makes these models well-suited for numerical implementation and calibration. The network setting is different from the one adopted in the related literature, where space is modeled as a subset of a Euclidean space, which gives rise to infinite dimensional optimal control problems. After introducing the model and the related control problem, we prove existence and uniqueness of an optimal control and a regularity result for the value function, which sets up the basis for a deeper study of the optimal strategies. Then, we focus on specific cases where it is possible to find, under suitable assumptions, an explicit solution of the control problem. Finally, we discuss the cases of networks of two and three geographic locations.

math.OC

HJB equations and stochastic control on half-spaces of Hilbert spaces

In this paper we study a first extension of the theory of mild solutions for HJB equations in Hilbert spaces to the case when the domain is not the whole space. More precisely, we consider a half-space as domain, and a semilinear Hamilton-Jacobi-Bellman (HJB) equation. Our main goal is to establish the existence and the uniqueness of solutions to such HJB equations, that are continuously differentiable in the space variable. We also provide an application of our results to an exit time optimal control problem and we show that the corresponding value function is the unique solution to a semilinear HJB equation, possessing sufficient regularity to express the optimal control in feedback form. Finally, we give an illustrative example.

math.OC

A simple planning problem for COVID-19 lockdown: a dynamic programming approach

A large number of recent studies consider a compartmental SIR model to study optimal control policies aimed at containing the diffusion of COVID-19 while minimizing the economic costs of preventive measures. Such problems are non-convex and standard results need not to hold. We use a Dynamic Programming approach and prove some continuity properties of the value function of the associated optimization problem. We study the corresponding Hamilton-Jacobi-Bellman equation and show that the value function solves it in the viscosity sense. Finally, we discuss some optimality conditions. Our paper represents a first contribution towards a complete analysis of non-convex dynamic optimization problems, within a Dynamic Programming approach.

math.OC

Nonlinear Filtering of Partially Observed Systems arising in Singular Stochastic Optimal Control

This paper deals with a nonlinear filtering problem in which a multi-dimensional signal process is additively affected by a process $\nu$ whose components have paths of bounded variation. The presence of the process $\nu$ prevents from directly applying classical results and novel estimates need to be derived. By making use of the so-called reference probability measure approach, we derive the Zakai equation satisfied by the unnormalized filtering process, and then we deduce the corresponding Kushner-Stratonovich equation. Under the condition that the jump times of the process $\nu$ do not accumulate over the considered time horizon, we show that the unnormalized filtering process is the unique solution to the Zakai equation, in the class of measure-valued processes having a square-integrable density. Our analysis paves the way to the study of stochastic control problems where a decision maker can exert singular controls in order to adjust the dynamics of an unobservable It\^o-process.

math.OC

State constrained control problems in Banach lattices and applications

This paper aims to study a family of deterministic optimal control problems in infinite dimensional spaces. The peculiar feature of such problems is the presence of a positivity state constraint, which often arises in economic applications. To deal with such constraints, we set up the problem in a Banach space with a Riesz space structure (i.e., a Banach lattice) not necessarily reflexive: a typical example is the space of continuous functions on a compact set. In this setting, which seems to be new in this context, we are able to find explicit solutions to the Hamilton-Jacobi-Bellman (HJB) equation associated to a suitable auxiliary problem and to write the corresponding optimal feedback control. Thanks to a type of infinite dimensional Perron-Frobenius Theorem, we use these results to get information about the optimal paths of the original problem. This was not possible in the infinite dimensional setting used in earlier works on this subject, where the state space was an $\mathrm L^2$ space.

math.OC

Stochastic filtering of a pure jump process with predictable jumps and path-dependent local characteristics

The objective of this paper is to study the filtering problem for a system of partially observable processes $(X, Y)$, where $X$ is a non-Markovian pure-jump process representing the signal and $Y$ is a general jump-diffusion which provides observations. Our model covers the case where both processes are not necessarily quasi left-continuous, allowing them to jump at predictable stopping times. By introducing the Markovian version of the signal, we are able to compute an explicit equation for the filtering process via the innovations approach.

math.PR

Risk measures and progressive enlargement of filtration: a BSDE approach

We consider dynamic risk measures induced by Backward Stochastic Differential Equations (BSDEs) in enlargement of filtration setting. On a fixed probability space, we are given a standard Brownian motion and a pair of random variables $(τ, ζ) \in (0,+\infty) \times E$, with $E \subset \mathbb{R}^m$, that enlarge the reference filtration, i.e., the one generated by the Brownian motion. These random variables can be interpreted financially as a default time and an associated mark. After introducing a BSDE driven by the Brownian motion and the random measure associated to $(τ, ζ)$, we define the dynamic risk measure $(ρ_t)_{t \in [0,T]}$, for a fixed time $T > 0$, induced by its solution. We prove that $(ρ_t)_{t \in [0,T]}$ can be decomposed in a pair of risk measures, acting before and after $τ$ and we characterize its properties giving suitable assumptions on the driver of the BSDE. Furthermore, we prove an inequality satisfied by the penalty term associated to the robust representation of $(ρ_t)_{t \in [0,T]}$ and we discuss the dynamic entropic risk measure case, providing examples where it is possible to write explicitly its decomposition and simulate it numerically.

q-fin.RM

Stochastic filtering and optimal control of pure jump Markov processes with noise-free partial observation

We consider an infinite horizon optimal control problem for a pure jump Markov process $X$, taking values in a complete and separable metric space $I$, with noise-free partial observation. The observation process is defined as $Y_t = h(X_t)$, $t \geq 0$, where $h$ is a given map defined on $I$. The observation is noise-free in the sense that the only source of randomness is the process $X$ itself. The aim is to minimize a discounted cost functional. In the first part of the paper we write down an explicit filtering equation and characterize the filtering process as a Piecewise Deterministic Process. In the second part, after transforming the original control problem with partial observation into one with complete observation (the separated problem) using filtering equations, we prove the equivalence of the original and separated problems through an explicit formula linking their respective value functions. The value function of the separated problem is also characterized as the unique fixed point of a suitably defined contraction mapping.

math.OC

Optimal control of continuous-time Markov chains with noise-free observation

We consider an infinite horizon optimal control problem for a continuous-time Markov chain $X$ in a finite set $I$ with noise-free partial observation. The observation process is defined as $Y_t = h(X_t)$, $t \geq 0$, where $h$ is a given map defined on $I$. The observation is noise-free in the sense that the only source of randomness is the process $X$ itself. The aim is to minimize a discounted cost functional and study the associated value function $V$. After transforming the control problem with partial observation into one with complete observation (the separated problem) using filtering equations, we provide a link between the value function $v$ associated to the latter control problem and the original value function $V$. Then, we present two different characterizations of $v$ (and indirectly of $V$): on one hand as the unique fixed point of a suitably defined contraction mapping and on the other hand as the unique constrained viscosity solution (in the sense of Soner) of a HJB integro-differential equation. Under suitable assumptions, we finally prove the existence of an optimal control.

math.OC