SearcharxivSearch

arXiv subjects

Fausto Gozzi

Publications and source records attributed to Fausto Gozzi.

At least 55 records · Page 3Linked to original sources

Optimal Investment with Vintage Capital:Equilibrium Distributions

The paper concerns the study of equilibrium points, or steady states, of economic systems arising in modeling optimal investment with \textit{vintage capital}, namely, systems where all key variables (capitals, investments, prices) are indexed not only by time $τ$ but also by age $s$. Capital accumulation is hence described as a partial differential equation (briefly, PDE), and equilibrium points are in fact equilibrium distributions in the variable $s$ of ages. Investments in frontier as well as non-frontier vintages are possible. Firstly a general method is developed to compute and study equilibrium points of a wide range of infinite dimensional, infinite horizon boundary control problems for linear PDEs with convex criterion, possibly applying to a wide variety of economic problems. Sufficient and necessary conditions for existence of equilibrium points are derived in this general context. In particular, for optimal investment with vintage capital, existence and uniqueness of a long run equilibrium distribution is proved for general concave revenues and convex investment costs, and analytic formulas are obtained for optimal controls and trajectories in the long run, definitely showing how effective the theoretical machinery of optimal control in infinite dimension is in computing explicitly equilibrium distributions, and suggesting that the same method can be applied in examples yielding the same abstract structure. To this extent, the results of this work constitutes a first crucial step towards a thorough understanding of the behavior of optimal controls and trajectories in the long run.

math.OC

Verification theorems for stochastic optimal control problems in Hilbert spaces by means of a generalized Dynkin formula

Verification theorems are key results to successfully employ the dynamic programming approach to optimal control problems. In this paper we introduce a new method to prove verification theorems for infinite dimensional stochastic optimal control problems. The method applies in the case of additively controlled Ornstein-Uhlenbeck processes, when the associated Hamilton-Jacobi-Bellman (HJB) equation admits a mild solution. The main methodological novelty of our result relies on the fact that it is not needed to prove, as in previous literature, that the mild solution is a strong solution, i.e. a suitable limit of classical solutions of the HJB equation. To achieve our goal we prove a new type of Dynkin formula, which is the key tool for the proof of our main result.

math.OC

Mild solutions of semilinear elliptic equations in Hilbert spaces

This paper extends the theory of regular solutions ($C^1$ in a suitable sense) for a class of semilinear elliptic equations in Hilbert spaces. The notion of regularity is based on the concept of $G$-derivative, which is introduced and discussed. A result of existence and uniqueness of solutions is stated and proved under the assumption that the transition semigroup associated to the linear part of the equation has a smoothing property, that is, it maps continuous functions into $G$-differentiable ones. The validity of this smoothing assumption is fully discussed for the case of the Ornstein-Uhlenbeck transition semigroup and for the case of invertible diffusion coefficient covering cases not previously addressed by the literature. It is shown that the results apply to Hamilton-Jacobi-Bellman (HJB) equations associated to infinite horizon optimal stochastic control problems in infinite dimension and that, in particular, they cover examples of optimal boundary control of the heat equation that were not treatable with the approaches developed in the literature up to now.

math.AP

Minimum energy for linear systems with finite horizon: a non-standard Riccati equation

This paper deals with a non-standard infinite dimensional linear-quadratic control problem arising in the physics of non-stationary states (see e.g. [6]): finding the minimum energy to drive a fixed stationary state x = 0 into an arbitrary non-stationary state x. The Riccati Equation (RE) associated to this problem is not standard since the sign of the linear part is opposite to the usual one, thus preventing the use of the known theory. Here we consider the finite horizon case. We prove that the linear selfadjoint operator P(t), associated to the value function, solves the above mentioned RE (Theorem 4.12). Uniqueness does not hold in general but we are able to prove a partial uniqueness result in the class of invertible operators (Theorem 4.13). In the special case where the involved operators commute, a more detailed analysis of the set of solutions is given (Theorems 4.14, 4.15 and 4.16). Examples of applications are given.

math.OC

Path-dependent equations and viscosity solutions in infinite dimension

Path-dependent PDEs (PPDEs) are natural objects to study when one deals with non Markovian models. Recently, after the introduction of the so-called pathwise (or functional or Dupire) calculus (see [15]), in the case of finite-dimensional underlying space various papers have been devoted to studying the well-posedness of such kind of equations, both from the point of view of regular solutions (see e.g. [15, 9]) and viscosity solutions (see e.g. [16]). In this paper, motivated by the study of models driven by path-dependent stochastic PDEs, we give a first well-posedness result for viscosity solutions of PPDEs when the underlying space is a separable Hilbert space. We also observe that, in contrast with the finite-dimensional case, our well-posedness result, even in the Markovian case, applies to equations which cannot be treated, up to now, with the known theory of viscosity solutions.

math.PR

Stochastic Optimal Control with Delay in the Control: solution through partial smoothing

Stochastic optimal control problems governed by delay equations with delay in the control are usually more difficult to study than the the ones when the delay appears only in the state. This is particularly true when we look at the associated Hamilton-Jacobi-Bellman (HJB) equation. Indeed, even in the simplified setting (introduced first by Vinter and Kwong for the deterministic case) the HJB equation is an infinite dimensional second order semilinear Partial Differential Equation (PDE) that does not satisfy the so-called "structure condition" which substantially means that "the noise enters the system with the control." The absence of such condition, together with the lack of smoothing properties which is a common feature of problems with delay, prevents the use of the known techniques (based on Backward Stochastic Differential Equations (BSDEs) or on the smoothing properties of the linear part) to prove the existence of regular solutions of this HJB equation and so no results on this direction have been proved till now. In this paper we provide a result on existence of regular solutions of such kind of HJB equations and we use it to solve completely the corresponding control problem finding optimal feedback controls also in the more difficult case of pointwise delay. The main tool used is a partial smoothing property that we prove for the transition semigroup associated to the uncontrolled problem. Such results holds for a specific class of equations and data which arises naturally in many applied problems.

math.PR

Impact of time illiquidity in a mixed market without full observation

We study a problem of optimal investment/consumption over an infinite horizon in a market consisting of two possibly correlated assets: one liquid and one illiquid. The liquid asset is observed and can be traded continuously, while the illiquid one can be traded only at discrete random times corresponding to the jumps of a Poisson process with intensity $λ$, is observed at the trading dates, and is partially observed between two different trading dates. The problem is a nonstandard mixed discrete/continuous optimal control problem which we face by the dynamic programming approach. When the utility has a general form we prove that the value function is the unique viscosity solution of the HJB equation and, assuming sufficient regularity of the value function, we give a verification theorem that describes the optimal investment strategies for the illiquid asset. In the case of power utility, we prove the regularity of the value function needed to apply the verification theorem, providing the complete theoretical solution of the problem. This allows us to perform numerical simulation, so to analyze the impact of time illiquidity in this mixed market and how this impact is affected by the degree of observation.

q-fin.PM

Utility maximization with current utility on the wealth: regularity of solutions to the HJB equation

We consider a utility maximization problem for an investment-consumption portfolio when the current utility depends also on the wealth process. Such kind of problems arise, e.g., in portfolio optimization with random horizon or with random trading times. To overcome the difficulties of the problem we use the dual approach. We define a dual problem and treat it by means of dynamic programming, showing that the viscosity solutions of the associated Hamilton-Jacobi-Bellman equation belong to a suitable class of smooth functions. This allows to define a smooth solution of the primal Hamilton-Jacobi-Bellman equation, proving that this solution is indeed unique in a suitable class and coincides with the value function of the primal problem. Some financial applications of the results are provided.

q-fin.PM

On the equivalence of internal and external habit formation models with finite memory

In this paper we use a dynamic programming approach to analytically solve an endogenous growth model with internal habits where the key parameters describing their formation, namely the intensity, persistence and lag structure (or memory), are kept generic. Then we show that external and internal habits lead to the same closed loop policy function and then to the same (Pareto) optimal equilibrium path of the aggregate variables when the utility function is subtractive nonseparable. The paper uses new theoretical results from those previously developed by the dynamic programming literature applied to optimal control problems with delay and it extends the existing results on the equivalence between models with internal and external habits to the case of finite memory.

math.OC

Investment/consumption problem in illiquid markets with regime-switching

We consider an illiquid financial market with different regimes modeled by a continuous-time finite-state Markov chain. The investor can trade a stock only at the discrete arrival times of a Cox process with intensity depending on the market regime. Moreover, the risky asset price is subject to liquidity shocks, which change its rate of return and volatility, and induce jumps on its dynamics. In this setting, we study the problem of an economic agent optimizing her expected utility from consumption under a non-bankruptcy constraint. By using the dynamic programming method, we provide the characterization of the value function of this stochastic control problem in terms of the unique viscosity solution to a system of integro-partial differential equations. We next focus on the popular case of CRRA utility functions, for which we can prove smoothness $C^2$ results for the value function. As an important byproduct, this allows us to get the existence of optimal investment/consumption strategies characterized in feedback forms. We analyze a convergent numerical scheme for the resolution to our stochastic control problem, and we illustrate finally with some numerical experiments the effects of liquidity regimes in the investor's optimal decision.

q-fin.PM

HJB Equations for the Optimal Control of Differential Equations with Delays and State Constraints: Regularity and Applications

We study a class of optimal control problems with state constraints where the state equation is a differential equation with delays. This class includes some problems arising in economics, in particular the so-called models with time to build. We embed the problem in a suitable Hilbert space H and consider the associated Hamilton-Jacobi-Bellman (HJB) equation. This kind of infinite-dimensional HJB equation has not been previously studied and is difficult due to the presence of state constraints and the lack of smoothing properties of the state equation. Our main result on the regularity of solutions to such a HJB equation seems to be completely new. More precisely we prove that the value function is continuous in a sufficiently big open set of H , that it solves in the viscosity sense the associated HJB equation and it has continuous classical derivative in the direction of the present. This regularity result is the starting point to define a feedback map in classical sense, which gives rise to a candidate optimal feedback strategy for the problem. The study of verification theorems and of the closed loop equation will be the subject of a forthcoming paper.

math.OC

HJB Equations for the Optimal Control of Differential Equations with Delays and State Constraints, II: Optimal Feedbacks and Approximations

This paper, which is the natural continuation of a previous paper by the same authors, studies a class of optimal control problems with state constraints where the state equation is a differential equation with delays. This class includes some problems arising in economics, in particular the so-called models with time to build. The problem is embedded in a suitable Hilbert space H and the regularity of the associated Hamilton-Jacobi-Bellman (HJB) equation is studied. Therein the main result is that the value function V solves the HJB equation and has continuous classical derivative in the direction of the present. The goal of the present paper is to exploit such result to find optimal feedback strategies for the problem. While it is easy to define formally a feedback strategy in classical sense the proof of its existence and of its optimality is hard due to lack of full regularity of V and to the infinite dimension. Finally, we show some approximation results that allow us to apply our main theorem to obtain epsilon-optimal strategies for a wider class of problems.

math.OC

On controlled linear diffusions with delay in a model of optimal advertising under uncertainty with memory effects

We consider a class of dynamic advertising problems under uncertainty in the presence of carryover and distributed forgetting effects, generalizing a classical model of Nerlove and Arrow. In particular, we allow the dynamics of the product goodwill to depend on its past values, as well as previous advertising levels. Building on previous work of two of the authors, the optimal advertising model is formulated as an infinite dimensional stochastic control problem. We obtain (partial) regularity as well as approximation results for the corresponding value function. Under specific structural assumptions we study the effects of delays on the value function and optimal strategy. In the absence of carryover effects, since the value function and the optimal advertising policy can be characterized in terms of the solution of the associated HJB equation, we obtain sharper characterizations of the optimal policy.

math.OC

Optimal consumption policies in illiquid markets

We investigate optimal consumption policies in the liquidity risk model introduced in Pham and Tankov (2007). Our main result is to derive smoothness results for the value functions of the portfolio/consumption choice problem. As an important consequence, we can prove the existence of the optimal control (portfolio/consumption strategy) which we characterize both in feedback form in terms of the derivatives of the value functions and as the solution of a second-order ODE. Finally, numerical illustrations of the behavior of optimal consumption strategies between two trading dates are given.

math.PR

Dynamic programming for infinite horizon boundary control problems of PDE's with age structure

We develop the dynamic programming approach for a family of infinite horizon boundary control problems with linear state equation and convex cost. We prove that the value function of the problem is the unique regular solution of the associated stationary Hamilton--Jacobi--Bellman equation and use this to prove existence and uniqueness of feedback controls. The idea of studying this kind of problem comes from economic applications, in particular from models of optimal investment with vintage capital. Such family of problems has already been studied in the finite horizon case by Faggian. The infinite horizon case is more difficult to treat and it is more interesting from the point of view of economic applications, where what mainly matters is the behavior of optimal trajectories and controls in the long run. The study of infinite horizon is here performed through a nontrivial limiting procedure from the corresponding finite horizon problem.

math.OC

On the Dynamic Programming approach to economic models governed by DDE's

In this paper we consider a family of optimal control problems for economic models whose state variables are driven by Delay Differential Equations (DDE's). We consider two main examples: an AK model with vintage capital and an advertising model with delay effect. These problems are very difficult to treat for three main reasons: the presence of the DDE's, that makes them infinite dimensional; the presence of state constraints; the presence of delay in the control. Our main goal is to develop, at a first stage, the Dynamic Programming approach for this family of problems. The Dynamic Programming approach has been already used for similar problems in cases when it is possible to write explicitly the value function V. Here we deal with cases when the explicit form of V cannot be found, as most often occurs. We carefully describe the basic setting and give some first results on the solution of the Hamilton-Jacobi-Bellman (HJB) equation as a first step to find optimal strategies in closed loop form.

math.OC

Weak Dirichlet processes with a stochastic control perspective

The motivation of this paper is to prove verification theorems for stochastic optimal control of finite dimensional diffusion processes without control in the diffusion term, in the case that the value function is assumed to be continuous in time and once differentiable in the space variable ($C^{0,1}$) instead of once differentiable in time and twice in space ($C^{1,2}$), like in the classical results. For this purpose, the replacement tool of the Itô formula will be the Fukushima-Dirichlet decomposition for weak Dirichlet processes. Given a fixed filtration, a weak Dirichlet process is the sum of a local martingale $M$ plus an adapted process $A$ which is orthogonal, in the sense of covariation, to any continuous local martingale. The mentioned decomposition states that a $C^{0,1}$ function of a weak Dirichlet process with finite quadratic variation is again a weak Dirichlet process. That result is established in this paper and it is applied to the strong solution of a Cauchy problem with final condition. Applications to the proof of verification theorems will be addressed in a companion paper.

math.PR

Verification Theorems for Stochastic Optimal Control Problems via a Time Dependent Fukushima - Dirichlet Decomposition

This paper is devoted to present a method of proving verification theorems for stochastic optimal control of finite dimensional diffusion processes without control in the diffusion term. The value function is assumed to be continuous in time and once differentiable in the space variable ($C^{0,1}$) instead of once differentiable in time and twice in space ($C^{1,2}$), like in the classical results. The results are obtained using a time dependent Fukushima - Dirichlet decomposition proved in a companion paper by the same authors using stochastic calculus via regularization. Applications, examples and comparison with other similar results are also given.

math.PR