Searcharxiv⌕ Search

arXiv subjects

Bernardo Freitas Paulo da Costa

Publications and source records attributed to Bernardo Freitas Paulo da Costa.

9 recordsLinked to original sources

Singular Perturbation in Multiscale Stochastic Control Problems with Domain Restriction in the Slow Variable

We study a multiscale stochastic optimal control problem subject to state constraints on the slow variable. To address this class of problems, we develop a rigorous theoretical framework based on singular perturbation analysis, tailored to settings with constrained dynamics. Our approach relies on the theory of viscosity solutions for degenerate Hamilton-Jacobi-Bellman equations with Neumann-type boundary conditions. We also establish the convergence of the multiscale value functions in the infinite-horizon regime. Finally, we present two illustrative examples that highlight the applicability and effectiveness of the proposed framework.

math.OC↗

Stochastic Optimal Control with Control-Dependent Diffusion and State Constraints: A Degenerate Elliptic Approach

We study a stochastic optimal control problem with the state constrained to a smooth, compact domain. The control influences both the drift and a possibly degenerate, control-dependent dispersion matrix, leading to a fully nonlinear, degenerate elliptic Hamilton--Jacobi--Bellman (HJB) equation with a nontrivial Neumann boundary condition. Although these features have been studied separately, this work provides the first unified treatment combining them all. We establish that the optimal value function associated with the control problem is the unique viscosity solution of the HJB equation with a nontrivial Neumann boundary condition, and we present an illustrative example demonstrating the applicability of the framework.

math.OC↗

Get rid of your constraints and reparametrize: A study in NNLS and implicit bias

Over the past years, there has been significant interest in understanding the implicit bias of gradient descent optimization and its connection to the generalization properties of overparametrized neural networks. Several works observed that when training linear diagonal networks on the square loss for regression tasks (which corresponds to overparametrized linear regression) gradient descent converges to special solutions, e.g., non-negative ones. We connect this observation to Riemannian optimization and view overparametrized GD with identical initialization as a Riemannian GD. We use this fact for solving non-negative least squares (NNLS), an important problem behind many techniques, e.g., non-negative matrix factorization. We show that gradient flow on the reparametrized objective converges globally to NNLS solutions, providing convergence rates also for its discretized counterpart. Unlike previous methods, we do not rely on the calculation of exponential maps or geodesics. We further show accelerated convergence using a second-order ODE, lending itself to accelerated descent methods. Finally, we establish the stability against negative perturbations and discuss generalization to other constrained optimization problems.

math.OC↗

Dual SDDP for risk-averse multistage stochastic programs

Risk-averse multistage stochastic programs appear in multiple areas and are challenging to solve. Stochastic Dual Dynamic Programming (SDDP) is a well-known tool to address such problems under time-independence assumptions. We show how to derive a dual formulation for these problems and apply an SDDP algorithm, leading to converging and deterministic upper bounds for risk-averse problems.

math.OC↗

Risk Budgeting Portfolios from Simulations

Risk budgeting is a portfolio strategy where each asset contributes a prespecified amount to the aggregate risk of the portfolio. In this work, we propose an efficient numerical framework that uses only simulations of returns for estimating risk budgeting portfolios. Besides a general cutting planes algorithm for determining the weights of risk budgeting portfolios for arbitrary coherent distortion risk measures, we provide a specialised version for the Expected Shortfall, and a tailored Stochastic Gradient Descent (SGD) algorithm, also for the Expected Shortfall. We compare our algorithm to standard convex optimisation solvers and illustrate different risk budgeting portfolios, constructed using an especially designed Julia package, on real financial data and compare it to classical portfolio strategies.

q-fin.PM↗

Reaction-diffusion models for a class of infinite-dimensional non-linear stochastic differential equations

We establish the existence of solutions to a class of non-linear stochastic differential equation of reaction-diffusion type in an infinite-dimensional space, with diffusion corresponding to a given transition kernel. The solution obtained is the scaling limit of a sequence of interacting particle systems, and satisfies the martingale problem corresponding to the target differential equation.

math.PR↗

Stochastic Lipschitz Dynamic Programming

We propose a new algorithm for solving multistage stochastic mixed integer linear programming (MILP) problems with complete continuous recourse. In a similar way to cutting plane methods, we construct nonlinear Lipschitz cuts to build lower approximations for the non-convex cost to go functions. An example of such a class of cuts are those derived using Augmented Lagrangian Duality for MILPs. The family of Lipschitz cuts we use is MILP representable, so that the introduction of these cuts does not change the class of the original stochastic optimization problem. We illustrate the application of this algorithm on two simple case studies, comparing our approach with the convex relaxation of the problems, for which we can apply SDDP, and for a discretized approximation, applying SDDiP.

math.OC↗

Nested distance for stagewise-independent processes

We prove that, for two discrete-time stagewise-independent processes with a stagewise metric, the nested distance is equal to the sum of the Wasserstein distances between the marginal distributions of each stage.

math.OC↗