Searcharxiv⌕ Search

arXiv subjects

Francesco Cordiano

Publications and source records attributed to Francesco Cordiano.

5 recordsLinked to original sources

On the Value Function of Infinite-Horizon Optimal Control of Piecewise Affine Systems

In this paper, we study the structure of the value function in constrained infinite-time optimal control (CITOC) problems of piecewise affine (PWA) systems, with $\ell_1$ or $\ell_\infty$ stage cost. Existing works, such as [1], establish that the resulting value function is PWA in the state. However, existing results do not analyze whether the value function is a proper PWA function, i.e., with a finite number of affine pieces over compact sets, or whether the number of pieces can be infinite. We show that the latter case is indeed possible by means of an explicit example, which is also instrumental in establishing rigorous and easily verifiable sufficient conditions that ensure that the resulting value function is a proper PWA function. Our theoretical findings complement well-known results, e.g., the linear-quadratic case, and serve as support for recent learning-based control schemes for PWA systems. Throughout the paper, the proposed results are illustrated by means of a numerical example.

math.OC↗

Learning-Based Stochastic Optimal Control with Infinite-Horizon Probabilistic Constraints

In this paper, we consider stochastic optimal control problems with infinite-horizon joint chance constraints. By means of an appropriate state augmentation, we reformulate the original problem as a constrained Markov decision process, in which both the cost and the constraint function exhibit an additive structure. We then prove that this formulation enjoys strong duality, thereby enabling us to reformulate the problem as an equivalent unconstrained one in the Lagrange dual framework. We propose a dual-ascent algorithm to solve the resulting problem and show that it converges to a deterministic Markov policy defined over the augmented state space that is both optimal and feasible. To accommodate continuous state-input spaces, we propose a dedicated learning algorithm to approximate the value function in an offline training setting, thereby significantly reducing the computational complexity of the online control phase. We then test our approach on a numerical example and demonstrate its effectiveness compared to online predictive control methods in terms of performance and computational complexity.

math.OC↗

Uncertainty Partitioning with Probabilistic Feasibility and Performance Guarantees for Chance-Constrained Optimization

We propose a novel distribution-free scheme to solve optimization problems where the goal is to minimize the expected value of a cost function subject to probabilistic constraints. Unlike standard sampling-based methods, our idea consists of partitioning the uncertainty domain in a user-defined number of sets, enabling more flexibility in the trade-off between conservatism and computational complexity. We provide sufficient conditions to ensure that our approximated problem is feasible for the original stochastic program, in terms of chance constraint satisfaction. In addition, we perform a rigorous performance analysis, by quantifying the distance between the optimal values of the original and the approximated problem. We show that our approach is tractable for optimization problems that include model predictive control of piecewise affine systems, and we demonstrate the benefits of our approach, in terms of the trade-off between conservatism and computational complexity, on a numerical example.

math.OC↗

Scenario Reduction with Guarantees for Stochastic Optimal Control of Linear Systems

Scenario reduction algorithms can be an effective means to provide a tractable description of the uncertainty in optimal control problems. However, they might significantly compromise the performance of the controlled system. In this paper, we propose a method to compensate for the effect of scenario reduction on stochastic optimal control problems for chance-constrained linear systems with additive uncertainty. We consider a setting in which the uncertainty has a discrete distribution, where the number of possible realizations is large. We then propose a reduction algorithm with a problem-dependent loss function, and we define sufficient conditions on the stochastic optimal control problem to ensure out-of-sample guarantees (i.e., against the original distribution of the uncertainty) for the controlled system in terms of performance and chance constraint satisfaction. Finally, we demonstrate the effectiveness of the approach on a numerical example.

math.OC↗

Distributed Model Predictive Control with Reconfigurable Terminal Ingredients for Reference Tracking

Various efforts have been devoted to developing stabilizing distributed Model Predictive Control (MPC) schemes for tracking piecewise constant references. In these schemes, terminal sets are usually computed offline and used in the MPC online phase to guarantee recursive feasibility and asymptotic stability. Maximal invariant terminal sets do not necessarily respect the distributed structure of the network, hindering the distributed implementation of the controller. On the other hand, ellipsoidal terminal sets respect the distributed structure, but may lead to conservative schemes. In this paper, a novel distributed MPC scheme is proposed for reference tracking of networked dynamical systems where the terminal ingredients are reconfigured online depending on the closed-loop states to alleviate the aforementioned issues. The resulting non-convex infinite-dimensional problem is approximated using a quadratic program. The proposed scheme is tested in simulation where the proposed MPC problem is solved using distributed optimization.

eess.SY↗