Searcharxiv⌕ Search

arXiv subjects

Ruchuan Ou

Publications and source records attributed to Ruchuan Ou.

16 recordsLinked to original sources
arXiv2026

Towards turnpike-based performance analysis of risk-averse stochastic predictive control

In this paper, we present performance estimates for stochastic economic MPC schemes with risk-averse cost formulations. For MPC algorithms with costs given by expectations, it was recently shown that the guaranteed near-optimal performance of abstract MPC in random variables coincides with its implementable variant using pathwise feedback. In general, this property does not extend to costs formulated in terms of risk measures. However, through a turnpike-based analysis, this paper demonstrates that for a particular class of risk measures, this result can still be leveraged to formulate an implementable risk-averse MPC scheme, resulting in near-optimal averaged performance.

math.OC↗
arXiv2026

Stability and performance of stochastic economic MPC -- Stochastic characterization of the closed-loop asymptotics

Model Predictive Control (MPC) is well understood in the deterministic setting, yet rigorous stability and performance guarantees for stochastic MPC remain limited to the consideration of terminal constraints and penalties. In contrast, this work analyzes stochastic economic MPC with an expected cost criterion and establishes closed-loop guarantees without terminal conditions. Relying on stochastic dissipativity and turnpike properties, we construct closed-loop Lyapunov functions that ensure $P$-practical asymptotic stability of a particular optimal stationary process under different notions of stochastic convergence, such as in distribution or in the $p$-th mean. In addition, we derive tight near-optimal bounds for both averaged and non-averaged performance, thereby extending classical deterministic results to the stochastic domain. Finally, we show that the abstract stochastic MPC scheme requiring distributional knowledge shares the same closed-loop properties as a practically implementable algorithm based only on sampled state information, ensuring applicability of our findings. Our findings are illustrated by a numerical example.

math.OC↗
arXiv2026

A Stochastic Fundamental Lemma with Reduced Disturbance Data Requirements

Recently, the fundamental lemma by Willems et al. has been extended towards stochastic LTI systems subject to process disturbances. Using this lemma requires previously recorded data of inputs, outputs, and disturbances. In this paper, we exploit causality concepts of stochastic control to propose a variant of the stochastic fundamental lemma that does not require past disturbance data in the Hankel matrices. Our developments rely on polynomial chaos expansions and on the knowledge of the disturbance distribution. Similar to our previous results, the proposed variant of the fundamental lemma allows to predict future input-output trajectories of stochastic LTI systems. We draw upon a numerical example to illustrate the proposed variant in data-driven control context.

eess.SY↗
arXiv2026

PolyOCP.jl -- A Julia Package for Stochastic OCPs and MPC

The consideration of stochastic uncertainty in optimal and predictive control is a well-explored topic. Recently Polynomial Chaos Expansions (PCE) have received considerable attention for problems involving stochastically uncertain system parameters and also for problems with additive stochastic i.i.d. disturbances. While there exist a number of open-source PCE toolboxes, tailored open-source codes for the solution of OCPs involving additive stochastic i.i.d. disturbances in julia are not available. Hence, this paper introduces the toolbox PolyOCP$.$jl which enables to efficiently solve stochastic OCPs for linear systems subject to a large class of disturbance distributions. We explain the main mathematical concepts between the PCE transcription of stochastic OCPs and how they are provided in the toolbox. We draw upon two examples to illustrate the functionalities of PolyOCP$.$jl.

eess.SY↗
arXiv2026

Closed-loop analysis of linear stochastic MPC with risk-averse constraints

Chance constraints are widely used in stochastic model predictive control (MPC) to enforce probabilistic state and input constraints in the presence of unbounded disturbances. However, they only restrict violation probabilities and do not account for the magnitude of rare but severe constraint violations. In this paper, we extend the indirect feedback approach for linear stochastic MPC from chance constraints to risk-averse constraints like the conditional value-at-risk. For the resulting risk-averse MPC scheme, we establish recursive feasibility and closed-loop constraint satisfaction. Furthermore, based on a stochastic dissipativity notion and suitable conditions on the terminal ingredients we show that (near)-optimality of the averaged closed-loop performance can be ensured.

math.OC↗
arXiv2025

Turnpike and dissipativity in generalized discrete-time stochastic linear-quadratic optimal control

We investigate different turnpike phenomena of generalized discrete-time stochastic linear-quadratic optimal control problems. Our analysis is based on a novel strict dissipativity notion for such problems, in which a stationary stochastic process replaces the optimal steady state of the deterministic setting. We show that from this time-varying dissipativity notion, we can conclude turnpike behaviors concerning different objects like distributions, moments, or sample paths of the stochastic system and that the distributions of the stationary pair can be characterized by a stationary optimization problem. The analytical findings are illustrated by numerical simulations.

math.OC↗
arXiv2025

A Polynomial Chaos Approach to Stochastic LQ Optimal Control: Error Bounds and Infinite-Horizon Results

The stochastic linear--quadratic regulator problem subject to Gaussian disturbances is well known and usually addressed via a moment-based reformulation. Here, we leverage polynomial chaos expansions, which model random variables via series expansions in a suitable $\mathcal{L}^2$ probability space, to tackle the non-Gaussian case. We present the optimal solutions for finite and infinite horizons and we analyze the infinite-horizon asymptotics. We show that the limit of the optimal state-input trajectory is the unique solution to a corresponding stochastic stationary optimization problem in the sense of probability measures. Moreover, we provide a constructive error analysis for finite-dimensional polynomial chaos approximations of the optimal solutions and of the optimal stationary pair in non-Gaussian settings. A numerical example illustrates our findings.

math.OC↗
arXiv2024

On Data-Driven Stochastic Output-Feedback Predictive Control

The fundamental lemma by Jan C. Willems and co-authors enables the representation of all input-output trajectories of a linear time-invariant system by measured input-output data. This result has proven to be pivotal for data-driven control. Building on a stochastic variant of the fundamental lemma, this paper presents a data-driven output-feedback predictive control scheme for stochastic Linear Time-Invariant (LTI) systems. The considered LTI systems are subject to non-Gaussian disturbances about which only information about their first two moments is known. Leveraging polynomial chaos expansions, the proposed scheme is centered around a data-driven stochastic Optimal Control Problem (OCP). Through tailored online design of initial conditions, we provide sufficient conditions for the recursive feasibility of the proposed output-feedback scheme based on a data-driven design of the terminal ingredients of the OCP. Furthermore, we provide a robustness analysis of the closed-loop performance. A numerical example illustrates the efficacy of the proposed scheme.

eess.SY↗
arXiv2024

Near-optimal performance of stochastic economic MPC

This paper presents first results for near optimality in expectation of the closed-loop solutions for stochastic economic MPC. The approach relies on a recently developed turnpike property for stochastic optimal control problems at an optimal stationary process, combined with techniques for analyzing time-varying economic MPC schemes. We obtain near optimality in finite time as well as overtaking and average near optimality on infinite time horizons.

math.OC↗
arXiv2023

On a Stochastic Fundamental Lemma and Its Use for Data-Driven Optimal Control

Data-driven control based on the fundamental lemma by Willems et al. is frequently considered for deterministic LTI systems subject to measurement noise. However, besides measurement noise, stochastic disturbances might also directly affect the dynamics. In this paper, we leverage Polynomial Chaos Expansions (PCE) to extend the deterministic fundamental lemma towards stochastic systems. This extension allows to predict future statistical distributions of the inputs and outputs for stochastic LTI systems in data-driven fashion, i.e., based on the knowledge of previously recorded input-output-disturbance data and of the disturbance distribution we perform data-driven uncertainty propagation. Finally, we analyze data-driven stochastic optimal control problems and we propose a conceptual framework for data-driven stochastic predictive control. Numerical examples illustrate the efficacy of the proposed concepts.

eess.SY↗
arXiv2023

Behavioral Theory for Stochastic Systems? A Data-driven Journey from Willems to Wiener and Back Again

The fundamental lemma by Jan C. Willems and co-workers, which is deeply rooted in behavioral systems theory, has become one of the supporting pillars of the recent progress on data-driven control and system analysis. This tutorial-style paper combines recent insights into stochastic and descriptor-system formulations of the lemma to further extend and broaden the formal basis for behavioral theory of stochastic linear systems. We show that series expansions -- in particular Polynomial Chaos Expansions (PCE) of $L^2$-random variables, which date back to Norbert Wiener's seminal work -- enable equivalent behavioral characterizations of linear stochastic systems. Specifically, we prove that under mild assumptions the behavior of the dynamics of the $L^2$-random variables is equivalent to the behavior of the dynamics of the series expansion coefficients and that it entails the behavior composed of sampled realization trajectories. We also illustrate the short-comings of the behavior associated to the time-evolution of the statistical moments. The paper culminates in the formulation of the stochastic fundamental lemma for linear (descriptor) systems, which in turn enables numerically tractable formulations of data-driven stochastic optimal control combining Hankel matrices in realization data (i.e. in measurements) with PCE concepts.

math.OC↗
arXiv2022

Towards data-driven stochastic predictive control

Data-driven predictive control based on the fundamental lemma by Willems et al. is frequently considered for deterministic LTI systems subject to measurement noise. However, little has been done on data-driven stochastic control. In this paper, we propose a data-driven stochastic predictive control scheme for LTI systems subject to possibly unbounded additive process disturbances. Based on a stochastic extension of the fundamental lemma and leveraging polynomial chaos expansions, we construct a data-driven surrogate Optimal Control Problem (OCP). Moreover, combined with an online selection strategy of the initial condition of the OCP, we provide sufficient conditions for recursive feasibility and for stability of the proposed data-driven predictive control scheme. Finally, two numerical examples illustrate the efficacy and closed-loop properties of the proposed scheme for process disturbances governed by different distributions.

eess.SY↗
arXiv2022

Data-driven Stochastic Output-Feedback Predictive Control: Recursive Feasibility through Interpolated Initial Conditions

The paper investigates data-driven output-feedback predictive control of linear systems subject to stochastic disturbances. The scheme relies on the recursive solution of a suitable data-driven reformulation of a stochastic Optimal Control Problem (OCP), which allows for forward prediction and optimization of statistical distributions of inputs and outputs. Our approach avoids the use of parametric system models. Instead it is based on previously recorded data using a recently proposed stochastic variant of Willems' fundamental lemma. The stochastic variant of the lemma is applicable to a large class of linear dynamics subject to stochastic disturbances of Gaussian and non-Gaussian nature. To ensure recursive feasibility, the initial condition of the OCP -- which consists of information about past inputs and outputs -- is considered as an extra decision variable of the OCP. We provide sufficient conditions for recursive feasibility and closed-loop practical stability of the proposed scheme as well as performance bounds. Finally, a numerical example illustrates the efficacy and closed-loop properties of the proposed scheme.

eess.SY↗
arXiv2021

ALADIN-$α$ -- An open-source MATLAB toolbox for distributed non-convex optimization

This paper introduces an open-source software for distributed and decentralized non-convex optimization named ALADIN-$α$. ALADIN-$α$ is a MATLAB implementation of tailored variants of the Augmented Lagrangian Alternating Direction Inexact Newton (ALADIN) algorithm. Its user interface is convenient for rapid prototyping of non-convex distributed optimization algorithms. An improved version of the recently proposed bi-level variant of ALADIN is included enabling decentralized non-convex optimization with reduced information exchange. A collection of examples from different applications fields including chemical engineering, robotics, and power systems underpins the potential of ALADIN-$α$.

eess.SY↗
arXiv2020

A Simulation Study on Turnpikes in Stochastic LQ Optimal Control

This paper presents a simulation study on turnpike phenomena in stochastic optimal control problems. We employ the framework of Polynomial Chaos Expansions (PCE) to investigate the presence of turnpikes in stochastic LQ problems. Our findings indicate that turnpikes can be observed in the evolution of PCE coefficients as well as in the evolution of statistical moments. Moreover, the turnpike phenomenon can be observed for optimal realization trajectories and with respect to the optimal stationary distribution. Finally, while adding variance penalization to the objective alters the turnpike, it does not destroy the phenomenon.

eess.SY↗