arXiv subjects

Boris Houska

Publications and source records attributed to Boris Houska.

At least 19 recordsLinked to original sources

arXiv2026

On Piecewise Quadratic Terminal Costs for MPC

This paper presents a novel approach to synthesize stabilizing termi- nal ingredients for linear model predictive control (MPC) schemes, with the aim of increasing the region of attraction while reducing suboptimal- ity with respect to the solution of the infinite-horizon optimal control problem. It is based on the construction of a novel terminal region using methods from the field of configuration-constrained polytopic computing, along with a terminal cost that is exactly equal to the infinite-horizon linear-quadratic regulator cost in a nontrivial neighborhood of the steady- state. The practical performance of the controller is illustrated through various case studies, and comparisons with state-of-the-art approaches are presented.

eess.SY↗

arXiv2026

Feedback Synthesis for Nonlinear Systems Via Convex Control Lyapunov Functions

This paper introduces computationally efficient methods for synthesizing explicit piecewise affine (PWA) feedback laws for nonlinear discrete-time systems, ensuring robustness and performance guarantees. The approach proceeds by optimizing a configuration-constrained PWA approximation of the value function of an infinite-horizon min-max Hamilton-Jacobi-Bellman equation. Here, robustness and performance are maintained by enforcing the PWA approximation to be a generalized control Lyapunov function for the given nonlinear system. This enables the generation of feedback laws with configurable storage complexity and pre-determined evaluation times, based on a selected configuration template. The framework's effectiveness is demonstrated through a constrained Van der Pol oscillator case study, where an explicit PWA controller with certified ergodic performance and specified complexity is synthesized over a large operational domain.

math.OC↗

arXiv2026

Relaxation via Separable Estimators: Arithmetic and Implementation

This article presents an arithmetic, called superposition relaxation, for bracketing the graph of a multivariate factorable function on a compact domain between a pair of underestimating and overestimating functions that are both separable. Propagation rules are established for affine and nonlinear composition operations, with a focus on exploiting global monotonicity and convexity properties in the composition. The local convergence properties of this arithmetic are also analyzed in both the pointwise and Hausdorff sense, including conditions under which quadratic pointwise convergence propagates through composition. Parameterizations of the univariate summands in a superposition relaxation either as piecewise-constant or continuous piecewise-linear functions are discussed for a practical implementation. It is shown through numerical case studies that superposition relaxations can be consistently tighter than McCormick relaxations, including for the relaxation of artificial neural networks. But superposition relaxations also incur a higher computational cost than McCormick relaxations. Further investigations are thus warranted as applications in global optimization seek to balance a relaxation's tightness with its computational cost.

math.NA↗

arXiv2025

Configuration-Constrained Tube MPC for Periodic Operation

Periodic operation often emerges as the economically optimal mode in industrial processes, particularly under varying economic or environmental conditions. This paper proposes a robust model predictive control (MPC) framework for uncertain systems modeled as polytopic linear differential inclusions (LDIs), where the dynamics evolve as convex combinations of finitely many affine control systems with additive disturbances. The robust control problem is reformulated as a convex optimization program by optimizing over configuration-constrained polytopic tubes and tracks a periodic trajectory that is optimal for a given economic criterion. Artificial variables embedded in the formulation ensure recursive feasibility and robust constraint satisfaction when the economic criterion is updated online, while guaranteeing convergence to the corresponding optimal periodic tube when the criterion remains constant. To improve computational efficiency, we introduce a quadratic over-approximation of the periodic cost under a Lipschitz continuity assumption, yielding a Quadratic Program (QP) formulation that preserves the above theoretical guarantees. The effectiveness and scalability of the approach are demonstrated on a benchmark example and a ball-plate system with eight states.

eess.SY↗

arXiv2025

Operator Models for Continuous-Time Offline Reinforcement Learning

Continuous-time stochastic processes underlie many natural and engineered systems. In healthcare, autonomous driving, and industrial control, direct interaction with the environment is often unsafe or impractical, motivating offline reinforcement learning from historical data. However, there is limited statistical understanding of the approximation errors inherent in learning policies from offline datasets. We address this by linking reinforcement learning to the Hamilton-Jacobi-Bellman equation and proposing an operator-theoretic algorithm based on a simple dynamic programming recursion. Specifically, we represent our world model in terms of the infinitesimal generator of controlled diffusion processes learned in a reproducing kernel Hilbert space. By integrating statistical learning methods and operator theory, we establish global convergence of the value function and derive finite-sample guarantees with bounds tied to system properties such as smoothness and stability. Our theoretical and numerical results indicate that operator-based approaches may hold promise in solving offline reinforcement learning using continuous-time optimal control.

stat.ML↗

arXiv2025

Data-Driven Stochastic Optimal Control in Reproducing Kernel Hilbert Spaces

This paper proposes a fully data-driven approach for optimal control of nonlinear control-affine systems represented by a stochastic diffusion. The focus is on the scenario where both the nonlinear dynamics and stage cost functions are unknown, while only a control penalty function and constraints are provided. To this end, we embed state probability densities into a reproducing kernel Hilbert space (RKHS) to leverage recent advances in operator regression, thereby identifying Markov transition operators associated with controlled diffusion processes. This operator learning approach integrates naturally with convex operator-theoretic Hamilton-Jacobi-Bellman recursions that scale linearly with state dimensionality, effectively solving a wide range of nonlinear optimal control problems. Numerical results demonstrate its ability to address diverse nonlinear control tasks, including the depth regulation of an autonomous underwater vehicle.

math.OC↗

arXiv2025

Efficient Configuration-Constrained Tube MPC via Variables Restriction and Template Selection

Configuration-Constrained Tube Model Predictive Control (CCTMPC) offers flexibility by using a polytopic parameterization of invariant sets and the optimization of an associated vertex control law. This flexibility, however, often demands computational trade-offs between set parameterization accuracy and optimization complexity. This paper proposes two innovations that help the user tackle this trade-off. First, a structured framework is proposed, which strategically limits optimization degrees of freedom, significantly reducing online computation time while retaining stability guarantees. This framework aligns with Homothetic Tube MPC (HTMPC) under maximal constraints. Second, a template refinement algorithm that iteratively solves quadratic programs is introduced to balance polytope complexity and conservatism. Simulation studies on an illustrative benchmark problem as well as a high-dimensional ten-state system demonstrate the approach's efficiency, achieving robust performance with minimal computational overhead. The results validate a practical pathway to leveraging CCTMPC's adaptability without sacrificing real-time viability.

eess.SY↗

arXiv2025

Real-Time-Feasible Collision-Free Motion Planning For Ellipsoidal Objects

Online planning of collision-free trajectories is a fundamental task for robotics and self-driving car applications. This paper revisits collision avoidance between ellipsoidal objects using differentiable constraints. Two ellipsoids do not overlap if and only if the endpoint of the vector between the center points of the ellipsoids does not lie in the interior of the Minkowski sum of the ellipsoids. This condition is formulated using a parametric over-approximation of the Minkowski sum, which can be made tight in any given direction. The resulting collision avoidance constraint is included in an optimal control problem (OCP) and evaluated in comparison to the separating-hyperplane approach. Not only do we observe that the Minkowski-sum formulation is computationally more efficient in our experiments, but also that using pre-determined over-approximation parameters based on warm-start trajectories leads to a very limited increase in suboptimality. This gives rise to a novel real-time scheme for collision-free motion planning with model predictive control (MPC). Both the real-time feasibility and the effectiveness of the constraint formulation are demonstrated in challenging real-world experiments.

cs.RO↗

arXiv2025

Kernel-Based Optimal Control: An Infinitesimal Generator Approach

This paper presents a novel operator-theoretic approach for optimal control of nonlinear stochastic systems within reproducing kernel Hilbert spaces. Our learning framework leverages data samples of system dynamics and stage cost functions, with only control penalties and constraints provided. The proposed method directly learns the infinitesimal generator of a controlled stochastic diffusion in an infinite-dimensional hypothesis space. We demonstrate that our approach seamlessly integrates with modern convex operator-theoretic Hamilton-Jacobi-Bellman recursions, enabling a data-driven solution to the optimal control problems. Furthermore, our learning framework includes nonparametric estimators for uncontrolled infinitesimal generators as a special case. Numerical experiments, ranging from synthetic differential equations to simulated robotic systems, showcase the advantages of our approach compared to both modern data-driven and classical nonlinear programming methods for optimal control.

math.OC↗

arXiv2025

Control Lyapunov Function Design via Configuration-Constrained Polyhedral Computing

This paper proposes novel approaches for designing control Lyapunov functions (CLFs) for constrained linear systems. We leverage recent configuration-constrained polyhedral computing techniques to devise piecewise affine convex CLFs. Additionally, we generalize these methods to uncertain systems with both additive and multiplicative disturbances. The proposed design methods are capable of approximating the infinite horizon cost function of both nominal and min-max optimal control problems by solving a single, one-stage, convex optimization problem. As such, these methods find practical applications in explicit controller design as well as in determining terminal regions and cost functions for nominal and min-max model predictive control (MPC). Numerical examples illustrate the effectiveness of this approach.

math.OC↗

arXiv2024

Polyhedral Control Design: Theory and Methods

In this article, we survey the primary research on polyhedral computing methods for constrained linear control systems. Our focus is on the modeling power of convex optimization, featured to design set-based robust and optimal controllers. In detail, we review the state-of-the-art techniques for computing geometric structures such as robust control invariant polytopes. Moreover, we survey recent methods for constructing control Lyapunov functions with polyhedral epigraphs as well as the extensive literature on robust model predictive control. The article concludes with a discussion of both the complexity and potential of polyhedral computing methods that rely on large-scale convex optimization.

math.OC↗

arXiv2024

Configuration-Constrained Tube MPC for Tracking

This paper proposes a novel tube-based Model Predictive Control (MPC) framework for tracking varying setpoint references with linear systems subject to additive and multiplicative uncertainties. The MPC controllers designed using this framework exhibit recursively feasible for changing references, and robust asymptotic stability for piecewise constant references. The framework leverages configuration-constrained polytopes to parameterize the tubes, offering flexibility to optimize their shape. The efficacy of the approach is demonstrated through two numerical examples. The first example illustrates the theoretical results, and the second uses the framework to design a lane-change controller for an autonomous vehicle.

eess.SY↗

arXiv2023

Intrinsic Separation Principles

This paper is about output-feedback control problems for general linear systems in the presence of given state-, control-, disturbance-, and measurement error constraints. Because the traditional separation theorem in stochastic control is inapplicable to such constrained systems, a novel information-theoretic framework is proposed. It leads to an intrinsic separation principle that can be used to break the dual control problem for constrained linear systems into a meta-learning problem that minimizes an intrinsic information measure and a robust control problem that minimizes an extrinsic risk measure. The theoretical results in this paper can be applied in combination with modern polytopic computing methods in order to approximate a large class of dual control problems by finite-dimensional convex optimization problems.

math.OC↗

arXiv2023

Convex operator-theoretic methods in stochastic control

This paper is about operator-theoretic methods for solving nonlinear stochastic optimal control problems to global optimality. These methods leverage on the convex duality between optimally controlled diffusion processes and Hamilton-Jacobi-Bellman (HJB) equations for nonlinear systems in an ergodic Hilbert-Sobolev space. In detail, a generalized Bakry-Emery condition is introduced under which one can establish the global exponential stabilizability of a large class of nonlinear systems. It is shown that this condition is sufficient to ensure the existence of solutions of the ergodic HJB for stochastic optimal control problems on infinite time horizons. Moreover, a novel dynamic programming recursion for bounded linear operators is introduced, which can be used to numerically solve HJB equations by a Galerkin projection.

math.OC↗

arXiv2022

Approximations for Optimal Experimental Design in Power System Parameter Estimation

This paper is about computationally tractable methods for power system parameter estimation and Optimal Experiment Design (OED). Here, the main motivation is that OED has the potential to significantly increase the accuracy of power system parameter estimates, for example, if only a few batches of data are available. The problem is, however, that solving the exact OED problem for larger power grids turns out to be computationally expensive and, in many cases, even computationally intractable. Therefore, the present paper proposes three numerical approximation techniques, which increase the computational tractability of OED for power systems. These approximation techniques are bench-marked on a 5-bus and a 14-bus case studies.

eess.SY↗

arXiv2022

Configuration-Constrained Tube MPC

This paper is about robust Model Predictive Control (MPC) for linear systems with additive and multiplicative uncertainty. A novel class of configuration-constrained polytopic robust forward invariant tubes is introduced, which admit a joint parameterization of their facets and vertices. They are the foundation for the development of novel Configuration-Constrained Tube MPC (CCTMPC) controllers that freely optimize the shape of their polytopic tube, subject to conic vertex configuration constraints, as well as associated vertex control laws by solving convex optimization problems online. It is shown that CCTMPC is -- under appropriate assumptions -- systematically less conservative than Rigid- and Homothetic- Tube MPC. Additionally, it is proven that there exist control systems for which CCTMPC is less conservative than Elastic Tube MPC, Disturbance Affine Feedback MPC, and Fully Parameterized Tube MPC.

math.OC↗

arXiv2022

Parallel MPC for Linear Systems with State and Input Constraints

This paper proposes a parallelizable algorithm for linear-quadratic model predictive control (MPC) problems with state and input constraints. The algorithm itself is based on a parallel MPC scheme that has originally been designed for systems with input constraints. In this context, one contribution of this paper is the construction of time-varying yet separable constraint margins ensuring recursive feasibility and asymptotic stability of sub-optimal parallel MPC in a general setting, which also includes state constraints. Moreover, it is shown how to tradeoff online run-time guarantees versus the conservatism that is introduced by the tightened state constraints. The corresponding performance of the proposed method as well as the cost of the recursive feasibility guarantees is analyzed in the context of controlling a large-scale mechatronic system. This is illustrated by numerical experiments for a large-scale control system with more than 100 states and 60 control inputs leading to run-times in the millisecond range.

math.OC↗

arXiv2022

Ambiguity Tube MPC

This paper is about a class of distributionally robust model predictive controllers (MPC) for nonlinear stochastic processes that evaluate risk and control performance measures by propagating ambiguity sets in the space of state probability measures. A framework for formulating such ambiguity tube MPC controllers is presented, which is based on modern measure-theoretic methods from the field of optimal transport theory. Moreover, a supermartingale based analysis technique is proposed, leading to stochastic stability results for a large class of distributionally robust controllers for linear and nonlinear systems. In this context, we also discuss how to construct terminal cost functions for stochastic and distributionally robust MPC that ensure closed-loop stability and asymptotic convergence to robust invariant sets. The corresponding theoretical developments are illustrated by tutorial-style examples and a numerical case study.

math.OC↗