Searcharxiv⌕ Search

arXiv subjects

Peter Seiler

Publications and source records attributed to Peter Seiler.

At least 19 recordsLinked to original sources

Generalizable Output Feedback Optimal Control via Transformers Without Explicit State Estimation

Classical optimal control is used to design a separate controller for each plant. This paper asks a different question. Can one learned policy serve a whole family of partially observed, noisy linear systems? We show that one transformer can. The policy is trained to imitate optimal LQG control on a heterogeneous family of Linear Time-Invariant (LTI) systems with Multiple Inputs and Multiple Outputs (MIMO), whose dimensions, cost matrices, and noise levels all vary. A shared representation with system-wise standardization, zero-padding, masking, and an encoding of the cost and noise covariances lets one set of weights control every member of the family. At run time, a short window of noisy measurements is all the policy needs to produce a control action, with no plant matrices and no state estimator. We characterize the relation between the optimal LQG policy (represented as a dynamic state-space model) and a static transformer acting on a finite window of measurements. We then express the closed-loop excess cost of any causal policy as the energy of its deviation from the optimal action. Finally, we evaluate the approach on 28 simulated systems. The trained policy reaches the optimal cost to within a median gap of $0.4\%$ for seen systems. For unseen systems, a light fine-tuning step brings the median gap to $1.0\%$.

eess.SY↗

A New Parametric Uncertainty Approach to Systems with Time-Varying Delay and Feedback Stabilization

Delay Differential Equations (DDEs) with an uncertain time-varying state delay are often modeled as a feedback interconnection of a nominal time-invariant system with a time-varying uncertainty operator. However, typical choices of uncertainty operators do not admit tight characterizations of input-output properties. In this paper, we propose a new representation of a DDE with time-varying delay system as a feedback interconnection of a nominal fixed delay DDE with a time-varying multiplicative parametric uncertainty operator, where the parameter is bounded in $L_\infty$ norms -- yielding an operator norm bound on the uncertainty. We then provide a modified uncertainty representation which uses the $L_2$ norm of the parameter to bound the operator norm of the uncertainty. Finally, we show that by representing the nominal system using Partial Integral Equations (PIEs), these characterizations of the uncertainty operator can be used for stability analysis or stabilizing feedback controller synthesis. The effectiveness of the approach is illustrated with simple numerical examples.

eess.SY↗

State-Dependent Delay Modeling of Wind-Farm Wake Dynamics

Turbines convert wind to electrical power. In the wake of a turbine, wind speed is reduced in proportion to the amount of power extracted. In a wind farm, downstream turbines may be located in wake of an upstream turbine, requiring coordination to yield maximum power generation. This paper creates a state-dependent delay model for a two turbine wind farm. The upstream turbine creates a wake that diminishes the wind speed at the downstream turbine. Changing the upstream turbine operation will affect the downstream turbine after a delay that depends on the wind-propagation time between them. This delay depends on the upstream power extraction and it can destabilize the combined dynamics. Conventional models of this effect rely on nonlinear partial differential equations (PDEs). Control design and analysis with such models is difficult with established methods. We first show that the PDE model can be represented by an Abel-type state-dependent delay differential equation. The equation has an implicit solution. To obtain an explicit representation, we then introduce a simplified state-dependent delay model. Both models predict destabilizing interactions between the two turbines. Numerical examples illustrate delay-induced oscillations using the simplified model and verify their effectiveness in simulation.

eess.SY↗

Lipschitz Bounds for Neural Networks Using a Two-Copy Linear Fractional Transformation

This paper proposes a new method to bound the global Lipschitz constant of a neural network (NN). Our formulation uses a two-copy linear fractional transformation (LFT) representation of the NN with stacked signals. We use biased quadratic constraints (QCs) to bound the input/output behavior of the nonlinear activation functions. We then formulate a linear matrix inequality condition, using these biased QCs, to bound the Lipschitz constant of the NN. The best (smallest) Lipschitz bound is computed via a convex, semidefinite program. There are two key distinctions of the proposed two-copy formulation in comparison to existing methods that rely on a single incremental representation with incremental signals. First, the NN bias terms are eliminated in the standard incremental representation, but appear in our formulation. Second, there is a larger class of QCs that can be expressed for the nonlinearities in our formulation than in the incremental representation. We show that our proposed formulation yields less conservative Lipschitz bounds due to these two differences. We illustrate these points via several simple, motivating examples. We also demonstrate the proposed method using a benchmark problem with a NN controller for an inverted pendulum.

eess.SY↗

A Frequency Domain Approach to Bounding Riccati Equation Perturbations

The discrete algebraic Riccati equation (DARE) is used to solve for the optimal feedback gain in linear-quadratic regulator (LQR) control of discrete-time systems. In this letter, we consider the effect of perturbations to the LQR data on the DARE solutions. We present a new frequency domain approach to derive an explicit bound on the difference in DARE solutions under such perturbations. Our bounds are similar to other results that have recently appeared in the literature with two distinctions. First, we use a frequency domain constant that measures the degree of closed-loop stability, in contrast to other results that use a time domain measure. Second, we start from weaker detectability assumptions on the LQR state cost matrix.

eess.SY↗

Generalizable Optimal Control with Transformers: One Policy Across Diverse Systems

Classical optimal control designs a separate controller for each plant. Even for the Linear Quadratic Regulator (LQR), every new model must be identified and its Riccati equation re-solved. We ask whether a single learned policy can instead serve an entire family of systems, and we show that one transformer can. We train the policy to imitate optimal LQR state feedback across a collection of heterogeneous Multiple-Input, Multiple-Output (MIMO) Linear Time-Invariant (LTI) systems that differ in their state and input dimensions and in their cost objectives. A shared representation lets the same parameters control every member of the family. It combines system-wise standardization, zero-padding and masking across dimensions, and an explicit encoding of the cost matrices. At run time, the policy maps a short window of recent states and the specified cost to a control action. It uses no plant matrices and identifies the dynamics implicitly from the state history. We evaluate on $28$ simulated systems over $9{,}675$ closed-loop rollouts, and no unstable rollout was observed in any of them. On the systems seen during training, it attains a median relative sub-optimality of $0.022\%$, even under parameter perturbations of up to $\pm10\%$. It transfers to unseen systems with lightweight fine-tuning, reaching a median sub-optimality of $0.19\%$. These results support transformers as generalizable near-optimal controllers for structured families of linear systems.

eess.SY↗

Generalizable Optimal Control with Transformers: Closed-Loop Certification and Near-Optimality Guarantees

This letter develops closed-loop performance certificates for a transformer-based feedback policy. The policy is trained to imitate optimal Linear Quadratic Regulator (LQR) control across a family of heterogeneous Multiple-Input, Multiple-Output (MIMO) Linear Time-Invariant (LTI) systems. First, we establish a finite-sample excess-risk bound for the imitation loss minimized during training. Second, for each fixed problem instance, we derive regional closed-loop guarantees consisting of a forward-invariant operating region and a worst-case bound on deviation from the optimal rollout. Our main result is a probabilistic certificate for finite-horizon closed-loop near-optimality. Using an exact LQR cost identity, we express excess cost as a measurable per-rollout statistic and use independent calibration and validation rollouts to obtain a high-confidence bound on its violation probability. We evaluate the certificate on $28$ benchmark systems. This uses the base policy on seen systems and system-specific fine-tuned copies on unseen systems, with each rollout drawing the plant, cost, and initial condition from the corresponding certification distribution. All per-system certificates have violation probabilities below $3.1\%$, each at $95\%$ confidence; twenty systems certify suboptimality below $10\%$, with the tightest threshold equal to $4.8\times10^{-6}$.

eess.SY↗

Scalable Incremental Robustness Analysis of Neural Network Feedback Systems

Semidefinite programming (SDP) certificates for feedback systems containing deep neural networks (NNs) typically scale with the total number of neurons, whereas small-gain tests are scalable but can be highly conservative. This paper develops a unified and scalable framework for incremental robust stability and performance analysis of feedback interconnections involving high-dimensional NNs and unmodeled dynamics. By combining a structured decomposition of the full-order SDP condition with scalable Lipschitz constant estimation algorithms, we derive reduced verification conditions that certify incremental convergence and incremental $\ell_2$-gain bounds. The dimensions of the resulting control-analysis linear matrix inequalities (LMIs) depend only on the widths of the last two network layers and are \textit{independent of network depth}. The framework preserves the coupling between the plant and the NN, with the incremental small-gain condition recovered as a special case. To further reduce conservatism, we develop a multi-round alternating update scheme that iteratively refines the coupling variables while preserving scalability. Numerical experiments show that the proposed framework achieves state-of-the-art incremental $\ell_2$-gain bounds for large-scale NN feedback systems.

math.OC↗

Control of Decommissioned Satellites and Space Debris Using CubeSats with Ion Electrospray Engines

The emergence of the New Space era has led to a rapidly increasing number of satellites in Low Earth Orbit (LEO). Consequently, more stringent deorbiting requirements have recently been imposed to avoid the Kessler syndrome in LEO. This has resulted in the proposal of new concepts for space debris removal, including attaching CubeSats to space debris as a promising mitigation strategy. The initial phase of this strategy involves stabilizing and controlling the debris' attitude. This paper proposes an attitude control design for decommissioned satellites using attached CubeSats with staged ion electrospray engines (iESE). The compact design of iESE combined with staging provides increased reliability and mission durations. The large uncertainty in the dynamics of the combined system, i.e. satellite and attached CubeSats, poses a significant challenge to the control design. The approach taken here uses the robust control framework, specifically $μ$-synthesis, to tackle this challenge. The feasibility of the approach is demonstrated on a decommissioned satellite with multiple flexile appendages.

eess.SY↗

Data-Driven Stability and Performance Analysis of Lurye Systems

This paper develops data-driven conditions for certifying internal stability and induced-$\ell_2$ performance of discrete-time Lurye systems. The Lurye system is an interconnection of a nominal LTI system in feedback with a static, memoryless nonlinearity. The nonlinearity satisfies a known set of quadratic constraints on the inputs and outputs. Existing conditions for Lurye systems require a state-space realization of the nominal LTI dynamics. Our first data-driven result instead formulates the stability and performance conditions using finite input, output, and state trajectories of the nominal LTI block. Our second condition removes the need for measured state trajectories by reconstructing the state sequence, up to a similarity transformation, from input/output data. This state reconstruction is performed using deterministic subspace-identification techniques. Both data-driven conditions are expressed as convex semidefinite programs. These conditions, given sufficiently exciting inputs, recover the corresponding model-based Lurye condition in the noiseless setting. The proposed methods are illustrated via a simple example with a sector-bounded nonlinearity. Both proposed methods obtain the same induced-$\ell_2$ gain bound as the model-based approach while using only trajectory data from the nominal system.

eess.SY↗

Polynomial Constraints for Robustness Analysis of Nonlinear Systems

This paper presents a framework for abstracting uncertain or non-polynomial components of dynamical systems using polynomial constraints. This enables the application of polynomial-based analysis tools, such as sum-of-squares programming, to a broader class of non-polynomial systems. A numerical method for constructing these constraints is proposed. The relationship between polynomial constraints and existing integral quadratic constraints (IQCs) is investigated, providing transformations of IQCs into polynomial constraints. The effectiveness of polynomial constraints in characterizing nonlinearities is validated via numerical examples to compute inner estimates of the region of attraction for two systems.

eess.SY↗

Synthesizing Neural Network Controllers with Closed-Loop Dissipativity Guarantees

This paper presents a method to synthesize neural network controllers to maximize reward subject to the hard constraint that the feedback system of plant and controller be dissipative, certifying requirements such as stability and $L_2$ gain bounds. It considers nonlinear and uncertain plants, modeled as the interconnection of a linear time-invariant (LTI) system and an uncertainty block, which incorporates nonlinearities. The uncertainty of the plant and the activation functions of the neural network are both described using integral quadratic constraints (IQCs). First, a dissipativity condition is derived for uncertain LTI systems. Second, this condition is used to construct a linear matrix inequality (LMI) which can be used to synthesize neural network controllers. Finally, this convex condition is used in a projection-based training method to synthesize neural network controllers with dissipativity guarantees. Numerical examples on an inverted pendulum and a flexible rod on a cart are provided to demonstrate the effectiveness of this approach.

eess.SY↗

Robust Time-Varying Control Barrier Functions with Sector-Bounded Nonlinearities

This paper presents a novel approach for ensuring safe operation of systems subject to input nonlinearities and time-varying safety constraints. We extend the time-varying barrier function framework to address time-varying safety constraints and explicitly account for control-dependent nonlinearities at the plant input. Guaranteed bounds on the input-output behavior of these nonlinearities are provided through pointwise-in-time quadratic constraints. The result is a class of robust time-varying control barrier functions that define a safety filter. This filter ensures robust safety for all admissible nonlinearities while minimally modifying the command generated by a baseline controller. We derive a second-order cone program (SOCP) to compute this safety filter online and provide novel feasibility conditions for ball-constrained inputs. The proposed approach is demonstrated on a spacecraft docking maneuver.

eess.SY↗

A Model Predictive Control Approach to Dual-Axis Agrivoltaic Panel Tracking

Agrivoltaic systems--photovoltaic (PV) panels installed above agricultural land--have emerged as a promising dual-use solution to address competing land demands for food and energy production. In this paper, we propose a model predictive control (MPC) approach to dual-axis agrivoltaic panel tracking control that dynamically adjusts panel positions in real time to maximize power production and crop yield given solar irradiance and ambient temperature measurements. We apply convex relaxations and shading factor approximations to reformulate the MPC optimization problem as a convex second-order cone program that determines the PV panel position adjustments away from the sun-tracking trajectory. Through case studies, we demonstrate our approach, exploring the Pareto front between i) an approach that maximizes power production without considering crop needs and ii) crop yield with no agrivoltaics. We also conduct a case study exploring the impact of forecast error on MPC performance. We find that dynamically adjusting agrivoltaic panel position helps us actively manage the trade-offs between power production and crop yield, and that active panel control enables the agrivoltaic system to achieve land equivalent ratio values of up to 1.897.

eess.SY↗

Partial Attention in Deep Reinforcement Learning for Safe Multi-Agent Control

Attention mechanisms excel at learning sequential patterns by discriminating data based on relevance and importance. This provides state-of-the-art performance in advanced generative artificial intelligence models. This paper applies this concept of an attention mechanism for multi-agent safe control. We specifically consider the design of a neural network to control autonomous vehicles in a highway merging scenario. The environment is modeled as a Decentralized Partially Observable Markov Decision Process (Dec-POMDP). Within a QMIX framework, we include partial attention for each autonomous vehicle, thus allowing each ego vehicle to focus on the most relevant neighboring vehicles. Moreover, we propose a comprehensive reward signal that considers the global objectives of the environment (e.g., safety and vehicle flow) and the individual interests of each agent. Simulations are conducted in the Simulation of Urban Mobility (SUMO). The results show better performance compared to other driving algorithms in terms of safety, driving speed, and reward.

eess.SY↗

Integral Quadratic Constraints for Repeated ReLU

This paper presents a new dynamic integral quadratic constraint (IQC) for the repeated Rectified Linear Unit (ReLU). These dynamic IQCs can be used to analyze stability and induced $\ell_2$-gain performance of discrete-time, recurrent neural networks (RNNs) with ReLU activation functions. These analysis conditions can be incorporated into learning-based controller synthesis methods, which currently rely on static IQCs. We show that our proposed dynamic IQCs for repeated ReLU form a superset of the dynamic IQCs for repeated, slope-restricted nonlinearities. We also prove that the $\ell_2$-gain bounds are nonincreasing with respect to the horizon used in the dynamic IQC filter. A numerical example using a simple (academic) RNN shows that our proposed IQCs lead to less conservative bounds than existing IQCs.

eess.SY↗

Parameterization of Seed Functions for Equivalent Representations of Time-Varying Delay Systems

Abel's classic transformation shows that any well-posed system with time-varying delay is equivalent to a parameter-varying system with fixed delay. The existence of such a parameter-varying constant delay representation then simplifies the problems of stability analysis and optimal control. Unfortunately, the method for construction of such transformations has been ad-hoc -- requiring an iterative time-stepping approach to constructing the transformation beginning with a seed function subject to boundary-value constraints. Moreover, a poor choice of seed function often results in a constant delay representation with large time-variations in system parameters -- obviating the benefits of such a representation. In this paper, we show how the set of all feasible seed functions can be parameterized using a basis for $L_2$. This parameterization is then used to search for seed functions for which the corresponding time-transformation results in smaller parameter variation. The parameterization of admissible seed functions is illustrated with numerical examples that contrast how well-chosen and poorly chosen seed functions affect the boundedness of a time transformation.

math.OC↗

Time-Transformation-Based Analysis of Systems with Periodic Delay via Perturbative Expansion

It is difficult to analyze the stability of systems with time-varying delays. One approach is to construct a time-transformation that converts the system into a form with a constant delay but with a time-varying scalar appearing in the system matrices. The stability of this transformed system can then be analyzed using methods to bound the effect of the time-varying scalar. One issue is that this transformation is non-unique and requires the solution of an Abel equation. A specific time-transformation typically must be computed numerically. We address this issue by computing an explicit, although approximate, time-transformation for systems where the delay has a constant plus small periodic term. We use a perturbative expansion to construct our explicit solutions. We provide a simple numerical example to illustrate the approach. We also demonstrate the use of this time-transformation to analyze stability of the system with this class of periodic delays.

eess.SY↗