Searcharxiv⌕ Search

arXiv subjects

Marco M. Nicotra

Publications and source records attributed to Marco M. Nicotra.

At least 19 recordsLinked to original sources

Direct and Indirect Data-Driven Control with Prior Information about the Equilibrium Manifold

By hinging on the assumption that a system to be controlled is fully unknown, many data-driven control approaches do not leverage available or readily inferable priors. In contrast to this viewpoint, this paper analyzes the impact of using the system's equilibrium subspace to inform direct and indirect linear quadratic regulation. For the indirect case, we show how including a constraint on the equilibrium subspace in the identification problem changes the statistical properties of the learned model. In particular, we show that enforcing consistency with respect to the equilibrium subspace leads to a reduction in the estimator variance that, in turn, enhances model-based control performance. In the direct case, we show how this prior can be leveraged to gain insight into the controlled system without requiring an explicit identification step. These results are supported by both numerical and experimental evidence, showcasing the advantages of explicitly leveraging the equilibrium manifold as a prior in data-driven control.

eess.SY↗

Using Dynamic Safety Margins as Control Barrier Functions

This paper presents an approach to design control barrier functions (CBFs) for arbitrary state and input constraints using tools from the reference governor literature. In particular, it is shown that dynamic safety margins (DSMs) are CBFs for an augmented system obtained by concatenating the state with a virtual reference. The proposed approach is agnostic to the relative degree and can handle multiple state and input constraints using the control-sharing property of CBFs. The construction of CBFs using Lyapunov-based DSMs is then investigated in further detail. Numerical simulations show that the method outperforms existing DSM-based approaches, while also guaranteeing safety and persistent feasibility of the associated optimization program.

eess.SY↗

Designing Control Barrier Functions Using a Dynamic Backup Policy

This paper presents a systematic approach to construct control barrier functions for nonlinear control affine systems subject to arbitrary state and input constraints. Taking inspiration from the reference governor literature, the proposed method defines a family of backup policies, parametrized by the equilibrium manifold of the system. The control barrier function is defined on the augmented state-and-reference space: given a state-reference pair, the approach quantifies the distance to constraint violation at any time in the future. The proposed method is applied to an inverted pendulum on cart.

eess.SY↗

Compliant Explicit Reference Governor for Contact Friendly Robotic Manipulators

This paper introduces the Compliant Explicit Reference Governor (CERG), a modular reference management system that enables robots to interact physically with their environment under provable guarantees. The CERG is an intermediate layer that can be placed between a high-level planner and a low-level controller: it enforces operational constraints and enables smooth transitions between free-motion and contact operations. The CERG ensures safety by limiting the total energy available to the robotic arm at the time of contact. In the absence of contact, however, the CERG does not penalize the system performance. Simulation and hardware experiments validate the CERG on increasingly complex systems.

cs.RO↗

A Semi-smooth Newton Method for the Constrained Optimal Control of Continuous-Time Linear Systems

This paper details a novel indirect method for solving constrained optimal control problems (OCPs) directly in continuous-time function space. The KKT conditions are embedded in a non-smooth complementarity function, which enables their reformulation as a rootfinding problem in Banach space. This problem is then solved using a non-smooth Newton method. Finally, the paper shows that the Newton update can be obtained by solving a modified differential Riccati equation, where the cost terms are reweighted at every iteration based on the constraint multipliers. Numerical simulations show the effectiveness of the method, which converges superlinearly up to the tolerance of the ODE solver.

math.OC↗

Moving On, Even When You're Broken: Fail-Active Trajectory Generation via Diffusion Policies Conditioned on Embodiment and Task

Robot failure is detrimental and disruptive, often requiring human intervention to recover. Our vision is 'fail-active' operation, allowing robots to safely complete their tasks even when damaged. Focusing on 'actuation failures', we introduce DEFT, a diffusion-based trajectory generator conditioned on the robot's current embodiment and task constraints. DEFT generalizes across failure types, supports constrained and unconstrained motions, and enables task completion under arbitrary failure. We evaluate DEFT in both simulation and real-world scenarios using a 7-DoF robotic arm. DEFT outperforms its baselines over thousands of failure conditions, achieving a 99.5% success rate for unconstrained motions versus RRT's 42.4%, and 46.4% for constrained motions versus differential IK's 30.9%. Furthermore, DEFT demonstrates robust zero-shot generalization by maintaining performance on failure conditions unseen during training. Finally, we perform real-world evaluations on two multi-step tasks, drawer manipulation and whiteboard erasing. These experiments demonstrate DEFT succeeding on tasks where classical methods fail. Our results show that DEFT achieves fail-active manipulation across arbitrary failure configurations and real-world deployments.

cs.RO↗

Solving quantum optimal control problems using projection-operator-based Newton steps

The Quantum Projection Operator-Based NewtonMethod for Trajectory Optimization (Q-PRONTO) is a numerical method for solving quantum optimal control problems. This paper significantly improves prior versions of the quantum projection operator by introducing a regulator that stabilizes the solution estimate at every iteration. This modification is shown to not only improve the convergence rate of the algorithm, but also steer the solver towards better local minima compared to the unregulated case. Numerical examples showcase how Q-PRONTO can be used to solve multi-input quantum optimal control problems featuring time-varying costs and undesirable populations that ought to be avoided during the transient.

quant-ph↗

Finite-Time Computation of Polyhedral Input-Saturated Output-Admissible Sets

The paper introduces a novel algorithm for computing the output admissible set of linear discrete-time systems subject to input saturation. The proposed method takes advantage of the piecewise-affine dynamics to propagate the output constraints within the non-saturated and saturated regions. The constraints are then shared between regions to ensure a proper transition from one region to another. The resulting algorithm generates a set that is proven to be polyhedral, safe, positively invariant, and finitely determined. Moreover, the set is also proven to be strictly larger than the maximal output admissible set that would be obtained by treating input saturation as a constraint.

math.OC↗

Stability Analysis of Hypersampled Model Predictive Control

This paper introduces a new framework for analyzing the stability of discrete-time model predictive controllers acting on continuous-time systems. The proposed framework introduces the distinction between discretization time (used to generate the optimal control problem) and sampling time (used to implement the controller). The paper not only shows that these two time constants are independent, but also motivates the benefits of selecting a sampling time that is smaller than the discretization time. The resulting approach, hereafter referred to as Hypersampled Model Predictive Control, overcomes the traditional trade-off between performance and computational complexity that arises when selecting the sampling time of traditional discrete-time model predictive controllers.

eess.SY↗

Attitude Trajectory Optimization and Momentum Conservation with Control Moment Gyroscopes

In this work, we develop a numerically tractable trajectory optimization problem for rest-to-rest attitude transfers with CMG-driven spacecraft. First, we adapt a specialized dynamical model which avoids many of the numerical challenges (singularities) introduced by common dynamical approximations. To formulate and solve our specialized trajectory optimization problem, we design a locally stabilizing Linear Quadratic (LQ) regulator on the system's configuration manifold then lift it into the ambient state space to produce suitable terminal and running LQ cost functionals. Finally, we examine the performance benefits and drawbacks of solutions to this optimization problem via the PRONTO solver and find significant improvements in maneuver time, terminal state accuracy, and total control effort. This analysis also highlights a critical shortcoming for objective functions which penalize only the norm of the control input rather than electrical power usage.

math.OC↗

A Projection Operator-based Newton Method for the Trajectory Optimization of Closed Quantum Systems

Quantum optimal control is an important technology that enables fast state preparation and gate design. In the absence of an analytic solution, most quantum optimal control methods rely on an iterative scheme to update the solution estimate. At present, the convergence rate of existing solvers is at most superlinear. This paper develops a new general purpose solver for quantum optimal control based on the PRojection Operator Newton method for Trajectory Optimization, or PRONTO. Specifically, the proposed approach uses a projection operator to incorporate the Schrödinger equation directly into the cost function, which is then minimized using a quasi-Newton method. At each iteration, the descent direction is obtained by computing the analytic solution to a Linear-Quadratic trajectory optimization problem. The resulting method guarantees monotonic convergence at every iteration and quadratic convergence in proximity of the solution. To highlight the potential of PRONTO, we present an numerical example that employs it to solve the optimal state-to-state mapping problem for a qubit and compares its performance to a state-of-the-art quadratic optimal control method.

quant-ph↗

Constrained Power Reference Control for Wind Turbines

The cost of wind energy can be reduced by controlling the power reference of a turbine to increase energy capture, while maintaining load and generator speed constraints. We apply standard torque and pitch controllers to the direct inputs of the turbine and use their set points to change the power output and reduce generator speed and blade load transients. A power reference controller increases the power output when conditions are safe and decreases it when problematic transient events are expected. Transient generator speeds and blade loads are estimated using a gust measure derived from a wind speed estimate. A hybrid controller decreases the power rating from a maximum allowable power. Compared to a baseline controller, with a constant power reference, the proposed controller results in generator speeds and blade loads that do not exceed the original limits, increases tower fore-aft damage equivalent loads by 1%, and increases the annual energy production by 5%.

eess.SY↗

Feasibility Governor for Linear Model Predictive Control

This paper introduces the Feasibility Governor (FG): an add-on unit that enlarges the region of attraction of Model Predictive Control by manipulating the reference to ensure that the underlying optimal control problem remains feasible. The FG is developed for linear systems subject to polyhedral state and input constraints. Offline computations using polyhedral projection algorithms are used to construct the feasibility set. Online implementation relies on the solution of a convex quadratic program that guarantees recursive feasibility. The closed-loop system is shown to satisfy constraints, achieve asymptotic stability, and exhibit zero-offset tracking.

math.OC↗

An Analysis of Closed-Loop Stability for Linear Model Predictive Control Based on Time-Distributed Optimization

Time-distributed Optimization (TDO) is an approach for reducing the computational burden of Model Predictive Control (MPC). When using TDO, optimization iterations are distributed over time by maintaining a running solution estimate and updating it at each sampling instant. In this paper, TDO applied to input constrained linear MPC is studied in detail, and analytic expressions for the system gains and a bound on the number of optimization iterations per sampling instant required to guarantee closed-loop stability is derived. Further, it is shown that the closed-loop stability of TDO-based MPC can be guaranteed using multiple mechanisms including increasing the number of solver iterations, preconditioning the optimal control problem, adjusting the MPC cost matrices, and reducing the length of the receding horizon. These results in a linear system setting also provide insights and guidelines that could be more broadly applicable, e.g., to nonlinear MPC.

math.OC↗

A Feasibility Governor for Enlarging the Region of Attraction of Linear Model Predictive Controllers

This paper proposes a method for enlarging the region of attraction of Linear Model Predictive Controllers (MPC) when tracking piecewise-constant references in the presence of pointwise-in-time constraints. It consists of an add-on unit, the Feasibility Governor (FG), that manipulates the reference command so as to ensure that the optimal control problem that underlies the MPC feedback law remains feasible. Offline polyhedral projection algorithms based on multi-objective linear programming are employed to compute the set of feasible states and reference commands. Online, the action of the FG is computed by solving a convex quadratic program. The closed-loop system is shown to satisfy constraints, be asymptotically stable, exhibit zero-offset tracking, and display finite-time convergence of the reference.

math.OC↗

Distributed Reinforcement Learning for Cooperative Multi-Robot Object Manipulation

We consider solving a cooperative multi-robot object manipulation task using reinforcement learning (RL). We propose two distributed multi-agent RL approaches: distributed approximate RL (DA-RL), where each agent applies Q-learning with individual reward functions; and game-theoretic RL (GT-RL), where the agents update their Q-values based on the Nash equilibrium of a bimatrix Q-value game. We validate the proposed approaches in the setting of cooperative object manipulation with two simulated robot arms. Although we focus on a small system of two agents in this paper, both DA-RL and GT-RL apply to general multi-agent systems, and are expected to scale well to large systems.

cs.RO↗

Sensitivity-based Warmstarting for Nonlinear Model Predictive Control with Polyhedral State and Control Constraints

Model predictive control (MPC) is of increasing interest in applications for constrained control of multivariable systems. However, one of the major obstacles to its broader use is the computation time and effort required to solve a possibly non-convex optimal control problem (OCP) online. This paper introduces a sensitivity-based warmstarting strategy for systems with nonlinear dynamics and polyhedral constraints with the goal of reducing the computational footprint of MPC controllers. It predicts changes in the solution of the parameterized OCP as the parameter varies, by calculating the semiderivative of the solution mapping. The main novelty of the paper is that the polyhedrality of the constraints allows us to avoid imposing any constraint qualification conditions or strict complementarity assumptions. A numerical study featuring MPC applied to unmanned aerial vehicles illustrates the proposed approach.

math.OC↗

Technical Note for "A Geodesic Approach for the Control of Tethered Quadrotors"

This technical note focuses on the control of a quadrotor unmanned aerial vehicle (UAV) tethered to the ground. The control objective is to stabilize the UAV to the desired position while ensuring that the cable remains taut at all times. A cascade control scheme is proposed. The inner loop controls the attitude of the UAV. The outer loop gives the attitude reference to the inner loop, and is designed so that (i) the gravity force is compensated, (ii) the cable is taut at all times, and (iii) the trajectory of the UAV follows the geodesic path. To prove asymptotic stability, small gain arguments are used. The control scheme is augmented with a reference governor to enforce constraints.

eess.SY↗