Searcharxiv⌕ Search

arXiv subjects

Abhishek Halder

Publications and source records attributed to Abhishek Halder.

At least 55 records · Page 3Linked to original sources

The Curious Case of Integrator Reach Sets, Part I: Basic Theory

This is the first of a two part paper investigating the geometry of the integrator reach sets, and the applications thereof. In this Part I, assuming box-valued input uncertainties, we establish that this compact convex reach set is semialgebraic, translated zonoid, and not a spectrahedron. We derive the parametric as well as the implicit representation of the boundary of this reach set. We also deduce the closed form formula for the volume and diameter of this set, and discuss their scaling with state dimension and time. We point out that these results may be utilized in benchmarking the performance of the reach set over-approximation algorithms.

eess.SY↗

Schrödinger Meets Kuramoto via Feynman-Kac: Minimum Effort Distribution Steering for Noisy Nonuniform Kuramoto Oscillators

We formulate and solve the problem of finite horizon minimum control effort steering of the state probability distribution between prescribed endpoint joints for a finite population of networked noisy nonuniform Kuramoto oscillators. We consider both the first and second order stochastic Kuramoto models. For numerical solution of the associated stochastic optimal control, we propose combining certain measure-valued proximal recursions and the Feynman-Kac path integral computation. We illustrate the proposed framework via numerical examples.

math.OC↗

A Physics-informed Deep Learning Approach for Minimum Effort Stochastic Control of Colloidal Self-Assembly

We propose formulating the finite-horizon stochastic optimal control problem for colloidal self-assembly in the space of probability density functions (PDFs) of the underlying state variables (namely, order parameters). The control objective is formulated in terms of steering the state PDFs from a prescribed initial probability measure towards a prescribed terminal probability measure with minimum control effort. For specificity, we use a univariate stochastic state model from the literature. Both the analysis and the computational steps for control synthesis as developed in this paper generalize for multivariate stochastic state dynamics given by generic nonlinear in state and non-affine in control models. We derive the conditions of optimality for the associated optimal control problem. This derivation yields a system of three coupled partial differential equations together with the boundary conditions at the initial and terminal times. The resulting system is a generalized instance of the so-called Schrödinger bridge problem. We then determine the optimal control policy by training a physics-informed deep neural network, where the "physics" are the derived conditions of optimality. The performance of the proposed solution is demonstrated via numerical simulations on a benchmark colloidal self-assembly problem.

math.OC↗

Stochastic Uncertainty Propagation in Power System Dynamics using Measure-valued Proximal Recursions

We present a proximal algorithm that performs a variational recursion on the space of joint probability measures to propagate the stochastic uncertainties in power system dynamics over high dimensional state space. The proposed algorithm takes advantage of the exact nonlinearity structures in the trajectory-level dynamics of the networked power systems, and is nonparametric. Lifting the dynamics to the space of probability measures allows us to design a scalable algorithm that obviates gridding the underlying high dimensional state space which is computationally prohibitive. The proximal recursion implements a generalized infinite dimensional gradient flow, and evolves probability-weighted scattered point clouds. We clarify the theoretical nuances and algorithmic details specific to the power system nonlinearities, and provide illustrative numerical examples.

math.OC↗

Certifying the Intersection of Reach Sets of Integrator Agents with Set-valued Input Uncertainties

We consider the problem of verifying safety for a pair of identical integrator agents in continuous time with compact set-valued input uncertainties. We encode this verification problem as that of certifying or falsifying the intersection of their reach sets. We transcribe the same into a variational problem, namely that of minimizing the support function of the difference of the two reach sets over the unit sphere. We illustrate the computational tractability of the proposed formulation by developing two cases in detail, viz. when the inputs have time-varying norm-bounded and generic hyperrectangular uncertainties. We show that the latter case allows distributed certification via second order cone programming.

math.OC↗

A Distributed Algorithm for Measure-valued Optimization with Additive Objective

We propose a distributed nonparametric algorithm for solving measure-valued optimization problems with additive objectives. Such problems arise in several contexts in stochastic learning and control including Langevin sampling from an unnormalized prior, mean field neural network learning and Wasserstein gradient flows. The proposed algorithm comprises a two-layer alternating direction method of multipliers (ADMM). The outer-layer ADMM generalizes the Euclidean consensus ADMM to the Wasserstein consensus ADMM, and to its entropy-regularized version Sinkhorn consensus ADMM. The inner-layer ADMM turns out to be a specific instance of the standard Euclidean ADMM. The overall algorithm realizes operator splitting for gradient flows in the manifold of probability measures.

math.OC↗

Boundary and Taxonomy of Integrator Reach Sets

Over-approximating the forward reach sets of controlled dynamical systems subject to set-valued uncertainties is a common practice in systems-control engineering for the purpose of performance verification. However, specific algebraic and topological results for the geometry of such sets are rather uncommon even for simple linear systems such as the integrators. This work explores the geometry of the forward reach set of the integrator dynamics subject to box-valued uncertainties in its control inputs. Our contribution includes derivation of a closed-form formula for the support functions of these sets. This result, then enables us to deduce the parametric as well as the implicit equations describing the exact boundaries of these reach sets. Specifically, the implicit equations for the bounding hypersurfaces are shown to be given by vanishing of certain Hankel determinants. Finally, it is established that these sets are semialgebraic as well as translated zonoids. Such results should be useful to benchmark existing reach set over-approximation algorithms, and to help design new algorithms for the same.

math.OC↗

On the Convexity of Discrete Time Covariance Steering in Stochastic Linear Systems with Wasserstein Terminal Cost

In this work, we analyze the properties of the solution to the covariance steering problem for discrete time Gaussian linear systems with a squared Wasserstein distance terminal cost. In our previous work, we have shown that by utilizing the state feedback control policy parametrization, this stochastic optimal control problem can be associated with a difference of convex functions program. Here, we revisit the same covariance control problem but this time we focus on the analysis of the problem. Specifically, we establish the existence of solutions to the optimization problem and derive the first and second order conditions for optimality. We provide analytic expressions for the gradient and the Hessian of the performance index by utilizing specialized tools from matrix calculus. Subsequently, we prove that the optimization problem always admits a global minimizer, and finally, we provide a sufficient condition for the performance index to be a strictly convex function (under the latter condition, the problem admits a unique global minimizer). In particular, we show that when the terminal state covariance is upper bounded, with respect to the Löwner partial order, by the covariance matrix of the desired terminal normal distribution, then our problem admits a unique global minimizing state feedback gain. The results of this paper set the stage for the development of specialized control design tools that exploit the structure of the solution to the covariance steering problem with a squared Wasserstein distance terminal cost.

math.OC↗

Wasserstein Proximal Algorithms for the Schrödinger Bridge Problem: Density Control with Nonlinear Drift

We study the Schrödinger bridge problem (SBP) with nonlinear prior dynamics. In control-theoretic language, this is a problem of minimum effort steering of a given joint state probability density function (PDF) to another over a finite time horizon, subject to a controlled stochastic differential evolution of the state vector. For generic nonlinear drift, we reduce the SBP to solving a system of forward and backward Kolmogorov partial differential equations (PDEs) that are coupled through the boundary conditions, with unknowns being the "Schrödinger factors" -- so named since their product at any time yields the optimal controlled joint state PDF at that time. We show that if the drift is a gradient vector field, or is of mixed conservative-dissipative nature, then it is possible to transform these PDEs into a pair of initial value problems (IVPs) involving the same forward Kolmogorov operator. Combined with a recently proposed fixed point recursion that is contractive in the Hilbert metric, this opens up the possibility to numerically solve the SBPs in these cases by computing the Schrödinger factors via a single IVP solver for the corresponding (uncontrolled) forward Kolmogorov PDE. The flows generated by such forward Kolmogorov PDEs, for the two aforementioned types of drift, in turn, enjoy gradient descent structures on the manifold of joint PDFs with respect to suitable distance functionals. We employ a proximal algorithm developed in our prior work, that exploits this geometric viewpoint, to solve these IVPs and compute the Schrödinger factors via weighted scattered point cloud evolution in the state space. We provide the algorithmic details and illustrate the proposed framework of solving the SBPs with nonlinear prior dynamics by numerical examples.

math.OC↗

Anytime Ellipsoidal Over-approximation of Forward Reach Sets of Uncertain Linear Systems

Computing tight over-approximation of reach sets of a controlled uncertain dynamical system is a common practice in verification of safety-critical cyber-physical systems (CPS). While several algorithms are available for this purpose, they tend to be computationally demanding in CPS applications since here, the computational resources such as processor availability tend to be scarce, time-varying and difficult to model. A natural idea then is to design "computation-aware" algorithms that can dynamically adapt with respect to the processor availability in a provably safe manner. Even though this idea should be applicable in broader context, here we focus on ellipsoidal over-approximations. We demonstrate that the algorithms for ellipsoidal over-approximation of reach sets of uncertain linear systems, are well-suited for anytime implementation in the sense the quality of the over-approximation can be dynamically traded off depending on the computational time available, all the while guaranteeing safety. We give a numerical example to illustrate the idea, and point out possible future directions.

eess.SY↗

Prediction and Optimal Feedback Steering of Probability Density Functions for Safe Automated Driving

We propose a stochastic prediction-control framework to promote safety in automated driving by directly controlling the joint state probability density functions (PDFs) subject to the vehicle dynamics via trajectory-level state feedback. To illustrate the main ideas, we focus on a multi-lane highway driving scenario although the proposed framework can be adapted to other contexts. The computational pipeline consists of a PDF prediction layer, followed by a PDF control layer. The prediction layer performs moving horizon nonparametric forecasts for the ego and the non-ego vehicles' stochastic states, and thereby derives safe target PDF for the ego. The latter is based on the forecasted collision probabilities, and promotes the probabilistic safety for the ego. The PDF control layer designs a feedback that optimally steers the joint state PDF subject to the controlled ego dynamics while satisfying the endpoint PDF constraints. Our computation for the PDF prediction layer leverages the structure of the controlled Liouville PDE to evolve the joint PDF values, as opposed to empirically approximating the PDFs. Our computation for the PDF control layer leverages the differential flatness structure in vehicle dynamics. We harness recent theoretical and algorithmic advances in optimal mass transport, and the Schrödinger bridge. The numerical simulations illustrate the efficacy of the proposed framework.

eess.SY↗

Density-based Stochastic Reachability Computation for Occupancy Prediction in Automated Driving

We propose a stochastic reachability computation framework for occupancy prediction in automated driving by directly solving the underlying transport partial differential equation governing the advection of the closed-loop joint density functions. The resulting nonparametric gridless computation is based on integration along the characteristic curves, and allows online computation of the time-varying collision probabilities. Numerical simulations highlight the scope the proposed method.

math.OC↗

Global Convergence of Second-order Dynamics in Two-layer Neural Networks

Recent results have shown that for two-layer fully connected neural networks, gradient flow converges to a global optimum in the infinite width limit, by making a connection between the mean field dynamics and the Wasserstein gradient flow. These results were derived for first-order gradient flow, and a natural question is whether second-order dynamics, i.e., dynamics with momentum, exhibit a similar guarantee. We show that the answer is positive for the heavy ball method. In this case, the resulting integro-PDE is a nonlinear kinetic Fokker Planck equation, and unlike the first-order case, it has no apparent connection with the Wasserstein gradient flow. Instead, we study the variations of a Lyapunov functional along the solution trajectories to characterize the stationary points and to prove convergence. While our results are asymptotic in the mean field limit, numerical simulations indicate that global convergence may already occur for reasonably small networks.

math.OC↗

Smallest Ellipsoid Containing $p$-Sum of Ellipsoids with Application to Reachability Analysis

We study the problem of ellipsoidal bounding of convex set-valued data, where the convex set is obtained by the $p$-sum of finitely many ellipsoids, for any real $p\geq 1$. The notion of $p$-sum appears in the Brunn-Minkowski-Firey theory in convex analysis, and generalizes several well-known set-valued operations such as the Minkowski sum of the summand convex sets (here, ellipsoids). We derive an outer ellipsoidal parameterization for the $p$-sum of a given set of ellipsoids, and compute the tightest such parameterization for two optimality criteria: minimum trace and minimum volume. For such optimal parameterizations, several known results in the system-control literature are recovered as special cases of our general formula. For the minimum volume criterion, our analysis leads to a fixed point recursion over a scalar that parameterizes the shape matrix of the outer ellipsoid. This recursion is proved to be contractive, and found to converge fast in practice. We apply these results to compute the forward reach sets for a linear control system subject to different convex set-valued uncertainty models for the initial condition and control, generated by varying $p\in[1,\infty]$. Our numerical results show that the proposed fixed point algorithm offers more than two orders of magnitude speed-up in computational time for $p=1$, compared to the existing semidefinite programming approach without significant effect on the numerical accuracy. For $p>1$, the reach set computation results reported here are novel. Our results are expected to be useful in real-time safety critical applications such as decision making for collision avoidance of autonomous vehicles, where the computational time-scale for reach set calculation needs to be much smaller than the vehicular dynamics time-scale.

math.OC↗

Finite Horizon Density Control for Static State Feedback Linearizable Systems

We consider the problem of steering the joint state probability density function of a static feedback linearizable control system over finite time horizon. Potential applications include controlling neuronal populations, swarm guidance, and probabilistic motion planning. Our theoretical developments reveal the structure of the minimum energy controller for the same, and can be viewed as a generalization of the Benamou-Brenier theory for dynamic optimal transport. Further analytical results are derived for solving the feasibility problem, i.e., for finding feedback that steers a given joint density function to another in fixed time, subject to the controlled nonlinear dynamics. An algorithm based on the Schrödinger bridge is proposed to approximate a feasible controller; a numerical example is worked out to illustrate the same.

math.OC↗

Reflected Schrödinger Bridge: Density Control with Path Constraints

How to steer a given joint state probability density function to another over finite horizon subject to a controlled stochastic dynamics with hard state (sample path) constraints? In applications, state constraints may encode safety requirements such as obstacle avoidance. In this paper, we perform the feedback synthesis for minimum control effort density steering (a.k.a. Schrödinger bridge) problem subject to state constraints. We extend the theory of Schrödinger bridges to account the reflecting boundary conditions for the sample paths, and provide a computational framework building on our previous work on proximal recursions, to solve the same.

math.OC↗

The Convex Geometry of Integrator Reach Sets

We study the convex geometry of the forward reach sets for integrator dynamics in finite dimensions with bounded control. We derive closed-form expressions for the volume and the diameter (i.e., maximal width) of these sets in terms of the state space dimension, control bound, and time. These results are novel, and use convex analysis to give an analytical handle on the "size" of the integrator reach set. Several concrete examples are provided to illustrate our results. We envision that the ideas presented here will motivate further theoretical and algorithmic development in reach set computation.

math.OC↗

Hopfield Neural Network Flow: A Geometric Viewpoint

We provide gradient flow interpretations for the continuous-time continuous-state Hopfield neural network (HNN). The ordinary and stochastic differential equations associated with the HNN were introduced in the literature as analog optimizers, and were reported to exhibit good performance in numerical experiments. In this work, we point out that the deterministic HNN can be transcribed into Amari's natural gradient descent, and thereby uncover the explicit relation between the underlying Riemannian metric and the activation functions. By exploiting an equivalence between the natural gradient descent and the mirror descent, we show how the choice of activation function governs the geometry of the HNN dynamics. For the stochastic HNN, we show that the so-called "diffusion machine", while not a gradient flow itself, induces a gradient flow when lifted in the space of probability measures. We characterize this infinite dimensional flow as the gradient descent of certain free energy with respect to a Wasserstein metric that depends on the geodesic distance on the ground manifold. Furthermore, we demonstrate how this gradient flow interpretation can be used for fast computation via recently developed proximal algorithms.

math.OC↗