Searcharxiv⌕ Search

arXiv subjects

Karthik Elamvazhuthi

Publications and source records attributed to Karthik Elamvazhuthi.

At least 19 recordsLinked to original sources

Noise-Induced Navigation in Non-convex Domains and Compact Manifolds

In this note, we study the problem of designing a feedback law that globally steers a system to a prescribed target configuration. Even if the system is fully actuated, topological obstructions generally prevent the existence of globally asymptotically stabilizing continuous feedback laws. We revisit this problem in a stochastic setting by allowing noise to enter through the control channels. Using a criterion for asymptotic stability in the large that combines local Lyapunov stability with positive recurrence, we constructively show that one can construct elementary feedback laws that achieve global asymptotic stability in the large, of the target equilibrium point in connected Euclidean domains with obstacles and manifolds without boundary. For Euclidean domains with obstacles, we also show that the method extends naturally to the problem of finding the minimizer of a strongly convex function with non-convex constraints. Numerical experiments illustrate the effectiveness of the approach for Euclidean domains with circular obstacles and the two dimensional sphere. Additionally, we study the role noise strength when there is a non-convex obstacle, in which case the system might show metastability.

math.OC↗

Notes on Generative Modeling for Feedback Control and Planning

In these notes, we view control as a dynamically constrained sampling problem on the state-space of a control system. With this viewpoint, we extend methods from generative modeling, such as flow matching, normalizing flows and denoising diffusions to control problems. Concepts such as controllability, optimal control and trajectory planning play an important role in guiding the extension and understanding well-posedeness of the corresponding algorithms, with application to steering systems to target states or distributions and sampling from reachable sets. The notes are intended as an accessible introduction for readers with a background in control theory and robotics.

math.OC↗

Discrete Diffusion with Sample-Efficient Estimators for Conditionals

We study a discrete denoising diffusion framework that integrates a sample-efficient estimator of single-site conditionals with round-robin noising and denoising dynamics for generative modeling over discrete state spaces. Rather than approximating a discrete analog of a score function, our formulation treats single-site conditional probabilities as the fundamental objects that parameterize the reverse diffusion process. We employ a sample-efficient method known as Neural Interaction Screening Estimator (NeurISE) to estimate these conditionals in the diffusion dynamics. Controlled experiments on synthetic Ising models, MNIST, and scientific data sets produced by a D-Wave quantum annealer, synthetic Potts model and one dimensional quantum systems demonstrate the proposed approach. On the binary data sets, these experiments demonstrate that the proposed approach outperforms popular existing methods including ratio-based approaches, achieving improved performance in total variation, cross-correlations, and kernel density estimation metrics.

cs.LG↗

Geometry-Preserving Neural Architectures on Manifolds with Boundary

A growing number of neural architectures have been proposed to enforce geometric constraints, including projection-based networks, exponential-map updates, constrained output layers, and manifold neural ODEs. We provide a unified framework for these geometry-preserving architectures by organizing them according to where and how constraints are enforced, either throughout the intermediate layers or only at the final output. This perspective reveals several gaps in the existing theory. To address these gaps, we prove high-level approximation theorems for projected neural ODEs, intermediate augmented architectures, and final augmented architectures on prox-regular constraint sets, including smooth manifolds with boundary. Numerical experiments on synthetic dynamics over S^2, the disk, SO(3), together with real-world protein backbone data on SE(3), demonstrate exact feasibility for analytic updates and show that the final augmentation have simpler architecture and outperform in most tasks considered. When the constraint set is unknown, we learn projections via small-time heat-kernel limits, showing diffusion/flow-matching can be used as data-based projections. Moreover, we also the demonstrate the usefulness of the architectures that enforce non-convex constraints for path planning on manifolds with boundary.

cs.LG↗

From Schrodinger Bridge to Optimal Transport over Sub-Riemannian Manifolds

We study the least-energy way to reshape a probability distribution when motion is constrained to a horizontal bundle, that is, optimal transport and distribution steering in sub-Riemannian geometry, motivated by density control over underactuated systems. To obtain a continuous and numerically tractable formulation, we introduce an entropic regularization by adding small noise aligned with the control directions and study the associated Schrodinger bridge problem. The resulting reference process is a degenerate diffusion on the sub-Riemannian manifold. Under bracket-generating hypotheses we obtain smooth, strictly positive transition densities and a forward--backward characterization of the optimal bridge. This leads to a practical Sinkhorn-type algorithm for the Schrodinger potentials and, as the noise level vanishes, a recovery of the deterministic sub-Riemannian optimal transport problem. We demonstrate with a numerical example.

math.OC↗

Flow Matching for Measure Transport and Feedback Stabilization of Control-Affine Systems

We develop a \emph{flow-matching framework} for transporting probability measures under control-affine dynamics and for steering systems to points or target sets. Starting from the continuity equation associated with the control affine system of the form dx/dt = f_0(x) + \sum_{i=1}^m u_i f_i(x), we construct measure interpolations through exact, approximate flow matching, and extend the approach to output flow matching when only output distributions must align. These constructions allow to directly import standard control tools, such as feedback design, oscillatory inputs, and trajectory steering, and yield sample-efficient, regression-based feedback controllers for measure-to-measure transport. We also introduce a complementary ``noising + time-reversal'' perspective for classical state or set stabilization, inspired by denoising diffusion models. Here stabilization is interpreted as a denoising problem: noising corresponds to destabilizing the system through excitations, while denoising corresponds to stabilization via time reversal. We propose two methods for constructing the noising process: (i) Randomized-control noising, which employs regular (non-white noise) controls through the endpoint map and naturally accommodates control constraints. (iI) PMP-based noising, which leverages the Hamiltonian system from Pontryagin's Maximum Principle, corresponding to fixed or variable end-point optimal control problems, to explore the configuration space by randomizing the adjoint vectors and recovers the optimal controller for linear systems with convex costs, while providing feasible feedback laws in the nonlinear case. Finally, we numerically illustrate the framework on linear and nonlinear systems, demonstrating its effectiveness for measure transport, steering systems to target sets and path planning in a domain with obstacles.

math.OC↗

Score Matching Diffusion Based Feedback Control and Planning of Nonlinear Systems

In this paper, we propose a deterministic diffusion-based framework for controlling the probability density of nonlinear control-affine systems, with theoretical guarantees for drift-free and linear time-invariant (LTI) dynamics. The central idea is to first excite the system with white noise so that a forward diffusion process explores the reachable regions of state space, and then to design a deterministic feedback law that acts as a denoising mechanism driving the system back toward a desired target distribution supported on the target set. This denoising phase provides a feedback controller that steers the control system to the target set. In this framework, control synthesis reduces to constructing a deterministic reverse process that reproduces the desired evolution of state densities. We derive existence conditions ensuring such deterministic realizations of time-reversals for controllable drift-free and LTI systems, and show that the resulting feedback laws provide a tractable alternative to nonlinear control by viewing density control as a relaxation of controlling a system to target sets. Numerical studies on a unicycle model with obstacles, a five-dimensional driftless system, and a four-dimensional LTI system demonstrate reliable diffusion-inspired density control.

math.OC↗

Uniform Sampling from the Reachable Set Using Optimal Transport

Estimating the reachable set of a dynamical system is a fundamental problem in control theory, particularly when control inputs are bounded. Direct simulation using randomly sampled admissible controls often leads to trajectories that cluster near attractors, resulting in poor coverage of the reachable set. To achieve a more uniform distribution of terminal states, we formulate the problem within an Optimal Transport (OT) framework. In this setting, the goal is to steer the system so that the final state distribution, determined by the chosen controls and initial conditions, matches a desired target distribution. Enforcing this condition exactly is not possible since the reachable set is not known. So we introduce an $L_2$-norm based regularization of the terminal distribution that relaxes the constraint while promoting uniform coverage. The resulting formulation can be approximated by a finite-dimensional, particle-based optimal control problem with kernel-coupled terminal cost. We show that this approach converges to the original formulation and demonstrate through numerical examples that it provides significantly more uniform reachable-set sampling than random control strategies.

math.OC↗

The Ground Cost for Optimal Transport of Angular Velocity

We revisit the optimal transport problem over angular velocity dynamics given by the controlled Euler equation. The solution of this problem enables stochastic guidance of spin states of a rigid body (e.g., spacecraft) over a hard deadline constraint by transferring a given initial state statistics to a desired terminal state statistics. This is an instance of generalized optimal transport over a nonlinear dynamical system. While prior work has reported existence-uniqueness and numerical solution of this dynamical optimal transport problem, here we present structural results about the equivalent Kantorovich a.k.a. optimal coupling formulation. Specifically, we focus on deriving the ground cost for the associated Kantorovich optimal coupling formulation. The ground cost is equal to the cost of transporting unit amount of mass from a specific realization of the initial or source joint probability measure to a realization of the terminal or target joint probability measure, and determines the Kantorovich formulation. Finding the ground cost leads to solving a structured deterministic nonlinear optimal control problem, which is shown to be amenable to an analysis technique pioneered by Athans et al. We show that such techniques have broader applicability in determining the ground cost (thus Kantorovich formulation) for a class of generalized optimal mass transport problems involving nonlinear dynamics with translated norm-invariant drift.

math.OC↗

Universal Approximation of Mean-Field Models via Transformers

This paper investigates the use of transformers to approximate the mean-field dynamics of interacting particle systems exhibiting collective behavior. Such systems are fundamental in modeling phenomena across physics, biology, and engineering, including opinion formation, biological networks, and swarm robotics. The key characteristic of these systems is that the particles are indistinguishable, leading to permutation-equivariant dynamics. First, we empirically demonstrate that transformers are well-suited for approximating a variety of mean field models, including the Cucker-Smale model for flocking and milling, and the mean-field system for training two-layer neural networks. We validate our numerical experiments via mathematical theory. Specifically, we prove that if a finite-dimensional transformer effectively approximates the finite-dimensional vector field governing the particle system, then the $L_2$ distance between the \textit{expected transformer} and the infinite-dimensional mean-field vector field can be uniformly bounded by a function of the number of particles observed during training. Leveraging this result, we establish theoretical bounds on the distance between the true mean-field dynamics and those obtained using the transformer.

physics.comp-ph↗

Benamou-Brenier Formulation of Optimal Transport for Nonlinear Control Systems on Rd

In this paper we consider the Benamou-Brenier formulation of optimal transport for nonlinear control affine systems on $\Rd$, removing the compactness assumption of the underlying manifold in previous work by the author. By using Bernard's Young measure based weak formulation of optimal transport, the results are established for cases not covered by previous treatments using the Monge problem. Particularly, no assumptions are made on the non-existence of singular minimizing controls or the cost function being Lipschitz. Therefore, the existence of solutions to dynamical formulation is established for general Sub-Riemmanian energy costs not covered by literature previously. The results also establish controllability of the continuity equation whenever the corresponding Kantorovich problem admits a feasible solution, leveraging the equivalence between the Kantorovich and Benamou-Brenier formulations. Furthermore, when the cost function does not admit singular minimizing curves, we demonstrate that the Benamou-Brenier problem is equivalent to its convexified formulation in momentum and measure coordinates. In this regular setting, we further show that the constructed transport solutions possess sufficient regularity: for the feedback control laws that achieve transport, the associated continuity equation admits a unique weak solution. These findings apply in particular to linear-quadratic costs for controllable linear time-invariant (LTI) systems, as well as to certain classes of driftless nonlinear systems. Thus, in these cases, controllability of the continuity equation is achieved with control laws regular enough to guarantee uniqueness of solutions.

math.OC↗

Quantitative Flow Approximation Properties of Narrow Neural ODEs

In this note, we revisit the problem of flow approximation properties of neural ordinary differential equations (NODEs). The approximation properties have been considered as a flow controllability problem in recent literature. The neural ODE is considered {\it narrow} when the parameters have dimension equal to the input of the neural network, and hence have limited width. We derive the relation of narrow NODEs in approximating flows of shallow but wide NODEs. Due to existing results on approximation properties of shallow neural networks, this facilitates understanding which kind of flows of dynamical systems can be approximated using narrow neural ODEs. While approximation properties of narrow NODEs have been established in literature, the proofs often involve extensive constructions or require invoking deep controllability theorems from control theory. In this paper, we provide a simpler proof technique that involves only ideas from ODEs and Gr{ö}nwall's lemma. Moreover, we provide an estimate on the number of switches needed for the time dependent weights of the narrow NODE to mimic the behavior of a NODE with a single layer wide neural network as the velocity field.

math.OC↗

A Linear Test for Global Nonlinear Controllability

It is known that if a nonlinear control affine system without drift is bracket generating, then its associated sub-Laplacian is invertible under some conditions on the domain. In this note, we investigate the converse. We show how invertibility of the sub-Laplacian operator implies a weaker form of controllability, where the reachable sets of a neighborhood of a point have full measure. From a computational point of view, one can then use the spectral gap of the (infinite-dimensional) self-adjoint operator to define a notion of degree of controllability. An essential tool to establish the converse result is to use the relation between invertibility of the sub-Laplacian to the the controllability of the corresponding continuity equation using possibly non-smooth controls. Then using Ambrosio-Gigli-Savare's superposition principle from optimal transport theory we relate it to controllability properties of the control system. While the proof can be considered of the Perron-Frobenius type, we also provide a second dual Koopman point of view.

math.OC↗

Density Stabilization Strategies for Nonholonomic Agents on Compact Manifolds

In this article, we consider the problem of stabilizing stochastic processes, which are constrained to a bounded Euclidean domain or a compact smooth manifold, to a given target probability density. Most existing works on modeling and control of robotic swarms that use PDE models assume that the robots' dynamics are holonomic, and hence, the associated stochastic processes have generators that are elliptic. We relax this assumption on the ellipticity of the generator of the stochastic processes, and consider the more practical case of the stabilization problem for a swarm of agents whose dynamics are given by a controllable driftless control-affine system. We construct state-feedback control laws that exponentially stabilize a swarm of nonholonomic agents to a target probability density that is sufficiently regular. State-feedback laws can stabilize a swarm only to target probability densities that are positive everywhere. To stabilize the swarm to probability densities that possibly have disconnected supports, we introduce a semilinear PDE model of a collection of interacting agents governed by a hybrid switching diffusion process. The interaction between the agents is modeled using a (mean-field) feedback law that is a function of the local density of the swarm, with the switching parameters as the control inputs. We show that the semilinear PDE system is globally asymptotically stable about the given target probability density. The stabilization strategies are verified without inter-agent interactions is verified numerically for agents that evolve according to the Brockett integrator and a nonholonomic system on the special orthogonal group of 3-dimensional rotations $SO(3)$. The stabilization strategy with inter-agent interactions is verified numerically for agents that evolve according to the Brockett integrator and a holonomic system on the sphere $S^2$.

eess.SY↗

A Blob Method for Mean Field Control With Terminal Constraints

In the present work, we develop a novel particle method for a general class of mean field control problems, with source and terminal constraints. Specific examples of the problems we consider include the dynamic formulation of the p-Wasserstein metric, optimal transport around an obstacle, and measure transport subject to acceleration controls. Unlike existing numerical approaches, our particle method is meshfree and does not require global knowledge of an underlying cost function or of the terminal constraint. A key feature of our approach is a novel way of enforcing the terminal constraint via a soft, nonlocal approximation, inspired by recent work on blob methods for diffusion equations. We prove convergence of our particle approximation to solutions of the continuum mean-field control problem in the sense of Gamma-convergence. A byproduct of our result is an extension of existing discrete-to-continuum convergence results for mean field control problems to more general state and measure costs, as arise when modeling transport around obstacles, and more general constraint sets, including controllable linear time invariant systems. Finally, we conclude by implementing our method numerically and using it to compute solutions the example problems discussed above. We conduct a detailed numerical investigation of the convergence properties of our method, as well as its behavior in sampling applications and for approximation of optimal transport maps.

math.OC↗

Denoising Diffusion-Based Control of Nonlinear Systems

We propose a novel approach based on Denoising Diffusion Probabilistic Models (DDPMs) to control nonlinear dynamical systems. DDPMs are the state-of-art of generative models that have achieved success in a wide variety of sampling tasks. In our framework, we pose the feedback control problem as a generative task of drawing samples from a target set under control system constraints. The forward process of DDPMs constructs trajectories originating from a target set by adding noise. We learn to control a dynamical system in reverse such that the terminal state belongs to the target set. For control-affine systems without drift, we prove that the control system can exactly track the trajectory of the forward process in reverse, whenever the the Lie bracket based condition for controllability holds. We numerically study our approach on various nonlinear systems and verify our theoretical results. We also conduct numerical experiments for cases beyond our theoretical results on a physics-engine.

math.OC↗

Optimal Transport of Linear Systems over Equilibrium Measures

We consider the optimal transport problem over convex costs arising from optimal control of linear time-invariant(LTI) systems when the initial and target measures are assumed to be supported on the set of equilibrium points of the LTI system. In this case, the probability measures are singular with respect to the Lebesgue measure, thus not considered in previous results on optimal transport of linear systems. This problem is motivated by applications, such as robotics, where the initial and target configurations of robots, represented by measures, are in equilibrium or stationary. Despite the singular nature of the measures, for many cases of practical interest, we show that the Monge problem has a solution by applying classical optimal transport results. Moreover, the problem is computationally tractable even if the state space of the LTI system is moderately high in dimension, provided the equilibrium set lives in a low dimensional space. In fact, for an important subclass of linear quadratic problems, such as control of the double integrator with linear quadratic cost, the optimal transport map happens to coincide with that of the Euclidean cost. We demonstrate our results by computing the optimal transport map for the minimum energy cost for a two dimensional double integrator, despite the fact that the state space is four dimensional due to position and velocity variables.

math.OC↗

Noise in the reverse process improves the approximation capabilities of diffusion models

In Score based Generative Modeling (SGMs), the state-of-the-art in generative modeling, stochastic reverse processes are known to perform better than their deterministic counterparts. This paper delves into the heart of this phenomenon, comparing neural ordinary differential equations (ODEs) and neural stochastic differential equations (SDEs) as reverse processes. We use a control theoretic perspective by posing the approximation of the reverse process as a trajectory tracking problem. We analyze the ability of neural SDEs to approximate trajectories of the Fokker-Planck equation, revealing the advantages of stochasticity. First, neural SDEs exhibit a powerful regularizing effect, enabling $L^2$ norm trajectory approximation surpassing the Wasserstein metric approximation achieved by neural ODEs under similar conditions, even when the reference vector field or score function is not Lipschitz. Applying this result, we establish the class of distributions that can be sampled using score matching in SGMs, relaxing the Lipschitz requirement on the gradient of the data distribution in existing literature. Second, we show that this approximation property is preserved when network width is limited to the input dimension of the network. In this limited width case, the weights act as control inputs, framing our analysis as a controllability problem for neural SDEs in probability density space. This sheds light on how noise helps to steer the system towards the desired solution and illuminates the empirical success of stochasticity in generative modeling.

cs.LG↗