SearcharxivSearch

arXiv subjects

Anant A. Joshi

Publications and source records attributed to Anant A. Joshi.

8 recordsLinked to original sources

A Dual Ensemble Kalman Filter Approach to Robust Control of Nonlinear Systems: An Application to Partial Differential Equations

This paper considers the problem of data-driven robust control design for nonlinear systems, for instance, obtained when discretizing nonlinear partial differential equations (PDEs). A robust learning control approach is developed for nonlinear affine in control systems based on Lyapunov redesign technique. The robust control is developed as a sum of an optimal learning control which stabilizes the system in absence of disturbances, and an additive Lyapunov-based robustification term which handles the effects of disturbances. The dual ensemble Kalman filter (dual EnKF) algorithm is utilized in the optimal control design methodology. A simulation study is done on the heat equation and Burgers partial differential equation.

math.OC

Error Analysis of Sampling Algorithms for Approximating Stochastic Optimal Control

This paper is concerned with the error analysis of two types of sampling algorithms, namely model predictive path integral (MPPI) and an interacting particle system (\IPS) algorithm, that have been proposed in the literature for numerical approximation of the stochastic optimal control. The analysis is presented through the lens of Gibbs variational principle. For an illustrative example of a single-stage stochastic optimal control problem, analytical expressions for approximation error and scaling laws, with respect to the state dimension and sample size, are derived. The analytical results are illustrated with numerical simulations.

eess.SY

Dual Ensemble Kalman Filter for Stochastic Optimal Control

In this paper, stochastic optimal control problems in continuous time and space are considered. In recent years, such problems have received renewed attention from the lens of reinforcement learning (RL) which is also one of our motivation. The main contribution is a simulation-based algorithm -- dual ensemble Kalman filter (EnKF) -- to numerically approximate the solution of these problems. The paper extends our previous work where the dual EnKF was applied in deterministic settings of the problem. The theoretical results and algorithms are illustrated with numerical experiments.

eess.SY

Backward Map for Filter Stability Analysis

In this paper, a backward map is introduced for the purposes of analysis of the nonlinear (stochastic) filter stability. The backward map is important because the filter-stability in the sense of $\chisq$-divergence follows from showing a certain variance decay property for the backward map. To show this property requires additional assumptions on the model properties of the hidden Markov model (HMM). The analysis in this paper is based on introducing a Poincaré Inequality (PI) for HMMs with white noise observations. In finite state-space settings, PI is related to both the ergodicity of the Markov process as well as the observability of the HMM. It is shown that the Poincaré constant is positive if and only if the HMM is detectable.

math.PR

A bundle framework for observer design on smooth manifolds with symmetry

The article presents a bundle framework for nonlinear observer design on a manifold with a Lie group action. The group action on the manifold decomposes the manifold to a quotient structure and an orbit space, and the problem of observer design for the entire system gets decomposed to a design over the orbit (the group space) and a design over the quotient space. The emphasis throughout the article is on presenting an overarching geometric structure; the special case when the group action is free is given special emphasis. Gradient based observer design on a Lie group is given explicit attention. The concepts developed are illustrated by applying them on well known examples, which include the action of $\mathbb{SO}(3)$ on $\mathbb{R}^3 \setminus \{0\}$ and the simultaneous localisation and mapping (SLAM) problem.

eess.SY

Robust Discrete-Time Pontryagin Maximum Principle on Matrix Lie Groups

This article considers a discrete-time robust optimal control problem on matrix Lie groups. The underlying system is assumed to be perturbed by exogenous unmeasured bounded disturbances, and the control problem is posed as a min-max optimal control wherein the disturbance is the adversary and tries to maximise a cost that the control tries to minimise. Assuming the existence of a saddle point in the problem, we present a version of the Pontryagin maximum principle (PMP) that encapsulates first-order necessary conditions that the optimal control and disturbance trajectories must satisfy. This PMP features a saddle point condition on the Hamiltonian and a set of backward difference equations for the adjoint dynamics. We also present a special case of our result on Euclidean spaces. We conclude with applying the PMP to robust version of single axis rotation of a rigid body.

math.OC

Modification of Hilbert's Space-Filling Curve to Avoid Obstacles: A Robotic Path-Planning Strategy

This paper addresses the problem of exploring a region using the Hilbert's space-filling curve in the presence of obstacles. No prior knowledge of the region being explored is assumed. An online algorithm is proposed which can implement evasive strategies to avoid obstacles comprising a single or two blocked unit squares placed side by side and successfully explore the entire region. The strategies are specified by the change in the waypoint array which robot going to follow. The fractal nature of the Hilbert's space-filling curve has been exploited in proving the validity of the solution.

eess.SY

Uncertainty Quantification And Analysis Of Dynamical Systems With Invariants

This paper considers uncertainty quantification in systems perturbed by stochastic disturbances, in particular, Gaussian white noise. The main focus of this work is on describing the time evolution of statistical moments of certain invariants (for instance total energy and magnitude of angular momentum) for such systems. A first case study for the attitude dynamics of a rigid body is presented where it is shown that these techniques offer a closed form representation of the evolution of the first and second moments of the kinetic energy of the resulting stochastic dynamical system. A second case study of a two body problem is presented in which bounds on the first and second moments of the angular momentum are presented.

eess.SY