arXiv subjects

Farnaz Adib Yaghmaie

Publications and source records attributed to Farnaz Adib Yaghmaie.

6 recordsLinked to original sources

arXiv2026

Consensus and Synchronization of Multi-agent Systems over Finite Fields - Graph Topologies

This paper presents cooperative protocols for multi-agent systems with agents having a finite state-space. Both scalar single-integrator consensus and general LTI system synchronization are considered. Systems having a finite state-space describe agents with minimal memory capacity processing only a finite alphabet. Such systems are remarkably resilient to communication noise. The crucial problem, however, is to construct the admissible communication topology, which is NP-hard. We address this by efficiently exploring the subsets of admissible graph matrices and propose two new algorithms to generate them. Simulations validate the proposed approach.

eess.SY↗

arXiv2026

Policy Iteration for Domain Randomized Linear Quadratic Systems

In this work, we study policy optimization under domain randomization for linear quadratic control, focusing on learning a single state-feedback controller that minimizes the average cost across systems with uncertain dynamics. We propose a policy iteration algorithm with a step-size rule that preserves stability across all sampled systems at each iteration. We show that the method yields monotonic improvement of the sample-average objective and that a stabilizing step size always exists. Under standard smoothness assumptions, the iterates converge subsequentially to stationary points, and under a gradient-dominance condition, we obtain a global linear convergence rate.

math.OC↗

arXiv2026

Direct Data Driven Natural Gradient Descent for Control

This paper introduces a novel direct data-driven control framework based on Natural Gradient Descent (NGD) to design interpretable and robust closed-loop policies without requiring explicit model identification. We propose two data-driven NGD formulations that incorporate the closed-loop covariance matrix through the Fisher Information Matrix (FIM), allowing gradient updates to be preconditioned according to the system's intrinsic uncertainty. Leveraging two distinct data-based parameterizations of the closed-loop system, our method enables stability-guaranteed policy synthesis directly from data. We provide theoretical guarantees for contraction and convergence using semidefinite programs (SDPs) and validate our framework in both simulations and on hardware on a ROSbot XL platform. The results demonstrate intuitive features compared to linear-quadratic regulator (LQR) and standard data-driven baselines, particularly in terms of convergence speed, robustness, and control interpretability. This work bridges the gap between trajectory-oriented natural gradient methods and practical data-driven control design.

eess.SY↗

arXiv2025

Convergence of Flow-Policy Gradient Learning for Linear Quadratic Regulator Problems

Flow $Q$-learning has recently been introduced to integrate learning from expert demonstrations into an actor-critic structure. Central to this innovation is the ``the one-step policy'' network, which is optimized through a $Q$-function that is regularized with the behavioral cloning from expert trajectories, allowing learning more expressive policies using flow-based generative models. In this paper, we studied the convergence property and stabilizablity of the one-step policy during learning for linear quadratic problems under the offline settings. Our theoretical results are based on a new formulation of the one-step policy loss based on the average expected cost, and regularized with the behavioral cloning loss. Such a formulation allows us to tap into existing strong theoretical results from the policy gradient theorem to study the convergence properties of the one-step policy. We verify our theoretical finding with simulation results on a linearized inverted pendulum.

eess.SY↗

arXiv2025

Natural Gradient Descent for Control

This paper bridges optimization and control, and presents a novel closed-loop control framework based on natural gradient descent, offering a trajectory-oriented alternative to traditional cost-function tuning. By leveraging the Fisher Information Matrix, we formulate a preconditioned gradient descent update that explicitly shapes system trajectories. We show that, in sharp contrast to traditional controllers, our approach provides flexibility to shape the system's low-level behavior. To this end, the proposed method parameterizes closed-loop dynamics in terms of stationary covariance and an unknown cost function, providing a geometric interpretation of control adjustments. We establish theoretical stability conditions. The simulation results on a rotary inverted pendulum benchmark highlight the advantages of natural gradient descent in trajectory shaping.

eess.SY↗

arXiv2021

A Crash Course on Reinforcement Learning

The emerging field of Reinforcement Learning (RL) has led to impressive results in varied domains like strategy games, robotics, etc. This handout aims to give a simple introduction to RL from control perspective and discuss three possible approaches to solve an RL problem: Policy Gradient, Policy Iteration, and Model-building. Dynamical systems might have discrete action-space like cartpole where two possible actions are +1 and -1 or continuous action space like linear Gaussian systems. Our discussion covers both cases.

cs.LG↗