Searcharxiv⌕ Search

arXiv subjects

Amirreza Neshaei Moghaddam

Publications and source records attributed to Amirreza Neshaei Moghaddam.

3 recordsLinked to original sources

Sample Complexity of Linear Quadratic Regulator Without Initial Stability

Inspired by REINFORCE, we introduce a novel receding-horizon algorithm for the Linear Quadratic Regulator (LQR) problem with unknown dynamics. Unlike prior methods, our algorithm avoids reliance on two-point gradient estimates while maintaining the same order of sample complexity. Furthermore, it eliminates the restrictive requirement of starting with a stable initial policy, broadening its applicability. Beyond these improvements, we introduce a refined analysis of error propagation through the contraction of the Riccati operator under the Riemannian distance. This refinement leads to a better sample complexity and ensures improved convergence guarantees.

math.OC↗

Structural Averaged Controllability for Linear Ensemble Systems: Multi-input Case

We study structural averaged controllability for multi-input linear ensemble systems. In this problem, one asks whether a sparsity pattern admits a linear ensemble system that is averaged controllable. The single-input case has been characterized completely, while the general multi-input case has remained open. In this work, we give a complete characterization for the general multi-input case. In particular, we prove that in addition to accessibility, a necessary and sufficient condition for structural averaged controllability of ensemble systems is existence of a row-saturating matching for its \emph{core}, an acyclic subgraph associated with the system which plays a central role in the result for the single-input case.

eess.SY↗

Sample Complexity of the Linear Quadratic Regulator: A Reinforcement Learning Lens

We provide the first known algorithm that provably achieves $\varepsilon$-optimality within $\widetilde{\mathcal{O}}(1/\varepsilon)$ function evaluations for the discounted discrete-time LQR problem with unknown parameters, without relying on two-point gradient estimates. These estimates are known to be unrealistic in many settings, as they depend on using the exact same initialization, which is to be selected randomly, for two different policies. Our results substantially improve upon the existing literature outside the realm of two-point gradient estimates, which either leads to $\widetilde{\mathcal{O}}(1/\varepsilon^2)$ rates or heavily relies on stability assumptions.

eess.SY↗