arXiv subjects

Yorai Wardi

Publications and source records attributed to Yorai Wardi.

At least 19 recordsLinked to original sources

arXiv2026

Interleaved POMDP Planning for Multi-Object Search in Unknown Multi-Room Household Environments

Multi-object search in unknown household environments requires planning under extensive uncertainty - from unknown object locations to cluttered spaces with unobserved obstacles. POMDPs offer a principled framework for such problems but remain intractable in large domains. We propose Inter-POMDP, a novel interleaved POMDP planning algorithm that decomposes this challenge into two interacting levels: a high-level POUCT planner reasons over object distributions using LLM-informed histogram beliefs, while a low-level motion planner models navigation uncertainty with obstacle-aware particle beliefs as domain knowledge to guide high-level POUCT. This interleaved design balances planning quality and efficiency despite the large search space across unknown multi-room environments. Both simulation and real-world experiments show that our Inter-POMDP algorithm reduces collision counts by up to 63%, navigation steps by up to 35%, and detection counts by up to 32% compared with baseline methods. Full videos are https://sites.google.com/view/inter-pomdp

cs.RO↗

arXiv2026

Lightweight Tracking Control for Computationally Constrained Aerial Systems with the Newton-Raphson Method

We investigate the performance of a lightweight tracking controller, based on a flow version of the Newton-Raphson method, applied to a miniature blimp and a mid-size quadrotor. This tracking technique admits theoretical performance guarantees for certain classes of systems and has been successfully applied in simulation studies and on mobile robots with simplified motion models. We evaluate the technique through real-world flight experiments on aerial hardware platforms subject to realistic deployment and onboard computational constraints. The technique's performance is assessed in comparison with established baseline control frameworks of feedback linearization for the blimp, and nonlinear model predictive control for both the quadrotor and the blimp. The performance metrics under consideration are (i) root mean square error of flight trajectories with respect to target trajectories, (ii) algorithms' computation times, and (iii) CPU energy consumption associated with the control algorithms. The experimental findings show that the Newton-Raphson-based tracking controller achieves competitive or superior tracking performance to the baseline methods with substantially reduced computation time and energy expenditure.

cs.RO↗

arXiv2025

Stability Analysis of the Newton-Raphson Controller for a Class of Differentially Flat Systems

The Newton-Raphson Controller, established on the output prediction and the Newton-Raphson algorithm, is shown to be effective in a variety of control applications. Although the stability condition of the controller for linear systems has already been established, such condition for nonlinear systems remains unexplored. In this paper, we study the stability of the Newton-Raphson controller for a class of differentially flat nonlinear systems in the context of output regulation and tracking control. For output regulation, we prove that the controlled system is stable within a neighborhood of the origin if the corresponding flat system and output predictor satisfy a verifiable stability criterion. A semi-quantitative analysis is conducted to determine the measure of the domain of attraction. For tracking control, we prove that the controller is capable of driving the outputs to the external reference signals using a specific selection of controller parameters. Simulation results show that the controller achieves regulation and tracking respectively on the inverted pendulum and the kinematic bicycle, suggesting a potential in future control applications.

eess.SY↗

arXiv2024

Newton-Raphson Flow for Aggressive Quadrotor Tracking Control

We apply the Newton-Raphson flow tracking controller to aggressive quadrotor flight and demonstrate that it achieves good tracking performance over a suite of benchmark trajectories, beating the native trajectory tracking controller in the popular PX4 Autopilot. The Newton-Raphson flow tracking controller is a recently proposed integrator-type controller that aims to drive to zero the error between a future predicted system output and the reference trajectory. This controller is computationally lightweight, requiring only an imprecise predictor, and achieves guaranteed asymptotic error bounds under certain conditions. We show that these theoretical advantages are realizable on a quadrotor hardware platform. Our experiments are conducted on a Holybrox x500v2 quadrotor using a Pixhawk 6x flight controller and a Rasbperry Pi 4 companion computer which receives location information from an OptiTrack motion capture system and sends input commands through the ROS2 API for the PX4 software stack.

cs.RO↗

arXiv2020

Integral Control Barrier Functions for Dynamically Defined Control Laws

This paper introduces integral control barrier functions (I-CBFs) as a means to enable the safety-critical integral control of nonlinear systems. Importantly, I-CBFs allow for the holistic encoding of both state constraints and input bounds in a single framework. We demonstrate this by applying them to a dynamically defined tracking controller, thereby enforcing safety in state and input through a minimally invasive I-CBF controller framed as a quadratic program.

math.OC↗

arXiv2020

Intersection-Traffic Control of Autonomous Vehicles using Newton-Raphson Flows and Barrier Functions

This paper concerns an application of a recently-developed nonlinear tracking technique to trajectory control of autonomous vehicles at traffic intersections. The technique uses a flow version of the Newton-Raphson method for controlling a predicted system-output to a future reference target. Its implementations are based on numerical solutions of ordinary differential equations, and it does not specify any particular method for computing its future reference trajectories. Consequently it can use relatively simple algorithms on crude models for computing the target trajectories, and more-accurate models and algorithms for trajectory control in the tight loop. We demonstrate this point at an extant predictive traffic planning-and-control method with our tracking technique. Furthermore, we guarantee safety specifications by applying to the tracking technique the framework of control barrier functions.

eess.SY↗

arXiv2019

Tracking Control by the Newton-Raphson Method with Output Prediction and Controller Speedup

This paper presents a control technique for output tracking of reference signals in continuous-time dynamical systems. The technique is comprised of the following three elements: (i) output prediction which has to track the reference signal, (ii) a controller based on an integrator with variable gain, and (iii) a speedup of the control action for enhancing the tracker's accuracy and, in some cases, guaranteeing stability of the closed-loop system. The technique is suitable for linear and nonlinear systems, implementable by simple algorithms, can track reference points as well as time-dependent reference signals, and may have large, even global domains of attraction. The derived theoretical results include convergence of the tracking controller and error analysis, and are supported by illustrative simulation and laboratory experiments.

math.OC↗

arXiv2019

A Predictive Deep Learning Approach to Output Regulation: The Case of Collaborative Pursuit Evasion

In this paper, we consider the problem of controlling an underactuated system in unknown, and potentially adversarial environments. The emphasis will be on autonomous aerial vehicles, modelled by Dubins dynamics. The proposed control law is based on a variable integrator via online prediction for target tracking. To showcase the efficacy of our method, we analyze a pursuit evasion game between multiple autonomous agents. To obviate the need for perfect knowledge of the evader's future strategy, we use a deep neural network that is trained to approximate the behavior of the evader based on measurements gathered online during the pursuit.

cs.MA↗

arXiv2019

Tracking Control by the Newton-Raphson Flow: Applications to Autonomous Vehicles

This paper concerns applications of a recently-developed output-tracking technique to trajectory control of autonomous vehicles. The technique is based on three principles: Newton-Raphson flow for solving algebraic equations,output prediction, and controller speedup. Early applications of the technique, made to simple systems of an academic nature,were implemented by simple algorithms requiring modest computational efforts. In contrast, this paper tests it on commonly-used dynamic models to see if it can handle more complex control scenarios. Results are derived from simulations as well as a laboratory setting, and they indicate effective tracking convergence despite the simplicity of the control algorithm.

eess.SY↗

arXiv2018

TRINITY: Coordinated Performance, Energy and Temperature Management in 3D Processor-Memory Stacks

The consistent demand for better performance has lead to innovations at hardware and microarchitectural levels. 3D stacking of memory and logic dies delivers an order of magnitude improvement in available memory bandwidth. The price paid however is, tight thermal constraints. In this paper, we study the complex multiphysics interactions between performance, energy and temperature. Using a cache coherent multicore processor cycle level simulator coupled with power and thermal estimation tools, we investigate the interactions between (a) thermal behaviors (b) compute and memory microarchitecture and (c) application workloads. The key insights from this exploration reveal the need to manage performance, energy and temperature in a coordinated fashion. Furthermore, we identify the concept of "effective heat capacity" i.e. the heat generated beyond which no further gains in performance is observed with increases in voltage-frequency of the compute logic. Subsequently, a real-time, numerical optimization based, application agnostic controller (TRINITY) is developed which intelligently manages the three parameters of interest. We observe up to $30\%$ improvement in Energy Delay$^2$ Product and up to $8$ Kelvin lower core temperatures as compared to fixed frequencies. Compared to the \texttt{ondemand} Linux CPU DVFS governor, for similar energy efficiency, TRINITY keeps the cores cooler by $6$ Kelvin which increases the lifetime reliability by up to 59\%.

cs.AR↗

arXiv2018

Optimal control policies for evolutionary dynamics with environmental feedback

We study a dynamical model of a population of cooperators and defectors whose actions have long-term consequences on environmental "commons" - what we term the "resource". Cooperators contribute to restoring the resource whereas defectors degrade it. The population dynamics evolve according to a replicator equation coupled with an environmental state. Our goal is to identify methods of influencing the population with the objective to maximize accumulation of the resource. In particular, we consider strategies that modify individual-level incentives. We then extend the model to incorporate a public opinion state that imperfectly tracks the true environmental state, and study strategies that influence opinion. We formulate optimal control problems and solve them using numerical techniques to characterize locally optimal control policies for three problem formulations: 1) control of incentives, and control of opinions through 2) propaganda-like strategies and 3) awareness campaigns. We show numerically that the resulting controllers in all formulations achieve the objective, albeit with an unintended consequence. The resulting dynamics include cycles between low and high resource states - a dynamical regime termed an "oscillating tragedy of the commons". This outcome may have desirable average properties, but includes risks to resource depletion. Our findings suggest the need for new approaches to controlling coupled population-environment dynamics.

eess.SY↗

arXiv2016

Hamiltonian-based Algorithm for Relaxed Optimal Control

This paper concerns a first-order algorithmic technique for a class of optimal control problems defined on switched-mode hybrid systems. The salient feature of the algorithm is that it avoids the computation of Fréchet or Gâteaux derivatives of the cost functional, which can be time consuming, but rather moves in a projected-gradient direction that is easily computable (for a class of problems) and does not require any explicit derivatives. The algorithm is applicable to a class of problems where a pointwise minimizer of the Hamiltonian is computable by a simple formula, and this includes many problems that arise in theory and applications. The natural setting for the algorithm is the space of continuous-time relaxed controls, whose special structure renders the analysis simpler than the setting of ordinary controls. While the space of relaxed controls has theoretical advantages, its elements are abstract entities that may not be amenable to computation. Therefore, a key feature of the algorithm is that it computes adequate approximations to relaxed controls without loosing its theoretical convergence properties. Simulation results, including cpu times, support the theoretical developments.

math.OC↗

arXiv2016

IPA in the Loop: Control Design for Throughput Regulation in Computer Processors

A new technique for performance regulation in event-driven systems, recently proposed by the authors, consists of an adaptive-gain integral control. The gain is adjusted in the control loop by a real-time estimation of the derivative of the plant-function with respect to the control input. This estimation is carried out by Infinitesimal Perturbation Analysis (IPA). The main motivation comes from applications to throughput regulation in computer processors, where to-date, testing and assessment of the proposed control technique has been assessed by simulation. The purpose of this paper is to report on its implementation on a machine, namely an Intel Haswell microprocessor, and compare its performance to that obtained from cycle-level, full system simulation environment. The intrinsic contribution of the paper to the Workshop on Discrete Event System is in describing the process of taking an IPA-based design and simulation to a concrete implementation, thereby providing a bridge between theory and applications.

math.OC↗

arXiv2016

Motion and Communication Co-optimization with Path Planning and Online Channel Estimation

This paper considers the problem of optimally balancing motion energy and communication transmission energy of a mobile robot tasked with transmitting a given number of data bits to a remote station, while navigating to a prespecified destination in a given amount of time. The problem is cast in the setting of optimal control, where the robot has to choose its path, acceleration, and transmission rate along the path so as to minimize its energy required for transmission and motion, while satisfying various power and communication constraints. We use realistic models for the robot's channel estimation, motion dynamics, and power and energy costs. The main contribution of the paper is to show how to co-optimize robot's path along with other communication and motion variables. Two versions of the problem are solved: the first is defined offline by assuming that all the channel measurements are taken before the robots starts moving, while in the second the channel estimation is updated while the robot is in motion, and hence it is solved online. In both cases we utilize an in-house algorithm that computes near-optimal solutions in little time, which enables its use in the online setting. The optimization strategy is described in detail and validated by simulation of realistic scenarios.

math.OC↗

arXiv2016

Performance Regulation of Event-Driven Dynamical Systems Using Infinitesimal Perturbation Analysis

This paper presents a performance-regulation method for a class of stochastic timed event-driven systems aimed at output tracking of a given reference setpoint. The systems are either Discrete Event Dynamic Systems (DEDS) such as queueing networks or Petri nets, or Hybrid Systems (HS) with time-driven dynamics and event-driven dynamics, like fluid queues and hybrid Petri nets. The regulator, designed for simplicity and speed of computation, is comprised of a single integrator having a variable gain to ensure effective tracking under time-varying plants. The gain's computation is based on the Infinitesimal Perturbation Analysis (IPA) gradient of the plant function with respect to the control variable, and the resultant tracking can be quite robust with respect to modeling inaccuracies and gradient-estimation errors. The proposed technique is tested on examples taken from various application areas and modeled with different formalisms, including queueing models, Petri-net model of a production-inventory control system, and a stochastic DEDS model of a multicore chip control. Simulation results are presented in support of the proposed approach.

math.OC↗

arXiv2015

Congestion management in traffic-light intersections via Infinitesimal Perturbation Analysis

We present a flow-control technique in traffic-light intersections, aiming at regulating queue lengths to given reference setpoints. The technique is based on multivariable integrators with adaptive gains, computed at each control cycle by assessing the IPA gradients of the plant functions. Moreover, the IPA gradients are computable on-line despite the absence of detailed models of the traffic flows. The technique is applied to a two-intersection system where it exhibits robustness with respect to modeling uncertainties and computing errors, thereby permitting us to simplify the on-line computations perhaps at the expense of accuracy while achieving the desired tracking. We compare, by simulation, the performance of a centralized, joint two-intersection control with distributed control of each intersection separately, and show similar performance of the two control schemes for a range of parameters.

math.OC↗

arXiv2015

Temperature Regulation in Multicore Processors Using Adjustable-Gain Integral Controllers

This paper considers the problem of temperature regulation in multicore processors by dynamic voltage-frequency scaling. We propose a feedback law that is based on an integral controller with adjustable gain, designed for fast tracking convergence in the face of model uncertainties, time-varying plants, and tight computing-timing constraints. Moreover, unlike prior works we consider a nonlinear, time-varying plant model that trades off precision for simple and efficient on-line computations. Cycle-level, full system simulator implementation and evaluation illustrates fast and accurate tracking of given temperature reference values, and compares favorably with fixed-gain controllers.

math.OC↗

arXiv2014

Infinitesimal Perturbation Analysis of Stochastic Hybrid Systems: Application to Congestion Management in Traffic-Light Intersections

This paper presents a new approach to congestion management at traffic-light intersections. The approach is based on controlling the relative lengths of red/green cycles in order to have the congestion level track a given reference. It uses an integral control with adaptive gains, designed to provide fast tracking and wide stability margins. The gains are inverse-proportional to the derivative of the plant-function with respect to the control parameter, and are computed by infinitesimal perturbation analysis. Convergence of this technique is shown to be robust with respect to modeling uncertainties, computing errors, and other random effects. The framework is presented in the setting of stochastic hybrid systems, and applied to a particular traffic-light model. This is but an initial study and hence the latter model is simple, but it captures some of the salient features of traffic-light processes. The paper concludes with comments on possible extensions of the proposed approach to traffic-light grids with realistic flow models.

math.OC↗