arXiv subjects

Jamal Daafouz

Publications and source records attributed to Jamal Daafouz.

28 records · Page 2Linked to original sources

arXiv2020

Studying Node Cooperation in Reputation Based Packet Forwarding within Mobile Ad hoc Networks

In the paradigm of mobile Ad hoc networks (MANET), forwarding packets originating from other nodes requires cooperation among nodes. However, as each node may not want to waste its energy, cooperative behavior can not be guaranteed. Therefore, it is necessary to implement some mechanism to avoid selfish behavior and to promote cooperation. In this paper, we propose a simple quid pro quo based reputation system, i.e., nodes that forward gain reputation, but lose more reputation if they do not forward packets from cooperative users (determined based on reputation), and lose less reputation when they chose to not forward packets from non-cooperative users. Under this framework, we model the behavior of users as an evolutionary game and provide conditions that result in cooperative behavior by studying the evolutionary stable states of the proposed game. Numerical analysis is provided to study the resulting equilibria and to illustrate how the proposed model performs compared to traditional models.

cs.NI↗

arXiv2020

When to stop value iteration: stability and near-optimality versus computation

Value iteration (VI) is a ubiquitous algorithm for optimal control, planning, and reinforcement learning schemes. Under the right assumptions, VI is a vital tool to generate inputs with desirable properties for the controlled system, like optimality and Lyapunov stability. As VI usually requires an infinite number of iterations to solve general nonlinear optimal control problems, a key question is when to terminate the algorithm to produce a "good" solution, with a measurable impact on optimality and stability guarantees. By carefully analysing VI under general stabilizability and detectability properties, we provide explicit and novel relationships of the stopping criterion's impact on near-optimality, stability and performance, thus allowing to tune these desirable properties against the induced computational cost. The considered class of stopping criteria encompasses those encountered in the control, dynamic programming and reinforcement learning literature and it allows considering new ones, which may be useful to further reduce the computational cost while endowing and satisfying stability and near-optimality properties. We therefore lay a foundation to endow machine learning schemes based on VI with stability and performance guarantees, while reducing computational complexity.

math.OC↗

arXiv2019

Optimistic planning for the near-optimal control of nonlinear switched discrete-time systems with stability guarantees

Originating in the artificial intelligence literature, optimistic planning (OP) is an algorithm that generates near-optimal control inputs for generic nonlinear discrete-time systems whose input set is finite. This technique is therefore relevant for the near-optimal control of nonlinear switched systems, for which the switching signal is the control. However, OP exhibits several limitations, which prevent its application in a standard control context. First, it requires the stage cost to take values in [0,1], an unnatural prerequisite as it excludes, for instance, quadratic stage costs. Second, it requires the cost function to be discounted. Third, it applies for reward maximization, and not cost minimization. In this paper, we modify OP to overcome these limitations, and we call the new algorithm OPmin. We then make stabilizability and detectability assumptions, under which we derive near-optimality guarantees for OPmin and we show that the obtained bound has major advantages compared to the bound originally given by OP. In addition, we prove that a system whose inputs are generated by OPmin in a receding-horizon fashion exhibits stability properties. As a result, OPmin provides a new tool for the near-optimal, stable control of nonlinear switched discrete-time systems for generic cost functions.

math.OC↗

arXiv2017

Stability analysis of a general class of singularly perturbed linear hybrid systems

Motivated by a real problem in steel production, we introduce and analyze a general class of singularly perturbed linear hybrid systems with both switches and impulses, in which the slow or fast nature of the variables can be mode-dependent. This means that, at switching instants, some of the slow variables can become fast and vice-versa. Firstly, we show that using a mode-dependent variable reordering we can rewrite this class of systems in a form in which the variables preserve their nature over time. Secondly, we establish, through singular perturbation techniques, an upper bound on the minimum dwell-time ensuring the overall system's stability. Remarkably, this bound is the sum of two terms. The first term corresponds to an upper bound on the minimum dwell-time ensuring the stability of the reduced order linear hybrid system describing the slow dynamics. The order of magnitude of the second term is determined by that of the parameter defining the ratio between the two time-scales of the singularly perturbed system. We show that the proposed framework can also take into account the change of dimension of the state vector at switching instants. Numerical illustrations complete our study.

eess.SY↗

arXiv2015

Minimizing the impact of EV charging on the electricity distribution network

The main objective of this paper is to design electric vehicle (EV) charging policies which minimize the impact of charging on the electricity distribution network (DN). More precisely, the considered cost function results from a linear combination of two parts: a cost with memory and a memoryless cost. In this paper, the first component is identified to be the transformer ageing while the second one corresponds to distribution Joule losses. First, we formulate the problem as a non-trivial discrete-time optimal control problem with finite time horizon. It is non-trivial because of the presence of saturation constraints and a non-quadratic cost. It turns out that the system state, which is the transformer hot-spot (HS) temperature here, can be expressed as a function of the sequence of control variables; the cost function is then seen to be convex in the control for typical values for the model parameters. The problem of interest thus becomes a standard optimization problem. While the corresponding problem can be solved by using available numerical routines, three distributed charging policies are provided. The motivation is threefold: to decrease the computational complexity; to model the important scenario where the charging profile is chosen by the EV itself; to circumvent the allocation problem which arises with the proposed formulation. Remarkably, the performance loss induced by decentralization is verified to be small through simulations. Numerical results show the importance of the choice of the charging policies. For instance, the gain in terms of transformer lifetime can be very significant when implementing advanced charging policies instead of plug-and-charge policies. The impact of the accuracy of the non-EV demand forecasting is equally assessed.

math.OC↗

arXiv2014

Modal occupation measures and LMI relaxations for nonlinear switched systems control

This paper presents a linear programming approach for the optimal control of nonlinear switched systems where the control is the switching sequence. This is done by introducing modal occupation measures, which allow to relax the problem as a primal linear programming (LP) problem. Its dual linear program of Hamilton-Jacobi-Bellman inequalities is also characterized. The LPs are then solved numerically with a converging hierarchy of primal-dual moment-sum-of-squares (SOS) linear matrix inequalities (LMI). Because of the special structure of switched systems, we obtain a much more efficient method than could be achieved by applying standard moment/SOS LMI hierarchies for general optimal control problems.

math.OC↗

arXiv2014

Co-design of output feedback laws and event-triggering conditions for linear systems

We present a procedure to simultaneously design the output feedback law and the event-triggering condition to stabilize linear systems. The closed-loop system is shown to satisfy a global asymptotic stability property and the existence of a strictly positive minimum amount of time between two transmissions is guaranteed. The event-triggered controller is obtained by solving linear matrix inequalities (LMIs). We then exploit the flexibility of the method to maximize the guaranteed minimum amount of time between two transmissions. Finally, we provide a (heuristic) method to reduce the amount of transmissions, which is supported by numerical simulations.

eess.SY↗

arXiv2014

Event-triggered control of nonlinear singularly perturbed systems based only on the slow dynamics

Controllers are often designed based on a reduced or simplified model of the plant dynamics. In this context, we investigate whether it is possible to synthesize a stabilizing event-triggered feedback law for networked control systems (NCS) which have two time-scales, based only on an approximate model of the slow dynamics. We follow an emulation-like approach as we assume that we know how to solve the problem in the absence of sampling and then we study how to design the event-triggering rule under communication constraints. The NCS is modeled as a hybrid singularly perturbed system which exhibits the feature to generate jumps for both the fast variable and the error variable induced by the sampling. The first conclusion is that a triggering law which guarantees the stability and the existence of a uniform minimum amount of time between two transmissions for the slow model may not ensure the existence of such a time for the overall system, which makes the controller not implementable in practice. The objective of this contribution is twofold. We first show that existing event-triggering conditions can be adapted to singularly perturbed systems and semiglobal practical stability can be ensured in this case. Second, we propose another technique that combines event-triggered and time-triggered results in the sense that transmissions are only allowed after a predefined amount of time has elapsed since the last transmission. This technique has the advantage, under an additional assumption, to ensure a global asymptotic stability property and to allow the user to directly tune the minimum inter-transmission interval. We believe that this technique is of its own interest independently of the two-time scale nature of the addressed problem. The results are shown to be applicable to a class of globally Lipschitz systems.

eess.SY↗

arXiv2014

Stabilization of nonlinear systems using event-triggered output feedback controllers

The objective is to design output feedback event-triggered controllers to stabilize a class of nonlinear systems. One of the main difficulties of the problem is to ensure the existence of a minimum amount of time between two consecutive transmissions, which is essential in practice. We solve this issue by combining techniques from event-triggered and time-triggered control. The idea is to turn on the event-triggering mechanism only after a fixed amount of time has elapsed since the last transmission. This time is computed based on results on the stabilization of time-driven sampled-data systems. The overall strategy ensures an asymptotic stability property for the closed-loop system. The results are proved to be applicable to linear time-invariant (LTI) systems as a particular case.

eess.SY↗

arXiv2013

Optimal switching control design for polynomial systems: an LMI approach

We propose a new LMI approach to the design of optimal switching sequences for polynomial dynamical systems with state constraints. We formulate the switching design problem as an optimal control problem which is then relaxed to a linear programming (LP) problem in the space of occupation measures. This infinite-dimensional LP can be solved numerically and approximately with a hierarchy of convex finite-dimensional LMIs. In contrast with most of the existing work on LMI methods, we have a guarantee of global optimality, in the sense that we obtain an asympotically converging (i.e. with vanishing conservatism) hierarchy of lower bounds on the achievable performance. We also explain how to construct an almost optimal switching sequence.

math.OC↗