Searcharxiv⌕ Search
Home/Archive/arXiv

arXiv · 1410.4421

Decentralized Convergence to Nash Equilibria in Constrained Deterministic Mean Field Control

Sergio Grammatico·Francesca Parise·Marcello Colombino·John Lygeros
View original source ↗Read source document ↗Export metadata ↓

Abstract

This paper considers decentralized control and optimization methodologies for large populations of systems, consisting of several agents with different individual behaviors, constraints and interests, and affected by the aggregate behavior of the overall population. For such large-scale systems, the theory of aggregative and mean field games has been established and successfully applied in various scientific disciplines. While the existing literature addresses the case of unconstrained agents, we formulate deterministic mean field control problems in the presence of heterogeneous convex constraints for the individual agents, for instance arising from agents with linear dynamics subject to convex state and control constraints. We propose several model-free feedback iterations to compute in a decentralized fashion a mean field Nash equilibrium in the limit of infinite population size. We apply our methods to the constrained linear quadratic deterministic mean field control problem and to the constrained mean field charging control problem for large populations of plug-in electric vehicles.

Explore related subjects

eess.SYcs.GTcs.SYmath.OC

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Sergio Grammatico, Francesca Parise, Marcello Colombino, John Lygeros. 2015-05-17. Decentralized Convergence to Nash Equilibria in Constrained Deterministic Mean Field Control. https://doi.org/10.1109/tac.2015.2513368

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Cooperative Multi-Agent Assignment over Stochastic Graphs via Constrained Reinforcement Learning

Constrained multi-agent reinforcement learning offers the framework to design scalable and almost surely feasible solutions for teams of agents operating in dynamic environments to carry out conflicting tasks. We address the challenges of multi-agent coordination through an unconventional formulation in which the dual variables are not driven to convergence but are free to cycle, enabling agents to adapt their policies dynamically based on real-time constraint satisfaction levels. The coordination relies on a light single-bit communication protocol over a network with stochastic connectivity. Using this gossiped information, agents update local estimates of the dual variables. Furthermore, we modify the local dual dynamics by introducing a contraction factor, which lets us use finite communication buffers and keep the estimation error bounded. Under this model, we provide theoretical guarantees of almost sure feasibility and corroborate them with numerical experiments in which a team of robots successfully patrols multiple regions, communicating under a time-varying ad-hoc network.

eess.SY↗
arXiv2026

Which Top Energy-Intensive Manufacturing Countries Can Compete in a Renewable Energy Future?

In a world increasingly powered by renewables and aiming for greenhouse gas-neutral industrial production, the future competitiveness of todays top manufacturing countries is questioned. This study applies detailed energy system modeling to quantify the Renewable Pull, an incentive for industry relocation exerted by countries with favorable renewable conditions. Results reveal that the Renewable Pull is not a cross-industrial phenomenon but strongly depends on the relationship between energy costs and transport costs. The intensity of the Renewable Pull varies, with China, India, and Japan facing a significantly stronger effect than Germany and the United States. Incorporating national capital cost assumptions proves critical, reducing Germanys Renewable Pull by a factor of six and positioning it as the second least affected top manufacturing country after Saudi Arabia. Using Germany as a case study, the analysis moreover illustrates that targeted import strategies, especially within the EU, can nearly eliminate the Renewable Pull, offering policymakers clear options for risk mitigation.

eess.SY↗
arXiv2026

Certifying Frequency Stability for Systems with Line Dynamics and Heterogeneous Bus Dynamics

This work presents a framework for certifying small-signal frequency stability of a power system with line dynamics and heterogeneous bus dynamics. This framework can certify the stability of systems which include synchronous generators, synchronous condensers, and converter-interfaced resources with a wide range of controls. Moreover, it can do so without detailed or precise knowledge of the network topology. With this framework, we also provide a detailed analysis of how proportional-derivative (PD) droop can improve the stability margin of the frequency response. The stability certificates presented in this work, which extend prior results by incorporating line dynamics, provide insight into how the control parameters for different units in the system impact the overall frequency stability. While damper windings have long been understood to improve the frequency synchronization between machines, the dynamics of the damper windings are complex, making them difficult to analyze. To address this gap, this paper derives a novel reduced-order model of the damper windings in the form of a derivative droop term. Moreover, we show that derivative droop terms used in grid-forming (GFM) control can be understood as a form of damper winding emulation. Our analytical stability conditions highlight the importance of damper windings (or their emulation) in facilitating frequency synchronization and suppressing unstable interactions between GFM converters. These results are validated with electromagnetic-transient (EMT) simulation.

eess.SY↗