SearcharxivSearch

arXiv subjects

R. Eddie Wilson

Publications and source records attributed to R. Eddie Wilson.

3 recordsLinked to original sources

Systematic Analyses of Reinforcement Learning Controllers in Signalized Urban Corridors

In this work, we extend our systematic capacity region perspective to multi-junction traffic networks, focussing on the special case of an urban corridor network. In particular, we train and evaluate centralized, fully decentralized, and parameter-sharing decentralized RL controllers, and compare their capacity regions and ATTs together with a classical baseline MaxPressure controller. Further, we show how the parametersharing controller may be generalised to be deployed on a larger network than it was originally trained on. In this setting, we show some initial findings that suggest that even though the junctions are not formally coordinated, traffic may self organise into `green waves'.

cs.AI

Agent swarms: cooperation and coordination under stringent communications constraint

Here we consider the communications tactics appropriate for a group of agents that need to "swarm" together in a highly adversarial environment. Specfically, whilst they need to cooperate by exchanging information with each other about their location and their plans; at the same time they also need to keep such communications to an absolute minimum. This might be due to a need for stealth, or otherwise be relevant to situations where communications are signficantly restricted. Complicating this process is that we assume each agent has (a) no means of passively locating others, (b) it must rely on being updated by reception of appropriate messages; and if no such update messages arrive, (c) then their own beliefs about other agents will gradually become out of date and increasingly inaccurate. Here we use a geometry-free multi-agent model that is capable of allowing for message-based information transfer between agents with different intrinsic connectivities, as would be present in a spatial arrangement of agents. We present agent-centric performance metrics that require only minimal assumptions, and show how simulated outcome distributions, risks, and connectivities depend on the ratio of information gain to loss. We also show that checking for too-long round-trip times can be an effective minimal-information filter for determining which agents to no longer target with messages.

cs.MA

Reconstructing the Traffic State by Fusion of Heterogeneous Data

We present an advanced interpolation method for estimating smooth spatiotemporal profiles for local highway traffic variables such as flow, speed and density. The method is based on stationary detector data as typically collected by traffic control centres, and may be augmented by floating car data or other traffic information. The resulting profiles display transitions between free and congested traffic in great detail, as well as fine structures such as stop-and-go waves. We establish the accuracy and robustness of the method and demonstrate three potential applications: 1. compensation for gaps in data caused by detector failure; 2. separation of noise from dynamic traffic information; and 3. the fusion of floating car data with stationary detector data.

physics.data-an