Searcharxiv⌕ Search
Home/Archive/arXiv

arXiv · 2610.42068

RAMA: Retrieval-Augmented Multi-Agent Routing with Episodic Memory for LEO Satellite Networks

Xin Ming Li·Peng Hu
View original source ↗Read source document ↗Export metadata ↓

Abstract

Low-Earth orbit (LEO) satellite networks present a challenging routing environment due to rapidly changing topology, traffic, and link conditions. Existing deep reinforcement learning (DRL) routing methods typically rely on current observations and information encoded in network weights, limiting their ability to exploit successful past experiences. We propose RAMA, a retrieval-augmented multi-agent DRL framework with Approximate Information State (AIS), in which each satellite combines its local observation, recent routing history, neighboring state information, and retrieved entries from a per-satellite episodic memory. Retrieved experiences are integrated through a Transformer-based decision network trained with AIS-based auxiliary objectives. With weights frozen in a 140-satellite Kepler constellation, RAMA reduces mean end-to-end latency by 13.4% and 99th-percentile latency by 66.7% relative to the state-of-theart double deep Q-network (DDQN) routing method, mainly by avoiding long detours. Updated online, RAMA remains stable while DDQN degrades. On the 1,584-satellite Starlink shell 1, the reduction in mean latency grows to 93.2%, and updating RAMA online lowers its mean latency by a further 25.5%. These results demonstrate the effectiveness of retrieval-augmented memory for scalable decentralized routing in LEO satellite networks.

Explore related subjects

cs.NIcs.LG

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Xin Ming Li, Peng Hu. 2026-10-30. RAMA: Retrieval-Augmented Multi-Agent Routing with Episodic Memory for LEO Satellite Networks. https://arxiv.org/abs/2610.42068

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Which Deep Learner? A Systematic Evaluation of Advanced Deep Forecasting Models Accuracy and Efficiency for Network Traffic Prediction

Network traffic prediction is an essential tool for automating modern network management. It is a difficult time series forecasting (TSF) problem that has been addressed by Deep Learning (DL) models due to their ability to capture complex patterns. Recent years have witnessed advances in deep forecasting models, from sophisticated transformer architectures to simple linear models, improving performance across diverse prediction tasks. However, given the diversity of these models, the variability of network traffic across environments and timescales, and the inherent challenges of network traffic prediction, it is essential to identify effective deployment choices and modeling directions. Henceforth, this study systematically identifies 12 deep forecasting models, comprising 8 advanced TSF models and 4 traditional deep learning architectures -- each with unique advantages for network traffic prediction -- against 3 statistical baselines, for a total of 15 forecasting methods and evaluate them on four real traffic datasets, across multiple time scales and horizons, assessing performance, robustness to anomalies, data gaps, external factors, data efficiency, and resource efficiency in terms of time, memory, and energy. Our results provide insights into model behaviour and guidelines for network management, highlighting performance regimes, efficiency thresholds, and promising architectures that balance accuracy, efficiency, and robustness to traffic challenges.

cs.NI↗
arXiv2026

ORCHID: Fairness-Aware Orchestration in Mission-Critical Air-Ground Integrated Networks

Uncrewed Aerial Vehicles (UAVs) provide on-demand wireless coverage for mission-critical Air-Ground Integrated Networks (AGINs). However, DRL-based orchestration faces challenges from multi-agent non-stationarity and the trade-off between energy efficiency (EE) and service fairness. To address these issues, we propose ORCHID (Orchestration of Resilient Coverage via Hybrid Intelligent Deployment), a stability-enhanced two-stage learning framework. First, GBS-aware topology partitioning provides a topology-informed warm start for UAV deployment. Second, a Reset-and-Finetune (R\&F) mechanism is integrated into Multi-Agent Proximal Policy Optimization (MAPPO) to support stable late-stage policy refinement through event-triggered rollback and learning-rate adaptation. To study the efficiency-fairness trade-off, ORCHID employs a Max-Min Fairness (MMF)-oriented bandwidth allocation based on a closed-form Egalitarian Bargaining Game (EBG) solution and is compared with Proportional Fairness (PF). Experiments show stronger served-user bottleneck-rate protection under MMF, together with competitive coverage and user-rate fairness and favorable energy-efficiency and UAV-load-balancing performance under zero-shot scalability and mobility tests. Overall, ORCHID provides an effective balance among user-level service protection, energy efficiency, and policy stability for resilient mission-critical UAV networks.

cs.NI↗
arXiv2026

Halley: A Predictive Control Plane for Optical AI Data Center Networks

A frontier AI model is trained in an AI data center, on tens of thousands of accelerators joined by a dedicated network, and every training step ends with all of them exchanging data at once. Between racks, that network is optical, and each of its four layers, from lasers to switches, runs a fixed or after-the-fact policy. Lasers sharing an enclosure, cooling, and power can fail together. At a fixed spare ratio, correlated failure provably caps a pool's availability however large it grows. In this paper, we present a comprehensive predictive control plane framework, called Halley, that reads each resource's next state and acts before the failure occurs. It has four components, each carrying a formal guarantee: LightReserve that sizes the laser pool to provide a coverage bound, FoldFit that schedules the switch within $11/9$ of the optimal, ThermaLead that holds a microring with one-step-ahead control, and TriageGuard that protects the highest-risk modules first. Halley gives each layer a predictive controller that defers to the deployed policy when unsure. Composed from simulations at that point, effective goodput, the share of ideal throughput kept, rises from 65.2\% to 76.5\% if a window that exhausts its spares is lost. If only the dark channels' bandwidth is lost, it reaches 67.4\%. Per megawatt, that is up to 1.03--1.17 times the training; for the same training, up to 3.3--14.7\% less data center capacity. \textsf{Halley}'s fallback circuits are formally verified and are shown to achieve close timing on a commercial FPGA, and pass a 130~nm signoff.

cs.NI↗