Throughput-Optimal Random Access: A Queueing-Theoretical Analysis for Learning-Based Access Design

Abstract

Random access networks have long been observed to suffer from low throughput if nodes' access strategy is not properly designed. To improve the throughput performance, learning-based approaches, with which each node learns from the observations and experience to determine its own access strategy, have shown immense potential, but are often designed empirically due to the lack of theoretical guidance. As we will demonstrate in this paper, the queueing-theoretical analysis can be leveraged as a powerful tool for optimal design of learning-based access. Specifically, based on a Multi-Armed-Bandit (MAB) framework, two random access schemes, MTOA-L with local rewards and MTOA-G with global rewards, are proposed for throughput optimization. Though both can achieve the maximum throughput of 1, they have different short-term fairness performance. Through identifying the access strategies learned via MTOA-L and MTOA-G and feeding them into the proposed unified queueing-theoretical framework, the throughput-fairness tradeoff of each is characterized and optimized by properly tuning the key parameters. The comparison of the optimal tradeoffs shows that MTOA-G is much superior to MTOA-L especially when the number of nodes is large.