arXiv subjects

Dongning Guo

Publications and source records attributed to Dongning Guo.

At least 37 records · Page 2Linked to original sources

arXiv2020

Deep Reinforcement Learning for Joint Spectrum and Power Allocation in Cellular Networks

A wireless network operator typically divides the radio spectrum it possesses into a number of subbands. In a cellular network those subbands are then reused in many cells. To mitigate co-channel interference, a joint spectrum and power allocation problem is often formulated to maximize a sum-rate objective. The best known algorithms for solving such problems generally require instantaneous global channel state information and a centralized optimizer. In fact those algorithms have not been implemented in practice in large networks with time-varying subbands. Deep reinforcement learning algorithms are promising tools for solving complex resource management problems. A major challenge here is that spectrum allocation involves discrete subband selection, whereas power allocation involves continuous variables. In this paper, a learning framework is proposed to optimize both discrete and continuous decision variables. Specifically, two separate deep reinforcement learning algorithms are designed to be executed and trained simultaneously to maximize a joint objective. Simulation results show that the proposed scheme outperforms both the state-of-the-art fractional programming algorithm and a previous solution based on deep reinforcement learning.

eess.SP↗

arXiv2020

Deep Actor-Critic Learning for Distributed Power Control in Wireless Mobile Networks

Deep reinforcement learning offers a model-free alternative to supervised deep learning and classical optimization for solving the transmit power control problem in wireless networks. The multi-agent deep reinforcement learning approach considers each transmitter as an individual learning agent that determines its transmit power level by observing the local wireless environment. Following a certain policy, these agents learn to collaboratively maximize a global objective, e.g., a sum-rate utility function. This multi-agent scheme is easily scalable and practically applicable to large-scale cellular networks. In this work, we present a distributively executed continuous power control algorithm with the help of deep actor-critic learning, and more specifically, by adapting deep deterministic policy gradient. Furthermore, we integrate the proposed power control algorithm to a time-slotted system where devices are mobile and channel conditions change rapidly. We demonstrate the functionality of the proposed algorithm using simulation results.

eess.SP↗

arXiv2020

Scheduling for Cellular Federated Edge Learning with Importance and Channel Awareness

In cellular federated edge learning (FEEL), multiple edge devices holding local data jointly train a neural network by communicating learning updates with an access point without exchanging their data samples. With very limited communication resources, it is beneficial to schedule the most informative local learning updates. In this paper, a novel scheduling policy is proposed to exploit both diversity in multiuser channels and diversity in the "importance" of the edge devices' learning updates. First, a new probabilistic scheduling framework is developed to yield unbiased update aggregation in FEEL. The importance of a local learning update is measured by its gradient divergence. If one edge device is scheduled in each communication round, the scheduling policy is derived in closed form to achieve the optimal trade-off between channel quality and update importance. The probabilistic scheduling framework is then extended to allow scheduling multiple edge devices in each communication round. Numerical results obtained using popular models and learning datasets demonstrate that the proposed scheduling policy can achieve faster model convergence and higher learning accuracy than conventional scheduling policies that only exploit a single type of diversity.

cs.IT↗

arXiv2020

Continuous-Time Analysis of the Bitcoin and Prism Backbone Protocols

Bitcoin is a peer-to-peer payment system proposed by Nakamoto in 2008. Based on the Nakamoto consensus, Bagaria, Kannan, Tse, Fanti, and Viswanath proposed the Prism protocol in 2018 and showed that it achieves near-optimal blockchain throughput while maintaining a similar level of security as bitcoin. Previous probabilistic security guarantees for the bitcoin and Prism backbone protocols were either established under a simplified discrete-time model or expressed in terms of exponential order results. This paper presents a streamlined and strengthened analysis under a more realistic continuous-time model. A fully rigorous model for blockchains is developed with no restrictions on adversarial miners except for an upper bound on their aggregate mining rate. The only assumption on the peer-to-peer network is that all block propagation delays are upper bounded by a constant. A new notion of "t-credible blockchains" is introduced, which, together with some carefully defined "typical" events concerning block production over time intervals, is crucial to establish probabilisitic security guarantees in continuous time. A blockchain growth theorem, a blockchain quality theorem, and a common prefix theorem are established with explicit probability bounds. Moreover, under a certain typical event which occurs with probability close to $1$, a valid transaction that is deep enough in one credible blockchain is shown to be permanent in the sense that it must be found in} in all future credible blockchains.

cs.CR↗

arXiv2020

A Resource Allocation and Coordinated Transmission Scheme for Large Cellular Networks

With the increasing number of user equipment (UE) and data demands, denser access points (APs) are being employed. Resource allocation problems have been extensively researched with interference treated as noise. It is well understood that the overall spectral efficiency can be significantly improved if multiple terminals coordinate their transmissions either coherently or non-coherently.The focus of this paper is to study how to select pairs of APs for coordination and allocate resources accordingly. An optimization problem is formulated to maximize the network utility function by optimizing AP paring, spectrum allocation, user association, and power management in a flexible manner. A scalable and efficient algorithm is proposed based on iterative scheme pursuit and fractional programming. Numerical results demonstrate substantial gains in the network utility due to coordinated transmission in a network of 128 APs and 384 UE.

cs.NI↗

arXiv2020

Massive Access in Multi-cell Wireless Networks Using Reed-Muller Codes

Providing connectivity to a massive number of devices is a key challenge in 5G wireless systems. In particular, it is crucial to develop efficient methods for active device identification and message decoding in a multi-cell network with fading and path loss uncertainties. In this paper, we design such a scheme using second-order Reed-Muller (RM) sequences. For given positive integer $m$, a codebook is generated with up to $2^{m(m+3)/2}$ codewords of length $2^m$, where each codeword is a unique RM sequence determined by a matrix-vector pair with binary entries. This allows every device to send $m(m+3)/2$ bits of information where an arbitrary number of these bits can be used to represent the identity of a node, and the remaining bits represent a message. There can be up to $2^{m(m+3)/2}$ devices in total. Using an iterative algorithm, an access point can estimate the matrix-vector pairs of each nearby device, as long as not too many devices transmit simultaneously. To improve the performance, we also describe an enhanced RM coding scheme with slotting. We show that both the computational complexity and the error performance of the latter algorithm exceed another state-of-the-art algorithm. The device identification and message decoding scheme developed in this work can serve as the basis for grant-free massive access for billions of devices with hundreds of simultaneously active devices in each cell.

cs.IT↗

arXiv2019

On Analysis of the Bitcoin and Prism Backbone Protocols

Bitcoin is a peer-to-peer payment system proposed by Nakamoto in 2008. Properties of the bitcoin backbone protocol have been investigated in some depth: the blockchain growth property quantifies the number of blocks added to the blockchain during any time intervals; the blockchain quality property ensures the honest miners always contribute at least a certain fraction of the blockchain; the common prefix property ensures if a block is deep enough, it will eventually be adopted by all honest miners with high probability. Following the spirit of decoupling various functionalities of the blockchain, the Prism protocol is proposed to dramatically improve the throughput while maintaining the same level of security. Prior analyses of the bitcoin and Prism backbone protocols assume the lifespan of blockchain is finite. This paper presents a streamlined and strengthened analysis without the finite horizon assumption. Specifically, the results include a blockchain growth property, a blockchain quality property, and a common prefix property of the bitcoin backbone protocol, as well as the liveness and persistence of the Prism backbone protocol regardless of whether the blockchains have a infinite lifespan. We also express the properties of bitcoin and Prism backbone protocols in explicit expressions rather than order optimal results, which lead to tighter bounds and practical references for public transaction ledger protocol design.

cs.CR↗

arXiv2019

Beam Acquisition and Training in Millimeter Wave Networks with Narrowband Pilots

This paper studies initial beam acquisition in a millimeter wave network consisting of multiple access points (APs) and mobile devices. A training protocol for joint estimation of transmit and receive beams is presented with a general frame structure consisting of an initial access sub-frame followed by data transmission sub-frames. During the initial subframe, APs and mobiles sweep through a set of beams and determine the best transmit and receive beams via a handshake. All pilot signals are narrowband (tones), and the mobiles are distinguished by their assigned pilot frequencies. Both non-coherent and coherent beam estimation methods based on, respectively, power detection and maximum likelihood (ML) are presented. To avoid exchanging information about beamforming vectors between APs and mobiles, a local maximum likelihood (LML) algorithm is also presented. An efficient fast Fourier transform implementation is proposed for ML and LML to achieve high-resolution. A system-level optimization is performed in which the frame length, training time, and training bandwidth are selected to maximize a rate objective taking into account blockage and mobility. Simulation results based on a realistic network topology are presented to compare the performance of different estimation methods and training codebooks, and demonstrate the effectiveness of the proposed protocol.

eess.SP↗

arXiv2019

Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks

This work demonstrates the potential of deep reinforcement learning techniques for transmit power control in wireless networks. Existing techniques typically find near-optimal power allocations by solving a challenging optimization problem. Most of these algorithms are not scalable to large networks in real-world scenarios because of their computational complexity and instantaneous cross-cell channel state information (CSI) requirement. In this paper, a distributively executed dynamic power allocation scheme is developed based on model-free deep reinforcement learning. Each transmitter collects CSI and quality of service (QoS) information from several neighbors and adapts its own transmit power accordingly. The objective is to maximize a weighted sum-rate utility function, which can be particularized to achieve maximum sum-rate or proportionally fair scheduling. Both random variations and delays in the CSI are inherently addressed using deep Q-learning. For a typical network architecture, the proposed algorithm is shown to achieve near-optimal power allocation in real time based on delayed CSI measurements available to the agents. The proposed scheme is especially suitable for practical scenarios where the system model is inaccurate and CSI delay is non-negligible.

eess.SP↗

arXiv2019

Dual-Timescale Spectrum Management in Small-Cell Wireless Networks

To attain the targeted data rates of next generation cellular networks requires dense deployment of small cells in addition to macro cells which provide wide coverage. Dynamic radio resource management is crucial to the success of such heterogeneous networks due to much more pronounced traffic and interference variations in small cells. This work proposes a framework for spectrum management organized according to two timescales, which include 1) centralized optimization on a moderate timescale corresponding to typical duration of user sessions (several seconds to minutes in today's networks), and 2) distributed spectrum allocation on a fast timescale corresponding to typical latency requirements (a few milliseconds). An optimization problem is formulated to allocate resources on the slower timescale with consideration of (distributed) opportunistic scheduling on the faster timescale. Both fixed and fully flexible user association schemes are considered. Iterative algorithms are developed to solve these optimization problems efficiently for a cluster of cells with guaranteed convergence. Simulation results demonstrate advantages of the proposed framework and algorithms.

cs.IT↗

arXiv2018

Asynchronous Neighbor Discovery Using Coupled Compressive Sensing

The neighbor discovery paradigm finds wide application in Internet of Things networks, where the number of active devices is orders of magnitude smaller than the total device population. Designing low-complexity schemes for asynchronous neighbor discovery has recently gained significant attention from the research community. Concurrently, a divide-and-conquer framework, referred to as coupled compressive sensing, has been introduced for the synchronous massive random access channel. This work adapts this novel algorithm to the problem of asynchronous neighbor discovery with unknown transmission delays. Simulation results suggest that the proposed scheme requires much fewer transmissions to achieve a performance level akin to that of state-of-the-art techniques.

eess.SP↗

arXiv2018

Joint Routing and Resource Allocation for Millimeter Wave Picocellular Backhaul

Picocellular architectures are essential for providing the spatial reuse required to satisfy the ever-increasing demand for mobile data. A key deployment challenge is to provide backhaul connections with sufficiently high data rate. Providing wired support (e.g., using optical fiber) to pico base stations deployed opportunistically on lampposts and rooftops is impractical, hence wireless backhaul becomes an attractive approach. A multihop mesh network comprised of directional millimeter wave links is considered here for this purpose. The backhaul design problem is formulated as one of joint routing and resource allocation, accounting for mutual interference across simultaneously active links. A computationally tractable formulation is developed by leveraging the localized nature of interference and the provable existence of a sparse optimal allocation. Numerical results are provided for millimeter (mm) wave mesh networks, which are well suited for scaling backhaul data rates due to abundance of spectrum, and the ability to form highly directional, electronically steerable beams.

eess.SP↗

arXiv2018

Large-Scale Spectrum Allocation for Cellular Networks via Sparse Optimization

This paper studies joint spectrum allocation and user association in large heterogeneous cellular networks. The objective is to maximize some network utility function based on given traffic statistics collected over a slow timescale, conceived to be seconds to minutes. A key challenge is scalability: interference across cells creates dependencies across the entire network, making the optimization problem computationally challenging as the size of the network becomes large. A suboptimal solution is presented, which performs well in networks consisting of one hundred access points (APs) serving several hundred user devices. This is achieved by optimizing over local overlapping neighborhoods, defined by interference conditions, and by exploiting the sparsity of a globally optimal solution. Specifically, with a total of $k$ user devices in the entire network, it suffices to divide the spectrum into $k$ segments, where each segment is mapped to a particular set, or pattern, of active APs within each local neighborhood. The problem is then to find a mapping of segments to patterns, and to optimize the widths of the segments. A convex relaxation is proposed for this, which relies on a re-weighted $\ell_1$ approximation of an $\ell_0$ constraint, and is used to enforce the mapping of a unique pattern to each spectrum segment. A distributed implementation based on alternating direction method of multipliers (ADMM) is also proposed. Numerical comparisons with benchmark schemes show that the proposed method achieves a substantial increase in achievable throughput and/or reduction in the average packet delay.

cs.IT↗

arXiv2018

A Centralized Metropolitan-Scale Radio Resource Management Scheme

This work studies centralized radio resource management in metropolitan area networks with a very large number of access points and user devices. A central controller collects time-averaged traffic and channel conditions from all access points and coordinates spectrum allocation, user association, and power control throughout the network on an appropriate timescale. The timescale is conceived to be seconds in today's networks, and it is likely to become faster in the future. The coordination problem in each time epoch is formulated as a network utility maximization problem, where any subset of access points may use any parts of the spectrum to serve any subsets of devices. It is proved that the network utility can be maximized by an extremely sparse spectrum allocation. By exploiting this sparsity, an efficient iterative algorithm with guaranteed convergence is developed, each iteration of which is performed in closed form. The proposed centralized optimization framework can incorporate a broad class of utility functions that account for weighted sum rates, average packet delay, and/or energy consumption, along with very general constraints on transmission powers. Numerical results demonstrate the feasibility of the algorithm for networks with up to 1,000 access points and several thousand devices. Moreover, the proposed scheme yields significantly improved throughput region and average packet delay comparing with several well-known competing schemes.

cs.IT↗

arXiv2017

Scalable Spectrum Allocation for Large Networks Based on Sparse Optimization

Joint allocation of spectrum and user association is considered for a large cellular network. The objective is to optimize a network utility function such as average delay given traffic statistics collected over a slow timescale. A key challenge is scalability: given $n$ Access Points (APs), there are $O(2^n)$ ways in which the APs can share the spectrum. The number of variables is reduced from $O(2^n)$ to $O(nk)$, where $k$ is the number of users, by optimizing over local overlapping neighborhoods, defined by interference conditions, and by exploiting the existence of sparse solutions in which the spectrum is divided into $k+1$ segments. We reformulate the problem by optimizing the assignment of subsets of active APs to those segments. An $\ell_0$ constraint enforces a one-to-one mapping of subsets to spectrum, and an iterative (reweighted $\ell_1$) algorithm is used to find an approximate solution. Numerical results for a network with 100 APs serving several hundred users show the proposed method achieves a substantial increase in total throughput relative to benchmark schemes.

cs.IT↗

arXiv2017

Capacity of Gaussian Many-Access Channels

Classical multiuser information theory studies the fundamental limits of models with a fixed (often small) number of users as the coding blocklength goes to infinity. This work proposes a new paradigm, referred to as {\em many-user information theory}, where the number of users is allowed to grow with the blocklength. This paradigm is motivated by emerging systems with a massive number of users in an area, such as machine-to-machine communication systems and sensor networks. The focus of the current paper is the {\em many-access} channel model, which consists of a single receiver and many transmitters, whose number increases unboundedly with the blocklength. Moreover, an unknown subset of transmitters may transmit in a given block and need to be identified. A new notion of capacity is introduced and characterized for the Gaussian many-access channel with random user activities. The capacity can be achieved by first detecting the set of active users and then decoding their messages.

cs.IT↗

arXiv2017

Sharing of Unlicensed Spectrum by Strategic Operators

Facing the challenge of meeting ever-increasing demand for wireless data, the industry is striving to exploit large swaths of spectrum which anyone can use for free without having to obtain a license. Major standards bodies are currently considering a proposal to retool and deploy Long Term Evolution (LTE) technologies in unlicensed bands below 6 GHz. This paper studies the fundamental questions of whether and how the unlicensed spectrum can be shared by intrinsically strategic operators without suffering from the tragedy of the commons. A class of general utility functions is considered. The spectrum sharing problem is formulated as a repeated game over a sequence of time slots. It is first shown that a simple static sharing scheme allows a given set of operators to reach a subgame perfect Nash equilibrium for mutually beneficial sharing. The question of how many operators will choose to enter the market is also addressed by studying an entry game. A sharing scheme which allows dynamic spectrum borrowing and lending between operators is then proposed to address time-varying traffic and proved to achieve perfect Bayesian equilibrium. Numerical results show that the proposed dynamic sharing scheme outperforms static sharing, which in turn achieves much higher revenue than uncoordinated full-spectrum sharing. Implications of the results to the standardization and deployment of LTE in unlicensed bands (LTE-U) are also discussed.

cs.IT↗

arXiv2017

Scalable Spectrum Allocation and User Association in Networks with Many Small Cells

A scalable framework is developed to allocate radio resources across a large number of densely deployed small cells with given traffic statistics on a slow timescale. Joint user association and spectrum allocation is first formulated as a convex optimization problem by dividing the spectrum among all possible transmission patterns of active access points (APs). To improve scalability with the number of APs, the problem is reformulated using local patterns of interfering APs. To maintain global consistency among local patterns, inter-cluster interaction is characterized as hyper-edges in a hyper-graph with nodes corresponding to neighborhoods of APs. A scalable solution is obtained by iteratively solving a convex optimization problem for bandwidth allocation with reduced complexity and constructing a global spectrum allocation using hyper-graph coloring. Numerical results demonstrate the proposed solution for a network with 100 APs and several hundred user equipments. For a given quality of service (QoS), the proposed scheme can increase the network capacity several fold compared to assigning each user to the strongest AP with full-spectrum reuse.

cs.IT↗