arXiv subjects

Hung V. Vu

Publications and source records attributed to Hung V. Vu.

3 recordsLinked to original sources

arXiv2022

Reinforcement Learning based Multi-connectivity Resource Allocation in Factory Automation Systems

We propose joint user association, channel assignment and power allocation for mobile robot Ultra-Reliable and Low Latency Communications (URLLC) based on multi-connectivity and reinforcement learning. The mobile robots require control messages from the central guidance system at regular intervals. We use a two-phase communication scheme where robots can form multiple clusters. The robots in a cluster are close to each other and can have reliable Device-to-Device (D2D) communications. In Phase I, the APs transmit the combined payload of a cluster to the cluster leader within a latency constraint. The cluster leader broadcasts this message to its members in Phase II. We develop a distributed Multi-Agent Reinforcement Learning (MARL) algorithm for joint user association and resource allocation (RA) for Phase I. The cluster leaders use their local Channel State Information (CSI) to decide the APs for connection along with the sub-band and power level. The cluster leaders utilize multi-connectivity to connect to multiple APs to increase their reliability. The objective is to maximize the successful payload delivery probability for all robots. Illustrative simulation results indicate that the proposed scheme can approach the performance of the centralized algorithm and offer a substantial gain in reliability as compared to single-connectivity (when cluster leaders are able to connect to 1 AP).

eess.SP↗

arXiv2022

Multi-Agent Reinforcement Learning for Channel Assignment and Power Allocation in Platoon-Based C-V2X Systems

We consider the problem of joint channel assignment and power allocation in underlaid cellular vehicular-to-everything (C-V2X) systems where multiple vehicle-to-network (V2N) uplinks share the time-frequency resources with multiple vehicle-to-vehicle (V2V) platoons that enable groups of connected and autonomous vehicles to travel closely together. Due to the nature of high user mobility in vehicular environment, traditional centralized optimization approach relying on global channel information might not be viable in C-V2X systems with large number of users. Utilizing a multi-agent reinforcement learning (RL) approach, we propose a distributed resource allocation (RA) algorithm to overcome this challenge. Specifically, we model the RA problem as a multi-agent system. Based solely on the local channel information, each platoon leader, acting as an agent, collectively interacts with each other and accordingly selects the optimal combination of sub-band and power level to transmit its signals. Toward this end, we utilize the double deep Q-learning algorithm to jointly train the agents under the objectives of simultaneously maximizing the sum-rate of V2N links and satisfying the packet delivery probability of each V2V link in a desired latency limitation. Simulation results show that our proposed RL-based algorithm provides a close performance compared to that of the well-known exhaustive search algorithm.

eess.SP↗

arXiv2020

Underlaid FD D2D Communications in Massive MIMO Systems via Joint Beamforming and Power Allocation

This paper studies the benefits of incorporating underlaid full-duplex (FD) device-to-device (D2D) communications into massive multiple-input-multiple-output (MIMO) downlink systems. Due to the nature of cellular downlink and FD D2D transmission, the performances of cellular and D2D services are severely impaired due to high interference caused by base-stations (BSs) and D2D transceivers. As a consequence, integrating a large number of D2D links into exiting cellular networks might degrade the system performances. To overcome this challenge, utilizing the large uniform linear array (ULA) equipped at BSs, we propose a joint beamforming and power allocation design for average sum-rate maximization while considering the effects of interference to both cellular and D2D transmission. The problem formulation leads to a nonconvex vector-variable optimization problem, where we develop an efficient solution using a fractional programming (FP) based approach. Numerical results show that, at sufficiently high self-interference cancellation (SIC) levels and numbers of active D2D links, the FD D2D transmission provides a significant sum-rate improvement as compared to the half-duplex (HD) counterpart and pure cellular systems in absence of D2D.

eess.SP↗