arXiv subjects

Majid Bavand

Publications and source records attributed to Majid Bavand.

29 records · Page 2Linked to original sources

arXiv2023

On-Device Intelligence for 5G RAN: Knowledge Transfer and Federated Learning enabled UE-Centric Traffic Steering

Traffic steering (TS) is a promising approach to support various service requirements and enhance transmission reliability by distributing network traffic loads to appropriate base stations (BSs). In conventional cell-centric TS strategies, BSs make TS decisions for all user equipment (UEs) in a centralized manner, which focuses more on the overall performance of the whole cell, disregarding specific requirements of individual UE. The flourishing machine learning technologies and evolving UE-centric 5G network architecture have prompted the emergence of new TS technologies. In this paper, we propose a knowledge transfer and federated learning-enabled UE-centric (KT-FLUC) TS framework for highly dynamic 5G radio access networks (RAN). Specifically, first, we propose an attention-weighted group federated learning scheme. It enables intelligent UEs to make TS decisions autonomously using local models and observations, and a global model is defined to coordinate local TS decisions and share experiences among UEs. Secondly, considering the individual UE's limited computation and energy resources, a growing and pruning-based model compression method is introduced, mitigating the computation burden of UEs and reducing the communication overhead of federated learning. In addition, we propose a Q-value-based knowledge transfer method to initialize newcomer UEs, achieving a jump start for their training efficiency. Finally, the simulations show that our proposed KT-FLUC algorithm can effectively improve the service quality, achieving 65\% and 38\% lower delay and 52% and 57% higher throughput compared with cell-based TS and other UE-centric TS strategies, respectively.

cs.NI↗

arXiv2023

Distributed Attacks over Federated Reinforcement Learning-enabled Cell Sleep Control

Federated learning (FL) is particularly useful in wireless networks due to its distributed implementation and privacy-preserving features. However, as a distributed learning system, FL can be vulnerable to malicious attacks from both internal and external sources. Our work aims to investigate the attack models in a FL-enabled wireless networks. Specifically, we consider a cell sleep control scenario, and apply federated reinforcement learning to improve energy-efficiency. We design three attacks, namely free rider attacks, Byzantine data poisoning attacks and backdoor attacks. The simulation results show that the designed attacks can degrade the network performance and lead to lower energy-efficiency. Moreover, we also explore possible ways to mitigate the above attacks. We design a defense model called refined-Krum to defend against attacks by enabling a secure aggregation on the global server. The proposed refined- Krum scheme outperforms the existing Krum scheme and can effectively prevent wireless networks from malicious attacks, improving the system energy-efficiency performance.

cs.NI↗

arXiv2023

Intent-driven Intelligent Control and Orchestration in O-RAN Via Hierarchical Reinforcement Learning

rApps and xApps need to be controlled and orchestrated well in the open radio access network (O-RAN) so that they can deliver a guaranteed network performance in a complex multi-vendor environment. This paper proposes a novel intent-driven intelligent control and orchestration scheme based on hierarchical reinforcement learning (HRL). The proposed scheme can orchestrate multiple rApps or xApps according to the operator's intent of optimizing certain key performance indicators (KPIs), such as throughput, energy efficiency, and latency. Specifically, we propose a bi-level architecture with a meta-controller and a controller. The meta-controller provides the target performance in terms of KPIs, while the controller performs xApp orchestration at the lower level. Our simulation results show that the proposed HRL-based intent-driven xApp orchestration mechanism achieves 7.5% and 21.4% increase in average system throughput with respect to two baselines, i.e., a single xApp baseline and a non-machine learning-based algorithm, respectively. Similarly, 17.3% and 37.9% increase in energy efficiency are observed in comparison to the same baselines.

cs.NI↗

arXiv2023

Beam Selection for Energy-Efficient mmWave Network Using Advantage Actor Critic Learning

The growing adoption of mmWave frequency bands to realize the full potential of 5G, turns beamforming into a key enabler for current and next-generation wireless technologies. Many mmWave networks rely on beam selection with Grid-of-Beams (GoB) approach to handle user-beam association. In beam selection with GoB, users select the appropriate beam from a set of pre-defined beams and the overhead during the beam selection process is a common challenge in this area. In this paper, we propose an Advantage Actor Critic (A2C) learning-based framework to improve the GoB and the beam selection process, as well as optimize transmission power in a mmWave network. The proposed beam selection technique allows performance improvement while considering transmission power improves Energy Efficiency (EE) and ensures the coverage is maintained in the network. We further investigate how the proposed algorithm can be deployed in a Service Management and Orchestration (SMO) platform. Our simulations show that A2C-based joint optimization of beam selection and transmission power is more effective than using Equally Spaced Beams (ESB) and fixed power strategy, or optimization of beam selection and transmission power disjointly. Compared to the ESB and fixed transmission power strategy, the proposed approach achieves more than twice the average EE in the scenarios under test and is closer to the maximum theoretical EE.

eess.SP↗

arXiv2023

Hierarchical Reinforcement Learning Based Traffic Steering in Multi-RAT 5G Deployments

In 5G non-standalone mode, an intelligent traffic steering mechanism can vastly aid in ensuring smooth user experience by selecting the best radio access technology (RAT) from a multi-RAT environment for a specific traffic flow. In this paper, we propose a novel load-aware traffic steering algorithm based on hierarchical reinforcement learning (HRL) while satisfying diverse QoS requirements of different traffic types. HRL can significantly increase system performance using a bi-level architecture having a meta-controller and a controller. In our proposed method, the meta-controller provides an appropriate threshold for load balancing, while the controller performs traffic admission to an appropriate RAT in the lower level. Simulation results show that HRL outperforms a Deep Q-Learning (DQN) and a threshold-based heuristic baseline with 8.49%, 12.52% higher average system throughput and 27.74%, 39.13% lower network delay, respectively.

cs.NI↗

arXiv2023

Hierarchical Deep Q-Learning Based Handover in Wireless Networks with Dual Connectivity

5G New Radio proposes the usage of frequencies above 10 GHz to speed up LTE's existent maximum data rates. However, the effective size of 5G antennas and consequently its repercussions in the signal degradation in urban scenarios makes it a challenge to maintain stable coverage and connectivity. In order to obtain the best from both technologies, recent dual connectivity solutions have proved their capabilities to improve performance when compared with coexistent standalone 5G and 4G technologies. Reinforcement learning (RL) has shown its huge potential in wireless scenarios where parameter learning is required given the dynamic nature of such context. In this paper, we propose two reinforcement learning algorithms: a single agent RL algorithm named Clipped Double Q-Learning (CDQL) and a hierarchical Deep Q-Learning (HiDQL) to improve Multiple Radio Access Technology (multi-RAT) dual-connectivity handover. We compare our proposal with two baselines: a fixed parameter and a dynamic parameter solution. Simulation results reveal significant improvements in terms of latency with a gain of 47.6% and 26.1% for Digital-Analog beamforming (BF), 17.1% and 21.6% for Hybrid-Analog BF, and 24.7% and 39% for Analog-Analog BF when comparing the RL-schemes HiDQL and CDQL with the with the existent solutions, HiDQL presented a slower convergence time, however obtained a more optimal solution than CDQL. Additionally, we foresee the advantages of utilizing context-information as geo-location of the UEs to reduce the beam exploration sector, and thus improving further multi-RAT handover latency results.

cs.NI↗

arXiv2023

Traffic Steering for 5G Multi-RAT Deployments using Deep Reinforcement Learning

In 5G non-standalone mode, traffic steering is a critical technique to take full advantage of 5G new radio while optimizing dual connectivity of 5G and LTE networks in multiple radio access technology (RAT). An intelligent traffic steering mechanism can play an important role to maintain seamless user experience by choosing appropriate RAT (5G or LTE) dynamically for a specific user traffic flow with certain QoS requirements. In this paper, we propose a novel traffic steering mechanism based on Deep Q-learning that can automate traffic steering decisions in a dynamic environment having multiple RATs, and maintain diverse QoS requirements for different traffic classes. The proposed method is compared with two baseline algorithms: a heuristic-based algorithm and Q-learningbased traffic steering. Compared to the Q-learning and heuristic baselines, our results show that the proposed algorithm achieves better performance in terms of 6% and 10% higher average system throughput, and 23% and 33% lower network delay, respectively.

cs.NI↗

arXiv2023

Hierarchical Reinforcement Learning for RIS-Assisted Energy-Efficient RAN

Reconfigurable intelligent surface (RIS) is emerging as a promising technology to boost the energy efficiency (EE) of 5G beyond and 6G networks. Inspired by this potential, in this paper, we investigate the RIS-assisted energy-efficient radio access networks (RAN). In particular, we combine RIS with sleep control techniques, and develop a hierarchical reinforcement learning (HRL) algorithm for network management. In HRL, the meta-controller decides the on/off status of the small base stations (SBSs) in heterogeneous networks, while the sub-controller can change the transmission power levels of SBSs to save energy. The simulations show that the RIS-assisted sleep control can achieve significantly lower energy consumption, higher throughput, and more than doubled energy efficiency than no-RIS conditions.

eess.SP↗

arXiv2017

User Selection and Widely Linear Multiuser Precoding for One-dimensional Signalling

Massive deployment of low data rate Internet of things and ehealth devices prompts us to develop more practical precoding and user selection techniques that comply with these requirements. Moreover, it is known that when the data is real-valued and the observation is complex-valued, widely linear (WL) estimation can be employed in lieu of linear estimation to improve the performance. With these motivations, in this paper, we study the transmit precoding (beamforming) in multiuser multiple-input single-output communications systems assuming the transmit signal is one-dimensionally modulated and widely linear estimation is performed at the receivers. Closed-form solutions for widely linear maximum ratio transmission (MRT), WL zero-forcing (ZF), WL minimum mean square error (MMSE), and WL maximum signal to leakage and noise ratio (MSLNR) precoding are obtained. It is shown that widely linear processing can potentially double the number of simultaneous users compared to the linear processing of one-dimensionally modulated signals. Furthermore, to deal with the increasing number of communications devices a user selection algorithm compatible with widely linear processing of one-dimensionally modulated signals is proposed. The proposed user selection algorithm can double the number of simultaneously selected users compared to conventional user selection methods.

cs.IT↗

arXiv2017

Maximum Signal Minus Interference to Noise Ratio Multiuser Receive Beamforming

Motivated by massive deployment of low data rate Internet of things (IoT) and ehealth devices with requirement for highly reliable communications, this paper proposes receive beamforming techniques for the uplink of a single-input multiple-output (SIMO) multiple access channel (MAC), based on a per-user probability of error metric and one-dimensional signalling. Although beamforming by directly minimizing probability of error (MPE) has potential advantages over classical beamforming methods such as zero-forcing and minimum mean square error beamforming, MPE beamforming results in a non-convex and a highly nonlinear optimization problem. In this paper, by adding a set of modulation-based constraints, the MPE beamforming problem is transformed into a convex programming problem. Then, a simplified version of the MPE beamforming is proposed which reduces the exponential number of constraints in the MPE beamforming problem. The simplified problem is also shown to be a convex programming problem. The complexity of the simplified problem is further reduced by minimizing a convex function which serves as an upper bound on the error probability. Minimization of this upper bound results in the introduction of a new metric, which is termed signal minus interference to noise ratio (SMINR). It is shown that maximizing SMINR leads to a closed-form expression for beamforming vectors as well as improved performance over existing beamforming methods.

cs.IT↗

arXiv2016

Modulation-Specific Multiuser Transmit Precoding and User Selection for BPSK Signalling

Motivated by challenges to existing multiuser transmission methods in a low signal to noise ratio (SNR) regime, and emergence of massive numbers of low data rate ehealth and internet of things (IoT) devices, in this paper we show that it is beneficial to incorporate knowledge of modulation type into multiuser transmit precoder design. Particularly, we propose a transmit precoding (beamforming) specific to BPSK modulation, which has maximum power efficiency and capacity in poor channel conditions. To be more specific, in a multiuser scenario, an objective function is formulated based on the weighted sum of error probabilities of BPSK modulated users. Convex optimization is used to transform and solve this ill-behaved non-convex minimum probability of error (MPE) precoding problem. Numerical results confirm significant performance improvement. We then develop a low-complexity user selection algorithm for MPE precoding. Based on line packing principles in Grassmannian manifolds, the number of supported users is able to exceed the number of transmit antennas, and hence the proposed approach is able to support more simultaneous users compared with existing multiuser transmit precoding methods.

cs.IT↗