arXiv subjects

Lin X. Cai

Publications and source records attributed to Lin X. Cai.

At least 19 recordsLinked to original sources

arXiv2026

Near-Field Dual-UPA Communications: A Generalized Geometric Approach

This paper investigates a near-field (NF) multiple-input multiple-output (MIMO) communication system equipped with dual uniform planar arrays (UPAs). We first develop a generalized geometric model to calculate the 3D distance between arbitrary antenna elements across the transmitter and receiver panels. Leveraging the distance analysis, we derive a closed-form near-field to far-field (NF-FF) boundary for dual-UPA configurations. By exploiting the geometric structure of the UPAs, we further decompose the near-field channel matrix into a Kronecker-product of two lower-dimensional matrices. This decomposition enables a low-complexity NF beamforming design for achievable-rate maximization. Numerical results validate the analysis and demonstrate that the conventional Rayleigh distance is a special case of the generalized model. Furthermore, the proposed beamforming design achieves near-optimal rate performance while significantly reducing the computational complexity compared to state-of-the-art NF beamforming methods.

eess.SP↗

arXiv2026

Joint Beamforming Design and Port Selection in Fluid Antenna-Assisted Multi-Cell Networks: A Personalized Federated Learning Approach

This paper investigates joint beamforming and port selection in multi-cell fluid antenna-assisted (FAS) networks. In such networks, active beamforming and discrete FA port selection are coupled through intra-cell and inter-cell interference and are jointly optimized to maximize the weighted sum-rate (WSR). We develop a federated representation learning (FedRep) framework with a position-aware dual-branch deep neural network (PA-DNN). The PA-DNN uses channel state information and port positional encoding as inputs, and jointly outputs beamforming vectors and port selections through two task-specific branches. To support decentralized training across heterogeneous cells, the FedRep framework shares global beamforming-related parameters among base stations while keeping port-selection parameters local for cell-specific adaptation. Simulation results show that the proposed scheme achieves a higher weighted sum-rate than conventional FL and port-selection benchmark schemes.

cs.IT↗

arXiv2026

Hierarchical Reinforcement Learning for Next Generation of Multi-AP Coordinated Spatial Reuse

In next generation of Wi-Fi networks Multiple Access Point Coordination (MAPC) is poised to significantly enhance the network performance by enabling a set of Access Points (APs) to coordinate with each other through advanced coordinating schemes so that to reduce inter-AP contention and congestion. This paper focuses on defining a framework to facilitate the coordination across multi-APs when these employ Coordinated Spatial Reuse (C-SR). In this case, the coordinating APs may need to reciprocally adjust their scheduling strategy, power control and link adaptation to meet specific Quality of Service (QoS) requirements, which by using classical approaches leads to high overhead due to negotiations needed across APs, and requires complex solutions in order to properly optimize the network across all the parameters in play. In this matter, a two layer Multi-Armed Bandit (MAB) algorithm has been proposed to optimize such a network while preserving the fair use of resources across all nodes. The validity of this holistic approach is confirmed by system level simulations, which show that the proposed algorithm not only improves the network in terms of sum-throughput, but also allows to enhance fairness, making this a robust solution for next-generation of Wi-Fi networks.

cs.NI↗

arXiv2025

Cost Optimization for Serverless Edge Computing with Budget Constraints using Deep Reinforcement Learning

Serverless computing adopts a pay-as-you-go billing model where applications are executed in stateless and shortlived containers triggered by events, resulting in a reduction of monetary costs and resource utilization. However, existing platforms do not provide an upper bound for the billing model which makes the overall cost unpredictable, precluding many organizations from managing their budgets. Due to the diverse ranges of serverless functions and the heterogeneous capacity of edge devices, it is challenging to receive near-optimal solutions for deployment cost in a polynomial time. In this paper, we investigated the function scheduling problem with a budget constraint for serverless computing in wireless networks. Users and IoT devices are sending requests to edge nodes, improving the latency perceived by users. We propose two online scheduling algorithms based on reinforcement learning, incorporating several important characteristics of serverless functions. Via extensive simulations, we justify the superiority of the proposed algorithm by comparing with an ILP solver (Midaco). Our results indicate that the proposed algorithms efficiently approximate the results of Midaco within a factor of 1.03 while our decision-making time is 5 orders of magnitude less than that of Midaco.

cs.NI↗

arXiv2024

Context-aware Container Orchestration in Serverless Edge Computing

Adopting serverless computing to edge networks benefits end-users from the pay-as-you-use billing model and flexible scaling of applications. This paradigm extends the boundaries of edge computing and remarkably improves the quality of services. However, due to the heterogeneous nature of computing and bandwidth resources in edge networks, it is challenging to dynamically allocate different resources while adapting to the burstiness and high concurrency in serverless workloads. This article focuses on serverless function provisioning in edge networks to optimize end-to-end latency, where the challenge lies in jointly allocating wireless bandwidth and computing resources among heterogeneous computing nodes. To address this challenge, We devised a context-aware learning framework that adaptively orchestrates a wide spectrum of resources and jointly considers them to avoid resource fragmentation. Extensive simulation results justified that the proposed algorithm reduces over 95% of converge time while the end-to-end delay is comparable to the state of the art.

cs.NI↗

arXiv2024

Optimizing NOMA Transmissions to Advance Federated Learning in Vehicular Networks

Diverse critical data, such as location information and driving patterns, can be collected by IoT devices in vehicular networks to improve driving experiences and road safety. However, drivers are often reluctant to share their data due to privacy concerns. The Federated Vehicular Network (FVN) is a promising technology that tackles these concerns by transmitting model parameters instead of raw data, thereby protecting the privacy of drivers. Nevertheless, the performance of Federated Learning (FL) in a vehicular network depends on the joining ratio, which is restricted by the limited available wireless resources. To address these challenges, this paper proposes to apply Non-Orthogonal Multiple Access (NOMA) to improve the joining ratio in a FVN. Specifically, a vehicle selection and transmission power control algorithm is developed to exploit the power domain differences in the received signal to ensure the maximum number of vehicles capable of joining the FVN. Our simulation results demonstrate that the proposed NOMA-based strategy increases the joining ratio and significantly enhances the performance of the FVN.

cs.NI↗

arXiv2023

Flexible Base Station Sleeping and Resource Allocation for Green Uplink Fully-Decoupled RAN

The fully-decoupled radio access network (FD-RAN) is an innovative architecture designed for next-generation mobile communication networks, featuring decoupled control and data planes as well as separated uplink and downlink transmissions. To further enhance energy efficiency, this paper explores a green approach to FD-RAN by incorporating adaptive base station (BS) sleeping and resource allocation. First, we introduce a holistic power consumption model and formulate a energy efficiency maximization problem for FD-RAN, involving joint optimization of user equipment (UE) association, BS sleeping, and power control. Subsequently, the optimization problem is decomposed into two subproblems. The first subproblem, involving UE power control, is solved using a successive lower-bound maximization approach based on Dinkelbach's algorithm. The second subproblem, addressing UE association and BS sleeping, is tackled via a modified, low-complexity many-to-many swap matching algorithm. Extensive simulation results demonstrate the superior effectiveness of FD-RAN with our proposed algorithms, revealing the sources of energy efficiency gains.

cs.NI↗

arXiv2022

A Deep Reinforcement Learning based Approach for NOMA-based Random Access Network with Truncated Channel Inversion Power Control

As a main use case of 5G and Beyond wireless network, the ever-increasing machine type communications (MTC) devices pose critical challenges over MTC network in recent years. It is imperative to support massive MTC devices with limited resources. To this end, Non-orthogonal multiple access (NOMA) based random access network has been deemed as a prospective candidate for MTC network. In this paper, we propose a deep reinforcement learning (RL) based approach for NOMA-based random access network with truncated channel inversion power control. Specifically, each MTC device randomly selects a pre-defined power level with a certain probability for data transmission. Devices are using channel inversion power control yet subject to the upper bound of the transmission power. Due to the stochastic feature of the channel fading and the limited transmission power, devices with different achievable power levels have been categorized as different types of devices. In order to achieve high throughput with considering the fairness between all devices, two objective functions are formulated. One is to maximize the minimum long-term expected throughput of all MTC devices, the other is to maximize the geometric mean of the long-term expected throughput for all MTC devices. A Policy based deep reinforcement learning approach is further applied to tune the transmission probabilities of each device to solve the formulated optimization problems. Extensive simulations are conducted to show the merits of our proposed approach.

cs.NI↗

arXiv2021

Responsive Regulation of Dynamic UAV Communication Networks Based on Deep Reinforcement Learning

In this chapter, the regulation of Unmanned Aerial Vehicle (UAV) communication network is investigated in the presence of dynamic changes in the UAV lineup and user distribution. We target an optimal UAV control policy which is capable of identifying the upcoming change in the UAV lineup (quit or join-in) or user distribution, and proactively relocating the UAVs ahead of the change rather than passively dispatching the UAVs after the change. Specifically, a deep reinforcement learning (DRL)-based UAV control framework is developed to maximize the accumulated user satisfaction (US) score for a given time horizon which is able to handle the change in both the UAV lineup and user distribution. The framework accommodates the changed dimension of the state-action space before and after the UAV lineup change by deliberate state transition design. In addition, to handle the continuous state and action space, deep deterministic policy gradient (DDPG) algorithm, which is an actor-critic based DRL, is exploited. Furthermore, to promote the learning exploration around the timing of the change, the original DDPG is adapted into an asynchronous parallel computing (APC) structure which leads to a better training performance in both the critic and actor networks. Finally, extensive simulations are conducted to validate the convergence of the proposed learning approach, and demonstrate its capability in jointly handling the dynamics in UAV lineup and user distribution as well as its superiority over a passive reaction method.

eess.SY↗

arXiv2021

Data-Driven Random Access Optimization in Multi-Cell IoT Networks with NOMA

Non-orthogonal multiple access (NOMA) is a key technology to enable massive machine type communications (mMTC) in 5G networks and beyond. In this paper, NOMA is applied to improve the random access efficiency in high-density spatially-distributed multi-cell wireless IoT networks, where IoT devices contend for accessing the shared wireless channel using an adaptive p-persistent slotted Aloha protocol. To enable a capacity-optimal network, a novel formulation of random channel access management is proposed, in which the transmission probability of each IoT device is tuned to maximize the geometric mean of users' expected capacity. It is shown that the network optimization objective is high dimensional and mathematically intractable, yet it admits favourable mathematical properties that enable the design of efficient data-driven algorithmic solutions which do not require a priori knowledge of the channel model or network topology. A centralized model-based algorithm and a scalable distributed model-free algorithm, are proposed to optimally tune the transmission probabilities of IoT devices and attain the maximum capacity. The convergence of the proposed algorithms to the optimal solution is further established based on convex optimization and game-theoretic analysis. Extensive simulations demonstrate the merits of the novel formulation and the efficacy of the proposed algorithms.

cs.NI↗

arXiv2020

SREC: Proactive Self-Remedy of Energy-Constrained UAV-Based Networks via Deep Reinforcement Learning

Energy-aware control for multiple unmanned aerial vehicles (UAVs) is one of the major research interests in UAV based networking. Yet few existing works have focused on how the network should react around the timing when the UAV lineup is changed. In this work, we study proactive self-remedy of energy-constrained UAV networks when one or more UAVs are short of energy and about to quit for charging. We target at an energy-aware optimal UAV control policy which proactively relocates the UAVs when any UAV is about to quit the network, rather than passively dispatches the remaining UAVs after the quit. Specifically, a deep reinforcement learning (DRL)-based self remedy approach, named SREC-DRL, is proposed to maximize the accumulated user satisfaction scores for a certain period within which at least one UAV will quit the network. To handle the continuous state and action space in the problem, the state-of-the-art algorithm of the actor-critic DRL, i.e., deep deterministic policy gradient (DDPG), is applied with better convergence stability. Numerical results demonstrate that compared with the passive reaction method, the proposed SREC-DRL approach shows a $12.12\%$ gain in accumulative user satisfaction score during the remedy period.

cs.LG↗

arXiv2020

A Gradient-Aware Search Algorithm for Constrained Markov Decision Processes

The canonical solution methodology for finite constrained Markov decision processes (CMDPs), where the objective is to maximize the expected infinite-horizon discounted rewards subject to the expected infinite-horizon discounted costs constraints, is based on convex linear programming. In this brief, we first prove that the optimization objective in the dual linear program of a finite CMDP is a piece-wise linear convex function (PWLC) with respect to the Lagrange penalty multipliers. Next, we propose a novel two-level Gradient-Aware Search (GAS) algorithm which exploits the PWLC structure to find the optimal state-value function and Lagrange penalty multipliers of a finite CMDP. The proposed algorithm is applied in two stochastic control problems with constraints: robot navigation in a grid world and solar-powered unmanned aerial vehicle (UAV)-based wireless network management. We empirically compare the convergence performance of the proposed GAS algorithm with binary search (BS), Lagrangian primal-dual optimization (PDO), and Linear Programming (LP). Compared with benchmark algorithms, it is shown that the proposed GAS algorithm converges to the optimal solution faster, does not require hyper-parameter tuning, and is not sensitive to initialization of the Lagrange penalty multiplier.

cs.LG↗

arXiv2020

Optimizing Non-Orthogonal Multiple Access in Random Access Networks

Non-orthogonal multiple access (NOMA) has been considered as a promising solution for improving the spectrum efficiency of next-generation wireless networks. In this paper, the performance of a p-persistent slotted ALOHA system in support of NOMA transmissions is investigated. Specifically, wireless users can choose to use high or low power for data transmissions with certain probabilities. To achieve the maximum network throughput, an analytical framework is developed to analyze the successful transmission probability of NOMA and long term average throughput of users involved in the non-orthogonal transmissions. The feasible region of the maximum number of concurrent users using high and low power to ensure successful NOMA transmissions are quantified. Based on the analysis, an algorithm is proposed to find the optimal transmission probabilities for users to choose high and low power to achieve the maximum system throughput. In addition, the impact of power settings on the network performance is further investigated. Simulations are conducted to validate the analysis.

cs.NI↗

arXiv2020

Constrained Deep Reinforcement Learning for Energy Sustainable Multi-UAV based Random Access IoT Networks with NOMA

In this paper, we apply the Non-Orthogonal Multiple Access (NOMA) technique to improve the massive channel access of a wireless IoT network where solar-powered Unmanned Aerial Vehicles (UAVs) relay data from IoT devices to remote servers. Specifically, IoT devices contend for accessing the shared wireless channel using an adaptive $p$-persistent slotted Aloha protocol; and the solar-powered UAVs adopt Successive Interference Cancellation (SIC) to decode multiple received data from IoT devices to improve access efficiency. To enable an energy-sustainable capacity-optimal network, we study the joint problem of dynamic multi-UAV altitude control and multi-cell wireless channel access management of IoT devices as a stochastic control problem with multiple energy constraints. To learn an optimal control policy, we first formulate this problem as a Constrained Markov Decision Process (CMDP), and propose an online model-free Constrained Deep Reinforcement Learning (CDRL) algorithm based on Lagrangian primal-dual policy optimization to solve the CMDP. Extensive simulations demonstrate that our proposed algorithm learns a cooperative policy among UAVs in which the altitude of UAVs and channel access probability of IoT devices are dynamically and jointly controlled to attain the maximal long-term network capacity while maintaining energy sustainability of UAVs. The proposed algorithm outperforms Deep RL based solutions with reward shaping to account for energy costs, and achieves a temporal average system capacity which is $82.4\%$ higher than that of a feasible DRL based solution, and only $6.47\%$ lower compared to that of the energy-constraint-free system.

cs.NI↗

arXiv2019

On the Fairness Performance of NOMA-based Wireless Powered Communication Networks

The near-far problem causes severe throughput unfairness in wireless powered communication networks (WPCN). In this paper, we exploit non-orthogonal multiple access (NOMA) technology and propose a fairness-aware NOMA-based scheduling scheme to mitigate the near-far effect and to enhance the max-min fairness. Specifically, we sort all users according to their channel conditions and divide them into two groups, the interference group with high channel gains and the noninterference group with low channel gains. The power station (PS) concurrently transmits energy signals with the data transmissions of the users in the interference group. Thus, the users in the noninterference group can harvest more energy and achieve a higher throughput, while the users in the interference group degrade their performance due to the interfering signals from the PS. We then apply order statistic theory to analyze the achievable rates of ordered users, based on which all users are appropriately grouped for NOMA transmission to achieve the max-min fairness of the system. Meanwhile, the optimal number of interfered users that determines the set of users in each group, is derived. Our simulation results validate the significant improvement of both network fairness and throughput via the fairness-aware NOMA-based scheduling scheme.

cs.IT↗

arXiv2018

Throughput Analysis and Energy Efficiency Optimization for Standalone LTE-U Networks with Randomly Delayed CSI

To coexist with Wi-Fi friendly, a standalone long-term evolution network over unlicensed spectrum (LTE-U) under listen-before-talk (LBT) mechanism can only access channel in a random and intermittent way, which results in random and time-variant delay in both data and signaling transmissions. In this work, we explore the impact of randomly delayed channel state information (CSI) on the performance of a standalone LTE-U network by analyzing its downlink throughput and users' energy efficiency (EE) under different CSI feedback schemes and frequency-domain schedulers. Further, aiming at maximizing users' EE of a standalone LTE-U network while guaranteeing fair coexistence with Wi-Fi, joint optimization on the medium access control (MAC) protocol and CSI feedback scheme is studied. Due to the non-convex and non-concave characteristic of the formulated optimization problems, decomposition-based low-complexity yet efficient algorithms are proposed. Simulation results not only verify the analysis and the effectiveness of the proposed algorithms but also show diverse impacts of CSI feedback scheme, frequency-domain scheduler, and traffic load of Wi-Fi on the standalone LTE-U network performance.

cs.NI↗

arXiv2018

A Stochastic Geometry Analysis of Energy Harvesting in Large Scale Wireless Networks

In this paper, the theoretical sustainable capacity of wireless networks with radio frequency (RF) energy harvesting is analytically studied. Specifically, we consider a large scale wireless network where base stations (BSs) and low power wireless devices are deployed by homogeneous Poisson point process (PPP) with different spatial densities. Wireless devices exploit the downlink transmissions from the BSs for either information delivery or energy harvesting. Generally, a BS schedules downlink transmission to wireless devices. The scheduled device receives the data information while other devices harvest energy from the downlink signals. The data information can be successfully received by the scheduled device only if the device has sufficient energy for data processing, i.e., the harvested energy is larger than a threshold. Given the densities of BSs and users, we apply stochastic geometry to analyze the expected number of users per cell and the successful information delivery probability of a wireless device, based on which the total network throughput can be derived. It is shown that the maximum network throughput per cell can be achieved under the optimal density of BSs. Extensive simulations validate the analysis.

cs.NI↗

arXiv2018

Beamforming Design for Max-Min Fair SWIPT in Green Cloud-RAN with Wireless Fronthaul

In this paper, a joint beamforming design for max-min fair simultaneous wireless information and power transfer (SWIPT) is investigated in a green cloud radio access network (Cloud-RAN) with millimeter wave (mmWave) wireless fronthaul. To achieve a balanced user experience for separately located data receivers (DRs) and energy receivers (ERs) in the network, joint transmit beamforming vectors are optimized to maximize the minimum data rate among all the DRs, while satisfying each ER with sufficient RF energy at the same time. Then, a two-step iterative algorithm is proposed to solve the original non-convex optimization problem with the fronthaul capacity constraint in an $l_0$-norm form. Specifically, the $l_0$-norm constraint can be approximated by the reweighted $l_1$-norm, from which the optimal max-min data rate and the corresponding joint beamforming vector can be derived via semidefinite relaxation (SDR) and bi-section search. Finally, extensive numerical simulations are performed to verify the superiority of the proposed joint beamforming design to other separate beamforming strategies.

cs.IT↗