arXiv subjects

Qiushi Zhao

Publications and source records attributed to Qiushi Zhao.

6 recordsLinked to original sources

arXiv2026

Artificial Intelligence for Spatially Reconfigurable Antennas: Movable, Fluid, and Pinching Antenna Systems

Recently, sixth-generation (6G) wireless networks have moved beyond fixed-array designs toward antenna architectures that can adapt their spatial configuration to specific environmental conditions. Movable antenna, fluid antenna, and pinching antenna systems represent this principle in different ways, but they share a common vision: exploiting spatial flexibility as an additional degree of freedom (DoF) to improve communication, sensing, security, and resource efficiency. These new techniques, however, also bring challenging problems, as antenna configuration must be jointly considered with channel acquisition, beamforming, mobility, and network resource management. Therefore, artificial intelligence (AI) has become an important tool for learning fast and adaptive control policies for these highly coupled systems. In this survey, we provide a unified review of AI for spatially reconfigurable antenna systems. We first introduce the basic principles of movable, fluid, and pinching antennas, which is followed by a summary of the latest AI-enabled designs according to their primary optimization objectives. Furthermore, we compare the roles of deep learning (DL), deep reinforcement learning (DRL), multi-agent reinforcement learning (MARL), graph learning, Transformers, large language models (LLMs), and structure-guided learning across different antenna architectures. Finally, we discuss open challenges and future directions toward scalable, robust, and hardware-aware intelligent reconfigurable antenna networks.

eess.SP↗

arXiv2026

From Denoising to Decision Making: A Survey on Diffusion Model-Enabled Deep Reinforcement Learning for Wireless Networks

Deep reinforcement learning (DRL) has long been a promising solution for sequential resource management in wireless networks. However, conventional DRL methods are fundamentally limited by their reliance on unimodal policy distributions, inefficient exploration in high-dimensional action spaces, and poor adaptability to dynamic and heterogeneous environments. Meanwhile, diffusion models (DMs) as one of the most powerful families of generative AI have demonstrted remarkable capabilities in modeling complex, multi-modal data distributions across diverse domains. The integration of DMs and DRL has opened a new and rapidly growing research direction, in which DM-enabled policies substantially enhance decision quality by capturing the complex, discontinuous, and multimodal action structures inherent in wireless resource management. In this paper, we present a comprehensive survey of DM-enabled DRL algorithms and their applications for various issues in wireless networks. Particularly, we first provide the theoretical background of DM and present different DM-enabled DRL algorithms. We then systematically review applications of DM-enabled DRL for across computation offloading in mobile edge computing, UAV-assisted, vehicular, and AIGC-driven systems, as well as wireless resource allocation, physical-layer security, and robotics and UAV planning. We conclude the paper by higlight future research directions.

eess.SP↗

arXiv2026

Transformer-Enhanced Reinforcement Learning: Fundamentals and Applications in Communication Networks

Reinforcement Learning (RL) has long been a powerful solution to various problems in communication networks. However, traditional RL models still face with several limitations. Not only do they rely on large numbers of interactions with the environment, but they are also limited in terms of modeling long-term relationships and tackling partial observability. In recent years, the Transformer model has demonstrated the ability to enhance RL models, allowing them to overcome these issues. Particularly, the self-attention mechanism within the Transformer enables efficient modeling of long-range dependencies and global correlations, as well as accelerates training processes and handles heterogeneous data modalities. In this paper, we present a comprehensive survey of Transformer-based RL algorithms and their applications in communication networks. Specifically, the paper provides the mathematical background of RL and Transformer architectures, along with insights into key issues such as resource allocation, computation offloading, routing, and trajectory control, and network security. We conclude the paper by discussing challenges, open issues, and notable future research directions, including Transformer-enhanced DRL algorithms for semantic communication and network optimization.

eess.SP↗

arXiv2026

Dynamic Antenna Placement for Mobile Users in Urban Micro Pinching-Antenna Systems

The pinching-antenna systems (PASS) enable blockage mitigation in urban micro (UMi) networks through flexible antenna placement. However, the joint optimization of antenna positions and beamforming precoding is inherently nonconvex and becomes significantly more challenging under user mobility. To address this issue, we propose a bilevel optimization framework for dynamic antenna positioning and beamforming precoding design. In the outer level, a soft actor-critic (SAC) agent learns a continuous control policy for real-time antenna positioning, while in the inner level, zero-forcing (ZF) precoding is applied based on the instantaneous effective channel. Numerical results demonstrate that the proposed framework significantly improves spectral efficiency (SE) and enhances robustness against user mobility and random blockages.

eess.SP↗

arXiv2026

Physics-Informed Deep Recurrent Back-Projection Network for Tunnel Propagation Modeling

Accurate and efficient modeling of radio wave propagation in railway tunnels is is critical for ensuring reliable communication-based train control (CBTC) systems. Fine-grid parabolic wave equation (PWE) solvers provide high-fidelity field predictions but are computationally expensive for large-scale tunnels, whereas coarse-grid models lose essential modal and geometric details. To address this challenge, we propose a physics-informed recurrent back-projection propagation network (PRBPN) that reconstructs fine-resolution received-signal-strength (RSS) fields from coarse PWE slices. The network integrates multi-slice temporal fusion with an iterative projection/back-projection mechanism that enforces physical consistency and avoids any pre-upsampling stage, resulting in strong data efficiency and improved generalization. Simulations across four tunnel cross-section geometries and four frequencies show that the proposed PRBPN closely tracks fine-mesh PWE references. Engineering-level validation on the Massif Central tunnel in France further confirms robustness in data-scarce scenarios, trained with only a few paired coarse/fine RSS. These results indicate that the proposed PRBPN can substantially reduce reliance on computationally intensive fine-grid solvers while maintaining high-fidelity tunnel propagation predictions.

cs.ET↗

arXiv2025

Intelligent Optimization of Wireless Access Point Deployment for Communication-Based Train Control Systems Using Deep Reinforcement Learning

Urban railway systems increasingly rely on communication based train control (CBTC) systems, where optimal deployment of access points (APs) in tunnels is critical for robust wireless coverage. Traditional methods, such as empirical model-based optimization algorithms, are hindered by excessive measurement requirements and suboptimal solutions, while machine learning (ML) approaches often struggle with complex tunnel environments. This paper proposes a deep reinforcement learning (DRL) driven framework that integrates parabolic wave equation (PWE) channel modeling, conditional generative adversarial network (cGAN) based data augmentation, and a dueling deep Q network (Dueling DQN) for AP placement optimization. The PWE method generates high-fidelity path loss distributions for a subset of AP positions, which are then expanded by the cGAN to create high resolution path loss maps for all candidate positions, significantly reducing simulation costs while maintaining physical accuracy. In the DRL framework, the state space captures AP positions and coverage, the action space defines AP adjustments, and the reward function encourages signal improvement while penalizing deployment costs. The dueling DQN enhances convergence speed and exploration exploitation balance, increasing the likelihood of reaching optimal configurations. Comparative experiments show that the proposed method outperforms a conventional Hooke Jeeves optimizer and traditional DQN, delivering AP configurations with higher average received power, better worst-case coverage, and improved computational efficiency. This work integrates high-fidelity electromagnetic simulation, generative modeling, and AI-driven optimization, offering a scalable and data-efficient solution for next-generation CBTC systems in complex tunnel environments.

eess.SP↗