Atchutaram K. Kocharlakota

arXiv2026

Computationally Efficient Neural Receivers via Axial Self-Attention

Deep learning-based neural receivers offer promising physical-layer solutions for next-generation wireless systems. We propose an axial self-attention transformer neural receiver that achieves state-of-the-art Block Error Rate (BLER) performance with significantly improved computational efficiency during inference and large-scale training. By factorizing attention operations along temporal and spectral axes, the proposed architecture reduces computational complexity from $O((TF)^2)$ to $O(T^2F+TF^2)$, yielding substantially fewer floating-point operations and attention matrix multiplications per transformer block. Experimental validation under 3GPP Clustered Delay Line (CDL) channels demonstrates consistent performance gains across varying mobility scenarios. Under non-line-of-sight conditions, our proposed axial neural receiver outperforms global self-attention and convolutional neural receiver baselines at 10% BLER and 1% BLER respectively, with reduced computational complexity.

eess.SP↗

arXiv2024

Pilot Contamination Aware Transformer for Downlink Power Control in Cell-Free Massive MIMO Networks

Learning-based downlink power control in cell-free massive multiple-input multiple-output (CFmMIMO) systems offers a promising alternative to conventional iterative optimization algorithms, which are computationally intensive due to online iterative steps. Existing learning-based methods, however, often fail to exploit the intrinsic structure of channel data and neglect pilot allocation information, leading to suboptimal performance, especially in large-scale networks with many users. This paper introduces the pilot contamination-aware power control (PAPC) transformer neural network, a novel approach that integrates pilot allocation data into the network, effectively handling pilot contamination scenarios. PAPC employs the attention mechanism with a custom masking technique to utilize structural information and pilot data. The architecture includes tailored preprocessing and post-processing stages for efficient feature extraction and adherence to power constraints. Trained in an unsupervised learning framework, PAPC is evaluated against the accelerated proximal gradient (APG) algorithm, showing comparable spectral efficiency fairness performance while significantly improving computational efficiency. Simulations demonstrate PAPC's superior performance over fully connected networks (FCNs) that lack pilot information, its scalability to large-scale CFmMIMO networks, and its computational efficiency improvement over APG. Additionally, by employing padding techniques, PAPC adapts to the dynamically varying number of users without retraining.

cs.LG↗