arXiv subjects

Marios Aristodemou

Publications and source records attributed to Marios Aristodemou.

4 recordsLinked to original sources

arXiv2026

Multi-Agent Reinforcement Learning Counteracts Delayed CSI in Multi-Satellite Systems

The integration of satellite communication networks with next-generation (NG) technologies is a promising approach towards global connectivity. However, the quality of services is highly dependant on the availability of accurate channel state information (CSI). Channel estimation in satellite communications is challenging due to the high propagation delay between terrestrial users and satellites, which results in outdated CSI observations on the satellite side. In this paper, we study the downlink transmission of multiple satellites acting as distributed base stations (BS) to mobile terrestrial users. We propose a multi-agent reinforcement learning (MARL) algorithm which aims for maximising the sum-rate of the users, while coping with the outdated CSI. We design a novel bi-level optimisation, procedure themes as dual stage proximal policy optimisation (DS-PPO), for tackling the problem of large continuous action spaces as well as of independent and non-identically distributed (non-IID) environments in MARL. Specifically, the first stage of DS-PPO maximises the sum-rate for an individual satellite and the second stage maximises the sum-rate when all the satellites cooperate to form a distributed multi-antenna BS. Our numerical results demonstrate the robustness of DS-PPO to CSI imperfections as well as the sum-rate improvement attached by the use of DS-PPO. In addition, we provide the convergence analysis for the DS-PPO along with the computational complexity.

cs.IT↗

arXiv2025

Semantic Communications for Vehicle-Based Mission-Critical Services: Challenges and Solutions

As mission-critical (MC) services such as Unmanned Aerial Vehicles (UAVs) based emergency communication and Internet of Vehicles (IoVs) enabled autonomous driving emerge, the traditional communication framework can not meet the growing demands for higher reliability and lower latency and the increasing transmission loads. Semantic Communication (SemCom), an emerging communication paradigm that shifts the focus from bit-level data to its context and intended task at the receiver (i.e., semantic level), is envisioned to be a key revolution in Sixth Generation (6G) networks. However, an explicit and systematic SemCom framework specifically tailored for Vehicle-based MC (VbMC) services has yet to be proposed, primarily due to the complexity and lack of analysis on their MC characteristics. In this article, we first present the key information-critical and infrastructure-critical vehicle-based services within the SemCom framework. We then analyze the unique characteristics of MC services and the corresponding challenges they present for SemCom. Building on this, we propose a novel SemCom framework designed to address the specific needs of MC services in vehicle systems, offering potential solutions to existing challenges. Finally, we present a case study on UAV-based rapid congestion relief, utilizing eXplainable AI (XAI) to validate the effectiveness of the proposed SemCom framework.

eess.SY↗

arXiv2025

Reinforcement Learning-Based Downlink Transmit Precoding for Mitigating the Impact of Delayed CSI in Satellite Systems

The integration of low earth orbit (LEO) satellites with terrestrial communication networks holds the promise of seamless global connectivity. The efficiency of this connection, however, depends on the availability of reliable channel state information (CSI). Due to the large space-ground propagation delays, the estimated CSI is outdated. In this paper we consider the downlink of a satellite operating as a base station in support of multiple mobile users. The estimated outdated CSI is used at the satellite side to design a transmit precoding (TPC) matrix for the downlink. We propose a deep reinforcement learning (DRL)-based approach to optimize the TPC matrices, with the goal of maximizing the achievable data rate. We utilize the deep deterministic policy gradient (DDPG) algorithm to handle the continuous action space, and we employ state augmentation techniques to deal with the delayed observations and rewards. We show that the DRL agent is capable of exploiting the time-domain correlations of the channels for constructing accurate TPC matrices. This is because the proposed method is capable of compensating for the effects of delayed CSI in different frequency bands. Furthermore, we study the effect of handovers in the system, and show that the DRL agent is capable of promptly adapting to the environment when a handover occurs.

eess.SP↗

arXiv2025

Maximizing Uncertainty for Federated learning via Bayesian Optimisation-based Model Poisoning

As we transition from Narrow Artificial Intelligence towards Artificial Super Intelligence, users are increasingly concerned about their privacy and the trustworthiness of machine learning (ML) technology. A common denominator for the metrics of trustworthiness is the quantification of uncertainty inherent in DL algorithms, and specifically in the model parameters, input data, and model predictions. One of the common approaches to address privacy-related issues in DL is to adopt distributed learning such as federated learning (FL), where private raw data is not shared among users. Despite the privacy-preserving mechanisms in FL, it still faces challenges in trustworthiness. Specifically, the malicious users, during training, can systematically create malicious model parameters to compromise the models predictive and generative capabilities, resulting in high uncertainty about their reliability. To demonstrate malicious behaviour, we propose a novel model poisoning attack method named Delphi which aims to maximise the uncertainty of the global model output. We achieve this by taking advantage of the relationship between the uncertainty and the model parameters of the first hidden layer of the local model. Delphi employs two types of optimisation , Bayesian Optimisation and Least Squares Trust Region, to search for the optimal poisoned model parameters, named as Delphi-BO and Delphi-LSTR. We quantify the uncertainty using the KL Divergence to minimise the distance of the predictive probability distribution towards an uncertain distribution of model output. Furthermore, we establish a mathematical proof for the attack effectiveness demonstrated in FL. Numerical results demonstrate that Delphi-BO induces a higher amount of uncertainty than Delphi-LSTR highlighting vulnerability of FL systems to model poisoning attacks.

cs.LG↗