arXiv subjects

Touraj Soleymani

Publications and source records attributed to Touraj Soleymani.

At least 19 recordsLinked to original sources

arXiv2026

Age of Incorrect Information for Pull-Based State Estimation of General Markov Sources

We study pull-based remote state estimation of an arbitrary, multi-state Markov source while accounting for both freshness and correctness attributes of information. To that end, we formulate a discounted optimization problem in terms of the age of incorrect information (AoII), and express it as a joint source-AoII belief Markov decision process (MDP) under maximum a posteriori (MAP) estimation. We then exploit the information structure of the model and prove that every reachable belief is represented by the last successfully observed source state and the number of time slots elapsed since that observation. For numerical computation, we truncate the elapsed no-success duration at a finite level and derive an explicit error bound and a criterion for selecting the truncation parameter. For reliable links, we show that an optimal policy can be represented by a look-up table of waiting times. For unreliable links, we propose a persistent policy and derive computable performance bounds. We also show that the MAP estimate stabilizes after a finite number of time slots. To further reduce memory requirements, we introduce a hybrid estimator with an early stationary switch and derive a computable bound on the resulting difference in performance. Finally, we extend the framework to multiple sources, formulate the scheduling problem as a restless multi-armed bandit, establish a sufficient condition for indexability, and develop an approximate Whittle index policy based on interpolation. Our numerical results illustrate the structure of the optimal single-source policy, evaluate the performance of the multi-source policies, and verify that the proposed heuristic policies closely approach the optimal solution while substantially reducing computational efforts.

cs.IT↗

arXiv2026

Status Updating via Integrated Sensing and Communication: Freshness Optimisation

In this paper, we study how sensing and communication should be jointly coordinated in integrated sensing and communication (ISAC) systems to maintain timely situational awareness under reliability and resource constraints. We consider an ISAC-enabled base station that supports a remote source by dynamically choosing between sensing new state information and communicating previously acquired information, with the two operations semantically intertwined rather than serving separate targets and users. Both sensing and communication are unreliable and costly. The objective is to optimise a long-term cost that captures information freshness at the source, measured by the age of information (AoI), together with sensing and communication overheads. The resulting sequential decision problem is formulated as an infinite-horizon Markov decision process (MDP) with two-dimensional AoI states that capture information freshness at the source and at the base station. We prove that the optimal stationary policy admits a monotone threshold structure characterised by a nondecreasing switching curve in the AoI state space, and show that, as the base-station information becomes staler, the system increasingly favours sensing over communication. Our numerical analysis corroborates the theoretical findings.

cs.IT↗

arXiv2026

Feedback Control via Integrated Sensing and Communication: Uncertainty Optimisation

This paper studies integrated sensing and communication (ISAC) coordination for feedback control tasks under shared platform constraints. We consider a cyber-physical system in which a remote dynamical process (i.e., remote source) is regulated with the support of an ISAC-enabled base station that alternates between sensing the source state and communicating control-relevant information to the source, with the two operations semantically intertwined rather than serving separate targets and users. For a Gauss-Markov source with Bernoulli-distributed sensing and communication links and a finite-horizon linear-quadratic-Gaussian (LQG) cost, we derive the optimal ISAC and control policies. Under a Bellman-operator condition, we prove that the optimal ISAC policy at the base station follows an order-threshold structure in terms of the source and base-station estimation covariances, while the optimal control policy at the source follows a certainty-equivalent structure in terms of the source state estimate. We show that the threshold region, defined as the set of estimation covariance pairs for which communication is preferred over sensing, expands with increasing source uncertainty and contracts with increasing base-station uncertainty. Our numerical analysis validates the theoretical findings.

cs.IT↗

arXiv2026

Age of Information Optimization for Status Updates in Integrated Sensing and Communication Systems

In this paper, we study age of information (AoI) optimization for status updating in an integrated sensing and communication (ISAC) system. We consider a discrete-time architecture in which a base station interacts with a physical environment and a remote monitor, and at each time slot can operate in one of three modes: sensing, communication, or joint sensing and communication. Each mode is unreliable and incurs a different operational cost. The objective is to minimize a discounted infinite-horizon cost that combines the AoI at the monitor with action-dependent sensing and communication costs. For the single source scenario, we formulate the problem as a Markov decision process with a two-dimensional AoI state and prove that the optimal stationary policy admits an ordered threshold structure in the AoI state space. Since the AoI evolves over an infinite space, we truncate the state space to reduce complexity and rigorously bound the resulting error. The analysis analytically determines the truncation size needed to keep the error below a given threshold. For the multi-source scenario, we formulate the scheduling problem as a restless multi-armed bandit. We develop both a Whittle index policy and an approximate Whittle index policy for scheduling under two different regimes, one where indexability is guaranteed, and one where it is not. Numerical results illustrate the structure of the optimal policy in the single-source case and show that the proposed approximate Whittle index policy performs comparably to the Whittle index policy in the indexable regime, while remaining effective beyond it.

cs.IT↗

arXiv2026

Deep Adaptive Rate Allocation in Volatile Heterogeneous Wireless Networks

Modern multi-access 5G+ networks provide mobile terminals with additional capacity, improving network stability and performance. However, in highly mobile environments such as vehicular networks, supporting multi-access connectivity remains challenging. The rapid fluctuations of wireless link quality often outpace the responsiveness of existing multipath schedulers and transport-layer protocols. This paper addresses this challenge by integrating Transformer-based path state forecasting with a new multipath splitting scheduler called Deep Adaptive Rate Allocation (DARA). The proposed scheduler employs a deep reinforcement learning engine to dynamically compute optimal congestion window fractions on available paths, determining data allocation among them. A six-component normalised reward function with weight-mediated conflict resolution drives a DQN policy that eliminates the observation-reaction lag inherent in reactive schedulers. Performance evaluation uses a Mininet-based Multipath Datagram Congestion Control Protocol testbed with traces from mobile users in vehicular environments. Experimental results demonstrate that DARA achieves better file transfer time reductions compared to learning-based schedulers under moderate-volatility traces. For buffered video streaming, resolution improvements are maintained across all tested conditions. Under controlled burst scenarios with sub-second buffer constraints, DARA achieves substantial rebuffering improvements whilst state-of-the-art schedulers exhibit near-continuous stalling.

cs.IT↗

arXiv2026

Remote State Estimation over Unreliable Channels with Unreliable Feedback: Strategies and Limits

In this article, we establish a comprehensive theoretical framework for remote estimation in a networked system composed of a source that is observed by a sensor, a remote monitor that needs to estimate the state of the source in real time, and a communication channel that connects the source to the monitor. The source is a partially observable dynamical process, and the communication channel is a packet-erasure channel with feedback. We consider a novel communication model that captures implicit information. Our main objective is to identify the optimal strategies and the fundamental performance limits of the underlying system in the sense of a causal tradeoff between the packet rate and the mean square error when both forward and backward channels are unreliable. We characterise an optimal coding policy profile consisting of a scheduling policy for an encoder and an estimation policy for a decoder, collocated with the source and the monitor, respectively. We derive the recursive equations that must be solved online by the encoder and the decoder. In addition, we prove that the value function, originally defined over an expanding information set, admits a lower-dimensional representation depending only on two variables. We discuss the structural properties of the optimal policies, and analyse the computational complexity of an algorithm proposed for their computation. We then examine a range of special cases derived from our main theoretical results. We complement the theoretical results with a numerical analysis, and compare the performance of different remote estimation tasks in various operating regimes.

cs.IT↗

arXiv2025

Semantics of Instability in Networked Control

This paper addresses a scheduling problem in the context of a cyber-physical system where a sensor and a controller communicate over an unreliable channel. The sensor observes the state of a source at each time, and according to a scheduling policy determines whether to transmit a compressed sampled state, transmit the uncompressed sampled state, or remain idle. Upon receiving the transmitted information, the controller executes a control action aimed at stabilizing the system, such that the effectiveness of stabilization depends on the quality of the received sensory information. Our primary objective is to derive an optimal scheduling policy that optimizes system performance subject to resource constraints, when the performance is measured by a dual-aspect metric penalizing both the frequency of transitioning to unstable states and the continuous duration of remaining in those states. We formulate this problem as a Markov decision process, and derive an optimal multi-threshold scheduling policy.

math.OC↗

arXiv2024

Optimal Denial-of-Service Attacks Against Partially-Observable Real-Time Monitoring Systems

In this paper, we investigate the impact of denial-of-service attacks on the status updating of a cyber-physical system with one or more sensors connected to a remote monitor via unreliable channels. We approach the problem from the perspective of an adversary that can strategically jam a subset of the channels. The sources are modeled as Markov chains, and the performance of status updating is measured based on the age of incorrect information at the monitor. Our objective is to derive jamming policies that strike a balance between the degradation of the system's performance and the conservation of the adversary's energy. For a single-source scenario, we formulate the problem as a partially-observable Markov decision process, and rigorously prove that the optimal jamming policy is of a threshold form. We then extend the problem to a multi-source scenario. We formulate this problem as a restless multi-armed bandit, and provide a jamming policy based on the Whittle's index. Our numerical results highlight the performance of our policies compared to baseline policies.

cs.IT↗

arXiv2024

Goal-Oriented Communication for Networked Control Assisted by Reconfigurable Meta-Surfaces

In this paper, we develop a theoretical framework for goal-oriented communication assisted by reconfigurable meta-surfaces in the context of networked control systems. The relation to goal-oriented communication stems from the fact that optimization of the phase shifts of the meta-surfaces is guided by the performance of networked control systems tasks. To that end, we consider a networked control system in which a set of sensors observe the states of a set of physical processes, and communicate this information over an unreliable wireless channel assisted by a reconfigurable intelligent surface with multiple reflecting elements to a set of controllers that correct the behaviors of the physical processes based on the received information. Our objective is to find the optimal control policy for the controllers and the optimal phase policy for the reconfigurable intelligent surface that jointly minimize a regulation cost function associated with the networked control system. We characterize these policies, and also propose an approximate solution based on a semi-definite relaxation technique.

cs.IT↗

arXiv2024

Pragmatic Communication for Remote Control of Finite-State Markov Processes

Pragmatic or goal-oriented communication can optimize communication decisions beyond the reliable transmission of data, instead aiming at directly affecting application performance with the minimum channel utilization. In this paper, we develop a general theoretical framework for the remote control of finite-state Markov processes, using pragmatic communication over a costly zero-delay communication channel. To that end, we model a cyber-physical system composed of an encoder, which observes and transmits the states of a process in real-time, and a decoder, which receives that information and controls the behavior of the process. The encoder and the decoder should cooperatively optimize the trade-off between the control performance (i.e., reward) and the communication cost (i.e., channel use). This scenario underscores a pragmatic (i.e., goal-oriented) communication problem, where the purpose is to convey only the data that is most valuable for the underlying task, taking into account the state of the decoder (hence, the pragmatic aspect). We investigate two different decision-making architectures: in pull-based remote control, the decoder is the only decision-maker, while in push-based remote control, the encoder and the decoder constitute two independent decision-makers, leading to a multi-agent scenario. We propose three algorithms to optimize our system (i.e., design the encoder and the decoder policies), discuss the optimality guarantees ofs the algorithms, and shed light on their computational complexity and fundamental limits.

cs.MA↗

arXiv2024

Networked Control with Hybrid Automatic Repeat Request Protocols

We study feedback control of a dynamical process over a lossy channel equipped with a hybrid automatic repeat request protocol that connects a sensor to an actuator. The dynamical process is modeled by a Gauss-Markov process, and the lossy channel by a packet-erasure channel with ideal feedback. We suppose that data is communicated in the format of packets with negligible quantization error. In such a networked control system, whenever a packet loss occurs, there exists a tradeoff between transmitting new sensory information with a lower success probability and retransmitting previously failed sensory information with a higher success probability. In essence, an inherent tradeoff between freshness and reliability. To address this tradeoff, we consider a linear-quadratic-regulator performance index, which penalizes state deviations and control efforts over a finite horizon, and jointly design optimal policies for an encoder and a decoder, which are collocated with the sensor and the actuator, respectively. Our emphasis here lies specifically on designing switching and control policies, rather than error-correcting codes. We derive the structural properties of the optimal encoding and decoding policies. We show that the former is a threshold switching policy and the latter is a certainty-equivalent control policy. In addition, we specify the iterative equations that the encoder and the decoder need to solve in order to implement the optimal policies.

cs.IT↗

arXiv2024

Relation between Value and Age of Information in Feedback Control

In this chapter, we investigate the value of information as a more comprehensive instrument than the age of information for optimally shaping the information flow in a networked control system. In particular, we quantify the value of information based on the variation in a value function, and discuss the structural properties of this metric. Through our analysis, we establish the mathematical relation between the value of information and the age of information. We prove that the value of information is in general a function of an estimation discrepancy that depends on the age of information and the primitive variables. In addition, we prove that there exists a condition under which the value of information becomes completely expressible in terms of the age of information. Nonetheless, we show that this condition is not achievable without a degradation in the performance of the system.

cs.IT↗

arXiv2024

Foundations of Value of Information: A Semantic Metric for Networked Control Systems Tasks

In this chapter, we present our recent invention, i.e., the notion of the value of information$\unicode{x2014}$a semantic metric that is fundamental for networked control systems tasks. We begin our analysis by formulating a causal tradeoff between the packet rate and the regulation cost, with an encoder and a decoder as two distributed decision makers, and show that the valuation of information is conceivable and quantifiable grounded on this tradeoff. More precisely, we characterize an equilibrium, and quantify the value of information there as the variation in a value function with respect to a piece of sensory measurement that can be communicated from the encoder to the decoder at each time. We prove that, in feedback control of a dynamical process over a noiseless channel, the value of information is a function of the discrepancy between the state estimates at the encoder and the decoder, and that a data packet containing a sensory measurement at each time should be exchanged only if the value of information at that time is nonnegative. Finally, we prove that the characterized equilibrium is in fact globally optimal.

cs.IT↗

arXiv2024

Consistency of Value of Information: Effects of Packet Loss and Time Delay in Networked Control Systems Tasks

In this chapter, we study the consistency of the value of information$\unicode{x2014}$a semantic metric that claims to determine the right piece of information in networked control systems tasks$\unicode{x2014}$in a lossy and delayed communication regime. Our analysis begins with a focus on state estimation, and subsequently extends to feedback control. To that end, we make a causal tradeoff between the packet rate and the mean square error. Associated with this tradeoff, we demonstrate the existence of an optimal policy profile, comprising a symmetric threshold scheduling policy based on the value of information for the encoder and a non-Gaussian linear estimation policy for the decoder. Our structural results assert that the scheduling policy is expressible in terms of $3d-1$ variables related to the source and the channel, where $d$ is the time delay, and that the estimation policy incorporates no residual related to signaling. We then construct an optimal control policy by exploiting the separation principle.

cs.IT↗

arXiv2024

Optimal Denial-of-Service Attacks Against Status Updating

In this paper, we investigate denial-of-service attacks against status updating. The target system is modeled by a Markov chain and an unreliable wireless channel, and the performance of status updating in the target system is measured based on two metrics: age of information and age of incorrect information. Our objective is to devise optimal attack policies that strike a balance between the deterioration of the system's performance and the adversary's energy. We model the optimal problem as a Markov decision process and prove rigorously that the optimal jamming policy is a threshold-based policy under both metrics. In addition, we provide a low-complexity algorithm to obtain the optimal threshold value of the jamming policy. Our numerical results show that the networked system with the age-of-incorrect-information metric is less sensitive to jamming attacks than with the age-of-information metric. Index Terms-age of incorrect information, age of information, cyber-physical systems, status updating, remote monitoring.

cs.IT↗

arXiv2024

Remote Estimation of Markov Processes over Costly Channels: On the Benefits of Implicit Information

In this paper, we study the remote estimation problem of a Markov process over a channel with a cost. We formulate this problem as an infinite horizon optimization problem with two players, i.e., a sensor and a monitor, that have distinct information, and with a reward function that takes into account both the communication cost and the estimation quality. We show that the main challenge in solving this problem is associated with the consideration of implicit information, i.e., information that the monitor can obtain about the source when the sensor is silent. Our main objective is to develop a framework for finding solutions to this problem without neglecting implicit information a priori. To that end, we propose three different algorithms. The first one is an alternating policy algorithm that converges to a Nash equilibrium. The second one is an occupancy-state algorithm that is guaranteed to find a globally optimal solution. The last one is a heuristic algorithm that is able to find a near-optimal solution.

eess.SY↗

arXiv2023

State Estimation over Broadcast and Multi-Access Channels in an Unreliable Regime

This article examines the problem of state estimation over multi-terminal channels in an unreliable regime. More specifically, we consider two canonical settings. In the first setting, measurements of a common stochastic source need to be transmitted to two distinct remote monitors over a packet-erasure broadcast channel. In the second setting, measurements of two distinct stochastic sources need to be transmitted to a common remote monitor over a packet-erasure multi-access channel. For these networked systems, we uncover the fundamental performance limits in the sense of a causal tradeoff between the estimation error and the communication cost by identifying optimal encoding and decoding strategies. In the course of our analysis, we introduce two novel semantic metrics that play essential roles in state estimation over broadcast and multi-access channels. The first metric arising in the context of broadcast channels is the dissemination value of information, which quantifies the valuation of provisioning a piece of information to multiple receivers simultaneously. The second metric arising in the context of multi-access channels is the prioritization value of information, which quantifies the valuation of provisioning a piece of information chosen from one out of multiple transmitters. Our findings certify that the optimal encoding and decoding strategies hinge on these semantic metrics.

cs.IT↗

arXiv2022

Value of Information in Feedback Control: Global Optimality

The rate-regulation tradeoff, defined between two objective functions, one penalizing the packet rate and one the regulation cost, can express the fundamental performance bound of networked control systems. However, the characterization of the set of globally optimal solutions in this tradeoff for multi-dimensional Gauss-Markov processes has been an open problem. In the present article, we characterize a policy profile that belongs to this set without imposing any restrictions on the information structure or the policy structure. We prove that such a policy profile consists of a symmetric threshold triggering policy based on the value of information and a certainty-equivalent control policy based on a non-Gaussian linear estimator. These policies are deterministic and can be designed separately. Besides, we provide a global optimality analysis for the value of information $\text{VoI}_k$, a semantic metric that emerges from the rate-regulation tradeoff as the difference between the benefit and the cost of a data packet. We prove that it is globally optimal that a data packet containing sensory information at time $k$ be transmitted to the controller only if $\text{VoI}_k$ becomes nonnegative. These results have important implications in the areas of communication and control.

math.OC↗