Searcharxiv⌕ Search

arXiv subjects

Wanchun Liu

Publications and source records attributed to Wanchun Liu.

At least 37 records · Page 2Linked to original sources

Deep Reinforcement Learning for Radio Resource Allocation in NOMA-based Remote State Estimation

Remote state estimation, where many sensors send their measurements of distributed dynamic plants to a remote estimator over shared wireless resources, is essential for mission-critical applications of Industry 4.0. Most of the existing works on remote state estimation assumed orthogonal multiple access and the proposed dynamic radio resource allocation algorithms can only work for very small-scale settings. In this work, we consider a remote estimation system with non-orthogonal multiple access. We formulate a novel dynamic resource allocation problem for achieving the minimum overall long-term average estimation mean-square error. Both the estimation quality state and the channel quality state are taken into account for decision making at each time. The problem has a large hybrid discrete and continuous action space for joint channel assignment and power allocation. We propose a novel action-space compression method and develop an advanced deep reinforcement learning algorithm to solve the problem. Numerical results show that our algorithm solves the resource allocation problem effectively, presents much better scalability than the literature, and provides significant performance gain compared to some benchmarks.

cs.IT↗

DRL-based Resource Allocation in Remote State Estimation

Remote state estimation, where sensors send their measurements of distributed dynamic plants to a remote estimator over shared wireless resources, is essential for mission-critical applications of Industry 4.0. Existing algorithms on dynamic radio resource allocation for remote estimation systems assumed oversimplified wireless communications models and can only work for small-scale settings. In this work, we consider remote estimation systems with practical wireless models over the orthogonal multiple-access and non-orthogonal multiple-access schemes. We derive necessary and sufficient conditions under which remote estimation systems can be stabilized. The conditions are described in terms of the transmission power budget, channel statistics, and plants' parameters. For each multiple-access scheme, we formulate a novel dynamic resource allocation problem as a decision-making problem for achieving the minimum overall long-term average estimation mean-square error. Both the estimation quality and the channel quality states are taken into account for decision making. We systematically investigated the problems under different multiple-access schemes with large discrete, hybrid discrete-and-continuous, and continuous action spaces, respectively. We propose novel action-space compression methods and develop advanced deep reinforcement learning algorithms to solve the problems. Numerical results show that our algorithms solve the resource allocation problems effectively and provide much better scalability than the literature.

eess.SY↗

Splitting Receiver with Joint Envelope and Coherent Detection

This letter proposes a new splitting receiver design with joint envelope detection (ED) and coherent detection (CD). To characterize its fundamental performance limit, we conduct high signal-to-noise ratio (SNR) analysis on the proposed ED-CD splitting receiver and obtain closed-form approximations of both the achievable mutual information and the optimal splitting ratio (i.e., a key design parameter of the receiver). Our numerical results show that these high SNR approximations are accurate over a wide range of moderate SNR values, signifying the usefulness of the obtained analytical results. We also provide insights on the conditions at which the proposed splitting receiver has significant performance advantages over the traditional receivers.

eess.SP↗

Remote State Estimation with Smart Sensors over Markov Fading Channels

We consider a fundamental remote state estimation problem of discrete-time linear time-invariant (LTI) systems. A smart sensor forwards its local state estimate to a remote estimator over a time-correlated $M$-state Markov fading channel, where the packet drop probability is time-varying and depends on the current fading channel state. We establish a necessary and sufficient condition for mean-square stability of the remote estimation error covariance as $ρ^2(\mathbf{A})ρ(\mathbf{DM})<1$, where $ρ(\cdot)$ denotes the spectral radius, $\mathbf{A}$ is the state transition matrix of the LTI system, $\mathbf{D}$ is a diagonal matrix containing the packet drop probabilities in different channel states, and $\mathbf{M}$ is the transition probability matrix of the Markov channel states. To derive this result, we propose a novel estimation-cycle based approach, and provide new element-wise bounds of matrix powers. The stability condition is verified by numerical results, and is shown more effective than existing sufficient conditions in the literature. We observe that the stability region in terms of the packet drop probabilities in different channel states can either be convex or concave depending on the transition probability matrix $\mathbf{M}$. Our numerical results suggest that the stability conditions for remote estimation may coincide for setups with a smart sensor and with a conventional one (which sends raw measurements to the remote estimator), though the smart sensor setup achieves a better estimation performance.

eess.SY↗

Over-the-Air Computation via Broadband Channels

Over-the-air computation (AirComp) has been recognized as a low-latency solution for wireless sensor data fusion, where multiple sensors send their measurement signals to a receiver simultaneously for computation. Most existing work only considered performing AirComp over a single frequency channel. However, for a sensor network with a massive number of nodes, a single frequency channel may not be sufficient to accommodate the large number of sensors, and the AirComp performance will be very limited. So it is highly desirable to have more frequency channels for large-scale AirComp systems to benefit from multi-channel diversity. In this letter, we propose an $M$-frequency AirComp system, where each sensor selects a subset of the $M$ frequencies and broadcasts its signal over these channels under a certain power constraint. We derive the optimal sensors' transmission and receiver's signal processing methods separately, and develop an algorithm for joint design to achieve the best AirComp performance. Numerical results show that increasing one frequency channel can improve the AirComp performance by threefold compared to the single-frequency case.

cs.IT↗

Anytime Control under Practical Communication Model

We investigate a novel anytime control algorithm for wireless networked control with random dropouts. The controller computes sequences of tentative future control commands using time-varying (Markovian) computational resources. The sensor-controller and controller-actuator channel states are spatial- and time-correlated, and are modeled as a multi-state Markov process. To compensate for the effect of packet dropouts, a dual-buffer mechanism is proposed. We develop a novel cycle-cost-based approach to obtain the stability conditions on the nonlinear plant, controller, network and computational resources.

cs.IT↗

Over-the-Air Computation with Spatial-and-Temporal Correlated Signals

Over-the-air computation (AirComp) leveraging the superposition property of wireless multiple-access channel (MAC), is a promising technique for effective data collection and computation of large-scale wireless sensor measurements in Internet of Things applications. Most existing work on AirComp only considered computation of spatial-and-temporal independent sensor signals, though in practice different sensor measurement signals are usually correlated. In this letter, we propose an AirComp system with spatial-and-temporal correlated sensor signals, and formulate the optimal AirComp policy design problem for achieving the minimum computation mean-squared error (MSE). We develop the optimal AirComp policy with the minimum computation MSE in each time step by utilizing the current and the previously received signals. We also propose and optimize a low-complexity AirComp policy in closed form with the performance approaching to the optimal policy.

cs.IT↗

On the Latency, Rate and Reliability Tradeoff in Wireless Networked Control Systems for IIoT

Wireless networked control systems (WNCSs) provide a key enabling technique for Industry Internet of Things (IIoT). However, in the literature of WNCSs, most of the research focuses on the control perspective, and has considered oversimplified models of wireless communications which do not capture the key parameters of a practical wireless communication system, such as latency, data rate and reliability. In this paper, we focus on a WNCS, where a controller transmits quantized and encoded control codewords to a remote actuator through a wireless channel, and adopt a detailed model of the wireless communication system, which jointly considers the inter-related communication parameters. We derive the stability region of the WNCS. If and only if the tuple of the communication parameters lies in the region, the average cost function, i.e., a performance metric of the WNCS, is bounded. We further obtain a necessary and sufficient condition under which the stability region is $n$-bounded, where $n$ is the control codeword blocklength. We also analyze the average cost function of the WNCS. Such analysis is non-trivial because the finite-bit control-signal quantizer introduces a non-linear and discontinuous quantization function which makes the performance analysis very difficult. We derive tight upper and lower bounds on the average cost function in terms of latency, data rate and reliability. Our analytical results provide important insights into the design of the optimal parameters to minimize the average cost within the stability region.

cs.IT↗

Wireless Feedback Control with Variable Packet Length for Industrial IoT

The paper considers a wireless networked control system (WNCS), where a controller sends packets carrying control information to an actuator through a wireless channel to control a physical process for industrial-control applications. In most of the existing work on WNCSs, the packet length for transmission is fixed. However, from the channel-encoding theory, if a message is encoded into a longer codeword, its reliability is improved at the expense of longer delay. Both delay and reliability have great impact on the control performance. Such a fundamental delay-reliability tradeoff has rarely been considered in WNCSs. In this paper, we propose a novel WNCS, where the controller adaptively changes the packet length for control based on the current status of the physical process. We formulate a decision-making problem and find the optimal variable-length packet-transmission policy for minimizing the long-term average cost of the WNCSs. We derive a necessary and sufficient condition on the existence of the optimal policy in terms of the transmission reliabilities with different packet lengths and the control system parameter.

cs.IT↗

Over-the-Air Computation Systems: Optimal Design with Sum-Power Constraint

Over-the-air computation (AirComp), which leverages the superposition property of wireless multiple-access channel (MAC) and the mathematical tool of function representation, has been considered as a promising technique for effective collection and computation of massive sensor data in wireless Big Data applications. In most of the existing work on AirComp, optimal system-parameter design is commonly considered under the peak-power constraint of each sensor. In this paper, we propose an optimal transmitter-receiver (Tx-Rx) parameter design problem to minimize the computation mean-squared error (MSE) of an AirComp system under the sum-power constraint of the sensors. We solve the non-convex problem and obtain a closed-form solution. Also, we investigate another problem that minimizes the sum power of the sensors under the constraint of computation MSE. Our results show that in both of the problems, the sensors with poor and good channel conditions should use less power than the ones with moderate channel conditions.

cs.IT↗

Over-the-Air Computation Systems: Optimization, Analysis and Scaling Laws

For future Internet of Things (IoT)-based Big Data applications (e.g., smart cities/transportation), wireless data collection from ubiquitous massive smart sensors with limited spectrum bandwidth is very challenging. On the other hand, to interpret the meaning behind the collected data, it is also challenging for edge fusion centers running computing tasks over large data sets with limited computation capacity. To tackle these challenges, by exploiting the superposition property of a multiple-access channel and the functional decomposition properties, the recently proposed technique, over-the-air computation (AirComp), enables an effective joint data collection and computation from concurrent sensor transmissions. In this paper, we focus on a single-antenna AirComp system consisting of $K$ sensors and one receiver (i.e., the fusion center). We consider an optimization problem to minimize the computation mean-squared error (MSE) of the $K$ sensors' signals at the receiver by optimizing the transmitting-receiving (Tx-Rx) policy, under the peak power constraint of each sensor. Although the problem is not convex, we derive the computation-optimal policy in closed form. Also, we comprehensively investigate the ergodic performance of AirComp systems in terms of the average computation MSE and the average power consumption under Rayleigh fading channels with different Tx-Rx policies. For the computation-optimal policy, we prove that its average computation MSE has a decay rate of $O(1/\sqrt{K})$, and our numerical results illustrate that the policy also has a vanishing average power consumption with the increasing $K$, which jointly show the computation effectiveness and the energy efficiency of the policy with a large number of sensors.

cs.IT↗

On the Performance of Splitting Receiver with Joint Coherent and Non-Coherent Processing

In this paper, we revisit a recently proposed receiver design, named the splitting receiver, which jointly uses coherent and non-coherent processing for signal detection. By considering an improved signal model for the splitting receiver as compared to the original study in the literature, we conduct a performance analysis on the achievable data rate under Gaussian signaling and obtain a fundamentally different result on the performance gain of the splitting receiver over traditional receiver designs that use either coherent or non-coherent processing alone. Specifically, the original study ignored the antenna noise and concluded on a 50% gain in achievable data rate in the high signal-to-noise ratio (SNR) regime. In contrast, we include the antenna noise in the signal model and show that the splitting receiver improves the achievable data rate by a constant gap in the high SNR regime. This represents an important correction of the theoretical understanding on the performance of the splitting receiver. In addition, we examine the maximum-likelihood detection and derive a low-complexity detection rule for the splitting receiver for practical modulation schemes. Our numerical results give further insights into the conditions under which the splitting receiver achieves significant gains in terms of either achievable data rate or detection error probability.

cs.IT↗

SWIPT with Practical Modulation and RF Energy Harvesting Sensitivity

In this paper, we investigate the performance of simultaneous wireless information and power transfer (SWIPT) in a point-to-point system, adopting practical $M$-ary modulation. We take into account the fact that the receiver's radio-frequency (RF) energy harvesting circuit can only harvest energy when the received signal power is greater than a certain sensitivity level. For both power-splitting (PS) and time-switching (TS) schemes, we derive the energy harvesting performance as well as the information decoding performance for the Nakagami-$m$ fading channel. We also analyze the performance tradeoff between energy harvesting and information decoding by studying an optimization problem, which maximizes the information decoding performance and satisfies a constraint on the minimum harvested energy. Our analysis shows that (i) for the PS scheme, modulations with high peak-to-average power ratio achieve better energy harvesting performance, (ii) for the TS scheme, it is desirable to concentrate the power for wireless power transfer in order to minimize the non-harvested energy caused by the RF energy harvesting sensitivity level, and (iii) channel fading is beneficial for energy harvesting in both PS and TS schemes.

cs.IT↗

Wireless Networked Control Systems with Coding-Free Data Transmission for Industrial IoT

Wireless networked control systems for the Industrial Internet of Things (IIoT) require low latency communication techniques that are very reliable and resilient. In this paper, we investigate a coding-free control method to achieve ultra-low latency communications in single-controller-multi-plant networked control systems for both slow and fast fading channels. We formulate a power allocation problem to optimize the sum cost functions of multiple plants, subject to the plant stabilization condition and the controller's power limit. Although the optimization problem is a non-convex one, we derive a closed-form solution, which indicates that the optimal power allocation policy for stabilizing the plants with different channel conditions is reminiscent of the channel-inversion policy. We numerically compare the performance of the proposed coding-free control method and the conventional coding-based control methods in terms of the control performance (i.e., the cost function) of a plant, which shows that the coding-free method is superior in a practical range of SNRs.

cs.IT↗

Optimal Downlink-Uplink Scheduling of Wireless Networked Control for Industrial IoT

This paper considers a wireless networked control system (WNCS) consisting of a dynamic system to be controlled (i.e., a plant), a sensor, an actuator and a remote controller for mission-critical Industrial Internet of Things (IIoT) applications. A WNCS has two types of wireless transmissions, i.e., the sensor's measurement transmission to the controller and the controller's command transmission to the actuator. In this work, we consider a practical half-duplex controller, which introduces a novel transmission-scheduling problem for WNCSs. A frequent scheduling of sensor's transmission results in a better estimation of plant states at the controller and thus a higher quality of control command, but it leads to a less frequent/timely control of the plant. Therefore, considering the overall control performance of the plant in terms of its average cost function, there exists a fundamental tradeoff between the sensor's and the controller's transmissions. We formulate a new problem to optimize the transmission-scheduling policy for minimizing the long-term average cost function. We derive the necessary and sufficient condition of the existence of a stationary and deterministic optimal policy that results in a bounded average cost in terms of the transmission reliabilities of the sensor-to-controller and controller-to-actuator channels. Also, we derive an easy-to-compute suboptimal policy, which notably reduces the average cost of the plant compared to a naive alternative-scheduling policy.

cs.IT↗

Real-Time Remote Estimation with Hybrid ARQ in Wireless Networked Control

Real-time remote estimation is critical for mission-critical applications including industrial automation, smart grid and tactile Internet. In this paper, we propose a hybrid automatic repeat request (HARQ)-based real-time remote estimation framework for linear time-invariant (LTI) dynamic systems. Considering the estimation quality of such a system, there is a fundamental tradeoff between the reliability and freshness of the sensor's measurement transmission. We formulate a new problem to optimize the sensor's online transmission control policy for static and Markov fading channels, which depends on both the current estimation quality of the remote estimator and the current number of retransmissions of the sensor, so as to minimize the long-term remote estimation mean squared error (MSE). This problem is non-trivial. In particular, it is challenging to derive the condition in terms of the communication channel quality and the LTI system parameters, to ensure a bounded long-term estimation MSE. We derive an elegant sufficient condition of the existence of a stationary and deterministic optimal policy that stabilizes the remote estimation system and minimizes the MSE. Also, we prove that the optimal policy has a switching structure, and accordingly derive a low-complexity suboptimal policy. Numerical results show that the proposed optimal policy significantly improves the performance of the remote estimation system compared to the conventional non-HARQ policy.

cs.IT↗

Next Generation Backscatter Communication: Systems, Techniques and Applications

The rapid growth of IoT driven by recent advancements in consumer electronics, 5G communication technologies, and cloud-computing enabled big-data analytics, has recently attracted tremendous attention from both the industry and academia. One of the major open challenges for IoT is the limited network lifetime due to massive IoT devices being powered by batteries with finite capacities. The low-power and low-complexity backscatter communications (BackCom), which simply relies on passive reflection and modulation of an incident radio-frequency (RF) wave, has emerged to be a promising technology for tackling this challenge. However, the contemporary BackCom has several major limitations, such as short transmission range, low data rate, and uni-directional information transmission. The article aims at introducing the recent advances in the active area of BackCom. Specifically, we provide a systematic introduction of the next generation BackCom covering basic principles, systems, techniques besides IoT applications. Lastly, we describe the IoT application scenarios with the next generation BackCom.

cs.IT↗

To Retransmit or Not: Real-Time Remote Estimation in Wireless Networked Control

Real-time remote estimation is critical for mission-critical applications including industrial automation, smart grid, and the tactile Internet. In this paper, we propose a hybrid automatic repeat request (HARQ)-based real-time remote estimation framework for linear time-invariant (LTI) dynamic systems. Considering the estimation quality of such a system, there is a fundamental tradeoff between the reliability and freshness of the sensor's measurement transmission. When a failed transmission occurs, the sensor can either retransmit the previous old measurement such that the receiver can obtain a more reliable old measurement, or transmit a new but less reliable measurement. To design the optimal decision, we formulate a new problem to optimize the sensor's online decision policy, i.e., to retransmit or not, depending on both the current estimation quality of the remote estimator and the current number of retransmissions of the sensor, so as to minimize the long-term remote estimation mean-squared error (MSE). This problem is non-trivial. In particular, it is not clear what the condition is in terms of the communication channel quality and the LTI system parameters, to ensure that the long-term estimation MSE can be bounded. We give a sufficient condition of the existence of a stationary and deterministic optimal policy that stabilizes the remote estimation system and minimizes the MSE. Also, we prove that the optimal policy has a switching structure, and derive a low-complexity suboptimal policy. Our numerical results show that the proposed optimal policy notably improves the performance of the remote estimation system compared to the conventional non-HARQ policy.

cs.IT↗