Searcharxiv⌕ Search

arXiv subjects

Ying-Chang Liang

Publications and source records attributed to Ying-Chang Liang.

At least 109 records · Page 6Linked to original sources

Joint Transaction Transmission and Channel Selection in Cognitive Radio Based Blockchain Networks: A Deep Reinforcement Learning Approach

To ensure that the data aggregation, data storage, and data processing are all performed in a decentralized but trusted manner, we propose to use the blockchain with the mining pool to support IoT services based on cognitive radio networks. As such, the secondary user can send its sensing data, i.e., transactions, to the mining pools. After being verified by miners, the transactions are added to the blocks. However, under the dynamics of the primary channel and the uncertainty of the mempool state of the mining pool, it is challenging for the secondary user to determine an optimal transaction transmission policy. In this paper, we propose to use the deep reinforcement learning algorithm to derive an optimal transaction transmission policy for the secondary user. Specifically, we adopt a Double Deep-Q Network (DDQN) that allows the secondary user to learn the optimal policy. The simulation results clearly show that the proposed deep reinforcement learning algorithm outperforms the conventional Q-learning scheme in terms of reward and learning speed.

cs.NI↗

Applications of Deep Reinforcement Learning in Communications and Networking: A Survey

This paper presents a comprehensive literature review on applications of deep reinforcement learning in communications and networking. Modern networks, e.g., Internet of Things (IoT) and Unmanned Aerial Vehicle (UAV) networks, become more decentralized and autonomous. In such networks, network entities need to make decisions locally to maximize the network performance under uncertainty of network environment. Reinforcement learning has been efficiently used to enable the network entities to obtain the optimal policy including, e.g., decisions or actions, given their states when the state and action spaces are small. However, in complex and large-scale networks, the state and action spaces are usually large, and the reinforcement learning may not be able to find the optimal policy in reasonable time. Therefore, deep reinforcement learning, a combination of reinforcement learning with deep learning, has been developed to overcome the shortcomings. In this survey, we first give a tutorial of deep reinforcement learning from fundamental concepts to advanced models. Then, we review deep reinforcement learning approaches proposed to address emerging issues in communications and networking. The issues include dynamic network access, data rate control, wireless caching, data offloading, network security, and connectivity preservation which are all important to next generation networks such as 5G and beyond. Furthermore, we present applications of deep reinforcement learning for traffic routing, resource sharing, and data collection. Finally, we highlight important challenges, open issues, and future research directions of applying deep reinforcement learning.

cs.NI↗

Spectrum Sharing for Internet of Things: A Survey

The Internet of Things (IoT) is a promising paradigm to accommodate massive device connections in 5G and beyond. To pave the way for future IoT, the spectrum should be planed in advance. Spectrum sharing is a preferable solution for IoT due to the scarcity of available spectrum resource. In particular, mobile operators are inclined to exploit the existing standards and infrastructures of current cellular networks and deploy IoT within licensed cellular spectrum. Yet, proprietary companies prefer to deploy IoT within unlicensed spectrum to avoid any licence fee. In this paper, we provide a survey on prevalent IoT technologies deployed within licensed cellular spectrum and unlicensed spectrum. Notably, emphasis will be on the spectrum sharing solutions including the shared spectrum, interference model, and interference management. To this end, we discuss both advantages and disadvantages of different IoT technologies. Finally, we identify challenges for future IoT and suggest potential research directions.

cs.IT↗

Deep Reinforcement Learning for Time Scheduling in RF-Powered Backscatter Cognitive Radio Networks

In an RF-powered backscatter cognitive radio network, multiple secondary users communicate with a secondary gateway by backscattering or harvesting energy and actively transmitting their data depending on the primary channel state. To coordinate the transmission of multiple secondary transmitters, the secondary gateway needs to schedule the backscattering time, energy harvesting time, and transmission time among them. However, under the dynamics of the primary channel and the uncertainty of the energy state of the secondary transmitters, it is challenging for the gateway to find a time scheduling mechanism which maximizes the total throughput. In this paper, we propose to use the deep reinforcement learning algorithm to derive an optimal time scheduling policy for the gateway. Specifically, to deal with the problem with large state and action spaces, we adopt a Double Deep-Q Network (DDQN) that enables the gateway to learn the optimal policy. The simulation results clearly show that the proposed deep reinforcement learning algorithm outperforms non-learning schemes in terms of network throughput.

cs.LG↗

Noncoherent Multiantenna Receivers for Cognitive Backscatter System with Multiple RF Sources

Cognitive backscattering, an integration of cognitive radio and backsatter modulation, is emerging as a potential candidate for green Internet of Things (IoT). In cognitive backscatter systems, the backscatter device (BD) shares not only the same spectrum, but also the same radio-frequency (RF) source with the legacy system. In this paper, we investigate the signal transmission problem, in which a basic transmission model is considered which consists of K RF sources, one BD and one reader equipped with M antennas. A non-cooperative scenario is considered, where there is no cooperation between the legacy systems and the backscatter system, and no pilots are transmitted from the RF sources or BD to the reader. The on-off keying differential modulation is adopted to achieve noncoherent transmission. Firstly, through the capacity analyses, we point out that high-throughput backscatter transmission can be achieved when the number of the receive antennas satisfies M>K. The Chernoff Information (CI) is also derived to predict the detection performance. Next, we address the signal detection problem at the reader. The optimal soft decision (SD) and suboptimal hard decision (HD) detectors are designed based on the maximum likelihood criterion. To tackle the non-cooperation challenge, a fully blind channel estimation method is proposed to learn the detection-required parameters based on clustering. Extensive numerical results verify the effectiveness of the proposed detectors and the channel estimation method. In addition, it is illustrated that the increase of K may not necessarily lead to performance degradation when multiple receive antennas are exploited.

eess.SP↗

Analyzing the Weighted Nuclear Norm Minimization and Nuclear Norm Minimization based on Group Sparse Representation

Rank minimization methods have attracted considerable interest in various areas, such as computer vision and machine learning. The most representative work is nuclear norm minimization (NNM), which can recover the matrix rank exactly under some restricted and theoretical guarantee conditions. However, for many real applications, NNM is not able to approximate the matrix rank accurately, since it often tends to over-shrink the rank components. To rectify the weakness of NNM, recent advances have shown that weighted nuclear norm minimization (WNNM) can achieve a better matrix rank approximation than NNM, which heuristically set the weight being inverse to the singular values. However, it still lacks a sound mathematical explanation on why WNNM is more feasible than NNM. In this paper, we propose a scheme to analyze WNNM and NNM from the perspective of the group sparse representation. Specifically, we design an adaptive dictionary to bridge the gap between the group sparse representation and the rank minimization models. Based on this scheme, we provide a mathematical derivation to explain why WNNM is more feasible than NNM. Moreover, due to the heuristical set of the weight, WNNM sometimes pops out error in the operation of SVD, and thus we present an adaptive weight setting scheme to avoid this error. We then employ the proposed scheme on two low-level vision tasks including image denoising and image inpainting. Experimental results demonstrate that WNNM is more feasible than NNM and the proposed scheme outperforms many current state-of-the-art methods.

cs.CV↗

A Learning-Based Coexistence Mechanism for LAA-LTE Based HetNets

License-assisted access LTE (LAA-LTE) has been proposed to deal with the intense contradiction between tremendous mobile traffic demands and crowded licensed spectrums. In this paper, we investigate the coexistence mechanism for LAA-LTE based heterogenous networks (HetNets). A joint resource allocation and network access problem is considered to maximize the normalized throughput of the unlicensed band while guaranteeing the quality-of-service requirements of incumbent WiFi users. A two-level learning-based framework is proposed to solve the problem by decomposing it into two subproblems. In the master level, a Q-learning based method is developed for the LAA-LTE system to determine the proper transmission time. In the slave one, a game-theory based learning method is adopted by each user to autonomously perform network access. Simulation results demonstrate the effectiveness of the proposed solution.

cs.NI↗

Optimal Resource Allocation in Full-Duplex Ambient Backscatter Communication Networks for Wireless-Powered IoT

This paper considers an ambient backscatter communication (AmBC) network in which a full-duplex access point (FAP) simultaneously transmits downlink orthogonal frequency division multiplexing (OFDM) signals to its legacy user (LU) and receives uplink signals backscattered from multiple BDs in a time-division-multiple-access manner. To maximize the system throughput and ensure fairness, we aim to maximize the minimum throughput among all BDs by jointly optimizing the backscatter time and reflection coefficients of the BDs, and the FAP's subcarrier power allocation, subject to the LU's throughput constraint, the BDs' harvested-energy constraints, and other practical constraints. For the case with a single BD, we obtain closed-form solutions and propose an efficient algorithm by using the Lagrange duality method. For the general case with multiple BDs, we propose an iterative algorithm by leveraging the block coordinated decent and successive convex optimization techniques. We further show the convergence performances of the proposed algorithms and analyze their complexities. In addition, we study the throughput region which characterizes the Pareto-optimal throughput trade-offs among all BDs. Finally, extensive simulation results show that the proposed joint design achieves significant throughput gain as compared to the benchmark schemes.

cs.IT↗

Optimal Resource Allocation in Full-Duplex Ambient Backscatter Communication Networks for Green IoT

Ambient backscatter communication (AmBC) enables wireless-powered backscatter devices (BDs) to transmit information over ambient radio-frequency (RF) carriers without using an RF transmitter, and thus has emerged as a promising technology for green Internet-of-Things. This paper considers an AmBC network in which a full-duplex access point (FAP) simultaneously transmits downlink orthogonal frequency division multiplexing (OFDM) signals to its legacy user (LU) and receives uplink signals backscattered from multiple BDs in a time-division-multiple-access manner. To enhance the system performance from multiple design dimensions and ensure fairness, we maximize the minimum throughput among all BDs by jointly optimizing the BDs' backscatter time portions, the BDs' power reflection coefficients, and the FAP's subcarrier power allocation, subject to the LU's throughput constraint, the BDs' harvested-energy constraints, and other practical constraints. As such, we propose an efficient iterative algorithm for solving the formulated non-convex problem by leveraging the block coordinated decent and successive convex optimization techniques. We further show the convergence of the proposed algorithm, and analyze its complexity. Finally, extensive simulation results show that the proposed joint design achieves significant throughput gains as compared to the benchmark scheme with equal resource allocation.

cs.IT↗

Performance Analysis for Practical Unmanned Aerial Vehicle Networks with LoS/NLoS Transmissions

In this paper, we provide a performance analysis for practical unmanned aerial vehicle (UAV)-enabled networks. By considering both line-of-sight (LoS) and non-line-of-sight (NLoS) transmissions between aerial base stations (BSs) and ground users, the coverage probability and the area spectral efficiency (ASE) are derived. Considering that there is no consensus on the path loss model for studying UAVs in the literature, in this paper, three path loss models, i.e., high-altitude model, low-altitude model and ultra-low-altitude model, are investigated and compared. Moreover, the lower bound of the network performance is obtained assuming that UAVs are hovering randomly according to homogeneous Poisson point process (HPPP), while the upper bound is derived assuming that UAVs can instantaneously move to the positions directly overhead ground users. From our analytical and simulation results for a practical UAV height of 50 meters, we find that the network performance of the high-altitude model and the low-altitude model exhibit similar trends, while that of the ultra-low-altitude model deviates significantly from the above two models. In addition, the optimal density of UAVs to maximize the coverage probability performance has also been investigated.

cs.NI↗

Riding on the Primary: A New Spectrum Sharing Paradigm for Wireless-Powered IoT Devices

In this paper, a new spectrum sharing model referred to as riding on the primary (ROP) is proposed for wireless-powered IoT devices with ambient backscatter communication capabilities. The key idea of ROP is that the secondary transmitter harvests energy from the primary signal, then modulates its information bits to the primary signal, and reflects the modulated signal to the secondary receiver without violating the primary system's interference requirement. Compared with the conventional spectrum sharing model, the secondary system in the proposed ROP not only utilizes the spectrum of the primary system but also takes advantage of the primary signal to harvest energy and to carry its information. In this paper, we investigate the performance of such a spectrum sharing system under fading channels. To be specific, we maximize the ergodic capacity of the secondary system by jointly optimizing the transmit power of the primary signal and the reflection coefficient of the secondary ambient backscatter. Different (ideal/practical) energy consumption models, different (peak/average) transmit power constraints, different types (fixed/dynamically adjustable) reflection coefficient, different primary system's interference requirements (rate/outage) are considered. Optimal power allocation and reflection coefficient are obtained for each scenario.

cs.IT↗

State of the Art, Taxonomy, and Open Issues on Cognitive Radio Networks with NOMA

The explosive growth of mobile devices and the rapid increase of wideband wireless services call for advanced communication techniques that can achieve high spectral efficiency and meet the massive connectivity requirement. Cognitive radio (CR) and non-orthogonal multiple access (NOMA) are envisioned to be important solutions for the fifth generation wireless networks. Integrating NOMA techniques into CR networks (CRNs) has the tremendous potential to improve spectral efficiency and increase the system capacity. However, there are many technical challenges due to the severe interference caused by using NOMA. Many efforts have been made to facilitate the application of NOMA into CRNs and to investigate the performance of CRNs with NOMA. This article aims to survey the latest research results along this direction. A taxonomy is devised to categorize the literature based on operation paradigms, enabling techniques, design objectives and optimization characteristics. Moreover, the key challenges are outlined to provide guidelines for the domain researchers and designers to realize CRNs with NOMA. Finally, the open issues are discussed.

cs.NI↗

Cooperative Ambient Backscatter Communications for Green Internet-of-Things

Ambient backscatter communication (AmBC) enables a passive backscatter device to transmit information to a reader using ambient RF signals, and has emerged as a promising solution to green Internet-of-Things (IoT). Conventional AmBC receivers are interested in recovering the information from the ambient backscatter device (A-BD) only. In this paper, we propose a cooperative AmBC (CABC) system in which the reader recovers information not only from the A-BD, but also from the RF source. We first establish the system model for the CABC system from spread spectrum and spectrum sharing perspectives. Then, for flat fading channels, we derive the optimal maximum-likelihood (ML) detector, suboptimal linear detectors as well as successive interference-cancellation (SIC) based detectors. For frequency-selective fading channels, the system model for the CABC system over ambient orthogonal frequency division multiplexing (OFDM) carriers is proposed, upon which a low-complexity optimal ML detector is derived. For both kinds of channels, the bit-error-rate (BER) expressions for the proposed detectors are derived in closed forms. Finally, extensive numerical results have shown that, when the A-BD signal and the RF-source signal have equal symbol period, the proposed SIC-based detectors can achieve near-ML detection performance for typical application scenarios, and when the A-BD symbol period is longer than the RF-source symbol period, the existence of backscattered signal in the CABC system can enhance the ML detection performance of the RF-source signal, thanks to the beneficial effect of the backscatter link when the A-BD transmits at a lower rate than the RF source.

cs.IT↗

DOA and Polarization Estimation for Non-Circular Signals in 3-D Millimeter Wave Polarized Massive MIMO Systems

In this paper, an algorithm of multiple signal classification (MUSIC) is proposed for two-dimensional (2-D) direction of- arrival (DOA) and polarization estimation of non-circular signal in three-dimensional (3-D) millimeter wave polarized largescale/ massive multiple-input-multiple-output (MIMO) systems. The traditional MUSIC-based algorithms can estimate either the DOA and polarization for circular signal or the DOA for non-circular signal by using spectrum search. By contrast, in the proposed algorithm only the DOA estimation needs spectrum search, and the polarization estimation has a closedform expression. First, a novel dimension-reduced MUSIC (DRMUSIC) is proposed for DOA and polarization estimation of circular signal with low computational complexity. Next, based on the quaternion theory, a novel algorithm named quaternion non-circular MUSIC (QNC-MUSIC) is proposed for parameter estimation of non-circular signal with high estimation accuracy. Then based on the DOA estimation result using QNC-MUSIC, the polarization estimation of non-circular signal is acquired by using the closed-form expression of the polarization estimation in DR-MUSIC. In addition, the computational complexity analysis shows that compared with the conventional DOA and polarization estimation algorithms, our proposed QNC-MUSIC and DRMUSIC have much lower computational complexity, especially when the source number is large. The stochastic Cramer-Rao Bound (CRB) for the estimation of the 2-D DOA and polarization parameters of the non-circular signals is derived as well. Finally, numerical examples are provided to demonstrate that the proposed algorithms can improve the parameter estimation performance when the large-scale/massive MIMO systems are employed.

eess.SP↗

Backscatter Multiplicative Multiple-Access Systems: Fundamental Limits and Practical Design

In this paper, we consider a novel ambient backscatter multiple-access system, where a receiver (Rx) simultaneously detects the signals transmitted from an active transmitter (Tx) and a backscatter Tag. Specifically, the information-carrying signal sent by the Tx arrives at the Rx through two wireless channels: the direct channel from the Tx to the Rx, and the backscatter channel from the Tx to the Tag and then to the Rx. The received signal from the backscatter channel also carries the Tag's information because of the multiplicative backscatter operation at the Tag. This multiple-access system introduces a new channel model, referred to as multiplicative multiple-access channel (M-MAC). We analyze the achievable rate region of the M-MAC, and prove that its region is strictly larger than that of the conventional time-division multiple-access scheme in many cases, including, e.g., the high SNR regime and the case when the direct channel is much stronger than the backscatter channel. Hence, the multiplicative multiple-access scheme is an attractive technique to improve the throughput for ambient backscatter communication systems. Moreover, we analyze the detection error rates for coherent and noncoherent modulation schemes adopted by the Tx and the Tag, respectively, in both synchronous and asynchronous scenarios, which further bring interesting insights for practical system design.

cs.IT↗

Applications of Economic and Pricing Models for Resource Management in 5G Wireless Networks: A Survey

This paper presents a comprehensive literature review on applications of economic and pricing theory for resource management in the evolving fifth generation (5G) wireless networks. The 5G wireless networks are envisioned to overcome existing limitations of cellular networks in terms of data rate, capacity, latency, energy efficiency, spectrum efficiency, coverage, reliability, and cost per information transfer. To achieve the goals, the 5G systems will adopt emerging technologies such as massive Multiple-Input Multiple-Output (MIMO), mmWave communications, and dense Heterogeneous Networks (HetNets). However, 5G involves multiple entities and stakeholders that may have different objectives, e.g., high data rate, low latency, utility maximization, and revenue/profit maximization. This poses a number of challenges to resource management designs of 5G. While the traditional solutions may neither efficient nor applicable, economic and pricing models have been recently developed and adopted as useful tools to achieve the objectives. In this paper, we review economic and pricing approaches proposed to address resource management issues in the 5G wireless networks including user association, spectrum allocation, and interference and power management. Furthermore, we present applications of economic and pricing models for wireless caching and mobile data offloading. Finally, we highlight important challenges, open issues and future research directions of applying economic and pricing models to the 5G wireless networks.

cs.GT↗

Channel Estimation for TDD/FDD Massive MIMO Systems with Channel Covariance Computing

In this paper, we propose a new channel estimation scheme for TDD/FDD massive MIMO systems by reconstructing uplink/downlink channel covariance matrices (CCMs) with the aid of array signal processing techniques. Specifically, the angle information and power angular spectrum (PAS) of each multi-path channel is extracted from the instantaneous uplink channel state information (CSI). Then, the uplink CCM is reconstructed and can be used to improve the uplink channel estimation without any additional training cost. In virtue of angle reciprocity as well as PAS reciprocity between uplink and downlink channels, the downlink CCM could also be inferred with a similar approach even for FDD massive MIMO systems. Then, the downlink instantaneous CSI can be obtained by training towards the dominant eigen-directions of each user. The proposed strategy is applicable for any kind of PAS distributions and array geometries. Numerical results are provided to demonstrate the superiority of the proposed methods over the existing ones.

cs.IT↗

Modulation in the Air: Backscatter Communication over Ambient OFDM Carrier

Ambient backscatter communication (AmBC) enables radio-frequency (RF) powered backscatter devices (BDs) (e.g., sensors, tags) to modulate their information bits over ambient RF carriers in an over-the-air manner. This technology also called "modulation in the air", thus has emerged as a promising solution to achieve green communications for future Internet-of-Things. This paper studies an AmBC system by leveraging the ambient orthogonal frequency division multiplexing (OFDM) modulated signals in the air. We first model such AmBC system from a spread-spectrum communication perspective, upon which a novel joint design for BD waveform and receiver detector is proposed. The BD symbol period is designed to be in general an integer multiplication of the OFDM symbol period, and the waveform for BD bit `0' maintains the same state within a BD symbol period, while the waveform for BD bit `1' has a state transition in the middle of each OFDM symbol period within a BD symbol period. In the receiver detector design, we construct the test statistic that cancels out the direct-link interference by exploiting the repeating structure of the ambient OFDM signals due to the use of cyclic prefix. For the system with a single-antenna receiver, the maximum-likelihood detector is proposed to recover the BD bits, for which the optimal threshold is obtained in closed-form expression. For the system with a multi-antenna receiver, we propose a new test statistic, and derive the optimal detector. Moreover, practical timing synchronization algorithms are proposed, and we also analyze the effect of various system parameters on the system performance. Finally, extensive numerical results are provided to verify that the proposed transceiver design can improve the system bit-error-rate (BER) performance and the operating range significantly, and achieve much higher data rate, as compared to the conventional design.

cs.IT↗