arXiv subjects

Yuanming Shi

Publications and source records attributed to Yuanming Shi.

At least 91 records · Page 5Linked to original sources

arXiv2020

Fast Convergence Algorithm for Analog Federated Learning

In this paper, we consider federated learning (FL) over a noisy fading multiple access channel (MAC), where an edge server aggregates the local models transmitted by multiple end devices through over-the-air computation (AirComp). To realize efficient analog federated learning over wireless channels, we propose an AirComp-based FedSplit algorithm, where a threshold-based device selection scheme is adopted to achieve reliable local model uploading. In particular, we analyze the performance of the proposed algorithm and prove that the proposed algorithm linearly converges to the optimal solutions under the assumption that the objective function is strongly convex and smooth. We also characterize the robustness of proposed algorithm to the ill-conditioned problems, thereby achieving fast convergence rates and reducing communication rounds. A finite error bound is further provided to reveal the relationship between the convergence behavior and the channel fading and noise. Our algorithm is theoretically and experimentally verified to be much more robust to the ill-conditioned problems with faster convergence compared with other benchmark FL algorithms.

cs.IT↗

arXiv2020

Graph Neural Networks for Scalable Radio Resource Management: Architecture Design and Theoretical Analysis

Deep learning has recently emerged as a disruptive technology to solve challenging radio resource management problems in wireless networks. However, the neural network architectures adopted by existing works suffer from poor scalability, generalization, and lack of interpretability. A long-standing approach to improve scalability and generalization is to incorporate the structures of the target task into the neural network architecture. In this paper, we propose to apply graph neural networks (GNNs) to solve large-scale radio resource management problems, supported by effective neural network architecture design and theoretical analysis. Specifically, we first demonstrate that radio resource management problems can be formulated as graph optimization problems that enjoy a universal permutation equivariance property. We then identify a class of neural networks, named \emph{message passing graph neural networks} (MPGNNs). It is demonstrated that they not only satisfy the permutation equivariance property, but also can generalize to large-scale problems while enjoying a high computational efficiency. For interpretablity and theoretical guarantees, we prove the equivalence between MPGNNs and a class of distributed optimization algorithms, which is then used to analyze the performance and generalization of MPGNN-based methods. Extensive simulations, with power control and beamforming as two examples, will demonstrate that the proposed method, trained in an unsupervised manner with unlabeled samples, matches or even outperforms classic optimization-based algorithms without domain-specific knowledge. Remarkably, the proposed method is highly scalable and can solve the beamforming problem in an interference channel with $1000$ transceiver pairs within $6$ milliseconds on a single GPU.

cs.IT↗

arXiv2020

Stochastic Beamforming for Reconfigurable Intelligent Surface Aided Over-the-Air Computation

Over-the-air computation (AirComp) is a promising technology that is capable of achieving fast data aggregation in Internet of Things (IoT) networks. The mean-squared error (MSE) performance of AirComp is bottlenecked by the unfavorable channel conditions. This limitation can be mitigated by deploying a reconfigurable intelligent surface (RIS), which reconfigures the propagation environment to facilitate the receiving power equalization. The achievable performance of RIS relies on the availability of accurate channel state information (CSI), which however is generally difficult to be obtained. In this paper, we consider an RIS-aided AirComp IoT network, where an access point (AP) aggregates sensing data from distributed devices. Without assuming any prior knowledge on the underlying channel distribution, we formulate a stochastic optimization problem to maximize the probability that the MSE is below a certain threshold. The formulated problem turns out to be non-convex and highly intractable. To this end, we propose a data-driven approach to jointly optimize the receive beamforming vector at the AP and the phase-shift vector at the RIS based on historical channel realizations. After smoothing the objective function by adopting the sigmoid function, we develop an alternating stochastic variance reduced gradient (SVRG) algorithm with a fast convergence rate to solve the problem. Simulation results demonstrate the effectiveness of the proposed algorithm and the importance of deploying an RIS in reducing the MSE outage probability.

cs.IT↗

arXiv2020

Reconfigurable Intelligent Surface Assisted Massive MIMO with Antenna Selection

Antenna selection is capable of reducing the hardware complexity of massive multiple-input multiple-output (MIMO) networks at the cost of certain performance degradation. Reconfigurable intelligent surface (RIS) has emerged as a cost-effective technique that can enhance the spectrum-efficiency of wireless networks by reconfiguring the propagation environment. By employing RIS to compensate the performance loss due to antenna selection, in this paper we propose a new network architecture, i.e., RIS-assisted massive MIMO system with antenna selection, to enhance the system performance while enjoying a low hardware cost. This is achieved by maximizing the channel capacity via joint antenna selection and passive beamforming while taking into account the cardinality constraint of active antennas and the unit-modulus constraints of all RIS elements. However, the formulated problem turns out to be highly intractable due to the non-convex constraints and coupled optimization variables, for which an alternating optimization framework is provided, yielding antenna selection and passive beamforming subproblems. The computationally efficient submodular optimization algorithms are developed to solve the antenna selection subproblem under different channel state information assumptions. The iterative algorithms based on block coordinate descent are further proposed for the passive beamforming design by exploiting the unique problem structures. Experimental results will demonstrate the algorithmic advantages and desirable performance of the proposed algorithms for RIS- assisted massive MIMO systems with antenna selection.

cs.IT↗

arXiv2020

Reconfigurable-Intelligent-Surface Empowered Wireless Communications: Challenges and Opportunities

Reconfigurable intelligent surfaces (RISs) are regarded as a promising emerging hardware technology to improve the spectrum and energy efficiency of wireless networks by artificially reconfiguring the propagation environment of electromagnetic waves. Due to the unique advantages in enhancing wireless channel capacity, RISs have recently become a hot research topic. In this article, we focus on three fundamental physical-layer challenges for the incorporation of RISs into wireless networks, namely, channel state information acquisition, passive information transfer, and low-complexity robust system design. We summarize the state-of-the-art solutions and explore potential research directions. Furthermore, we discuss other promising research directions of RISs, including edge intelligence and physical-layer security.

cs.IT↗

arXiv2020

Distributed Optimization for Massive Connectivity

Massive device connectivity in Internet of Thing (IoT) networks with sporadic traffic poses significant communication challenges. To overcome this challenge, the serving base station is required to detect the active devices and estimate the corresponding channel state information during each coherence block. The corresponding joint activity detection and channel estimation problem can be formulated as a group sparse estimation problem, also known under the name "Group Lasso". This letter presents a fast and efficient distributed algorithm to solve such Group Lasso problems, which alternates between solving small-scaled problems in parallel and dealing with a linear equation for consensus. Numerical results demonstrate the speedup of this algorithm compared with the state-of-the-art methods in terms of convergence speed and computation time.

eess.SP↗

arXiv2020

Reconfigurable Intelligent Surface Enhanced Cognitive Radio Networks

The cognitive radio (CR) network is a promising network architecture that meets the requirement of enhancing scarce radio spectrum utilization. Meanwhile, reconfigurable intelligent surfaces (RIS) is a promising solution to enhance the energy and spectrum efficiency of wireless networks by properly altering the signal propagation via tuning a large number of passive reflecting units. In this paper, we investigate the downlink transmit power minimization problem for the RIS-enhanced single-cell cognitive radio (CR) network coexisting with a single-cell primary radio (PR) network by jointly optimizing the transmit beamformers at the secondary user (SU) transmitter and the phase shift matrix at the RIS. The investigated problem is a highly intractable due to the coupled optimization variables and unit modulus constraint, for which an alternative minimization framework is presented. Furthermore, a novel difference-of-convex (DC) algorithm is developed to solve the resulting non-convex quadratic program by lifting it into a low-rank matrix optimization problem. We then represent non-convex rank-one constraint as a DC function by exploiting the difference between trace norm and spectral norm. The simulation results validate that our proposed algorithm outperforms the existing state-of-the-art methods.

eess.SP↗

arXiv2020

Outage Minimization for Intelligent Reflecting Surface Aided MISO Communication Systems via Stochastic Beamforming

Intelligent reflecting surface (IRS) has the potential to significantly enhance the network performance by reconfiguring the wireless propagation environments. It is however difficult to obtain the accurate downlink channel state information (CSI) for efficient beamforming design in IRS-aided wireless networks. In this article, we consider an IRS-aided downlink multiple-input single-output (MISO) network, where the base station (BS) is not required to know the underlying channel distribution. We formulate an outage probability minimization problem by jointly optimizing the beamforming vector at the BS and the phase-shift matrix at the IRS, while taking into account the transmit power and unimodular constraints. The formulated problem turns out to be a non-convex non-smooth stochastic optimization problem. To this end, we employ the sigmoid function as the surrogate to tackle the non-smoothness of the objective function. In addition, we propose a data-driven efficient alternating stochastic gradient descent (SGD) algorithm to solve the problem by utilizing the historical channel samples. Simulation results demonstrate the performance gains of the proposed algorithm over the benchmark methods in terms of minimizing the outage probability.

cs.IT↗

arXiv2020

Reconfigurable Intelligent Surface for Interference Alignment in MIMO Device-to-Device Networks

In multiple-input multiple-output (MIMO) device-to-device (D2D) networks, interference and rank-deficient channels are the critical bottlenecks for achieving high degrees of freedom (DoFs). In this paper, we propose a reconfigurable intelligent surface (RIS) assisted interference alignment strategy to simultaneous mitigate the co-channel interference and cope with rank-deficient channels, thereby improving the feasibility of interference alignment conditions and in turn increasing the achievable DoFs. The key enabler is a general low-rank optimization approach that maximizes the achievable DoFs by jointly designing the phase-shift and transceiver matrices. To address the unique challenges of the coupled optimization variables, we develop a block-structured Riemannian pursuit method by solving fixed-rank and unit modulus constrained least square subproblems along with rank increase. Finally, to reduce the computational complexity and achieve good DoF performance, we develop unified Riemannian conjugate gradient algorithms to alternately optimize the fixed-rank transceiver matrix and the unit modulus constrained phase shifter by exploiting the non-compact Stiefel manifold and the complex circle manifold, respectively. Numerical results demonstrate the effectiveness of deploying an RIS and the superiority of the proposed block-structured Riemannian pursuit method in terms of the achievable DoFs and the achievable sum rate.

eess.SP↗

arXiv2020

Towards Reconfigurable Intelligent Surfaces Powered Green Wireless Networks

The adoption of reconfigurable intelligent surface (RIS) in wireless networks can enhance the spectrum- and energy-efficiency by controlling the propagation environment. Although the RIS does not consume any transmit power, the circuit power of the RIS cannot be ignored, especially when the number of reflecting elements is large. In this paper, we propose the joint design of beamforming vectors at the base station, active RIS set, and phase-shift matrices at the active RISs to minimize the network power consumption, including the RIS circuit power consumption, while taking into account each user's target data rate requirement and each reflecting element's constant modulus constraint. However, the formulated problem is a mixed-integer quadratic programming (MIQP) problem, which is NP-hard. To this end, we present an alternating optimization method, which alternately solves second order cone programming (SOCP) and MIQP problems to update the optimization variables. Specifically, the MIQP problem is further transformed into a semidefinite programming problem by applying binary relaxation and semidefinite relaxation. Finally, an efficient algorithm is developed to solve the problem. Simulation results show that the proposed algorithm significantly reduces the network power consumption and reveal the importance of taking into account the RIS circuit power consumption.

cs.IT↗

arXiv2020

Communication-Efficient Edge AI Inference Over Wireless Networks

Given the fast growth of intelligent devices, it is expected that a large number of high-stake artificial intelligence (AI) applications, e.g., drones, autonomous cars, tactile robots, will be deployed at the edge of wireless networks in the near future. As such, the intelligent communication networks will be designed to leverage advanced wireless techniques and edge computing technologies to support AI-enabled applications at various end devices with limited communication, computation, hardware and energy resources. In this article, we shall present the principles of efficient deployment of model inference at network edge to provide low-latency and energy-efficient AI services. This includes the wireless distributed computing framework for low-latency device distributed model inference as well as the wireless cooperative transmission strategy for energy-efficient edge cooperative model inference. The communication efficiency of edge inference systems is further improved by building up a smart radio propagation environment via intelligent reflecting surface.

eess.SP↗

arXiv2020

Federated Machine Learning for Intelligent IoT via Reconfigurable Intelligent Surface

Intelligent Internet-of-Things (IoT) will be transformative with the advancement of artificial intelligence and high-dimensional data analysis, shifting from "connected things" to "connected intelligence". This shall unleash the full potential of intelligent IoT in a plethora of exciting applications, such as self-driving cars, unmanned aerial vehicles, healthcare, robotics, and supply chain finance. These applications drive the need of developing revolutionary computation, communication and artificial intelligence technologies that can make low-latency decisions with massive real-time data. To this end, federated machine learning, as a disruptive technology, is emerged to distill intelligence from the data at network edge, while guaranteeing device privacy and data security. However, the limited communication bandwidth is a key bottleneck of model aggregation for federated machine learning over radio channels. In this article, we shall develop an over-the-air computation based communication-efficient federated machine learning framework for intelligent IoT networks via exploiting the waveform superposition property of a multi-access channel. Reconfigurable intelligent surface is further leveraged to reduce the model aggregation error via enhancing the signal strength by reconfiguring the wireless propagation environments.

eess.SP↗

arXiv2020

Large-Scale Beamforming for Massive MIMO via Randomized Sketching

Massive MIMO system yields significant improvements in spectral and energy efficiency for future wireless communication systems. The regularized zero-forcing (RZF) beamforming is able to provide good performance with the capability of achieving numerical stability and robustness to the channel uncertainty. However, in massive MIMO systems, the matrix inversion operation in RZF beamforming becomes computationally expensive. To address this computational issue, we shall propose a novel randomized sketching based RZF beamforming approach with low computational complexity. This is achieved by solving a linear system via randomized sketching based on the preconditioned Richard iteration, which guarantees high quality approximations to the optimal solution. We theoretically prove that the sequence of approximations obtained iteratively converges to the exact RZF beamforming matrix linearly fast as the number of iterations increases. Also, it turns out that the system sum-rate for such sequence of approximations converges to the exact one at a linear convergence rate. Our simulation results verify our theoretical findings.

cs.IT↗

arXiv2020

Reconfigurable Intelligent Surface Empowered Downlink Non-Orthogonal Multiple Access

Power-domain non-orthogonal multiple access (NOMA) has become a promising technology to exploit the new dimension of the power domain to enhance the spectral efficiency of wireless networks. However, most existing NOMA schemes rely on the strong assumption that users' channel gains are quite different, which may be invalid in practice. To unleash the potential of power-domain NOMA, we will propose a reconfigurable intelligent surface (RIS)-empowered NOMA network to introduce desirable channel gain differences among the users by adjusting the phase shifts at RIS. Our goal is to minimize the total transmit power by jointly optimizing the beamforming vectors at the base station and the phase-shift matrix at the RIS. To address the highly coupled optimization variables, we present an alternating optimization framework to decompose the non-convex bi-quadratically constrained quadratic problem into two rank-one constrained matrices optimization problems via matrix lifting. At the same time, to accurately detect the feasibility of the non-convex rank-one constraints and improve performance by avoiding early stopping in the alternating optimization procedure, we equivalently represent the rank-one constraint as the difference between nuclear norm and spectral norm. A difference-of-convex (DC) algorithm is further developed to solve the resulting DC programs via successive convex relaxation, followed by establishing the convergence of the proposed DC-based alternating optimization method. We further propose an efficient user ordering scheme with closed-form expressions, considering both the channel conditions and users' target data rates. Simulation results will validate the effectiveness of deploying an RIS and the superiority of the proposed DC-based alternating optimization method in reducing the total transmit power.

eess.SP↗

arXiv2020

Sparse Optimization for Green Edge AI Inference

With the rapid upsurge of deep learning tasks at the network edge, effective edge artificial intelligence (AI) inference becomes critical to provide low-latency intelligent services for mobile users via leveraging the edge computing capability. In such scenarios, energy efficiency becomes a primary concern. In this paper, we present a joint inference task selection and downlink beamforming strategy to achieve energy-efficient edge AI inference through minimizing the overall power consumption consisting of both computation and transmission power consumption, yielding a mixed combinatorial optimization problem. By exploiting the inherent connections between the set of task selection and group sparsity structural transmit beamforming vector, we reformulate the optimization as a group sparse beamforming problem. To solve this challenging problem, we propose a log-sum function based three-stage approach. By adopting the log-sum function to enhance the group sparsity, a proximal iteratively reweighted algorithm is developed. Furthermore, we establish the global convergence analysis and provide the ergodic worst-case convergence rate for this algorithm. Simulation results will demonstrate the effectiveness of the proposed approach for improving energy efficiency in edge AI inference systems.

cs.IT↗

arXiv2020

Energy-Efficient Processing and Robust Wireless Cooperative Transmission for Edge Inference

Edge machine learning can deliver low-latency and private artificial intelligent (AI) services for mobile devices by leveraging computation and storage resources at the network edge. This paper presents an energy-efficient edge processing framework to execute deep learning inference tasks at the edge computing nodes whose wireless connections to mobile devices are prone to channel uncertainties. Aimed at minimizing the sum of computation and transmission power consumption with probabilistic quality-of-service (QoS) constraints, we formulate a joint inference tasking and downlink beamforming problem that is characterized by a group sparse objective function. We provide a statistical learning based robust optimization approach to approximate the highly intractable probabilistic-QoS constraints by nonconvex quadratic constraints, which are further reformulated as matrix inequalities with a rank-one constraint via matrix lifting. We design a reweighted power minimization approach by iteratively reweighted $\ell_1$ minimization with difference-of-convex-functions (DC) regularization and updating weights, where the reweighted approach is adopted for enhancing group sparsity whereas the DC regularization is designed for inducing rank-one solutions. Numerical results demonstrate that the proposed approach outperforms other state-of-the-art approaches.

cs.IT↗

arXiv2020

Communication-Efficient Edge AI: Algorithms and Systems

Artificial intelligence (AI) has achieved remarkable breakthroughs in a wide range of fields, ranging from speech processing, image classification to drug discovery. This is driven by the explosive growth of data, advances in machine learning (especially deep learning), and easy access to vastly powerful computing resources. Particularly, the wide scale deployment of edge devices (e.g., IoT devices) generates an unprecedented scale of data, which provides the opportunity to derive accurate models and develop various intelligent applications at the network edge. However, such enormous data cannot all be sent from end devices to the cloud for processing, due to the varying channel quality, traffic congestion and/or privacy concerns. By pushing inference and training processes of AI models to edge nodes, edge AI has emerged as a promising alternative. AI at the edge requires close cooperation among edge devices, such as smart phones and smart vehicles, and edge servers at the wireless access points and base stations, which however result in heavy communication overheads. In this paper, we present a comprehensive survey of the recent developments in various techniques for overcoming these communication challenges. Specifically, we first identify key communication challenges in edge AI systems. We then introduce communication-efficient techniques, from both algorithmic and system perspectives for training and inference tasks at the network edge. Potential future research directions are also highlighted.

cs.IT↗

arXiv2020

Coordinated Passive Beamforming for Distributed Intelligent Reflecting Surfaces Network

Intelligent reflecting surface (IRS) is a proposing technology in 6G to enhance the performance of wireless networks by smartly reconfiguring the propagation environment with a large number of passive reflecting elements. However, current works mainly focus on single IRS-empowered wireless networks, where the channel rank deficiency problem has emerged. In this paper, we propose a distributed IRS-empowered communication network architecture, where multiple source-destination pairs communicate through multiple distributed IRSs. We further contribute to maximize the achievable sum-rates in this network via jointly optimizing the transmit power vector at the sources and the phase shift matrix with passive beamforming at all distributed IRSs. Unfortunately, this problem turns out to be non-convex and highly intractable, for which an alternating approach is developed via solving the resulting fractional programming problems alternatively. In particular, the closed-form expressions are proposed for coordinated passive beamforming at IRSs. The numerical results will demonstrate the algorithmic advantages and desirable performances of the distributed IRS-empowered communication network.

cs.IT↗