arXiv subjects

Chencheng Ye

Publications and source records attributed to Chencheng Ye.

9 recordsLinked to original sources

arXiv2022

Sample-based and Feature-based Federated Learning for Unconstrained and Constrained Nonconvex Optimization via Mini-batch SSCA

Federated learning (FL) has become a hot research area in enabling the collaborative training of machine learning models among multiple clients that hold sensitive local data. Nevertheless, unconstrained federated optimization has been studied mainly using stochastic gradient descent (SGD), which may converge slowly, and constrained federated optimization, which is more challenging, has not been investigated so far. This paper investigates sample-based and feature-based federated optimization, respectively, and considers both unconstrained and constrained nonconvex problems for each of them. First, we propose FL algorithms using stochastic successive convex approximation (SSCA) and mini-batch techniques. These algorithms can adequately exploit the structures of the objective and constraint functions and incrementally utilize samples. We show that the proposed FL algorithms converge to stationary points and Karush-Kuhn-Tucker (KKT) points of the respective unconstrained and constrained nonconvex problems, respectively. Next, we provide algorithm examples with appealing computational complexity and communication load per communication round. We show that the proposed algorithm examples for unconstrained federated optimization are identical to FL algorithms via momentum SGD and provide an analytical connection between SSCA and momentum SGD. Finally, numerical experiments demonstrate the inherent advantages of the proposed algorithms in convergence speeds, communication and computation costs, and model specifications.

cs.LG↗

arXiv2021

Sample-based Federated Learning via Mini-batch SSCA

In this paper, we investigate unconstrained and constrained sample-based federated optimization, respectively. For each problem, we propose a privacy preserving algorithm using stochastic successive convex approximation (SSCA) techniques, and show that it can converge to a Karush-Kuhn-Tucker (KKT) point. To the best of our knowledge, SSCA has not been used for solving federated optimization, and federated optimization with nonconvex constraints has not been investigated. Next, we customize the two proposed SSCA-based algorithms to two application examples, and provide closed-form solutions for the respective approximate convex problems at each iteration of SSCA. Finally, numerical experiments demonstrate inherent advantages of the proposed algorithms in terms of convergence speed, communication cost and model specification.

cs.LG↗

arXiv2020

Analysis and Optimization of an Intelligent Reflecting Surface-assisted System with Interference

In this paper, we study an intelligent reflecting surface (IRS)-assisted system where a multi-antenna base station (BS) serves a single-antenna user with the help of a multi-element IRS in the presence of interference generated by a multi-antenna BS serving its own single-antenna user. The signal and interference links via the IRS are modeled with Rician fading. To reduce phase adjustment cost, we adopt quasi-static phase shift design where the phase shifts do not change with the instantaneous channel state information (CSI). We investigate two cases of CSI at the BSs, namely, the instantaneous CSI case and the statistical CSI case, and apply Maximum Ratio Transmission (MRT) based on the complete CSI and the CSI of the Line-of-sight (LoS) components, respectively. Different costs on channel estimation and beamforming adjustment are incurred in the two CSI cases. First, we obtain a tractable expression of the average rate in the instantaneous CSI case and a tractable expression of the ergodic rate in the statistical CSI case. We also provide sufficient conditions for the average rate in the instantaneous CSI case to surpass the ergodic rate in the statistical CSI case, at any phase shifts. Then, we maximize the average rate and ergodic rate, both with respect to the phase shifts, leading to two non-convex optimization problems. For each problem, we obtain a globally optimal solution under certain system parameters, and propose an iterative algorithm based on parallel coordinate descent (PCD) to obtain a stationary point under arbitrary system parameters. Next, in each CSI case, we provide sufficient conditions under which the optimal quasi-static phase shift design is beneficial, compared to the system without IRS. Finally, we numerically verify the analytical results and demonstrate notable gains of the proposal solutions over existing ones.

cs.IT↗

arXiv2020

Optimal Wireless Streaming of Multi-Quality 360 VR Video by Exploiting Natural, Relative Smoothness-enabled and Transcoding-enabled Multicast Opportunities

In this paper, we would like to investigate optimal wireless streaming of a multi-quality tiled 360 virtual reality (VR) video from a server to multiple users. To this end, we propose to maximally exploit potential multicast opportunities by effectively utilizing characteristics of multi-quality tiled 360 VR videos and computation resources at the users' side. In particular, we consider two requirements for quality variation in one field-of-view (FoV), i.e., the absolute smoothness requirement and the relative smoothness requirement, and two video playback modes, i.e., the direct-playback mode (without user transcoding) and transcode-playback mode (with user transcoding). Besides natural multicast opportunities, we introduce two new types of multicast opportunities, namely, relative smoothness-enabled multicast opportunities, which allow flexible tradeoff between viewing quality and communications resource consumption, and transcoding-enabled multicast opportunities, which allow flexible tradeoff between computation and communications resource consumptions. Then, we establish a novel mathematical model that reflects the impacts of natural, relative smoothness-enabled and transcoding-enabled multicast opportunities on the average transmission energy and transcoding energy. Based on this model, we optimize the transmission resource allocation, playback quality level selection and transmission quality level selection to minimize the energy consumption in the four cases with different requirements for quality variation and video playback modes. By comparing the optimal values in the four cases, we prove that the energy consumption reduces when more multicast opportunities can be utilized. Finally, numerical results show substantial gains of the proposed solutions over existing schemes, and demonstrate the importance of effective exploitation of the three types of multicast opportunities.

cs.IT↗

arXiv2020

Rate Splitting for Multi-Antenna Downlink: Precoder Design and Practical Implementation

Rate splitting (RS) is a potentially powerful and flexible technique for multi-antenna downlink transmission. In this paper, we address several technical challenges towards its practical implementation for beyond 5G systems. To this end, we focus on a single-cell system with a multi-antenna base station (BS) and K single-antenna receivers. We consider RS in its most general form, and joint decoding to fully exploit the potential of RS. First, we investigate the achievable rates under joint decoding and formulate the precoder design problems to maximize a general utility function, or to minimize the transmit power under pre-defined rate targets. Building upon the concave-convex procedure (CCCP), we propose precoder design algorithms for an arbitrary number of users. Our proposed algorithms approximate the intractable non-convex problems with a number of successively refined convex problems, and provably converge to stationary points of the original problems. Then, to reduce the decoding complexity, we consider the optimization of the precoder and the decoding order under successive decoding. Further, we propose a stream selection algorithm to reduce the number of precoded signals. With a reduced number of streams and successive decoding at the receivers, our proposed algorithm can even be implemented when the number of users is relatively large, whereas the complexity was previously considered as prohibitively high in the same setting. Finally, we propose a simple adaptation of our algorithms to account for the imperfection of the channel state information at the transmitter. Numerical results demonstrate that the general RS scheme provides a substantial performance gain as compared to state-of-the-art linear precoding schemes, especially with a moderately large number of users.

cs.IT↗

arXiv2020

Optimal Transmission of Multi-Quality Tiled 360 VR Video by Exploiting Multicast Opportunities

In this paper, we would like to investigate fundamental impacts of multicast opportunities on efficient transmission of a 360 VR video to multiple users in the cases with and without transcoding at each user. We establish a novel mathematical model that reflects the impacts of multicast opportunities on the average transmission energy in both cases and the transcoding energy in the case with user transcoding, and facilitates the optimal exploitation of transcoding-enabled multicast opportunities. In the case without user transcoding, we optimize the transmission resource allocation to minimize the average transmission energy by exploiting natural multicast opportunities. The problem is nonconvex. We transform it to an equivalent convex problem and obtain an optimal solution using standard convex optimization techniques. In the case with user transcoding, we optimize the transmission resource allocation and the transmission quality level selection to minimize the weighted sum of the average transmission energy and the transcoding energy by exploiting both natural and transcoding-enabled multicast opportunities. The problem is a challenging mixed discrete-continuous optimization problem. We transform it to a Difference of Convex (DC) programming problem and obtain a suboptimal solution using a DC algorithm. Finally, numerical results demonstrate the importance of effective exploitation of transcoding-enabled multicast opportunities in the case with user transcoding.

cs.IT↗

arXiv2019

Stochastic Successive Convex Approximation for General Stochastic Optimization Problems

One key challenge for solving a general stochastic optimization problem with expectations in the objective and constraint functions using ordinary stochastic iterative methods lies in the infeasibility issue caused by the randomness over iterates. This letter aims to address this main challenge. First, we obtain an equivalent stochastic optimization problem which is to minimize the weighted sum of the original objective and the penalty for violating the original constraints. Then, we propose a stochastic successive convex approximation (SSCA) method to obtain a stationary point of the original stochastic optimization problem. Using similar techniques, we propose a parallel SSCA method to obtain a stationary point of a special case of the general stochastic optimization problem which has decoupled constraint functions. We also provide application examples of the proposed methods in power control for interference networks. The proposed SSCA and parallel SSCA methods achieve empirically higher convergence rates and lower computational complexities than existing ones, benefiting from the elegant way of balancing the objective minimization and constraint satisfaction over random iterates.

cs.IT↗

arXiv2019

Optimal Caching Designs for Perfect, Imperfect and Unknown File Popularity Distributions in Large-Scale Multi-Tier Wireless Networks

Most existing caching solutions for wireless networks rest on an unrealistic assumption that the file popularity distribution is perfectly known. In this paper, we consider optimal caching designs for perfect, imperfect and unknown file popularity distributions in large-scale multi-tier wireless networks. First, in the case of perfect file popularity distribution, we formulate the optimization problem to maximize the successful transmission probability (STP), which is a nonconvex problem. We develop an efficient parallel iterative algorithm to obtain a stationary point using parallel successive convex approximation (SCA). Then, in the case of imperfect file popularity distribution, we formulate the robust optimization problem to maximize the worst-case STP. To solve this challenging maximin problem, we transform it to an equivalent complementary geometric programming (CGP), and develop an efficient iterative algorithm which is shown to converge to a stationary point using SCA. To the best of our knowledge, this is the first work explicitly considering the estimation error of file popularity distribution in the optimization of caching design. Next, in the case of unknown file popularity distribution, we formulate the stochastic optimization problem to maximize the stochastic STP (i.e., the STP in the stochastic form), which is a challenging nonconvex stochastic optimization problem. Based on stochastic parallel SCA, we develop an efficient iterative algorithm to obtain a stationary point, by exploiting structural properties of the stochastic STP and making full use of instantaneous file requests. As far as we know, this is the first work considering stochastic optimization in a large-scale multi-tier wireless network. Finally, by numerical results, we show that the proposed solutions achieve significant gains over existing schemes in all three cases.

cs.IT↗

arXiv2019

Optimal Multi-Quality Multicast for 360 Virtual Reality Video

A 360 virtual reality (VR) video, recording a scene of interest in every direction, provides VR users with immersive viewing experience. However, transmission of a 360 VR video which is of a much larger size than a traditional video to mobile users brings a heavy burden to a wireless network. In this paper, we consider multi-quality multicast of a 360 VR video from a single server to multiple users using time division multiple access (TDMA). To improve transmission efficiency, tiling is adopted, and each tile is pre-encoded into multiple representations with different qualities. We optimize the quality level selection, transmission time allocation and transmission power allocation to maximize the total utility of all users under the transmission time and power allocation constraints as well as the quality smoothness constraints for mixed-quality tiles. The problem is a challenging mixed discrete-continuous opti-mization problem. We propose two low-complexity algorithms to obtain two suboptimal solutions, using continuous relaxation and DC programming, respectively. Finally, numerical results demonstrate the advantage of the proposed solutions.

cs.IT↗