arXiv subjects

Shun Zhang

Publications and source records attributed to Shun Zhang.

At least 109 records · Page 6Linked to original sources

arXiv2020

Differentially Private Combinatorial Cloud Auction

Cloud service providers typically provide different types of virtual machines (VMs) to cloud users with various requirements. Thanks to its effectiveness and fairness, auction has been widely applied in this heterogeneous resource allocation. Recently, several strategy-proof combinatorial cloud auction mechanisms have been proposed. However, they fail to protect the bid privacy of users from being inferred from the auction results. In this paper, we design a differentially private combinatorial cloud auction mechanism (DPCA) to address this privacy issue. Technically, we employ the exponential mechanism to compute a clearing unit price vector with a probability proportional to the corresponding revenue. We further improve the mechanism to reduce the running time while maintaining high revenues, by computing a single clearing unit price, or a subgroup of clearing unit prices at a time, resulting in the improved mechanisms DPCA-S and its generalized version DPCA-M, respectively. We theoretically prove that our mechanisms can guarantee differential privacy, approximate truthfulness and high revenue. Extensive experimental results demonstrate that DPCA can generate near-optimal revenues at the price of relatively high time complexity, while the improved mechanisms achieve a tunable trade-off between auction revenue and running time.

cs.CR↗

arXiv2019

Differentially Private Aggregated Mobility Data Publication Using Moving Characteristics

With the rapid development of GPS enabled devices (smartphones) and location-based applications, location privacy is increasingly concerned. Intuitively, it is widely believed that location privacy can be preserved by publishing aggregated mobility data, such as the number of users in an area at some time. However, a recent attack shows that these aggregated mobility data can be exploited to recover individual trajectories. In this paper, we first propose two differentially private basic schemes for aggregated mobility data publication, namely direct perturbation and threshold perturbation, which preserve location privacy of users and especially resist the trajectory recovery attack. Then, we explore the moving characteristics of mobile users, and design an improved scheme named static hybrid perturbation by combining the two basic schemes according to the moving characteristics. Since static hybrid perturbation works only for static data, which are entirely available before publishing, we further adapt the static hybrid perturbation by combining it with linear regression, and yield another improved scheme named dynamic hybrid perturbation. The dynamic hybrid perturbation works also for dynamic data, which are generated on the fly during publication. Privacy analysis shows that the proposed schemes achieve differential privacy. Extensive experiments on both simulated and real datasets demonstrate that all proposed schemes resist the trajectory recovery attack well, and the improved schemes significantly outperform the basic schemes.

cs.CR↗

arXiv2019

Multi-Antenna Covert Communications with Random Access Protocol

In this paper, we consider the issue of covert communications with random access protocol. We consider that the legitimate user Bob has no priori knowledge about packet arrival time and thus employs data-aided frame detection based on reference sequence. The warden user Willie tries to detect this covert communication by using a radiometer. The detection performance analysis is provided for both Bob and Willie under Rayleigh fading channel. It is demonstrated that the covert performance can benefit from the increase of the frame length or the number of receive antennas from frame detection perspective. Numerical results are provided to verify the proposed studies.

cs.IT↗

arXiv2019

Adaptive Flux-Only Least-Squares Finite Element Methods for Linear Transport Equations

In this paper, two flux-only least-squares finite element methods (LSFEM) for the linear hyperbolic transport problem are developed. The transport equation often has discontinuous solutions and discontinuous inflow boundary conditions, but the normal component of the flux across the mesh interfaces is continuous. In traditional LSFEMs, the continuous finite element space is used to approximate the solution. This will cause unnecessary error around the discontinuity and serious overshooting. In arXiv:1807.01524 [math.NA], we reformulate the equation by introducing a new flux variable to separate the continuity requirements of the flux and the solution. Realizing that the Raviart-Thomas mixed element space has enough degrees of freedom to approximate both the flux and its divergence, we eliminate the solution from the system and get two flux-only formulations, and develop corresponding LSFEMs. The solution then is recovered by simple post-processing methods using its relation with the flux. These two versions of flux-only LSFEMs use less DOFs than the method we developed in arXiv:1807.01524 [math.NA]. Similar to the LSFEM developed in arXiv:1807.01524 [math.NA], both flux-only LSFEMs can handle discontinuous solutions better than the traditional continuous polynomial approximations. We show the existence, uniqueness, a priori and a posteriori error estimates of the proposed methods. With adaptive mesh refinements driven by the least-squares a posteriori error estimators, the solution can be accurately approximated even when the mesh is not aligned with discontinuity. The overshooting phenomenon is very mild if a piecewise constant reconstruction of the solution is used. Extensive numerical tests are done to show the effectiveness of the methods developed in the paper.

math.NA↗

arXiv2019

Adaptive Least-Squares Finite Element Methods for Linear Transport Equations Based on an H(div) Flux Reformulation

In this paper, we study the least-squares finite element methods (LSFEM) for the linear hyperbolic transport equations. The linear transport equation naturally allows discontinuous solutions and discontinuous inflow conditions, while the normal component of the flux across the mesh faces needs to be continuous. Traditional LSFEMs using continuous finite element approximations will introduce unnecessary extra error for discontinuous solutions and boundary conditions. In order to separate the continuity requirements, a new flux variable is introduced. With this reformulation, the continuities of the flux and the solution can be handled separately in natural $H(\mbox{div};Ω)\times L^2(Ω)$ conforming finite element spaces. Several variants of the methods are developed to handle the inflow boundary condition strongly or weakly. With the reformulation, the new LSFEMs can handle discontinuous solutions and boundary conditions much better than the traditional LSFEMs with continuous polynomial approximations. With least-squares functionals as a posteriori error estimators, the adaptive methods can naturally identify error sources including singularity and non-matching discontinuity. For discontinuity aligned mesh, no extra error is introduced. If an $RT_0 \times P_0$ pair is used to approximate the flux and the solution, the new adaptive LSFEMs can approximate discontinuous solutions with almost no overshooting even when the mesh is not aligned with discontinuity. Existence and uniqueness of the solutions and a priori and a posteriori error estimates are established for the proposed methods. Extensive numerical tests are performed to show the effectiveness of the methods developed in the paper.

math.NA↗

arXiv2019

Beamforming Network Optimization for Reducing Channel Time Variation in High-Mobility Massive MIMO

Communications in high-mobility environments have caught a lot of attentions recently. In this paper, fast time-varying channels for massive multiple-input multiple-output (MIMO) systems are addressed. We derive the exact channel power spectrum density (PSD) for the uplink from a high-speed railway (HSR) to a base station (BS) and propose to further reduce the channel time variation via beamforming network optimization. A large-scale uniform linear array (ULA) is equipped at the HSR to separate multiple Doppler shifts in angle domain through high-resolution transmit beamforming. Each branch comprises a dominant Doppler shift, which can be compensated to suppress the channel time variation, and we derive the channel PSD and the Doppler spread to assess the residual channel time variation. Interestingly, the channel PSD can be exactly expressed as the product of a pattern function and a beam-distortion function. The former reflects the impact of array aperture and is the converted radiation pattern of ULA, while the latter depends on the configuration of beamforming directions. Inspired by the PSD analysis, we introduce a common configurable amplitudes and phases (CCAP) parameter to optimize the beamforming network, by partly removing the constant modulus quantized phase constraints of matched filter (MF) beamformers. In this way, the residual Doppler shifts can be ulteriorly suppressed, further reducing the residual channel time variation. The optimal CCAP parameter minimizing the Doppler spread is derived in a closed form. Numerical results are provided to corroborate both the channel PSD analysis and the superiority of beamforming network optimization technique.

eess.SP↗

arXiv2019

Adaptive First-Order System Least-Squares Finite Element Methods for Second Order Elliptic Equations in Non-Divergence Form

This paper studies adaptive first-order least-squares finite element methods for second-order elliptic partial differential equations in non-divergence form. Unlike the classical finite element method which uses weak formulations of PDEs not applicable for the non-divergence equation, the first-order least-squares formulations naturally have stable weak forms without using integration by parts, allow simple finite element approximation spaces, and have build-in a posteriori error estimators for adaptive mesh refinements. The non-divergence equation is first written as a system of first-order equations by introducing the gradient as a new variable. Then two versions of least-squares finite element methods using simple $C^0$ finite elements are developed in the paper, one is the $L^2$-LSFEM which uses linear elements, the other is the weighted-LSFEM with a mesh-dependent weight to ensure the optimal convergence. Under a very mild assumption that the PDE has a unique solution, optimal a priori and a posteriori error estimates are proved. With an extra assumption on the operator regularity which is weaker than traditionally assumed, convergences in standard norms for the weighted-LSFEM are also discussed. $L^2$-error estimates are derived for both formulations. We perform extensive numerical experiments for smooth, non-smooth, and even degenerate coefficients on smooth and singular solutions to test the accuracy and efficiency of the proposed methods.

math.NA↗

arXiv2019

High-Mobility Massive MIMO Communications:Doppler Compensation and Transmit Diversity

High-mobility wireless communications have been receiving a lot attentions. In this paper, we consider the highmobility uplink transmission from a high-speed terminal (HST) to a base station (BS). We propose two transmit diversity schemes for high-mobility massive communications with angle domain Doppler compensation. In the first scheme, we propose the idea of block-wise angle domain Doppler compensation, such that the uplink equivalent channel would exhibit the feature of nearly perfect independent block fading. The signal space diversity encoding technique is then exploited to achieve transmit diversity. In the second scheme, the multiple parallel beamformers with Doppler compensation are exclusively occupied to transmit multiple orthogonal space-time block coding (OSTBC) data streams. Both analysis and numerical results verify that both the proposed schemes can achieve transmit diversity and outperform the conventional scheme.

eess.SP↗

arXiv2019

Fidelity Imposed Network Edit (FINE) for Solving Ill-Posed Image Reconstruction

Deep learning (DL) is increasingly used to solve ill-posed inverse problems in imaging, such as reconstruction from noisy or incomplete data, as DL offers advantages over explicit image feature extractions in defining the needed prior. However, DL typically does not incorporate the precise physics of data generation or data fidelity. Instead, DL networks are trained to output some average response to an input. Consequently, DL image reconstruction contains errors, and may perform poorly when the test data deviates significantly from the training data, such as having new pathological features. To address this lack of data fidelity problem in DL image reconstruction, a novel approach, which we call fidelity-imposed network edit (FINE), is proposed. In FINE, a pre-trained prior network's weights are modified according to the physical model, on a test case. Our experiments demonstrate that FINE can achieve superior performance in two important inverse problems in neuroimaging: quantitative susceptibility mapping (QSM) and under-sampled reconstruction in MRI.

eess.IV↗

arXiv2019

Time-Varying Downlink Channel Tracking for Quantized Massive MIMO Networks

This paper proposes a Bayesian downlink channel estimation algorithm for time-varying massive MIMO networks. In particular, the quantization effects at the receiver are considered. In order to fully exploit the sparsity and time correlations of channels, we formulate the time-varying massive MIMO channel as the simultaneously sparse signal model. Then, we propose a sparse Bayesian learning (SBL) framework to learn the model parameters of the sparse virtual channel. To reduce complexity, we employ the expectation maximization (EM) algorithm to achieve the approximated solution. Specifically, the factor graph and the general approximate message passing (GAMP) algorithms are used to compute the desired posterior statistics in the expectation step, so that high-dimensional integrals over the marginal distributions can be avoided. The non-zero supporting vector of a virtual channel is then obtained from channel statistics by a k-means clustering algorithm. After that, the reduced dimensional GAMP based scheme is applied to make the full use of the channel temporal correlation so as to enhance the virtual channel tracking accuracy. Finally, we demonstrate the efficacy of the proposed schemes through simulations.

cs.IT↗

arXiv2019

Time-Varying Massive MIMO Channel Estimation: Capturing, Reconstruction and Restoration

On the time-varying channel estimation, the traditional downlink (DL) channel restoration schemes usually require the reconstruction for the covariance of downlink process noise vector, which is dependent on DL channel covariance matrix (CCM). However, the acquisition of the CCM leads to unacceptable overhead in massive MIMO systems. To tackle this problem, in this paper, we propose a novel scheme for the DL channel tracking. First, with the help of virtual channel representation (VCR), we build a dynamic uplink (UL) massive MIMO channel model with the consideration of off-grid refinement. Then, a coordinate-wise maximization based expectation maximization (EM) algorithm is adopted for capturing the model parameters, including the spatial signatures, the time-correlation factors, the off-grid bias, the channel power, and the noise power. Thanks to the angle reciprocity, the spatial signatures, timecorrelation factors and off-grid bias of the DL channel model can be reconstructed with the knowledge of UL ones. However, the other two kinds of model parameters are closely related with the carrier frequency, which cannot be perfectly inferred from the UL ones. Instead of relearning the DL model parameters with dedicated training, we resort to the optimal Bayesian Kalman filter (OBKF) method to accurately track the DL channel with the partially prior knowledge. At the same time, the model parameters will be gradually restored. Specially, the factor-graph and the Metropolis Hastings MCMC are utilized within the OBKF framework. Finally, numerical results are provided to demonstrate the efficiency of our proposed scheme.

cs.IT↗

arXiv2019

$S^{2}$-LBI: Stochastic Split Linearized Bregman Iterations for Parsimonious Deep Learning

This paper proposes a novel Stochastic Split Linearized Bregman Iteration ($S^{2}$-LBI) algorithm to efficiently train the deep network. The $S^{2}$-LBI introduces an iterative regularization path with structural sparsity. Our $S^{2}$-LBI combines the computational efficiency of the LBI, and model selection consistency in learning the structural sparsity. The computed solution path intrinsically enables us to enlarge or simplify a network, which theoretically, is benefited from the dynamics property of our $S^{2}$-LBI algorithm. The experimental results validate our $S^{2}$-LBI on MNIST and CIFAR-10 dataset. For example, in MNIST, we can either boost a network with only 1.5K parameters (1 convolutional layer of 5 filters, and 1 FC layer), achieves 98.40\% recognition accuracy; or we simplify $82.5\%$ of parameters in LeNet-5 network, and still achieves the 98.47\% recognition accuracy. In addition, we also have the learning results on ImageNet, which will be added in the next version of our report.

stat.ML↗

arXiv2019

Robust and Local Optimal A Priori Error Estimates for Interface Problems with Low Regularity: Mixed Finite Element Approximations

For elliptic interface problems in two- and three-dimensions with a possible very low regularity, this paper establishes a priori error estimates for the Raviart-Thomas and Brezzi-Douglas-Marini mixed finite element approximations. These estimates are robust with respect to the diffusion coefficient and optimal with respect to the local regularity of the solution. Several versions of the robust best approximations of the flux and the potential approximations are obtained. These robust and local optimal a priori estimates provide guidance for constructing robust a posteriori error estimates and adaptive methods for the mixed approximations.

math.NA↗

arXiv2018

Differentially Private User-based Collaborative Filtering Recommendation Based on K-means Clustering

Collaborative filtering (CF) recommendation algorithms are well-known for their outstanding recommendation performances, but previous researches showed that they could cause privacy leakage for users due to k-nearest neighboring (KNN) attacks. Recently, the notion of differential privacy (DP) has been applied to privacy preservation for collaborative filtering recommendation algorithms. However, as far as we know, existing differentially private CF recommendation schemes degraded the recommendation performance (such as recall and precision) to an unacceptable level. In this paper, in order to address the performance degradation problem, we propose a differentially private user-based collaborative filtering recommendation scheme based on k-means clustering (KDPCF). Specifically, to improve the recommendation performance, we first cluster the dataset into categories by k-means clustering and appropriately adjust the size of the target category to which the target user belongs, so that only users in the well-sized target category can be used for recommendations. Then we efficiently select a set of neighbors from the target category at one time by employing only one exponential mechanism instead of the composition of multiple ones, and base on the neighbor set to recommend. We theoretically prove that our scheme achieves differential privacy. Empirically, we use the MovieLens dataset to evaluate our recommendation system. The experimental results demonstrate a significant performance gain compared to existing schemes.

cs.CR↗

arXiv2018

Probabilistic Matrix Factorization with Personalized Differential Privacy

Probabilistic matrix factorization (PMF) plays a crucial role in recommendation systems. It requires a large amount of user data (such as user shopping records and movie ratings) to predict personal preferences, and thereby provides users high-quality recommendation services, which expose the risk of leakage of user privacy. Differential privacy, as a provable privacy protection framework, has been applied widely to recommendation systems. It is common that different individuals have different levels of privacy requirements on items. However, traditional differential privacy can only provide a uniform level of privacy protection for all users. In this paper, we mainly propose a probabilistic matrix factorization recommendation scheme with personalized differential privacy (PDP-PMF). It aims to meet users' privacy requirements specified at the item-level instead of giving the same level of privacy guarantees for all. We then develop a modified sampling mechanism (with bounded differential privacy) for achieving PDP. We also perform a theoretical analysis of the PDP-PMF scheme and demonstrate the privacy of the PDP-PMF scheme. In addition, we implement the probabilistic matrix factorization schemes both with traditional and with personalized differential privacy (DP-PMF, PDP-PMF) and compare them through a series of experiments. The results show that the PDP-PMF scheme performs well on protecting the privacy of each user and its recommendation quality is much better than the DP-PMF scheme.

cs.CR↗

arXiv2018

Differentially Private Double Spectrum Auction with Approximate Social Welfare Maximization

Spectrum auction is an effective approach to improving spectrum utilization, by leasing idle spectrum from primary users to secondary users. Recently, a few differentially private spectrum auction mechanisms have been proposed, but, as far as we know, none of them addressed the differential privacy in the setting of double spectrum auctions. In this paper, we combine the concept of differential privacy with double spectrum auction design, and present a Differentially private Double spectrum auction mechanism with approximate Social welfare Maximization (DDSM). Specifically, we design the mechanism by employing the exponential mechanism to select clearing prices for the double spectrum auction with probabilities exponentially proportional to the related social welfare values, and then improve the mechanism in several aspects like the designs of the auction algorithm, the utility function and the buyer grouping algorithm. Through theoretical analysis, we prove that DDSM achieves differential privacy, approximate truthfulness, approximate social welfare maximization. Extensive experimental evaluations show that DDSM achieves a good performance in term of social welfare.

cs.CR↗

arXiv2018

Making Double Spectrum Auction Practical: Both Privacy and Efficiency Matter

Truthful spectrum auction is believed to be an effective method for spectrum redistribution. However, privacy concerns have largely hampered the practical applications of truthful spectrum auctions. In this paper, to make the applications of double spectrum auctions practical, we present a privacy-preserving and socially efficient double spectrum auction design, SDSA. Specifically, by combining three security techniques: homomorphic encryption, secret sharing and garbled circuits, we design a secure two-party protocol computing a socially efficient double spectrum auction, TDSA, without leaking any information about sellers' requests or buyers' bids beyond the auction outcome. We give the formal security definition in our context, and theoretically prove the security that our design achieves. Experimental results show that our design is also efficient in performance, even for large-scale double spectrum auctions.

cs.CR↗

arXiv2018

Extreme Network Compression via Filter Group Approximation

In this paper we propose a novel decomposition method based on filter group approximation, which can significantly reduce the redundancy of deep convolutional neural networks (CNNs) while maintaining the majority of feature representation. Unlike other low-rank decomposition algorithms which operate on spatial or channel dimension of filters, our proposed method mainly focuses on exploiting the filter group structure for each layer. For several commonly used CNN models, including VGG and ResNet, our method can reduce over 80% floating-point operations (FLOPs) with less accuracy drop than state-of-the-art methods on various image classification datasets. Besides, experiments demonstrate that our method is conducive to alleviating degeneracy of the compressed network, which hurts the convergence and performance of the network.

cs.CV↗