arXiv subjects

Jun Fang

Publications and source records attributed to Jun Fang.

At least 163 records · Page 9Linked to original sources

arXiv2016

Parallel 3-dim fast Fourier transforms with load balancing of the plane waves

The plane wave method is most widely used for solving the Kohn-Sham equations in first-principles materials science computations. In this procedure, the three-dimensional (3-dim) trial wave functions' fast Fourier transform (FFT) is a regular operation and one of the most demanding algorithms in terms of the scalability on a parallel machine. We propose a new partitioning algorithm for the 3-dim FFT grid to accomplish the trade-off between the communication overhead and load balancing of the plane waves. It is shown by qualitative analysis and numerical results that our approach could scale the plane wave first-principles calculations up to more nodes.

physics.comp-ph↗

arXiv2015

Spectral Compressed Sensing via CANDECOMP/PARAFAC Decomposition of Incomplete Tensors

We consider the line spectral estimation problem which aims to recover a mixture of complex sinusoids from a small number of randomly observed time domain samples. Compressed sensing methods formulates line spectral estimation as a sparse signal recovery problem by discretizing the continuous frequency parameter space into a finite set of grid points. Discretization, however, inevitably incurs errors and leads to deteriorated estimation performance. In this paper, we propose a new method which leverages recent advances in tensor decomposition. Specifically, we organize the observed data into a structured tensor and cast line spectral estimation as a CANDECOMP/PARAFAC (CP) decomposition problem with missing entries. The uniqueness of the CP decomposition allows the frequency components to be super-resolved with infinite precision. Simulation results show that the proposed method provides a competitive estimate accuracy compared with existing state-of-the-art algorithms.

math.NA↗

arXiv2015

An Efficient Bayesian PAPR Reduction Method for OFDM-Based Massive MIMO Systems

We consider the problem of peak-to-average power ratio (PAPR) reduction in orthogonal frequency-division multiplexing (OFDM) based massive multiple-input multiple-output (MIMO) downlink systems. Specifically, given a set of symbol vectors to be transmitted to K users, the problem is to find an OFDM-modulated signal that has a low PAPR and meanwhile enables multiuser interference (MUI) cancellation. Unlike previous works that tackled the problem using convex optimization, we take a Bayesian approach and develop an efficient PAPR reduction method by exploiting the redundant degrees-of-freedom of the transmit array. The sought-after signal is treated as a random vector with a hierarchical truncated Gaussian mixture prior, which has the potential to encourage a low PAPR signal with most of its samples concentrated on the boundaries. A variational expectation-maximization (EM) strategy is developed to obtain estimates of the hyperparameters associated with the prior model, along with the signal. In addition, the generalized approximate message passing (GAMP) is embedded into the variational EM framework, which results in a significant reduction in computational complexity of the proposed algorithm. Simulation results show our proposed algorithm achieves a substantial performance improvement over existing methods in terms of both the PAPR reduction and computational complexity.

cs.IT↗

arXiv2015

Real-Valued Khatri-Rao Subspace Approaches on the ULA and a New Nested Array

In underdetermined direction-of-arrival (DOA) estimation using the covariance-based signal models, the computational complexity turns into a noticeable issue because of the high dimension of the virtual array manifold. In this paper, real-valued Khatri-Rao (KR) approaches are developed on the uniform linear array (ULA) and the nested array. The complexities of subspace decomposition and spectral search are reduced compared with the complex-valued KR approach. By designing a special transformation matrix, the influence of the noise is removed in the mean time while the data is transformed from the complex domain to the real domain. Deploying the sensors with nonuniform spacings can raise the degree of freedom (DOF) and hence help detect more sources in the underdetermined situation. To increase the DOF further, a new nested array geometry is designed. The real-valued denoising KR approach developed on the new nested array can resolve more sources with reduced complexities. The performance improvement is demonstrated by numerical studies.

cs.IT↗

arXiv2015

An Iterative Reweighted Method for Tucker Decomposition of Incomplete Multiway Tensors

We consider the problem of low-rank decomposition of incomplete multiway tensors. Since many real-world data lie on an intrinsically low dimensional subspace, tensor low-rank decomposition with missing entries has applications in many data analysis problems such as recommender systems and image inpainting. In this paper, we focus on Tucker decomposition which represents an Nth-order tensor in terms of N factor matrices and a core tensor via multilinear operations. To exploit the underlying multilinear low-rank structure in high-dimensional datasets, we propose a group-based log-sum penalty functional to place structural sparsity over the core tensor, which leads to a compact representation with smallest core tensor. The method for Tucker decomposition is developed by iteratively minimizing a surrogate function that majorizes the original objective function, which results in an iterative reweighted process. In addition, to reduce the computational complexity, an over-relaxed monotone fast iterative shrinkage-thresholding technique is adapted and embedded in the iterative reweighted process. The proposed method is able to determine the model complexity (i.e. multilinear rank) in an automatic way. Simulation results show that the proposed algorithm offers competitive performance compared with other existing algorithms.

math.NA↗

arXiv2015

Global and Local Structure Preserving Sparse Subspace Learning: An Iterative Approach to Unsupervised Feature Selection

As we aim at alleviating the curse of high-dimensionality, subspace learning is becoming more popular. Existing approaches use either information about global or local structure of the data, and few studies simultaneously focus on global and local structures as the both of them contain important information. In this paper, we propose a global and local structure preserving sparse subspace learning (GLoSS) model for unsupervised feature selection. The model can simultaneously realize feature selection and subspace learning. In addition, we develop a greedy algorithm to establish a generic combinatorial model, and an iterative strategy based on an accelerated block coordinate descent is used to solve the GLoSS problem. We also provide whole iterate sequence convergence analysis of the proposed iterative algorithm. Extensive experiments are conducted on real-world datasets to show the superiority of the proposed approach over several state-of-the-art unsupervised feature selection approaches.

cs.LG↗

arXiv2015

On the Secrecy Capacity of a MIMO Gaussian Wiretap Channel with a Cooperative Jammer

We study the secrecy capacity of a helper-assisted Gaussian wiretap channel with a source, a legitimate receiver, an eavesdropper and an external helper, where each terminal is equipped with multiple antennas. Determining the secrecy capacity in this scenario generally requires solving a nonconvex secrecy rate maximization (SRM) problem. To deal with this issue, we first reformulate the original SRM problem into a sequence of convex subproblems. For the special case of single-antenna legitimate receiver, we obtain the secrecy capacity via a combination of convex optimization and one-dimensional search, while for the general case of multi-antenna legitimate receiver, we propose an iterative solution. To gain more insight into how the secrecy capacity of a helper-assisted Gaussian wiretap channel behaves, we examine the achievable secure degrees of freedom (s.d.o.f.) and obtain the maximal achievable s.d.o.f. in closed-form. We also derive a closed-form solution to the original SRM problem which achieves the maximal s.d.o.f.. Numerical results are presented to illustrate the efficacy of the proposed schemes.

cs.IT↗

arXiv2015

Two-Dimensional Pattern-Coupled Sparse Bayesian Learning via Generalized Approximate Message Passing

We consider the problem of recovering two-dimensional (2-D) block-sparse signals with \emph{unknown} cluster patterns. Two-dimensional block-sparse patterns arise naturally in many practical applications such as foreground detection and inverse synthetic aperture radar imaging. To exploit the block-sparse structure, we introduce a 2-D pattern-coupled hierarchical Gaussian prior model to characterize the statistical pattern dependencies among neighboring coefficients. Unlike the conventional hierarchical Gaussian prior model where each coefficient is associated independently with a unique hyperparameter, the pattern-coupled prior for each coefficient not only involves its own hyperparameter, but also its immediate neighboring hyperparameters. Thus the sparsity patterns of neighboring coefficients are related to each other and the hierarchical model has the potential to encourage 2-D structured-sparse solutions. An expectation-maximization (EM) strategy is employed to obtain the maximum a posterior (MAP) estimate of the hyperparameters, along with the posterior distribution of the sparse signal. In addition, the generalized approximate message passing (GAMP) algorithm is embedded into the EM framework to efficiently compute an approximation of the posterior distribution of hidden variables, which results in a significant reduction in computational complexity. Numerical results are provided to illustrate the effectiveness of the proposed algorithm.

cs.IT↗

arXiv2015

Sparse Bayesian Dictionary Learning with a Gaussian Hierarchical Model

We consider a dictionary learning problem whose objective is to design a dictionary such that the signals admits a sparse or an approximate sparse representation over the learned dictionary. Such a problem finds a variety of applications such as image denoising, feature extraction, etc. In this paper, we propose a new hierarchical Bayesian model for dictionary learning, in which a Gaussian-inverse Gamma hierarchical prior is used to promote the sparsity of the representation. Suitable priors are also placed on the dictionary and the noise variance such that they can be reasonably inferred from the data. Based on the hierarchical model, a variational Bayesian method and a Gibbs sampling method are developed for Bayesian inference. The proposed methods have the advantage that they do not require the knowledge of the noise variance \emph{a priori}. Numerical results show that the proposed methods are able to learn the dictionary with an accuracy better than existing methods, particularly for the case where there is a limited number of training signals.

cs.LG↗

arXiv2015

Computationally Efficient Sparse Bayesian Learning via Generalized Approximate Message Passing

The sparse Beyesian learning (also referred to as Bayesian compressed sensing) algorithm is one of the most popular approaches for sparse signal recovery, and has demonstrated superior performance in a series of experiments. Nevertheless, the sparse Bayesian learning algorithm has computational complexity that grows exponentially with the dimension of the signal, which hinders its application to many practical problems even with moderately large data sets. To address this issue, in this paper, we propose a computationally efficient sparse Bayesian learning method via the generalized approximate message passing (GAMP) technique. Specifically, the algorithm is developed within an expectation-maximization (EM) framework, using GAMP to efficiently compute an approximation of the posterior distribution of hidden variables. The hyperparameters associated with the hierarchical Gaussian prior are learned by iteratively maximizing the Q-function which is calculated based on the posterior approximation obtained from the GAMP. Numerical results are provided to illustrate the computational efficacy and the effectiveness of the proposed algorithm.

cs.IT↗

arXiv2014

Super-Resolution Compressed Sensing: A Generalized Iterative Reweighted L2 Approach

Conventional compressed sensing theory assumes signals have sparse representations in a known, finite dictionary. Nevertheless, in many practical applications such as direction-of-arrival (DOA) estimation and line spectral estimation, the sparsifying dictionary is usually characterized by a set of unknown parameters in a continuous domain. To apply the conventional compressed sensing technique to such applications, the continuous parameter space has to be discretized to a finite set of grid points, based on which a "presumed dictionary" is constructed for sparse signal recovery. Discretization, however, inevitably incurs errors since the true parameters do not necessarily lie on the discretized grid. This error, also referred to as grid mismatch, may lead to deteriorated recovery performance or even recovery failure. To address this issue, in this paper, we propose a generalized iterative reweighted L2 method which jointly estimates the sparse signals and the unknown parameters associated with the true dictionary. The proposed algorithm is developed by iteratively decreasing a surrogate function majorizing a given objective function, resulting in a gradual and interweaved iterative process to refine the unknown parameters and the sparse signal. A simple yet effective scheme is developed for adaptively updating the regularization parameter that controls the tradeoff between the sparsity of the solution and the data fitting error. Extension of the proposed algorithm to the multiple measurement vector scenario is also considered. Numerical results show that the proposed algorithm achieves a super-resolution accuracy and presents superiority over other existing methods.

cs.IT↗

arXiv2014

Prior Support Knowledge-Aided Sparse Bayesian Learning with Partly Erroneous Support Information

It has been shown both experimentally and theoretically that sparse signal recovery can be significantly improved given that part of the signal's support is known \emph{a priori}. In practice, however, such prior knowledge is usually inaccurate and contains errors. Using such knowledge may result in severe performance degradation or even recovery failure. In this paper, we study the problem of sparse signal recovery when partial but partly erroneous prior knowledge of the signal's support is available. Based on the conventional sparse Bayesian learning framework, we propose a modified two-layer Gaussian-inverse Gamma hierarchical prior model and, moreover, an improved three-layer hierarchical prior model. The modified two-layer model employs an individual parameter $b_i$ for each sparsity-controlling hyperparameter $α_i$, and has the ability to place non-sparsity-encouraging priors to those coefficients that are believed in the support set. The three-layer hierarchical model is built on the modified two-layer prior model, with a prior placed on the parameters $\{b_i\}$ in the third layer. Such a model enables to automatically learn the true support from partly erroneous information through learning the values of the parameters $\{b_i\}$. Variational Bayesian algorithms are developed based on the proposed hierarchical prior models. Numerical results are provided to illustrate the performance of the proposed algorithms.

cs.IT↗

arXiv2014

The structure of TeV-bright shell-type supernova remnants

Aims. Two-dimensional MHD simulations are used to model the emission properties of TeV-bright shell-type supernova remnants (SNRs) and to explore their nature. Methods. In the leptonic scenario for the TeV emission, the $γ$-ray emission is produced via Inverse Compton scattering of background soft photons by high-energy electrons accelerated by the shocks of the SNRs. The TeV emissivity is proportional to the magnetic field energy density and MHD simulations can be used to model the TeV structure of such remnants directly. 2D MHD simulations for SNRs are then performed under the assumption that the ambient interstellar medium is turbulent with the magnetic field and density fluctuations following a Kolmogorov-like power-law spectrum. Results. (1) As expected, these simulations confirm early 1D and 2D modelings of these sources, namely the hydrodynamical evolution of the shock waves and amplification of magnetic field by Rayleigh-Taylor convective flows and by shocks propagating in a turbulent medium; (2) We reproduce rather complex morphological structure for $γ$-rays, suggesting intrinsic variations of the source morphology not related to the structure of the progenitor and environment; (3)The observed radial profile of several remnants are well reproduced with an ambient medium density of $0.1-1$ cm$^{-3}$. An even lower ambient density leads to a sharper drop of the TeV brightness with radius than what is observed near the outer edge of these remnants. Conclusions. In a turbulent background medium, we can reproduce the observed characteristics of several shell-type TeV SNRs with reasonable parameters except for a higher ambient density than that inferred from X-ray observations.

astro-ph.HE↗

arXiv2014

Super-Resolution Compressed Sensing: An Iterative Reweighted Algorithm for Joint Parameter Learning and Sparse Signal Recovery

In many practical applications such as direction-of-arrival (DOA) estimation and line spectral estimation, the sparsifying dictionary is usually characterized by a set of unknown parameters in a continuous domain. To apply the conventional compressed sensing to such applications, the continuous parameter space has to be discretized to a finite set of grid points. Discretization, however, incurs errors and leads to deteriorated recovery performance. To address this issue, we propose an iterative reweighted method which jointly estimates the unknown parameters and the sparse signals. Specifically, the proposed algorithm is developed by iteratively decreasing a surrogate function majorizing a given objective function, which results in a gradual and interweaved iterative process to refine the unknown parameters and the sparse signal. Numerical results show that the algorithm provides superior performance in resolving closely-spaced frequency components.

cs.IT↗

arXiv2013

Pattern-Coupled Sparse Bayesian Learning for Recovery of Block-Sparse Signals

We consider the problem of recovering block-sparse signals whose structures are unknown \emph{a priori}. Block-sparse signals with nonzero coefficients occurring in clusters arise naturally in many practical scenarios. However, the knowledge of the block structure is usually unavailable in practice. In this paper, we develop a new sparse Bayesian learning method for recovery of block-sparse signals with unknown cluster patterns. Specifically, a pattern-coupled hierarchical Gaussian prior model is introduced to characterize the statistical dependencies among coefficients, in which a set of hyperparameters are employed to control the sparsity of signal coefficients. Unlike the conventional sparse Bayesian learning framework in which each individual hyperparameter is associated independently with each coefficient, in this paper, the prior for each coefficient not only involves its own hyperparameter, but also the hyperparameters of its immediate neighbors. In doing this way, the sparsity patterns of neighboring coefficients are related to each other and the hierarchical model has the potential to encourage structured-sparse solutions. The hyperparameters, along with the sparse signal, are learned by maximizing their posterior probability via an expectation-maximization (EM) algorithm. Numerical results show that the proposed algorithm presents uniform superiority over other existing methods in a series of experiments.

cs.IT↗

arXiv2013

One-Bit Quantization Design and Adaptive Methods for Compressed Sensing

There have been a number of studies on sparse signal recovery from one-bit quantized measurements. Nevertheless, little attention has been paid to the choice of the quantization thresholds and its impact on the signal recovery performance. This paper examines the problem of one-bit quantizer design for sparse signal recovery. Our analysis shows that the magnitude ambiguity that ever plagues conventional one-bit compressed sensing methods can be resolved, and an arbitrarily small reconstruction error can be achieved by setting the quantization thresholds close enough to the original data samples without being quantized. Note that unquantized data samples are unaccessible in practice. To overcome this difficulty, we propose an adaptive quantization method that adaptively adjusts the quantization thresholds in a way such that the thresholds converges to the optimal thresholds. Numerical results are illustrated to collaborate our theoretical results and the effectiveness of the proposed algorithm.

cs.IT↗

arXiv2013

On Feasibility of Generalized Interference Alignment with Partial Interference Cancelation

We study a new IA strategy which is referred to as "Partial Interference Cancelation-based Interference Alignment" (PIC-IA). Unlike the conventional IA strategy, PIC-IA does not strive to eliminate interference from all users. Instead, it aims to remove the most significant interference signals. This PIC-IA strategy generalizes the conventional IA concept by addressing partial, instead of complete, interference cancelation. The feasibility of this new strategy is studied in this paper. Our results show that for a symmetric, single-stream system with $N_t$ transmit antennas and $N_r$ receive antennas, the PIC-IA is feasible when the number of significant interference signals to be removed at each receiver is no more than $N_t+N_r-2$, no matter how many users are in the network. This is in sharp contrast to the conventional IA whose feasibility is severely limited by the number of users $K$.

cs.IT↗

arXiv2012

A Symmetry-based Decomposition Approach to Eigenvalue Problems: Formulation, Discretization, and Implementation

In this paper, we propose a decomposition approach for eigenvalue problems with spatial symmetries, including the formulation, discretization as well as implementation. This approach can handle eigenvalue problems with either Abelian or non-Abelian symmetries, and is friendly for grid-based discretizations such as finite difference, finite element or finite volume methods. With the formulation, we divide the original eigenvalue problem into a set of subproblems and require only a smaller number of eigenpairs for each subproblem. We implement the decomposition approach with finite elements and parallelize our code in two levels. We show that the decomposition approach can improve the efficiency and scalability of iterative diagonalization. In particular, we apply the approach to solving Kohn--Sham equations of symmetric molecules consisting of hundreds of atoms.

math.NA↗