arXiv subjects

Sung-Hsien Hsieh

Publications and source records attributed to Sung-Hsien Hsieh.

8 recordsLinked to original sources

arXiv2019

Greedy Algorithms for Hybrid Compressed Sensing

Compressed sensing (CS) is a technique which uses fewer measurements than dictated by the Nyquist sampling theorem. The traditional CS with linear measurements achieves efficient recovery performances, but it suffers from the large bit consumption due to the huge storage occupied by those measurements. Then, the one-bit CS with binary measurements is proposed and saves the bit budget, but it is infeasible when the energy information of signals is not available as a prior knowledge. Subsequently, the hybrid CS which combines the traditional CS and one-bit CS appears, striking a balance between the pros and cons of both types of CS. Considering the fact that the one-bit CS is optimal for the direction estimation of signals under noise with a fixed bit budget and that the traditional CS is able to provide residue information and estimated signals, we focus on the design of greedy algorithms, which consist of the main steps of support detection and recovered signal update, for the hybrid CS in this paper. We first propose a theorem on the random uniform tessellations for sparse signals to further investigate the properties of one-bit CS. Afterwards, we propose two greedy algorithms for the hybrid CS, with the one-bit CS responsible for support detection and traditional CS offering updated residues and signal estimates. For each of the proposed algorithms, we provide the corresponding theorem with proof to analyze their capabilities theoretically. Simulation results have demonstrated the efficacy of the proposed greedy algorithms under a limited bit budget in noisy environments.

eess.SP↗

arXiv2018

Link Delay Estimation Using Sparse Recovery for Dynamic Network Tomography

When the scale of communication networks has been growing rapidly in the past decades, it becomes a critical challenge to extract fast and accurate estimation of key state parameters of network links, e.g., transmission delays and dropped packet rates, because such monitoring operations are usually time-consuming. Based on the sparse recovery technique reported in [Wang et al. (2015) IEEE Trans. Information Theory, 61(2):1028--1044], which can infer link delays from a limited number of measurements using compressed sensing, we particularly extend to networks with dynamic changes including link insertion and deletion. Moreover, we propose a more efficient algorithm with a better theoretical upper bound. The experimental result also demonstrates that our algorithm outperforms the previous work in running time while maintaining a similar recovery performance, which shows its capability to cope with large-scale networks.

cs.NI↗

arXiv2016

Distributed Compressive Sensing: Performance Analysis with Diverse Signal Ensembles

Distributed compressive sensing is a framework considering jointly sparsity within signal ensembles along with multiple measurement vectors (MMVs). The current theoretical bound of performance for MMVs, however, is derived to be the same with that for single MV (SMV) because no assumption about signal ensembles is made. In this work, we propose a new concept of inducing the factor called "Euclidean distances between signals" for the performance analysis of MMVs. The novelty is that the size of signal ensembles will be taken into consideration in our analysis to theoretically show that MMVs indeed exhibit better performance than SMV. Although our concept can be broadly applied to CS algorithms with MMVs, the case study conducted on a well-known greedy solver called simultaneous orthogonal matching pursuit (SOMP) will be explored in this paper. We show that the performance of SOMP, when incorporated with our concept by modifying the steps of support detection and signal estimations, will be improved remarkably, especially when the Euclidean distances between signals are short. The performance of modified SOMP is verified to meet our theoretical prediction.

cs.IT↗

arXiv2016

Fast Greedy Approaches for Compressive Sensing of Large-Scale Signals

Cost-efficient compressive sensing is challenging when facing large-scale data, {\em i.e.}, data with large sizes. Conventional compressive sensing methods for large-scale data will suffer from low computational efficiency and massive memory storage. In this paper, we revisit well-known solvers called greedy algorithms, including Orthogonal Matching Pursuit (OMP), Subspace Pursuit (SP), Orthogonal Matching Pursuit with Replacement (OMPR). Generally, these approaches are conducted by iteratively executing two main steps: 1) support detection and 2) solving least square problem. To reduce the cost of Step 1, it is not hard to employ the sensing matrix that can be implemented by operator-based strategy instead of matrix-based one and can be speeded by fast Fourier Transform (FFT). Step 2, however, requires maintaining and calculating a pseudo-inverse of a sub-matrix, which is random and not structural, and, thus, operator-based matrix does not work. To overcome this difficulty, instead of solving Step 2 by a closed-form solution, we propose a fast and cost-effective least square solver, which combines a Conjugate Gradient (CG) method with our proposed weighted least square problem to iteratively approximate the ground truth yielded by a greedy algorithm. Extensive simulations and theoretical analysis validate that the proposed method is cost-efficient and is readily incorporated with the existing greedy algorithms to remarkably improve the performance for large-scale problems.

cs.DS↗

arXiv2016

Fast Binary Embedding via Circulant Downsampled Matrix -- A Data-Independent Approach

Binary embedding of high-dimensional data aims to produce low-dimensional binary codes while preserving discriminative power. State-of-the-art methods often suffer from high computation and storage costs. We present a simple and fast embedding scheme by first downsampling N-dimensional data into M-dimensional data and then multiplying the data with an MxM circulant matrix. Our method requires O(N +M log M) computation and O(N) storage costs. We prove if data have sparsity, our scheme can achieve similarity-preserving well. Experiments further demonstrate that though our method is cost-effective and fast, it still achieves comparable performance in image applications.

cs.IT↗

arXiv2015

Performance Analysis of Joint-Sparse Recovery from Multiple Measurements and Prior Information via Convex Optimization

We address the problem of compressed sensing with multiple measurement vectors associated with prior information in order to better reconstruct an original sparse matrix signal. $\ell_{2,1}-\ell_{2,1}$ minimization is used to emphasize co-sparsity property and similarity between matrix signal and prior information. We then derive the necessary and sufficient condition of successfully reconstructing the original signal and establish the lower and upper bounds of required measurements such that the condition holds from the perspective of conic geometry. Our bounds further indicates what prior information is helpful to improve the the performance of CS. Experimental results validates the effectiveness of all our findings.

cs.IT↗

arXiv2015

Fast Template Matching by Subsampled Circulant Matrix

Template matching is widely used for many applications in image and signal processing and usually is time-critical. Traditional methods usually focus on how to reduce the search locations by coarse-to-fine strategy or full search combined with pruning strategy. However, the computation cost of those methods is easily dominated by the size of signal N instead of that of template K. This paper proposes a probabilistic and fast matching scheme, which computation costs requires O(N) additions and O(K \log K) multiplications, based on cross-correlation. The nuclear idea is to first downsample signal, which size becomes O(K), and then subsequent operations only involves downsampled signals. The probability of successful match depends on cross-correlation between signal and the template. We show the sufficient condition for successful match and prove that the probability is high for binary signals with K^2/log K >= O(N). The experiments shows this proposed scheme is fast and efficient and supports the theoretical results.

cs.DS↗

arXiv2015

Sparse Fast Fourier Transform for Exactly and Generally K-Sparse Signals by Downsampling and Sparse Recovery

Fast Fourier Transform (FFT) is one of the most important tools in digital signal processing. FFT costs O(N \log N) for transforming a signal of length N. Recently, Sparse Fourier Transform (SFT) has emerged as a critical issue addressing how to compute a compressed Fourier transform of a signal with complexity being related to the sparsity of its spectrum. In this paper, a new SFT algorithm is proposed for both exactly K-sparse signals (with K non-zero frequencies) and generally K-sparse signals (with K significant frequencies), with the assumption that the distribution of the non-zero frequencies is uniform. The nuclear idea is to downsample the input signal at the beginning; then, subsequent processing operates under downsampled signals, where signal lengths are proportional to O(K). Downsampling, however, possibly leads to "aliasing." By the shift property of DFT, we recast the aliasing problem as complex Bose-Chaudhuri-Hocquenghem (BCH) codes solved by syndrome decoding. The proposed SFT algorithm for exactly K-sparse signals recovers 1-τfrequencies with computational complexity O(K \log K) and probability at least 1-O(\frac{c}τ)^{τK} under K=O(N), where c is a user-controlled parameter. For generally K-sparse signals, due to the fact that BCH codes are sensitive to noise, we combine a part of syndrome decoding with a compressive sensing-based solver for obtaining $K$ significant frequencies. The computational complexity of our algorithm is \max \left( O(K \log K), O(N) \right), where the Big-O constant of O(N) is very small and only a simple operation involves O(N). Our simulations reveal that O(N) does not dominate the computational cost of sFFT-DT.

cs.DS↗