arXiv subjects

Guohui Song

Publications and source records attributed to Guohui Song.

16 recordsLinked to original sources

arXiv2026

A hybrid reconstruction of piece-wise smooth functions from non-uniform Fourier data

In this paper, we consider the problem of reconstructing piece-wise smooth functions from their non-uniform Fourier data. We first extend the filter method for uniform Fourier data to the non-uniform setting by using the techniques of admissible frames. We show that the proposed non-uniform filter method converges exponentially away from the jump discontinuities. However, the convergence rate is significantly slower near the jump discontinuities due to the Gibbs phenomenon. To overcome this issue, we combine the non-uniform filter method with a stable extrapolation method to recover the function values near the jump discontinuities. We show that the proposed hybrid method could achieve exponential accuracy uniformly on the entire domain. Numerical experiments are provided to demonstrate the performance of the proposed method.

math.NA↗

arXiv2026

Proximity Operator of the $\ell_1$ over $\ell_2$ Function

We study the complete, possibly set-valued proximity operator of the nonconvex, scale-invariant ratio $h(\vx)=\|\vx\|_{1}/\|\vx\|_{2}$. A polar decomposition of the nonzero branch, followed by sign and permutation reductions, transforms the proximal problem into a smooth rank-one quadratic problem over the nonnegative orthant of the unit sphere. After the magnitudes of the data are sorted, every canonical proximal direction belongs to a finite candidate set indexed by its support size $k\in\{1,\ldots,n\}$. For each $k\geq 2$, a candidate exists if and only if an explicit quartic equation has a simple root satisfying both a positive-orthant condition and a second-order derivative condition. This characterization eliminates the need to guess the unknown sparsity. We further derive a necessary-and-sufficient $O(1)$ prefix test that enforces positivity and prunes support sizes for which no candidate can exist. Using prefix sums, the optimized method performs an $O(n)$ scan after an $O(n\log n)$ sorting step; the construction of multiple tied outputs is necessarily output-sensitive. Numerical experiments illustrate the finite-candidate selection, identify inputs on which a sparsity-guessing baseline is suboptimal, quantify the benefit of pruning, and demonstrate the numerical accuracy of the secular-equation solver. The observed runtimes exhibit near-linear growth over the tested range, consistent with the predicted $O(n)$ post-sorting scan and $O(n\log n)$ total complexity.

math.OC↗

arXiv2025

Exponential convergence of a distributed divide-and-conquer algorithm for constrained convex optimization on networks

We propose a divide-and-conquer (DAC) algorithm for constrained convex optimization over networks, where the global objective is the sum of local objectives attached to individual agents. The algorithm is fully distributed: each iteration solves local subproblems around selected fusion centers and coordinates only with neighboring fusion centers. Under standard assumptions of smoothness, strong convexity, and locality on the objective function, together with polynomial growth conditions on the underlying graph, we establish exponential convergence of the DAC iterations and derive explicit bounds for both exact and inexact local solvers. Numerical experiments on three representative losses ($L_2$ distance, quadratic, and entropy) confirm the theory and demonstrate scalability and effectiveness.

math.OC↗

arXiv2024

Hyperparameter Estimation for Sparse Bayesian Learning Models

Sparse Bayesian Learning (SBL) models are extensively used in signal processing and machine learning for promoting sparsity through hierarchical priors. The hyperparameters in SBL models are crucial for the model's performance, but they are often difficult to estimate due to the non-convexity and the high-dimensionality of the associated objective function. This paper presents a comprehensive framework for hyperparameter estimation in SBL models, encompassing well-known algorithms such as the expectation-maximization (EM), MacKay, and convex bounding (CB) algorithms. These algorithms are cohesively interpreted within an alternating minimization and linearization (AML) paradigm, distinguished by their unique linearized surrogate functions. Additionally, a novel algorithm within the AML framework is introduced, showing enhanced efficiency, especially under low signal noise ratios. This is further improved by a new alternating minimization and quadratic approximation (AMQ) paradigm, which includes a proximal regularization term. The paper substantiates these advancements with thorough convergence analysis and numerical experiments, demonstrating the algorithm's effectiveness in various noise conditions and signal-to-noise ratios.

cs.LG↗

arXiv2023

Sequential edge detection using joint hierarchical Bayesian learning

This paper introduces a new sparse Bayesian learning (SBL) algorithm that jointly recovers a temporal sequence of edge maps from noisy and under-sampled Fourier data. The new method is cast in a Bayesian framework and uses a prior that simultaneously incorporates intra-image information to promote sparsity in each individual edge map with inter-image information to promote similarities in any unchanged regions. By treating both the edges as well as the similarity between adjacent images as random variables, there is no need to separately form regions of change. Thus we avoid both additional computational cost as well as any information loss resulting from pre-processing the image. Our numerical examples demonstrate that our new method compares favorably with more standard SBL approaches.

stat.AP↗

arXiv2022

Fast Multiscale Functional Estimation in Optimal EMG Placement for Robotic Prosthesis Controllers

Electrocardiogram (EMG) signals play a significant role in decoding muscle contraction information for robotic hand prosthesis controllers. Widely applied decoders require large amount of EMG signals sensors, resulting in complicated calculations and unsatisfactory predictions. By the biomechanical process of single degree-of-freedom human hand movements, only several EMG signals are essential for accurate predictions. Recently, a novel predictor of hand movements adopts a multistage Sequential, Adaptive Functional Estimation (SAFE) method based on historical Functional Linear Model (FLM) to select important EMG signals and provide precise projections. However, SAFE repeatedly performs matrix-vector multiplications with a dense representation matrix of the integral operator for the FLM, which is computational expansive. Noting that with a properly chosen basis, the representation of the integral operator concentrates on a few bands of the basis, the goal of this study is to develop a fast Multiscale SAFE (MSAFE) method aiming at reducing computational costs while preserving (or even improving) the accuracy of the original SAFE method. Specifically, a multiscale piecewise polynomial basis is adopted to discretize the integral operator for the FLM, resulting in an approximately sparse representation matrix, and then the matrix is truncated to a sparse one. This approach not only accelerates computations but also improves robustness against noises. When applied to real hand movement data, MSAFE saves 85%$\sim$90% computing time compared with SAFE, while producing better sensor selection and comparable accuracy. In a simulation study, MSAFE shows stronger stability in sensor selection and prediction accuracy against correlated noise than SAFE.

math.OC↗

arXiv2022

Sequential image recovery from noisy and under-sampled Fourier data

A new algorithm is developed to jointly recover a temporal sequence of images from noisy and under-sampled Fourier data. Specifically, we consider the case where each data set is missing vital information that prevents its (individual) accurate recovery. Our new method is designed to restore the missing information in each individual image by "borrowing" it from the other images in the sequence. As a result, {\em all} of the individual reconstructions yield improved accuracy. The use of high resolution Fourier edge detection methods is essential to our algorithm. In particular, edge information is obtained directly from the Fourier data which leads to an accurate coupling term between data sets. Moreover, data loss is largely avoided as coarse reconstructions are not required to process inter- and intra-image information. Numerical examples are provided to demonstrate the accuracy, efficiency and robustness of our new method.

math.NA↗

arXiv2022

Generalized sparse Bayesian learning and application to image reconstruction

Image reconstruction based on indirect, noisy, or incomplete data remains an important yet challenging task. While methods such as compressive sensing have demonstrated high-resolution image recovery in various settings, there remain issues of robustness due to parameter tuning. Moreover, since the recovery is limited to a point estimate, it is impossible to quantify the uncertainty, which is often desirable. Due to these inherent limitations, a sparse Bayesian learning approach is sometimes adopted to recover a posterior distribution of the unknown. Sparse Bayesian learning assumes that some linear transformation of the unknown is sparse. However, most of the methods developed are tailored to specific problems, with particular forward models and priors. Here, we present a generalized approach to sparse Bayesian learning. It has the advantage that it can be used for various types of data acquisitions and prior information. Some preliminary results on image reconstruction/recovery indicate its potential use for denoising, deblurring, and magnetic resonance imaging.

math.NA↗

arXiv2021

A Divide-and-Conquer Algorithm for Distributed Optimization on Networks

In this paper, we consider networks with topologies described by some connected undirected graph ${\mathcal{G}}=(V, E)$ and with some agents (fusion centers) equipped with processing power and local peer-to-peer communication, and optimization problem $\min_{{\boldsymbol x}}\big\{F({\boldsymbol x})=\sum_{i\in V}f_i({\boldsymbol x})\big\}$ with local objective functions $f_i$ depending only on neighboring variables of the vertex $i\in V$. We introduce a divide-and-conquer algorithm to solve the above optimization problem in a distributed and decentralized manner. The proposed divide-and-conquer algorithm has exponential convergence, its computational cost is almost linear with respect to the size of the network, and it can be fully implemented at fusion centers of the network. Our numerical demonstrations also indicate that the proposed divide-and-conquer algorithm has superior performance than popular decentralized optimization methods do for the least squares problem with/without $\ell^1$ penalty.

math.OC↗

arXiv2019

Multi-task Learning in Vector-valued Reproducing Kernel Banach Spaces with the $\ell^1$ Norm

Targeting at sparse multi-task learning, we consider regularization models with an $\ell^1$ penalty on the coefficients of kernel functions. In order to provide a kernel method for this model, we construct a class of vector-valued reproducing kernel Banach spaces with the $\ell^1$ norm. The notion of multi-task admissible kernels is proposed so that the constructed spaces could have desirable properties including the crucial linear representer theorem. Such kernels are related to bounded Lebesgue constants of a kernel interpolation question. We study the Lebesgue constant of multi-task kernels and provide examples of admissible kernels. Furthermore, we present numerical experiments for both synthetic data and real-world benchmark data to demonstrate the advantages of the proposed construction and regularization models.

math.FA↗

arXiv2017

PCM-TV-TFV: A Novel Two Stage Framework for Image Reconstruction from Fourier Data

We propose in this paper a novel two-stage Projection Correction Modeling (PCM) framework for image reconstruction from (non-uniform) Fourier measurements. PCM consists of a projection stage (P-stage) motivated by the multi-scale Galerkin method and a correction stage (C-stage) with an edge guided regularity fusing together the advantages of total variation (TV) and total fractional variation (TFV). The P-stage allows for continuous modeling of the underlying image of interest. The given measurements are projected onto a space in which the image is well represented. We then enhance the reconstruction result at the C-stage that minimizes an energy functional consisting of a fidelity in the transformed domain and a novel edge guided regularity. We further develop efficient proximal algorithms to solve the corresponding optimization problem. Various numerical results in both 1D signals and 2D images have also been presented to demonstrate the superior performance of the proposed two-stage method to other classical one-stage methods.

cs.CV↗

arXiv2015

A Two-dimensional Inverse Frame Operator Approximation Technique

The ability to efficiently and accurately construct an inverse frame operator is critical for establishing the utility of numerical frame approximations. Recently, the admissible frame method was developed to approximate inverse frame operators for one-dimensional problems. Using the admissible frame approach, it is possible to project the corresponding frame data onto a more suitable (admissible) frame, even when the sampling frame is only weakly localized. As a result, a target function may be approximated as a finite frame expansion with its asymptotic convergence solely dependent on its smoothness. In this investigation, we seek to expand the admissible frame approach to two dimensions, which requires some additional constraints. We prove that the admissible frame technique converges in two dimensions and then demonstrate its usefulness with some numerical experiments that use sampling patterns inspired by applications that sample data non-uniformly in the Fourier domain.

math.NA↗

arXiv2014

A frame theoretic approach to the Non-Uniform Fast Fourier Transform

Nonuniform Fourier data are routinely collected in applications such as magnetic resonance imaging, synthetic aperture radar, and synthetic imaging in radio astronomy. To acquire a fast reconstruction that does not require an online inverse process, the non-uniform fast Fourier transform (NFFT), also called convolutional gridding, is frequently employed. While various investigations have led to improvements in accuracy, efficiency, and robustness of the NFFT, not much attention has been paid to the fundamental analysis of the scheme, and in particular its convergence properties. This paper analyzes the convergence of the NFFT by casting it as a Fourier frame approximation. In so doing, we are able to design parameters for the method that satisfy conditions for numerical convergence. Our so called frame theoretic convolutional gridding algorithm can also be applied to detect features (such as edges) from non-uniform Fourier samples of piecewise smooth functions.

math.NA↗

arXiv2012

Approximating the Inverse Frame Operator from Localized Frames

This investigation seeks to establish the practicality of numerical frame approximations. Specifically, it develops a new method to approximate the inverse frame operator and analyzes its convergence properties. It is established that sampling with {\em well-localized frames} improves both the accuracy of the numerical frame approximation as well as the robustness and efficiency of the (finite) frame operator inversion. Moreover, in applications such as magnetic resonance imaging, where the given data often may not constitute a well-localized frame, a technique is devised to project the corresponding frame data onto a more suitable frame. As a result, the target function may be approximated as a finite expansion with its asymptotic convergence solely dependent on its smoothness. Numerical examples are provided.

math.NA↗

arXiv2012

Reproducing Kernel Banach Spaces with the l1 Norm

Targeting at sparse learning, we construct Banach spaces B of functions on an input space X with the properties that (1) B possesses an l1 norm in the sense that it is isometrically isomorphic to the Banach space of integrable functions on X with respect to the counting measure; (2) point evaluations are continuous linear functionals on B and are representable through a bilinear form with a kernel function; (3) regularized learning schemes on B satisfy the linear representer theorem. Examples of kernel functions admissible for the construction of such spaces are given.

stat.ML↗

arXiv2011

Reproducing Kernel Banach Spaces with the l1 Norm II: Error Analysis for Regularized Least Square Regression

A typical approach in estimating the learning rate of a regularized learning scheme is to bound the approximation error by the sum of the sampling error, the hypothesis error and the regularization error. Using a reproducing kernel space that satisfies the linear representer theorem brings the advantage of discarding the hypothesis error from the sum automatically. Following this direction, we illustrate how reproducing kernel Banach spaces with the l1 norm can be applied to improve the learning rate estimate of l1-regularization in machine learning.

stat.ML↗