Searcharxiv⌕ Search

arXiv subjects

Xiaosheng Zhuang

Publications and source records attributed to Xiaosheng Zhuang.

At least 19 recordsLinked to original sources

A Survey on Spherical Designs: Existence, Numerical Constructions and Applications

This paper provides a survey of spherical designs and their applications, with a particular emphasis on the perspective of ``numerical analysis''. A set \(X_N\) of \(N\) points on the unit sphere \(\mathbb{S}^d\) is called a \textit{spherical \(t\)-design} if the average value of any polynomial of degree at most \(t\) over \(X_N\) equals its average over the entire sphere. Spherical designs represent one of the most significant topics in the study of point distributions on spheres. They are deeply connected to algebraic combinatorics, discrete geometry, differential geometry, approximation theory, optimization, coding theory, quantum physics, and other fields, which have led to the development of profound and elegant mathematical theories. This article reviews fundamental theoretical results, numerical construction methods, and applied outcomes related to spherical designs. Key topics covered include existence proofs, optimization-based construction techniques, fast computational algorithms, and applications in interpolation, numerical integration, hyperinterpolation, signal and image processing, as well as numerical solutions to partial differential and integral equations.

math.NA↗

Hierarchical Clustering and Signal Denoising on Digraphs

In this paper, we propose a representation of a digraph (directed graph) as a Hermitian matrix derived from its adjacency matrix. This representation characterizes both the connectivity and the edge orientation of the digraph. Based on the spectral decomposition of the Hermitian matrix, a digraph clustering algorithm with $k$-means is introduced to produce a partition on the graph. Applying this algorithm (bottom-up) recursively to a digraph with partially labeled vertices yields a spectral hierarchical digraph clustering (\myproj) algorithm that produces consistent nested partitions of the digraph, or equivalently, a tree structure. Furthermore, based on the in-degree and out-degree of each cluster in the digraph clustering, a pair of hierarchical interval partitions (filtrations) can be derived in a top-down manner to produce a pair of nested knot sequences. These knot sequences facilitate the construction of multilevel spline quasi-interpolants, enabling a noisy graph signal to be decomposed into a coarse approximation and inter-level details, followed by adaptive thresholding and reconstruction. Experiments on synthetic and real-world digraphs demonstrate the superiority of our {\myproj} algorithm for digraph clustering across diverse graph structural properties (homophily and heterophily) and supervision settings. Moreover, experiments on digraph signal processing using multilevel spline quasi-interpolants further demonstrate the effectiveness of signal recovery on digraphs in terms of RMSE and SNR.

eess.SP↗

Nested QMC designs on spheres

Nested cubature rules, in which each refinement retains all previously used nodes and thus reuses earlier function evaluations, are natural in multilevel and adaptive integration. For every fixed $s>d/2$, we show that the equal-weight QMC integration rate on $\mathbb S^d$ is compatible with such nested point sets. In the subcritical range $d/2 1$. At and above the critical index $s=d$, where the block-averaging estimate no longer yields the optimal rate, we prove an equal-weight completion theorem based on low-frequency discrepancy cancellation. A block-sensitive estimate sharpens the iteration and yields nested QMC designs for all $s\ge d$ with $N_{j+1}\lesssim(j+1)^{2s/d-1}N_j$. Every prescribed finite point set also admits an optimal-rate completion.

math.NA↗

Nearly tight framelet systems from nested Marcinkiewicz--Zygmund measures on compact Riemannian manifolds

Tight framelet systems on manifolds provide exact energy preservation and one-pass reconstruction, but their standard semi-discretization relies on polynomial-exact quadrature rules, which are difficult to reconcile with scattered and progressively refined data. We develop nested Marcinkiewicz--Zygmund (MZ) measures on compact Riemannian manifolds as a quantitative alternative. Using dyadic quasi-uniform nested point sets and local partition weights, we establish a sequence of deterministic MZ inequalities for diffusion polynomial spaces. The result has two complementary forms: a fixed-tolerance version, in which the polynomial bandwidth grows dyadically with the level, and a fixed-bandwidth refinement version, in which the MZ tolerance improves as more nested nodes are added. When these measures are used to discretize continuous tight framelets, the MZ tolerance transfers directly to the deviation of the frame bounds from one. Thus quadrature exactness is relaxed with a controlled loss of tightness, and near-tightness improves along the same nested hierarchy. For the fully discrete setting, we develop filter-bank analysis and synthesis procedures, characterize one-pass and canonical reconstruction, and show that the MZ tolerance also controls the conditioning of the frame-operator equation. Fast implementation of filter-bank transforms is also presented. Numerical experiments on the sphere and the flat torus illustrate the resulting multiscale decompositions and reconstruction behavior.

math.NA↗

Deeper Insights into Deep Graph Convolutional Networks: Stability and Generalization

Graph convolutional networks (GCNs) have emerged as powerful models for graph learning tasks, exhibiting promising performance in various domains. While their empirical success is evident, there is a growing need to understand their essential ability from a theoretical perspective. Existing theoretical research has primarily focused on the analysis of single-layer GCNs, while a comprehensive theoretical exploration of the stability and generalization of deep GCNs remains limited. In this paper, we bridge this gap by delving into the stability and generalization properties of deep GCNs, aiming to provide valuable insights by characterizing rigorously the associated upper bounds. Our theoretical results reveal that the stability and generalization of deep GCNs are influenced by certain key factors, such as the maximum absolute eigenvalue of the graph filter operators and the depth of the network. Our theoretical studies contribute to a deeper understanding of the stability and generalization properties of deep GCNs, potentially paving the way for developing more reliable and well-performing models.

cs.LG↗

Data-Adaptive Graph Framelets with Generalized Vanishing Moments for Graph Machine Learning

In this paper, we propose a general framework for constructing tight framelet systems on graphs with localized supports based on partition trees. Our construction of framelets provides a simple and efficient way to obtain the orthogonality with $k$ arbitrary orthonormal vectors. When the $k$ vectors contain most of the energy of a family of graph signals, the orthogonality of the framelets intuitively possesses ``generalized ($k$-)vanishing'' moments, and thus, the coefficients are sparse. Moreover, our construction provides not only framelets that are overall sparse vectors but also fast and schematically concise transforms. In a data-adaptive setting, the graph framelet systems can be learned by conducting optimizations on Stiefel manifolds to provide the utmost sparsity for a given family of graph signals. Furthermore, we further exploit the generality of our proposed graph framelet systems for heterophilous graph learning, where graphs are characterized by connecting nodes mainly from different classes. The usual assumption that connected nodes are similar and belong to the same class for homophilious graphs is contradictory for heterophilous graphs. Thus, we are motivated to bypass simple assumptions on heterophilous graphs and focus on generating rich node features induced by the graph structure, so as to improve the graph learning ability of certain neural networks in node classification. We derive a specific system of graph framelets and propose a heuristic method to select framelets as features for neural network input. Several experiments demonstrate the effectiveness and superiority of our approach for non-linear approximation, denoising, and node classification.

eess.SP↗

On the existence and estimates of nested spherical designs

In this paper, we prove the existence of a spherical $t$-design formed by adding extra points to an arbitrarily given point set on the sphere and, subsequently, deduce the existence of nested spherical designs. Estimates on the number of required points are also given. For the case that the given point set is a spherical $t_1$-design such that $t_1 < t$ and the number of points is of optimal order $t_1^d$, we show that the upper bound of the total number of extra points and given points for forming nested spherical $t$-design is of order $t^{2d+1}$. A brief discussion concerning the optimal order in nested spherical designs is also given.

math.FA↗

Spherical Designs for Function Approximation and Beyond

In this paper, we compare two optimization algorithms using full Hessian and approximation Hessian to obtain numerical spherical designs through their variational characterization. Based on the obtained spherical design point sets, we investigate the approximation of smooth and non-smooth functions by spherical harmonics with spherical designs. Finally, we use spherical framelets for denoising Wendland functions as an application, which shows the great potential of spherical designs in spherical data processing.

math.NA↗

Permutation Equivariant Graph Framelets for Heterophilous Graph Learning

The nature of heterophilous graphs is significantly different from that of homophilous graphs, which causes difficulties in early graph neural network models and suggests aggregations beyond the 1-hop neighborhood. In this paper, we develop a new way to implement multi-scale extraction via constructing Haar-type graph framelets with desired properties of permutation equivariance, efficiency, and sparsity, for deep learning tasks on graphs. We further design a graph framelet neural network model PEGFAN (Permutation Equivariant Graph Framelet Augmented Network) based on our constructed graph framelets. The experiments are conducted on a synthetic dataset and 9 benchmark datasets to compare performance with other state-of-the-art models. The result shows that our model can achieve the best performance on certain datasets of heterophilous graphs (including the majority of heterophilous datasets with relatively larger sizes and denser connections) and competitive performance on the remaining.

cs.LG↗

Spherical framelets from spherical designs

In this paper, we investigate in detail the structures of the variational characterization $A_{N,t}$ of the spherical $t$-design, its gradient $\nabla A_{N,t}$, and its Hessian $\mathcal{H}(A_{N,t})$ in terms of fast spherical harmonic transforms. Moreover, we propose solving the minimization problem of $A_{N,t}$ using the trust-region method to provide spherical $t$-designs with large values of $t$. Based on the obtained spherical $t$-designs, we develop (semi-discrete) spherical tight framelets as well as their truncated systems and their fast spherical framelet transforms for the practical spherical signal/image processing. Thanks to the large spherical $t$-designs and localization property of our spherical framelets, we are able to provide signal/image denoising using local thresholding techniques based on a fine-tuned spherical cap restriction. Many numerical experiments are conducted to demonstrate the efficiency and effectiveness of our spherical framelets, including Wendland function approximation, ETOPO data processing, and spherical image denoising.

math.NA↗

Convolutional Neural Networks for Spherical Signal Processing via Spherical Haar Tight Framelets

In this paper, we develop a general theoretical framework for constructing Haar-type tight framelets on any compact set with a hierarchical partition. In particular, we construct a novel area-regular hierarchical partition on the 2-sphere and establish its corresponding spherical Haar tight framelets with directionality. We conclude by evaluating and illustrating the effectiveness of our area-regular spherical Haar tight framelets in several denoising experiments. Furthermore, we propose a convolutional neural network (CNN) model for spherical signal denoising which employs the fast framelet decomposition and reconstruction algorithms. Experiment results show that our proposed CNN model outperforms threshold methods, and processes strong generalization and robustness properties.

eess.SP↗

Decimated Framelet System on Graphs and Fast G-Framelet Transforms

Graph representation learning has many real-world applications, from super-resolution imaging, 3D computer vision to drug repurposing, protein classification, social networks analysis. An adequate representation of graph data is vital to the learning performance of a statistical or machine learning model for graph-structured data. In this paper, we propose a novel multiscale representation system for graph data, called decimated framelets, which form a localized tight frame on the graph. The decimated framelet system allows storage of the graph data representation on a coarse-grained chain and processes the graph data at multi scales where at each scale, the data is stored at a subgraph. Based on this, we then establish decimated G-framelet transforms for the decomposition and reconstruction of the graph data at multi resolutions via a constructive data-driven filter bank. The graph framelets are built on a chain-based orthonormal basis that supports fast graph Fourier transforms. From this, we give a fast algorithm for the decimated G-framelet transforms, or FGT, that has linear computational complexity O(N) for a graph of size N. The theory of decimated framelets and FGT is verified with numerical examples for random graphs. The effectiveness is demonstrated by real-world applications, including multiresolution analysis for traffic network, and graph neural networks for graph classification tasks.

cs.LG↗

Dynamic Spectral Residual Superpixels

We consider the problem of segmenting an image into superpixels in the context of $k$-means clustering, in which we wish to decompose an image into local, homogeneous regions corresponding to the underlying objects. Our novel approach builds upon the widely used Simple Linear Iterative Clustering (SLIC), and incorporate a measure of objects' structure based on the spectral residual of an image. Based on this combination, we propose a modified initialisation scheme and search metric, which helps keeps fine-details. This combination leads to better adherence to object boundaries, while preventing unnecessary segmentation of large, uniform areas, while remaining computationally tractable in comparison to other methods. We demonstrate through numerical and visual experiments that our approach outperforms the state-of-the-art techniques.

cs.CV↗

Regularization with Multilevel Non-stationary Tight Framelets for Image Restoration

Variational regularization models are one of the popular and efficient approaches for image restoration. The regularization functional in the model carries prior knowledge about the image to be restored. The prior knowledge, in particular for natural images, are the first-order (i.e. variance in luminance) and second-order (i.e. contrast and texture) information. In this paper, we propose a model for image restoration, using a multilevel non-stationary tight framelet system that can capture the image's first-order and second-order information. We develop an algorithm to solve the proposed model and the numerical experiments show that the model is effective and efficient as compared to other higher-order models.

math.OC↗

Adaptive directional Haar tight framelets on bounded domains for digraph signal representations

Based on hierarchical partitions, we provide the construction of Haar-type tight framelets on any compact set $K\subseteq \mathbb{R}^d$. In particular, on the unit block $[0,1]^d$, such tight framelets can be built to be with adaptivity and directionality. We show that the adaptive directional Haar tight framelet systems can be used for digraph signal representations. Some examples are provided to illustrate results in this paper.

math.FA↗

Haar Graph Pooling

Deep Graph Neural Networks (GNNs) are useful models for graph classification and graph-based regression tasks. In these tasks, graph pooling is a critical ingredient by which GNNs adapt to input graphs of varying size and structure. We propose a new graph pooling operation based on compressive Haar transforms -- HaarPooling. HaarPooling implements a cascade of pooling operations; it is computed by following a sequence of clusterings of the input graph. A HaarPooling layer transforms a given input graph to an output graph with a smaller node number and the same feature dimension; the compressive Haar transform filters out fine detail information in the Haar wavelet domain. In this way, all the HaarPooling layers together synthesize the features of any given input graph into a feature vector of uniform size. Such transforms provide a sparse characterization of the data and preserve the structure information of the input graph. GNNs implemented with standard graph convolution layers and HaarPooling layers achieve state of the art performance on diverse graph classification and regression problems.

cs.LG↗

Fast Haar Transforms for Graph Neural Networks

Graph Neural Networks (GNNs) have become a topic of intense research recently due to their powerful capability in high-dimensional classification and regression tasks for graph-structured data. However, as GNNs typically define the graph convolution by the orthonormal basis for the graph Laplacian, they suffer from high computational cost when the graph size is large. This paper introduces Haar basis which is a sparse and localized orthonormal system for a coarse-grained chain on graph. The graph convolution under Haar basis, called Haar convolution, can be defined accordingly for GNNs. The sparsity and locality of the Haar basis allow Fast Haar Transforms (FHTs) on graph, by which a fast evaluation of Haar convolution between graph data and filters can be achieved. We conduct experiments on GNNs equipped with Haar convolution, which demonstrates state-of-the-art results on graph-based regression and node classification tasks.

cs.LG↗

Tight framelets and fast framelet filter bank transforms on manifolds

Tight framelets on a smooth and compact Riemannian manifold $\mathcal{M}$ provide a tool of multiresolution analysis for data from geosciences, astrophysics, medical sciences, etc. This work investigates the construction, characterizations, and applications of tight framelets on such a manifold $\mathcal{M}$. Characterizations of the tightness of a sequence of framelet systems for $L_{2}(\mathcal{M})$ in both the continuous and semi-discrete settings are provided. Tight framelets associated with framelet filter banks on $\mathcal{M}$ can then be easily designed and fast framelet filter bank transforms on $\mathcal{M}$ are shown to be realizable with nearly linear computational complexity. Explicit construction of tight framelets on the sphere $\mathbb{S}^{2}$ as well as numerical examples are given.

math.CA↗