SearcharxivSearch

arXiv · 2505.08144

Structural Packing and Dyadic Factorization of Sparse Positive Definite Matrices

Abstract

Efficient inversion of large sparse positive definite matrices requires exploiting sparsity patterns beyond those captured by conventional bandwidth reduction. In this work, we recast nested dissection, a prominent alternative, as a two-stage framework. The matrix was first packed into block-tridiagonal or dyadic form, followed by sparse Gram-Schmidt orthogonalization. This decomposition provided a unified perspective on sparse matrix factorization and inversion and identified dyadic structure as a fundamental component of sparse Cholesky factorization. For the first stage, we introduced a packing algorithm that recovered block-tridiagonal and dyadic patterns using a novel $\ell_1$ criterion. Using approximate distances obtained through classical multidimensional scaling, the method was effective when the target structure was sufficiently represented among the nonzero entries. Iterative application could also remove structural noise and reveal hidden dyadic organization, corresponding to separator identification in nested dissection. For the second stage, we developed the theory of dyadically structured matrices. We derived sparse factorization and inversion procedures, analyzed their computational complexity, and obtained an efficient inversion algorithm. A modified version reduced the cost of inverting block-tridiagonal matrices, demonstrating the benefit of exploiting their structure directly rather than treating them as generic band matrices.

Explore related subjects

Keep this discovery

BibTeXRIS

Michał Kos, Krzysztof Podgórski, Hanqing Wu. 2026-08-30. Structural Packing and Dyadic Factorization of Sparse Positive Definite Matrices. https://arxiv.org/abs/2505.08144

Cite the original work for its findings. Save a collection to share your selection of sources.

Discover connections

Connections use source metadata and explicit phrase matches, not verified experimental comparisons.

KEEP EXPLORING

Related discoveries

Stein's method for marginals on large graphical models

Many spatial models exhibit locality structures that effectively reduce their intrinsic dimensionality, enabling efficient approximation and sampling of high-dimensional distributions. However, existing approximation techniques primarily focus on joint distributions and do not provide precise accuracy control for low-dimensional marginals, which are of primary interest in many practical scenarios. By leveraging the locality structures, we establish a dimension independent uniform error bound for the marginals of approximate distributions. Inspired by the Stein's method, we introduce a novel $δ$-locality condition that quantifies the locality in distributions, and link it to the structural assumptions such as the sparse graphical models. The theoretical guarantee motivates the localization of existing sampling methods, as we illustrate through the localized likelihood-informed subspace method and localized score matching. We show that by leveraging the locality structure, these methods greatly reduce the sample complexity and computational cost via localized and parallel implementations.

stat.ML

Mamba-Assisted Non-Markovian Closure for Reduced-Order Modeling

Reduced-order modeling of high-dimensional dynamical systems is often hindered by closure effects arising from unresolved variables, which can introduce non-Markovian dependence into the resolved dynamics. Motivated by the history-dependent memory term arising in the Mori--Zwanzig formalism, we recast non-Markovian closure modeling as a sequence modeling problem and propose the Mamba-Assisted Closure (MAC) framework. MAC employs a Mamba-based sequence model to predict the closure from the resolved trajectory and couples the learned closure with the reduced-order governing equations through a numerical integrator to advance the resolved variables in time. During training, the selective scan mechanism in Mamba enables efficient parallel sequence processing with linear scaling in sequence length, while autoregressive inference proceeds through recurrent state updates at essentially constant per-step cost. We evaluate MAC on four benchmark systems with complementary characteristics: the viscous Burgers' equation, the chaotic two-scale Lorenz '96 system, the 3-bus DeMarco--Zheng power-grid system, and the dispersive Korteweg--de Vries equation. Across these benchmarks, MAC consistently improves predictive accuracy and long-time rollout stability relative to the comparison models, demonstrating an effective and computationally scalable approach to non-Markovian closure modeling.

cs.LG

3D Uncertainty Quantification for Photoacoustic Tomography

Photoacoustic tomography (PAT) is a promising modality for high-resolution biomedical imaging, motivating the need for reliable uncertainty quantification (UQ) of reconstructed images. Bayesian approaches provide a rigorous framework for UQ but remain computationally challenging for realistic three-dimensional PAT and are sensitive to numerical approximations in the governing wave equation. We develop a finite-element Bayesian UQ framework for PAT that accommodates complex computational domains and detector geometries while enabling large-scale three-dimensional inference. The proposed methodology reformulates the randomize-then-optimize (RTO) sampling strategy as a matrix-free algorithm that generates independent posterior samples using only forward and adjoint wave propagations. Particular attention is given to constructing an adjoint discretization that forms an exact transpose pair with the discrete forward operator while remaining consistent with the continuous PAT adjoint, enabling efficient least-squares solvers within the sampling procedure. We investigate the influence of temporal discretization, artificial boundary conditions, and adjoint consistency on posterior uncertainty and identify discretization strategies that avoid numerical artifacts. The framework is validated against exact posterior statistics, existing Bayesian PAT methods, and Hamiltonian Monte Carlo using the No-U-Turn Sampler (NUTS), and is demonstrated on a three-dimensional problem with approximately $2\times 10^5$ unknowns on a general finite-element domain. To the best of our knowledge, this is the first large-scale Bayesian PAT study on general three-dimensional finite-element geometries, and the methodology extends naturally to a broad class of linear PDE-constrained inverse problems.

math.NA