Searcharxiv⌕ Search

SEARCH · Searcharxiv

Search Searcharxiv

Search indexed arXiv papers on artificial intelligence, large language models, computer vision and robotics. Read source abstracts and follow links to arXiv.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2Linked to original sources

Accelerated Primal-Dual Proximal Gradient Splitting Methods for Convex-Concave Saddle-Point Problems

In this paper, based a novel primal-dual dynamical model with adaptive scaling parameters and Bregman divergences, we propose new accelerated primal-dual proximal gradient splitting methods for solving bilinear saddle-point problems with optimal nonergodic convergence rates. For the first, using the spectral analysis, we show that a naive extension of acceleration to a quadratic game is unstable. Motivated by this, we present an accelerated primal-dual gradient flow which combines acceleration with careful velocity correction. To work with non-Euclidean distances, we also equip our continuous model with general Bregman divergences and prove the exponential decay of a Lyapunov function. Then, new primal-dual splitting methods are developed based on proper semi-implicit Euler schemes of the continuous model, and the theoretical convergence rates are nonergodic and optimal with respect to the matrix norms, Lipschitz constants and convexity parameters. Moreover, we introduce efficient restart variants to further improve the proposed methods and provide some numerical results to validate the practical performance.

math.OC↗

TRACE: A spatiotemporal contact memory graph network simulator for granular dynamics

Learned graph simulators provide an efficient alternative to high-fidelity solvers for granular dynamics. However, granular motion depends strongly on inter-granular contact history, which is difficult to preserve when particle contacts form, break, and rearrange. Existing simulators mainly store temporal information in node features or node-level memory. Here we introduce TRACE, a graph-network simulator that stores interaction history directly on contact edges. Each edge maintains a persistent memory updated by attention-based message passing and a gated recurrent unit, while an edge-identity dictionary preserves this memory as the contact graph changes. A physics-structured decoder predicts inter-granular normal and tangential contact forces, enforces the Coulomb friction limit, and applies equal-and-opposite internal forces. The model is trained with single-step pretraining followed by autoregressive rollout fine-tuning. We evaluate TRACE on 2D and 3D granular column-collapse benchmarks. In both cases, TRACE produces stable, physically consistent long-horizon rollouts, closely reproducing the final deposit geometry and the kinetic energy released during collapse. Compared with graph network simulator (GNS) and node-memory graph neural simulator (NMGNS), TRACE reduces long-rollout position error by 31-62% and final-deposit error by 58-89% across the two benchmarks, while using fewer parameters and maintaining near-zero particle interpenetration. TRACE also achieves 12.2$\times$ and 8.9$\times$ speedups over the material point method (MPM) reference solver in 2D and 3D, respectively. Our code is available at https://github.com/Data-Driven-Computational-Geotechnics/TRACE.

cs.LG↗

A multilevel stochastic-gradient neural solver for boundary integral equations

We propose a multilevel stochastic-gradient neural solver (MLSG) for second-kind boundary integral equations. MLSG represents the unknown boundary density using a neural network optimized by stochastic residual minimization over a hierarchy of successively refined Nyström discretizations. Upon transitioning from one level to the next, the network parameters obtained on the previous level initialize training on the current one. This coarse-to-fine strategy retains a continuous, grid-independent density representation and is designed to reduce the total computational effort required to reach a prescribed residual tolerance at the target resolution. The algorithm avoids grid-transfer operators and hierarchical fast-summation machinery, relying instead on batched kernel evaluations and standard network forward and backward passes that map efficiently onto modern GPU architectures. For uniformly stable second-kind discretizations, so strongly nonuniform contraction rates originate in the empirical neural tangent kernel (NTK) rather than in the discretized operator. Within each level, parameter updates can reshape the NTK, while refinement re-samples the tangent kernel on a richer discrete space and reveals directions that were not adequately resolved on coarser levels. A cross-level estimate bounds the warm-start loss in terms of the preceding training tolerance and quadrature error, motivating a tolerance schedule that balances optimization and discretization errors. Experiments on Laplace/Poisson and Helmholtz problems in two and three dimensions, together with an exterior Robin problem on a hypersurface in $\R^4$, demonstrate the method under both parametric and signed-distance surface representations at up to million-scale discretizations.

math.NA↗

A General Superconvergence Result for Cubature on Tesselated Polytopal Domains in Two and Three Dimensions

Cubature rules, which approximate definite integrals as a linear combination of a set of function values, are ubiquitous and necessary for computational methods in the physical sciences. A superconvergence result for cubature rules on polytopal domains in two and three dimensions is developed, whereby a rule that is exact for all bivariate polynomials of a fixed even degree realizes an extra order of convergence under a decrease in the spacing between nodes.

math.NA↗

Optimal error estimates of sequential finite element method for nonlinear thermo-poroelasticity problems

This study introduces and analyzes a three-step sequential decoupling algorithm designed to address nonlinear, fully coupled quasi-static thermo-poroelasticity systems incorporating convective transport. The finite element method is employed for spatial discretization and the backward Euler method for temporal discretization. The proposed sequential method has a higher computing efficiency than the fully implicit nonlinear numerical scheme, since it does not require any internal iterations. The well-posedness of the numerical solution is discussed by introducing a cut-off operator and the stability analysis of the algorithm is performed. Rigorous analysis yields optimal convergence order estimates for both spatial and temporal discretizations. In order to confirm the theoretical results and the effectiveness of the suggested approach, numerical experiments are finally carried out.

math.NA↗

Learning Informative Prior with Infinite-Dimensional Continuous Normalizing Flow for Bayesian Inverse Problem

This paper addresses infinite-dimensional Bayesian inference for inverse problem of partial differential equations with model parameters in infinite-dimensional Hilbert space. To effectively incorporate prior information, we propose a novel continuous normalizing flows based infinite-dimensional model. Specifically, by introducing a well-defined neural ordinary differential equation in infinite-dimensional space, a simple reference measure can be transformed into a more complex measure which encodes the prior information. A corresponding theoretical framework is established to ensure the well-posedness of our proposed Bayesian prior in infinite-dimensional space. We also provide training methods of the prior for two distinct data settings, along with two sampling algorithms for the resulting Bayesian posterior. The proposed framework is applied to three representative inverse problems: the simple smooth inverse problem, inverse scattering problem, and the inverse heat conduction problem. Numerical experiments support the theoretical analysis and demonstrate the efficiency of the proposed algorithms.

math.NA↗

Accelerated primal-dual dynamics and algorithms for convex optimization with nonlinear inequality constraints

We consider convex optimization with nonlinear inequality constraints and develop a primal-dual multiplier framework that is consistent in continuous and discrete time. We first propose continuous-time dynamics with Nesterov-type vanishing damping $α/t$, together with compatible extrapolations of the dual variable and the nonlinear constraint mapping. Under convexity assumptions and $α\geq3$, we establish $\mathcal O(t^{-2})$ convergence rates for both nonlinear feasibility and the objective residual. In the noncritical regime $α>3$, with an admissible choice of the extrapolation parameter, we further prove that the entire primal-dual trajectory converges to a KKT pair and sharpen both continuous-time estimates to $o(t^{-2})$. We then derive an inexact accelerated primal-dual algorithm through a compatible discretization of a perturbed version of the dynamic. For composite convex objectives, a weighted summability condition on the primal inexactness yields $\mathcal O(k^{-2})$ rates for feasibility and the objective residual. In the corresponding noncritical regime, the discrete primal-dual sequence converges to a KKT pair and both residual estimates improve to $o(k^{-2})$. Thus the continuous and discrete results exhibit matching accelerated rates and matching asymptotic improvements. To the best of our knowledge, this is the first Nesterov-type primal-dual multiplier framework for convex optimization with nonlinear inequality constraints.

math.OC↗

Null-Space-Free 6D Spectral Embedding with Local Rayleigh Quotient Recovery for 3D Quasiperiodic Maxwell's Eigenproblems

We develop a numerical framework for three-dimensional quasiperiodic Maxwell eigenvalue problems obtained through a six-dimensional periodic embedding. A projected Bloch--Fourier discretization yields a structured generalized eigenvalue problem with a large gradient-type kernel. Explicit orthonormal bases for the longitudinal and transverse subspaces remove this kernel exactly and reduce the original generalized eigenvalue problem to a null-space-free standard eigenvalue problem containing only the positive spectrum. An explicit inverse representation of the reduced operator avoids nested inner--outer linear solves and leads to an inverse Lanczos method whose main inner computation is a Hermitian positive definite conjugate-gradient solve with condition number bounded by that of the mass matrix; a residual estimate quantifies the effect of inner solves on the inverse Ritz pairs. To recover the computed modes in physical space, the six-dimensional Fourier eigenvectors are reconstructed on a three-dimensional Yee grid by a separated multi-center Taylor expansion, which avoids the dense Fourier-to-grid phase matrix and remains practical when direct dense reconstruction becomes prohibitively expensive. Local weighted Rayleigh quotients provide an independent physical-space validation, and their mass-weighted expectation is proved to equal the cropped Yee Rayleigh quotient under a partition-of-unity condition. Numerical experiments confirm the accuracy and computational effectiveness of the proposed framework and its physical-space recovery of three-dimensional quasiperiodic Maxwell modes.

math.NA↗

Shape Holomorphy and Sparse Approximation of the Maxwell Electric Field Integral Operator

Time-harmonic Maxwell scattering by a perfectly conducting obstacle is governed by the electric field integral equation (EFIE), whose natural energy space is $\boldsymbol H^{-1/2}(\mathrm{div}_Γ,Γ)$. For countably parametrized surface deformations, both the operator and its energy space depend on the geometry. We establish operator-valued shape holomorphy of the EFIE operator on a fixed reference space and derive dimension-independent sparse approximation rates. The main analytical difficulty is a fractional mapping property absent from existing $L^2$-based operator-valued shape-holomorphy theory for weakly singular kernels: the Maxwell graph norm requires uniform holomorphy of the complex-deformed scalar single layer as an operator from $H^{-1/2}$ to $H^{1/2}$. We prove this one-order smoothing by realizing the Laplace principal part as the trace of a uniformly sectorial complex-coefficient divergence-form problem on a fixed real ambient domain. Combined with a surface contravariant Piola transformation, which identifies the geometry-dependent Maxwell trace spaces and cancels the surface Jacobians in the pulled-back EFIE exactly, this yields $(\mathbf b,p,\varepsilon)$-holomorphy of the EFIE operator family for $\ell^p$-summable shape deformations, $0<p<1$. Under pointwise exclusion of interior electric resonances, parameter-uniform invertibility is derived rather than assumed, and the surface current and far field inherit the same parametric regularity. Their Legendre coefficients are $\ell^p$-summable, yielding dimension-independent best $N$-term approximation rates. The operator-level results also transfer to Galerkin boundary element operators on a single reference mesh, with constants independent of the discretization dimension, and provide reusable surrogates for multiple incident fields and bounded linear observables.

math.NA↗

Comparison of Algebraic Block Multi-Coloring and Leiden Methods for Parallel Preconditioning in the ICCG Method

In the application of incomplete Cholesky preconditioning to the incomplete Cholesky-conjugate gradient (ICCG) method, forward and backward substitutions exhibit sequential dependencies that constitute a major bottleneck for parallelization in multicore environments. To alleviate this bottleneck, the algebraic block multi-coloring (ABMC) method achieves both parallelism and data locality through block-wise coloring. However, ABMC requires the number of blocks to be specified as an input parameter in advance. This study evaluates the Leiden method as an alternative blocking approach for parallel preconditioning in the ICCG method. As a community detection technique that maximizes a quality function for graph partitioning, the Leiden method automatically generates blocks that reflect the matrix structure without requiring the number of blocks a priori. We partition the adjacency graphs of sparse matrices using the Leiden method and utilize the resulting blocks for parallel preconditioning. We implement the Leiden method using modularity and the constant Potts model as quality functions and compare its performance with that of the ABMC method in terms of the number of iterations, execution time, and L2 cache efficiency across eight symmetric positive definite matrices. The experimental results demonstrate that the Leiden method with the constant Potts model achieves performance comparable to that of the ABMC method configured with an optimized number of blocks.

cs.DC↗

Data sparse multilevel covariance estimation in optimal complexity

We consider the $\calH^2$-formatted compression and computational estimation of covariance functions on a compact set in $\bbR^d$. The classical sample covariance or Monte Carlo estimator is prohibitively expensive for many practically relevant problems, where often approximation spaces with many degrees of freedom and many samples for the estimator are needed. In this article, we propose and analyze a data sparse multilevel sample covariance estimator, i.e., a multilevel Monte Carlo estimator. For this purpose, we generalize the notion of asymptotically smooth kernel functions to a Gevrey type class of kernels for which we derive new variable-order $\calH^2$-approximation rates. These variable-order $\calH^2$-approximations can be considered as a variant of $hp$-approximations. Our multilevel sample covariance estimator then uses an approximate multilevel hierarchy of variable-order $\calH^2$-approximations to compress the sample covariances on each level. The non-nestedness of the different levels makes the reduction to the final estimator nontrivial and we present a suitable algorithm which can handle this task in linear complexity. This allows for a data sparse multilevel estimator of Gevrey covariance kernel functions in the best possible complexity for Monte Carlo type multilevel estimators, which is quadratic. Numerical examples which estimate covariance matrices with tens of billions of entries are presented.

math.NA↗

Sampling recovery in Bochner spaces and applications to parametric PDEs

We prove convergence rates of linear sampling recovery of functions in abstract Bochner spaces satisfying weighted summability of their generalized polynomial chaos expansion coefficients. The underlying algorithm is a function-valued extension of the least squares method widely used and thoroughly studied in scalar-valued function recovery. We apply our theory to two core problems in Computational Uncertainty Quantification. First, we address non-intrusive approximations of solutions to parametric elliptic or parabolic PDEs with log-normal or affine inputs using a finite set of particular solvers. Second, we consider approximating infinite-dimensional holomorphic functions that arise as solutions to more general parametric PDEs with Gaussian random field inputs. Our framework allows a unified treatment of the log-normal and affine input models and yields substantial improvements to the state of the art of these problems. More specifically, we obtain convergence rates that improve known results by a polynomial factor in the log-normal case and by a logarithmic factor in the affine case.

math.NA↗

Eigenvalue stability and new perturbation bounds for the extremal eigenvalues of a matrix

Let $A$ be a full ranked $ n\times n$ matrix, with singular values $σ_1 (A) \ge \dots \ge σ_n (A) >0$. The condition number $κ(A):= σ_1(A)/σ_n(A)=\|A\|\cdot \|A\|^{-1}$ is a key parameter in the analysis of algorithms taking $A$ as input. In practice, matrices (representing real data) are often perturbed by noise. Technically speaking, the real input would be a noisy variant $\tilde A =A +E$ of $A$, where $E$ represents the noise. The condition number $κ(\tilde A)$ will be used instead of $κ(A)$. Thus, it is of importance to measure the impact of noise on the condition number. In this paper, we focus on the case when the noise is random. We introduce the notion of regional stability, via which we design a new framework to estimate the perturbation of the extremal singular values and the condition number of a matrix. Our framework allows us to bound the perturbation of singular values through the perturbation of singular spaces. We then bound the latter using a novel contour analysis argument, which, as a co-product, provides an improved version of the classical Davis-Kahan theorem in many settings. Our new estimates concerning the least singular value $σ_n(A)$ complement well-known results in this area, and are more favorable in the case when the ground matrix $A$ is large compared to the noise matrix $E$.

math.NA↗

Stabilizing the Rayleigh--Ritz procedure by randomization

Extracting approximate eigenpairs from a prescribed subspace is of fundamental importance in eigenvalue computation. While projecting the target eigenvector onto the subspace yields satisfactory accuracy, extracting an approximate eigenpair that attains a comparable convergence rate has remained a long-standing open problem. Although the standard Rayleigh--Ritz procedure is widely used for this purpose, it may suffer from deteriorated convergence of Ritz values and may even fail to produce convergent Ritz vectors. In this paper, we address this long-standing open problem by introducing a randomized Rayleigh--Ritz procedure whose output converges at a rate similar to the ideal projection. Our analysis requires only the simplicity of the target eigenvalue and extends naturally to nonlinear eigenvalue problems.

math.NA↗

Nonconforming virtual element method for the Monge-Ampère equation

In this article, we develop the $C^1$-nonconforming $C^0$-conforming virtual element method (VEM) for the vanishing moment approximation of the second-order fully nonlinear Monge-Ampère equation in two dimensions. In the vanishing moment equation an artificial biharmonic term is introduced which produces a quasilinear fourth order problem. We derive optimal a priori error estimates in the $H^2$-, $H^1$- and $L^2$-norms for the virtual element method, and show the existence and uniqueness of the virtual element solution. We perform several numerical experiments to validate the convergence rate of the error with respect to the mesh size.

math.NA↗

Optimal Energy-Norm Convergence for the Dynamic Diffusion Finite Element Method

We revisit the nonlinear two-scale Dynamic Diffusion (DD) finite element formulation mathematically analyzed by Santos et al. (2021) for stationary advection--diffusion--reaction problems. We establish an explicit local Lipschitz estimate for the artificial diffusivity, with a constant of order $h_T$, and use it to prove uniqueness of the discrete solution for sufficiently fine meshes. By separating the approximation error in the energy norm from the contribution associated with artificial diffusion, we derive an optimal first-order a priori energy-norm estimate for continuous piecewise linear finite elements enriched with simplex bubble functions. We further prove that the square root of the nonlinear artificial dissipation is $O(h)$. Consequently, the combined energy-error and artificial-dissipation measure also converges with first order, sharpening the previously available $O(h^{1/2})$ estimate. A smooth manufactured problem, considered with and without reaction, corroborates the predicted convergence rates. A second, strongly advection-dominated problem with sharp outflow layers illustrates the stabilizing behavior of the DD formulation.

math.NA↗

A uniform elliptic reduction, an order-matching criterion, and precision benchmarks for the strong-coupling Birman-Schwinger analysis of the lattice three-boson trimer

We present a rigorous strong-coupling Birman-Schwinger analysis of the three-boson lattice Schroedinger operator on Z^2 at the exceptional quasimomentum K = pi. First, we provide an exact closed-form benchmark for the fiber Fredholm determinant, valid for every quasimomentum K, obtained via a uniform elliptic reduction. Second, we formulate and prove a general order-matching criterion determining whether a leading-order Fredholm determinant asymptotic, with relative error O(1/mu), suffices to fix the constant-order additive energy correction, or if the next-order refinement is required. Applying the criterion to the formal branch z = -2mu + d, we identify an algebraic crossing -2mu + 6 + 8/mu + O(mu^{-2}), but demonstrate that this crossing does not correspond to a true eigenvalue of the full Hamiltonian. The actual ground state obeys the rigorous variational bounds -3mu <= z_1^{pi,s}(mu) <= -3mu + 6, so that z_1^{pi,s}(mu) = -3mu + O(1), the same leading branch as at K = 0; direct finite-volume diagonalisation confirms the refined asymptotic -3mu + 6 + O(mu^{-1}) and spectral gap 2mu - 2 + O(mu^{-1}). We independently confirm that the known K = 0 constant C approximately 3.96458 requires no analogous refinement. Finally, we compare the asymptotic precision levels achieved across recent lattice few-body models and draw a structural parallel with the parity-based classification of topological band insulators at time-reversal-invariant momenta.

math-ph↗

Eigenvalues and eigenfunctions of the fractional Laplacian on the interval

We prove a three-term asymptotic formula for the eigenvalues of the fractional Laplacian on the bounded interval $(-1,1)$. This improves the eigenvalue asymptotics of Kulczycki--Kwaśnicki--Małecki--Stós and Kwaśnicki, and confirms the conjectural $O_α(n^{-2})$ remainder suggested by the numerical simulations of Kaleta--Kwaśnicki--Małecki. Moreover, we prove that the normalized eigenfunctions are bounded uniformly in the eigenvalue index $n$ and the fractional order $α$. This settles the conjecture proposed by Kwaśnicki through numerical experiments. Furthermore, we prove that the $n$-th eigenfunction has exactly $n-1$ zeros in the interval $(-1,1)$ and every zero is simple, and hence there are exactly $n$ nodal domains. A key ingredient in the proof is an explicit representation of the eigenfunction.

math.CA↗