arXiv subjects

Alec Dektor

Publications and source records attributed to Alec Dektor.

14 recordsLinked to original sources

arXiv2026

Sampling two-dimensional isometric tensor network states

Sampling a quantum system's underlying probability distributions is an important computational task, e.g., for quantum advantage experiments and quantum Monte Carlo algorithms. Tensor networks are an invaluable tool for efficiently representing states of large quantum systems with limited entanglement. Algorithms for sampling one-dimensional (1D) tensor networks are well-established and utilized in several 1D tensor network methods. In this paper we introduce two novel sampling algorithms for two-dimensional (2D) isometric tensor network states (isoTNS) that generalize existing 1D tensor networks sampling algorithms. Our first proposed algorithm performs independent sampling and yields a single configuration together with its associated probability. The second algorithm employs a greedy search strategy to identify $K$ high-probability configurations and their corresponding probabilities. Numerical results demonstrate the effectiveness of these algorithms across quantum states with varying entanglement and system size.

quant-ph↗

arXiv2025

Computing excited states with isometric tensor networks in two-dimensions

We present a new subspace iteration method for computing low-lying eigenpairs (excited states) of high-dimensional quantum many-body Hamiltonians with nearest neighbor interactions on two-dimensional lattices. The method is based on a new block isometric projected entangled pair state (block-isoPEPS) ansatz that generalizes the block matrix product state (MPS) framework, widely used for Hamiltonians defined on one-dimensional chains, to two-dimensions. The proposed block-isoPEPS ansatz offers several attractive features for PEPS-based algorithms, including exact block orthogonalization, controlled local truncation via singular value decompositions, and efficient evaluation of observables. We demonstrate the proposed inexact subspace iteration for block-isoPEPS by computing excitations of the two-dimensional transverse-field Ising and Heisenberg models and compare our results with existing PEPS methods. Our results demonstrate that block isometric tensor networks provide a scalable framework for studying excitations in quantum many-body systems beyond one dimension.

math.NA↗

arXiv2025

RELift: Learned Coarse-to-Fine Propagators for Time-Dependent PDEs with Applications to Electron Dynamics

We present RELift (Restrict, Evolve, Lift), a two-phase learning framework that couples coarse-grid numerical solvers with neural operators to super-resolve and forecast fine-grid dynamics for time-dependent partial differential equations (PDEs). In Phase 1, RELift learns a super-resolution operator that maps the solution on a coarse grid to a fine grid. In Phase 2, this learned operator is composed with a coarse-grid numerical integrator to construct an effective fine-grid propagator for the governing equation. We benchmark RELift on three canonical two-dimensional PDEs of increasing dynamical complexity -- the heat equation, the wave equation, and the incompressible Navier--Stokes equations -- and we further demonstrate its performance on a kinetic electron dynamics case study via the 1D1V Vlasov--Poisson system. Across all examples, RELift delivers high-fidelity super-resolution (Phase 1) and accurate long-horizon rollouts (Phase 2), outperforming standard super-resolution and neural operator baselines in both field-level error metrics and physics-relevant diagnostics. Finally, we provide error analysis of the effective fine-grid propagator, characterizing how approximation errors accumulate over time and explaining the observed numerical stability of the RELift framework.

math.NA↗

arXiv2025

Numerical Optimization for Tensor Disentanglement

Tensor networks provide compact and scalable representations of high-dimensional data, enabling efficient computation in fields such as quantum physics, numerical partial differential equations (PDEs), and machine learning. This paper focuses on tensor disentangling, the task of identifying transformations that reduce bond dimensions by exploiting gauge freedom in the network. We formulate this task as an optimization problem over orthogonal matrices acting on a single tensor's indices, aiming to minimize the rank of its matricized form. We present Riemannian optimization methods and a joint optimization framework that alternates between optimizing the orthogonal transformation for a fixed low-rank approximation and optimizing the low-rank approximation for a fixed orthogonal transformation, offering a competitive alternative when the target rank is known. To seek the often unknown optimal rank, we introduce a binary search strategy integrated with the disentangling procedure. Numerical experiments on random tensors and tensors in an approximate isometric tensor network state are performed to compare different optimization methods and explore the possibility of combining different methods in a hybrid approach.

math.NA↗

arXiv2025

Inexact subspace projection methods for low-rank tensor eigenvalue problems

We propose inexact subspace iteration for solving high-dimensional eigenvalue problems with low-rank structure. Inexactness stems from low-rank compression, enabling efficient representation of high-dimensional vectors in a low-rank tensor format. A primary challenge in these methods is that standard operations, such as matrix-vector products and linear combinations, increase tensor rank, necessitating rank truncation and hence approximation. We compare the proposed methods with an existing inexact Lanczos method with low-rank compression. This method constructs an approximate orthonormal Krylov basis, which is often difficult to represent accurately in low-rank tensor formats, even when the eigenvectors themselves exhibit low-rank structure. In contrast, inexact subspace iteration uses approximate eigenvectors (Ritz vectors) directly as a subspace basis, bypassing the need for an orthonormal Krylov basis. Our analysis and numerical experiments demonstrate that inexact subspace iteration is much more robust to rank-truncation errors compared to the inexact Lanczos method. We also demonstrate that rank-truncated subspace iteration can converge for problems where the DMRG method stagnates. Furthermore, the proposed subspace iteration methods do not require a Hermitian matrix, in contrast to Lanczos and DMRG, which are designed specifically for Hermitian matrices.

math.NA↗

arXiv2024

Interpolatory dynamical low-rank approximation for the 3+3d Boltzmann-BGK equation

We introduce two novel interpolatory dynamical low-rank (DLR) approximation methods for the efficient time integration of the Boltzmann-BGK equation. Both methods overcome limitations of classic DLR schemes based on orthogonal projections for nonlinear equations. In particular, we demonstrate that the proposed methods can efficiently compute solutions to the full Boltzmann-BGK equation without restricting to e.g. weakly compressible or isothermal flow. The first method we propose directly applies the recently developed interpolatory projector-splitting scheme on low-rank matrix manifolds. The second method is a variant of the rank-adaptive basis update and Galerkin scheme, where the Galerkin step is replaced by a collocation step, resulting in a new scheme we call basis update and collocate (BUC). Numerical experiments in both fluid and kinetic regimes demonstrate the performance of the proposed methods. In particular we demonstrate that the methods can be used to efficiently compute low-rank solutions in the six-dimensional (three spatial and three velocity dimensions) setting on a standard laptop.

math.NA↗

arXiv2024

Collocation methods for nonlinear differential equations on low-rank manifolds

We introduce new methods for integrating nonlinear differential equations on low-rank manifolds. These methods rely on interpolatory projections onto the tangent space, enabling low-rank time integration of vector fields that can be evaluated entry-wise. A key advantage of our approach is that it does not require the vector field to exhibit low-rank structure, thereby overcoming significant limitations of traditional dynamical low-rank methods based on orthogonal projection. To construct the interpolatory projectors, we develop a sparse tensor sampling algorithm based on the discrete empirical interpolation method (DEIM) that parameterizes tensor train manifolds and their tangent spaces with cross interpolation. Using these projectors, we propose two time integration schemes on low-rank tensor train manifolds. The first scheme integrates the solution at selected interpolation indices and constructs the solution with cross interpolation. The second scheme generalizes the well-known orthogonal projector-splitting integrator to interpolatory projectors. We demonstrate the proposed methods with applications to several tensor differential equations arising from the discretization of partial differential equations.

math.NA↗

arXiv2023

Coordinate-adaptive integration of PDEs on tensor manifolds

We introduce a new tensor integration method for time-dependent PDEs that controls the tensor rank of the PDE solution via time-dependent diffeomorphic coordinate transformations. Such coordinate transformations are generated by minimizing the normal component of the PDE operator relative to the tensor manifold that approximates the PDE solution via a convex functional. The proposed method significantly improves upon and may be used in conjunction with the coordinate-adaptive algorithm we recently proposed in JCP (2023) Vol. 491, 112378, which is based on non-convex relaxations of the rank minimization problem and Riemannian optimization. Numerical applications demonstrating the effectiveness of the proposed coordinate-adaptive tensor integration method are presented and discussed for prototype Liouville and Fokker-Planck equations.

math.NA↗

arXiv2023

Tensor rank reduction via coordinate flows

Recently, there has been a growing interest in efficient numerical algorithms based on tensor networks and low-rank techniques to approximate high-dimensional functions and solutions to high-dimensional PDEs. In this paper, we propose a new tensor rank reduction method based on coordinate transformations that can greatly increase the efficiency of high-dimensional tensor approximation algorithms. The idea is simple: given a multivariate function, determine a coordinate transformation so that the function in the new coordinate system has smaller tensor rank. We restrict our analysis to linear coordinate transformations, which gives rise to a new class of functions that we refer to as tensor ridge functions. Leveraging Riemannian gradient descent on matrix manifolds we develop an algorithm that determines a quasi-optimal linear coordinate transformation for tensor rank reduction.The results we present for rank reduction via linear coordinate transformations open the possibility for generalizations to larger classes of nonlinear transformations. Numerical applications are presented and discussed for linear and nonlinear PDEs.

math.NA↗

arXiv2022

Adaptive integration of nonlinear evolution equations on tensor manifolds

We develop new adaptive algorithms for temporal integration of nonlinear evolution equations on tensor manifolds. These algorithms, which we call step-truncation methods, are based on performing one time step with a conventional time-stepping scheme, followed by a truncation operation onto a tensor manifold. By selecting the rank of the tensor manifold adaptively to satisfy stability and accuracy requirements, we prove convergence of a wide range of step-truncation methods, including explicit one-step and multi-step methods. These methods are very easy to implement as they rely only on arithmetic operations between tensors, which can be performed by efficient and scalable parallel algorithms. Adaptive step-truncation methods can be used to compute numerical solutions of high-dimensional PDEs, which have become central to many new areas of application such optimal mass transport, random dynamical systems, and mean field optimal control. Numerical applications are presented and discussed for a Fokker-Planck equation with spatially dependent drift on a flat torus of dimension two and four.

math.NA↗

arXiv2021

Rank-adaptive tensor methods for high-dimensional nonlinear PDEs

We present a new rank-adaptive tensor method to compute the numerical solution of high-dimensional nonlinear PDEs. The method combines functional tensor train (FTT) series expansions, operator splitting time integration, and a new rank-adaptive algorithm based on a thresholding criterion that limits the component of the PDE velocity vector normal to the FTT tensor manifold. This yields a scheme that can add or remove tensor modes adaptively from the PDE solution as time integration proceeds. The new method is designed to improve computational efficiency, accuracy and robustness in numerical integration of high-dimensional problems. In particular, it overcomes well-known computational challenges associated with dynamic tensor integration, including low-rank modeling errors and the need to invert covariance matrices of tensor cores at each time step. Numerical applications are presented and discussed for linear and nonlinear advection problems in two dimensions, and for a four-dimensional Fokker-Planck equation.

math.NA↗

arXiv2021

Spectral methods for nonlinear functionals and functional differential equations

We present a rigorous convergence analysis for cylindrical approximations of nonlinear functionals, functional derivatives, and functional differential equations (FDEs). The purpose of this analysis is twofold: first, we prove that continuous nonlinear functionals, functional derivatives and FDEs can be approximated uniformly on any compact subset of a real Banach space admitting a basis by high-dimensional multivariate functions and high-dimensional partial differential equations (PDEs), respectively. Second, we show that the convergence rate of such functional approximations can be exponential, depending on the regularity of the functional (in particular its Fréchet differentiability), and its domain. We also provide necessary and sufficient conditions for consistency, stability and convergence of cylindrical approximations to linear FDEs. These results open the possibility to utilize numerical techniques for high-dimensional systems such as deep neural networks and numerical tensor methods to approximate nonlinear functionals in terms of high-dimensional functions, and compute approximate solutions to FDEs by solving high-dimensional PDEs. Numerical examples are presented and discussed for prototype nonlinear functionals and for an initial value problem involving a linear FDE.

math.NA↗

arXiv2020

Dynamic tensor approximation of high-dimensional nonlinear PDEs

We present a new method based on functional tensor decomposition and dynamic tensor approximation to compute the solution of a high-dimensional time-dependent nonlinear partial differential equation (PDE). The idea of dynamic approximation is to project the time derivative of the PDE solution onto the tangent space of a low-rank functional tensor manifold at each time. Such a projection can be computed by minimizing a convex energy functional over the tangent space. This minimization problem yields the unique optimal velocity vector that allows us to integrate the PDE forward in time on a tensor manifold of constant rank. In the case of initial/boundary value problems defined in real separable Hilbert spaces, this procedure yields evolution equations for the tensor modes in the form of a coupled system of one-dimensional time-dependent PDEs. We apply the dynamic tensor approximation to a four-dimensional Fokker-Planck equation with non-constant drift and diffusion coefficients, and demonstrate its accuracy in predicting relaxation to statistical equilibrium.

math.NA↗

arXiv2019

Dynamically orthogonal tensor methods for high-dimensional nonlinear PDEs

We develop new dynamically orthogonal tensor methods to approximate multivariate functions and the solution of high-dimensional time-dependent nonlinear partial differential equations (PDEs). The key idea relies on a hierarchical decomposition of the approximation space obtained by splitting the independent variables of the problem into disjoint subsets. This process, which can be conveniently be visualized in terms of binary trees, yields series expansions analogous to the classical Tensor-Train and Hierarchical Tucker tensor formats. By enforcing dynamic orthogonality conditions at each level of binary tree, we obtain coupled evolution equations for the modes spanning each subspace within the hierarchical decomposition. This allows us to effectively compute the solution to high-dimensional time-dependent nonlinear PDEs on tensor manifolds of constant rank, with no need for rank reduction methods. We also propose new algorithms for dynamic addition and removal of modes within each subspace. Numerical examples are presented and discussed for high-dimensional hyperbolic and parabolic PDEs in bounded domains.

math.NA↗