SearcharxivSearch

arXiv subjects

Mazen Ali

Publications and source records attributed to Mazen Ali.

18 recordsLinked to original sources

STN-GPR: A Singularity Tensor Network Framework for Efficient Option Pricing

We develop a tensor-network surrogate for option pricing, targeting large-scale portfolio revaluation problems arising in market risk management (e.g., VaR and Expected Shortfall computations). The method involves representing high-dimensional price surfaces in tensor-train (TT) form using TT-cross approximation, constructing the surrogate directly from black-box price evaluations without materializing the full training tensor. For inference, we use a Laplacian kernel and derive TT representations of the kernel matrix and its closed-form inverse in the noise-free setting, enabling TT-based Gaussian process regression without dense matrix factorization or iterative linear solves. We found that hyperparameter optimization consistently favors a large kernel length-scale and show that in this regime the GPR predictor reduces to multilinear interpolation for off-grid inputs; we also derive a low-rank TT representation for this limit. We evaluate the approach on five-asset basket options over an eight dimensional parameter space (asset spot levels, strike, interest rate, and time to maturity). For European geometric basket puts, the tensor surrogate achieves lower test error at shorter training times than standard GPR by scaling to substantially larger effective training sets. For American arithmetic basket puts trained on LSMC data, the surrogate exhibits more favorable scaling with training-set size while providing millisecond-level evaluation per query, with overall runtime dominated by data generation.

q-fin.PR

Quantum circuit simulation with a local time-dependent variational principle

Classical simulations of quantum circuits are vital for assessing potential quantum advantage and benchmarking devices, yet they require sophisticated methods to avoid the exponential growth of resources. Tensor network approaches, in particular matrix product states (MPS) combined with the time-evolving block decimation (TEBD) algorithm, currently dominate large-scale circuit simulations. These methods scale efficiently when entanglement is limited but suffer rapid bond dimension growth with increasing entanglement and handle long-range gates via costly SWAP insertions. Motivated by the success of the time-dependent variational principle (TDVP) in many-body physics, we reinterpret quantum circuits as a series of discrete time evolutions, using gate generators to construct an MPS-based circuit simulation via a local TDVP formulation. This addresses TEBD's key limitations by (1) naturally accommodating long-range gates and (2) optimally representing states on the MPS manifold. By diffusing entanglement more globally, the method suppresses local bond growth and reduces memory and runtime costs. We benchmark the approach on five 49-qubit circuits: three Hamiltonian circuits (1D open and periodic Heisenberg, 2D 7x7 Ising) and two algorithmic ones (quantum approximate optimization, hardware-efficient ansatz). Across all cases, our method yields substantial resource reductions over standard tools, establishing a new state-of-the-art for circuit simulation and enabling advances across quantum computing, condensed matter, and beyond.

quant-ph

Lightweight Cloud Masking Models for On-Board Inference in Hyperspectral Imaging

Cloud and cloud shadow masking is a crucial preprocessing step in hyperspectral satellite imaging, enabling the extraction of high-quality, analysis-ready data. This study evaluates various machine learning approaches, including gradient boosting methods such as XGBoost and LightGBM as well as convolutional neural networks (CNNs). All boosting and CNN models achieved accuracies exceeding 93%. Among the investigated models, the CNN with feature reduction emerged as the most efficient, offering a balance of high accuracy, low storage requirements, and rapid inference times on both CPUs and GPUs. Variations of this version, with only up to 597 trainable parameters, demonstrated the best trade-off in terms of deployment feasibility, accuracy, and computational efficiency. These results demonstrate the potential of lightweight artificial intelligence (AI) models for real-time hyperspectral image processing, supporting the development of on-board satellite AI systems for space-based applications.

cs.CV

Quantum-Inspired Solver for Simulating Material Deformations

This paper explores the application of tensor networks (TNs) to the simulation of material deformations within the framework of linear elasticity. Material simulations are essential computational tools extensively used in both academic research and industrial applications. TNs, originally developed in quantum mechanics, have recently shown promise in solving partial differential equations (PDEs) due to their potential for exponential speedups over classical algorithms. Our study successfully employs TNs to solve linear elasticity equations with billions of degrees of freedom, achieving exponential reductions in both memory usage and computational time. These results demonstrate the practical viability of TNs as a powerful classical backend for executing quantum-inspired algorithms with significant efficiency gains. This work is based on our research conducted with IKERLAN.

quant-ph

SFFT-Based Homogenization: Using Tensor Trains to Enhance FFT-Based Homogenization

Homogenization is a fundamental technique for estimating the macroscopic properties of materials with microscale heterogeneity. Among Homogenization methods, the FFT-based Homogenization algorithm has become widely used due to its computational efficiency and ability to handle complex microstructures. Nevertheless, even with GPU acceleration, FFT-based Homogenization for industrial applications remains excessively time-consuming, particularly when generating elastic training data for AI models. This is due to the curse of dimensionality, which arises from the algorithms reliance on the Fast Fourier Transform, creating a fundamental bottleneck. In this paper, we propose a quantum-inspired SFFT-based Homogenization algorithm that leverages the improved time complexity of a Tensor Train variant of the Quantum Fourier Transform. By additionally exploiting structural properties of the underlying microstructure, our method achieves exponential improvements in time complexity and memory efficiency compared to the traditional FFT-based technique - all while remaining executable on classical hardware. We evaluate the performance of our algorithm across increasingly complex microstructures, demonstrating its potential advantages and limitations.

cond-mat.mtrl-sci

Piecewise Polynomial Tensor Network Quantum Feature Encoding

This work introduces a novel method for embedding continuous variables into quantum circuits via piecewise polynomial features, utilizing low-rank tensor networks. Our approach, termed Piecewise Polynomial Tensor Network Quantum Feature Encoding (PPTNQFE), aims to broaden the applicability of quantum algorithms by incorporating spatially localized representations suited for numerical applications like partial differential equations and function regression. We demonstrate the potential of PPTNQFE through efficient point evaluations of solutions of discretized differential equations and in modeling functions with localized features such as jump discontinuities. While promising, challenges such as unexplored noise impact and design of trainable circuits remain. This study opens new avenues for enhancing quantum models with novel feature embeddings and leveraging TN representations for a wider array of function types in quantum machine learning.

quant-ph

A Performance Study of Variational Quantum Algorithms for Solving the Poisson Equation on a Quantum Computer

Recent advances in quantum computing and their increased availability has led to a growing interest in possible applications. Among those is the solution of partial differential equations (PDEs) for, e.g., material or flow simulation. Currently, the most promising route to useful deployment of quantum processors in the short to near term are so-called hybrid variational quantum algorithms (VQAs). Thus, variational methods for PDEs have been proposed as a candidate for quantum advantage in the noisy intermediate scale quantum (NISQ) era. In this work, we conduct an extensive study of utilizing VQAs on real quantum devices to solve the simplest prototype of a PDE -- the Poisson equation. Although results on noiseless simulators for small problem sizes may seem deceivingly promising, the performance on quantum computers is very poor. We argue that direct resolution of PDEs via an amplitude encoding of the solution is not a good use case within reach of today's quantum devices -- especially when considering large system sizes and more complicated non-linear PDEs that are required in order to be competitive with classical high-end solvers.

quant-ph

Low-Rank Approximability and Entropy Area Laws for Ground States of Unbounded Hamiltonians

We show how local bounded interactions in an unbounded Hamiltonian lead to eigenfunctions with favorable low-rank properties. To this end, we utilize ideas from quantum entanglement of multi-particle spin systems. We begin by analyzing the connection between entropy area laws and low-rank approximability. The characterization for 1D chains such as Matrix Product States (MPS) / Tensor Trains (TT) is rather extensive though incomplete. We then show that a Nearest Neighbor Interaction (NNI) Hamiltonian has eigenfunctions that are approximately separable in a certain sense. Under a further assumption on the approximand, we show that this implies a constant entropy bound. To the best of our knowledge, this work is the first analysis of low-rank approximability for unbounded Hamiltonians. Moreover, it extends previous results on entanglement entropy area laws to unbounded operators. The assumptions include a variety of self-adjoint operators and have a physical interpretation. The weak points are the aforementioned assumption on the approximand and that the validity is limited to MPS/TT formats.

math.FA

Ranks of Tensor Networks for Eigenspace Projections and the Curse of Dimensionality

The hierarchical (multi-linear) rank of an order-$d$ tensor is key in determining the cost of representing a tensor as a (tree) Tensor Network (TN). In general, it is known that, for a fixed accuracy, a tensor with random entries cannot be expected to be efficiently approximable without the curse of dimensionality, i.e., a complexity growing exponentially with $d$. In this work, we show that the ground state projection (GSP) of a class of unbounded Hamiltonians can be approximately represented as an operator of low effective dimensionality that is independent of the (high) dimension $d$ of the GSP. This allows to approximate the GSP without the curse of dimensionality.

math.NA

Approximation of Smoothness Classes by Deep Rectifier Networks

We consider approximation rates of sparsely connected deep rectified linear unit (ReLU) and rectified power unit (RePU) neural networks for functions in Besov spaces $B^α_{q}(L^p)$ in arbitrary dimension $d$, on general domains. We show that \alert{deep rectifier} networks with a fixed activation function attain optimal or near to optimal approximation rates for functions in the Besov space $B^α_τ(L^τ)$ on the critical embedding line $1/τ=α/d+1/p$ for \emph{arbitrary} smoothness order $α>0$. Using interpolation theory, this implies that the entire range of smoothness classes at or above the critical line is (near to) optimally approximated by deep ReLU/RePU networks.

math.FA

On the Ordering of Sites in the Density Matrix Renormalization Group using Quantum Mutual Information

The density matrix renormalization group (DMRG) of White 1992 remains to this day an integral component of many state-of-the-art methods for efficiently simulating strongly correlated quantum systems. In quantum chemistry, QC-DMRG became a powerful tool for ab initio calculations with the non-relativistic Schrödinger equation. An important issue in QC-DMRG is the so-called ordering problem -- the optimal ordering of DMRG sites corresponding to electronic orbitals that produces the most accurate results. To this end, a commonly used heuristic is the grouping of strongly correlated orbitals as measured via quantum mutual information. In this work, we show how such heuristics can be directly related to minimizing the entanglement entropy of matrix product states and, consequently, to the truncation error of a fixed bond dimension approximation. Key to establishing this link is the strong subadditivity of entropy. This provides rigorous theoretical justification for the orbital ordering methods and suggests alternate ordering criteria.

quant-ph

Approximation Theory of Tree Tensor Networks: Tensorized Multivariate Functions

We study the approximation of multivariate functions with tensor networks (TNs), providing some answers to the following two questions: ``what are the approximation capabilities of TNs for functions from classical smoothness classes?'' and ``what are the properties of the class of functions that can be approximated with TNs with a certain performance?'' As a partial answer to the former, we show that TNs can (near to) optimally replicate $h$-uniform and $h$-adaptive spline approximation, for any smoothness order of the target function. Tensor networks thus exhibit universal expressivity w.r.t. isotropic, anisotropic and mixed smoothness spaces that is comparable with more general neural networks families such as deep rectified linear unit (ReLU) networks. Put differently, TNs have the capacity to (near to) optimally approximate many function classes -- without being adapted to the particular class in question. As a partial answer to the latter, as a candidate model class we consider approximation classes of TNs and show that these are (quasi-)Banach spaces, that many types of classical smoothness spaces are continuously embedded into said approximation classes and that TNs approximation classes are themselves not embedded in any classical smoothness space. In other words, TNs can efficiently approximate functions that lie beyond classical smoothness spaces.

math.FA

$H^1$-Stability of the $L^2$-Projection onto Finite Element Spaces on Adaptively Refined Quadrilateral Meshes

The $L^2$-orthogonal projection $Π_h:L^2(Ω)\rightarrow\mathbb{V}_h$ onto a finite element (FE) space $\mathbb{V}_h$ is called $H^1$-stable iff $\|\nablaΠ_h u\|_{L^2(Ω)}\leq C\|u\|_{H^1(Ω)}$, for any $u\in H^1(Ω)$ with a positive constant $C\neq C(h)$ independent of the mesh size $h>0$. In this work, we discuss local criteria for the $H^1$-stability of adaptively refined meshes. We show that adaptive refinement strategies for quadrilateral meshes in 2D (Q-RG and Q-RB), introduced originally in Bank et al. 1982 and Kobbelt 1996, are $H^1$-stable for FE spaces of polynomial degree $p=2,\ldots,9$.

math.NA

Approximation Theory of Tree Tensor Networks: Tensorized Univariate Functions -- Part I

We study the approximation of functions by tensor networks (TNs). We show that Lebesgue $L^p$-spaces in one dimension can be identified with tensor product spaces of arbitrary order through tensorization. We use this tensor product structure to define subsets of $L^p$ of rank-structured functions of finite representation complexity. These subsets are then used to define different approximation classes of tensor networks, associated with different measures of complexity. These approximation classes are shown to be quasi-normed linear spaces. We study some elementary properties and relationships of said spaces. In part II of this work, we will show that classical smoothness (Besov) spaces are continuously embedded into these approximation classes. We will also show that functions in these approximation classes do not possess any Besov smoothness, unless one restricts the depth of the tensor networks. The results of this work are both an analysis of the approximation spaces of TNs and a study of the expressivity of a particular type of neural networks (NN) -- namely feed-forward sum-product networks with sparse architecture. The input variables of this network result from the tensorization step, interpreted as a particular featuring step which can also be implemented with a neural network with a specific architecture. We point out interesting parallels to recent results on the expressivity of rectified linear unit (ReLU) networks -- currently one of the most popular type of NNs.

math.FA

Singular Value Decomposition in Sobolev Spaces: Part I

A well known result from functional analysis states that any compact operator between Hilbert spaces admits a singular value decomposition (SVD). This decomposition is a powerful tool that is the workhorse of many methods both in mathematics and applied fields. A prominent application in recent years is the approximation of high-dimensional functions in a low-rank format. This is based on the fact that, under certain conditions, a tensor can be identified with a compact operator and SVD applies to the latter. One key assumption for this application is that the tensor product norm is not weaker than the injective norm. This assumption is not fulfilled in Sobolev spaces, which are widely used in the theory and numerics of partial differential equations. Our goal is the analysis of the SVD in Sobolev spaces. This work consists of two parts. In this manuscript (part I), we address low-rank approximations and minimal subspaces in H1. We analyze the H1-error of the SVD performed in the ambient L2-space. In part II, we will address variants of the SVD in norms stronger than the L2-norm. We will provide a few numerical examples that support our theoretical findings.

math.FA

Singular Value Decomposition in Sobolev Spaces: Part II

Under certain conditions, an element of a tensor product space can be identified with a compact operator and the singular value decomposition (SVD) applies to the latter. These conditions are not fulfilled in Sobolev spaces. In the previous part of this work (part I), we introduced some preliminary notions in the theory of tensor product spaces. We analyzed low-rank approximations in H1 and the error of the SVD performed in the ambient L2 space. In this work (part II), we continue by considering variants of the SVD in norms stronger than the L2-norm. Overall and, perhaps surprisingly, this leads to a more difficult control of the H1-error. We briefly consider an isometric embedding of H1 that allows direct application of the SVD to H1-functions. Finally, we provide a few numerical examples that support our theoretical findings.

math.FA

HT-AWGM: A Hierarchical Tucker-Adaptive Wavelet Galerkin Method for High Dimensional Elliptic Problems

This paper is concerned with the construction, analysis and realization of a numerical method to approximate the solution of high dimensional elliptic partial differential equations. We propose a new combination of an Adaptive Wavelet Galerkin Method (AWGM) and the well known Hierarchical Tensor (HT) format. The arising HT-AWGM is adaptive both in the wavelet representation of the low dimensional factors and in the tensor rank of the HT representation. The point of departure is an adaptive wavelet method for the HT format using approximate Richardson iterations from [1] and an AWGM method as described in [13]. HT-AWGM performs a sequence of Galerkin solves based upon a truncated preconditioned conjugate gradient (PCG) algorithm from [33] in combination with a tensor-based preconditioner from [3]. Our analysis starts by showing convergence of the truncated conjugate gradient method. The next step is to add routines realizing the adaptive refinement. The resulting HT-AWGM is analyzed concerning convergence and complexity. We show that the performance of the scheme asymptotically depends only on the desired tolerance with convergence rates depending on the Besov regularity of low dimensional quantities and the low rank tensor structure of the solution. The complexity in the ranks is algebraic with powers of four stemming from the complexity of the tensor truncation. Numerical experiments show the quantitative performance.

math.NA

Reduced Basis Methods Based Upon Adaptive Snapshot Computations

We use asymptotically optimal \emph{adaptive} numerical methods (here specifically a wavelet scheme) for snapshot computations within the offline phase of the Reduced Basis Method (RBM). The resulting discretizations for each snapshot (i.e., parameter-dependent) do not permit the standard RB `truth space', but allow for error estimation of the RB approximation with respect to the exact solution of the considered parameterized partial differential equation. The residual-based a posteriori error estimators are computed by an adaptive dual wavelet expansion, which allows us to compute a surrogate of the dual norm of the residual. The resulting adaptive RBM is analyzed. We show the convergence of the resulting adaptive Greedy method. Numerical experiments for stationary and instationary problems underline the potential of this approach.

math.NA