Searcharxiv⌕ Search

arXiv subjects

Mohammad Javad Latifi Jebelli

Publications and source records attributed to Mohammad Javad Latifi Jebelli.

16 recordsLinked to original sources

Tensor network approximation of Koopman operators

We propose a tensor network framework for approximating the evolution of observables of measure-preserving ergodic systems. Our approach is based on a spectrally-convergent approximation of the skew-adjoint Koopman generator by a diagonalizable, skew-adjoint operator $W_τ$ that acts on a reproducing kernel Hilbert space $\mathcal H_τ$ with coalgebra structure and Banach algebra structure under the pointwise product of functions. Leveraging this structure, we lift the unitary evolution operators $e^{t W_τ}$ (which can be thought of as regularized Koopman operators) to a unitary evolution group on the Fock space $F(\mathcal H_τ)$ generated by $\mathcal H_τ$ that acts multiplicatively with respect to the tensor product. Our scheme also employs a representation of classical observables ($L^\infty$ functions of the state) by quantum observables (self-adjoint operators) acting on the Fock space, and a representation of probability densities in $L^1$ by quantum states. Combining these constructions leads to an approximation of the Koopman evolution of observables that is representable as evaluation of a tree tensor network built on a tensor product subspace $\mathcal H_τ^{\otimes n} \subset F(\mathcal H_τ)$ of arbitrarily high grading $n \in \mathbb N$. A key feature of this quantum-inspired approximation is that it captures information from a tensor product space of dimension $(2d+1)^n$, generated from a collection of $2d + 1$ eigenfunctions of $W_τ$. Furthermore, the approximation is positivity preserving. The paper contains a theoretical convergence analysis of the method and numerical applications to two dynamical systems on the 2-torus: an ergodic torus rotation as an example with pure point Koopman spectrum and a Stepanoff flow as an example with topological weak mixing.

math.DS↗

On Transformer Dynamics

We develop a geometric framework in which the token dynamics of a transformer are modeled by a system of interacting particles on a Riemannian manifold $\mathcal M$, the attention mechanism being encoded by a time-independent two-body interaction law, that is, a section of the pullback bundle $π_2^{*}(T\mathcal M)$ over $\mathcal M\times\mathcal M$. Within this framework we isolate two features that a family of interaction laws must possess in order to model language: it must realize generic nonlocal and nonreciprocal forces, and it must parametrize vector fields on a high-dimensional manifold efficiently. We show that both features are achieved simultaneously in a transformer model. Our main theorem produces a finitely parametrized family of interaction laws that is \emph{universal}: it realizes an arbitrary prescribed attention digraph. Moreover, we show that the cost of realizing a given attention digraph is governed by two combinatorial invariants of the digraph, namely its biclique cover number, which we identify with the least number of hubs in a hub extension, and its hub-chromatic index.

math.CO↗

On Algebras of Functions over Infinite Dimensions

We introduce a family of reproducing kernel Hilbert spaces $\mathcal A_Λ$ of holomorphic functions defined on an infinite--dimensional domain in a separable Hilbert space, $\mathbb{H}$. The reproducing kernel of $\mathcal A_Λ$ is constructed using the covariance operator associated with a Gaussian measure on $\mathbb{H}$, along with a holomorphic function $Λ$ on the unit disk. Under certain conditions on the kernel, $\mathcal A_Λ$ is closed under pointwise multiplication, giving it the structure of a reproducing kernel Hilbert algebra (RKHA). We also study twisted canonical commutation relations on these RKHAs, where the creation and annihilation operators are both bounded.

math-ph↗

Curvature of high-dimensional data

We consider the problem of estimating curvature where the data can be viewed as a noisy sample from an underlying manifold. For manifolds of dimension greater than one there are multiple definitions of local curvature, each suggesting a different estimation process for a given data set. Recently, there has been progress in proving that estimates of ``local point cloud curvature" converge to the related smooth notion of local curvature as the density of the point cloud approaches infinity. Herein we investigate practical limitations of such convergence theorems and discuss the significant impact of bias in such estimates as reported in recent literature. We provide theoretical arguments for the fact that bias increases drastically in higher dimensions, so much so that in high dimensions, the probability that a naive curvature estimate lies in a small interval near the true curvature could be near zero. We present a probabilistic framework that enables the construction of more accurate estimators of curvature for arbitrary noise models. The efficacy of our technique is supported with experiments on spheres of dimension as large as twelve.

math.ST↗

Symmetric star transforms and the algebraic geometry of their dual differential operators

The star transform is a generalized Radon transform mapping a function on $\mathbb{R}^n$ to the function whose value at a point is the integral along a union of rays emanating from the point in a fixed set of directions, called branch vectors. We show that the injectivity and inversion properties of the star transform are connected to its dual differential operator, an object introduced in this paper. We prove that if the set of branch vectors forms a symmetric shape with respect to the action of a finite rotation group $G$, then the symbol of its dual differential operator belongs to the ring of $G$-invariant polynomials. Furthermore, we show that star transforms with degenerate symmetry correspond to linear subspaces contained in the zero set of certain elementary symmetric polynomials, and we investigate the associated real algebraic Fano varieties. In particular, non-invertible star transforms in dimension 2 correspond to certain real lines on the Cayley nodal cubic surface.

math.AG↗

Second quantization for classical nonlinear dynamics

Using techniques from many-body quantum theory, we propose a framework for representing the evolution of observables of measure-preserving ergodic flows through infinite-dimensional rotation systems on tori. This approach is based on a class of weighted Fock spaces $F_w(\mathcal H_τ)$ generated by a 1-parameter family of reproducing kernel Hilbert spaces $\mathcal H_τ$, and endowed with commutative Banach algebra structure under the symmetric tensor product using a subconvolutive weight $w$. We describe the construction of the spaces $F_w(\mathcal H_τ)$ and show that their Banach algebra spectra, $σ(F_w(\mathcal H_τ))$, decompose into a family of tori of potentially infinite dimension. Spectrally consistent unitary approximations $U^t_τ$ of the Koopman operator acting on $\mathcal H_τ$ are then lifted to rotation systems on these tori akin to the topological models of ergodic systems with pure point spectra in the Halmos--von Neumann theorem. Our scheme also employs a procedure for representing observables of the original system by polynomial functions on finite-dimensional tori in $σ(F_w(\mathcal H_τ))$ of arbitrarily large degree, with coefficients determined from pointwise products of eigenfunctions of $U^t_τ$. This leads to models for the Koopman evolution of observables on $L^2$ built from tensor products of finite collections of approximate Koopman eigenfunctions. Numerically, the scheme is amenable to consistent data-driven implementation using kernel methods. We illustrate it with applications to Stepanoff flows on the 2-torus and the Lorenz 63 system. Connections with quantum computing are also discussed.

math.DS↗

Kernel Smoothing Operators on Thick Open Domains

We define the notion of a thick open set $Ω$ in a Euclidean space and show that a local Hardy-Littlewood inequality holds in $L^p(Ω)$, $p \in (1, \infty]$. We then establish pointwise and $L^p(Ω)$ convergence for families of convolution operators with a Markov normalization on $Ω$. We demonstrate application of such smoothing operators to piecewise-continuous density, velocity, and stress fields from discrete element models of sea ice dynamics.

math.CA↗

Numerical implementation of generalized V-line transforms on 2D vector fields and their inversions

The paper discusses numerical implementations of various inversion schemes for generalized V-line transforms on vector fields introduced in [6]. It demonstrates the possibility of efficient recovery of an unknown vector field from five different types of data sets, with and without noise. We examine the performance of the proposed algorithms in a variety of setups, and illustrate our results with numerical simulations on different phantoms.

math.NA↗

Multi-Priority Graph Sparsification

A \emph{sparsification} of a given graph $G$ is a sparser graph (typically a subgraph) which aims to approximate or preserve some property of $G$. Examples of sparsifications include but are not limited to spanning trees, Steiner trees, spanners, emulators, and distance preservers. Each vertex has the same priority in all of these problems. However, real-world graphs typically assign different ``priorities'' or ``levels'' to different vertices, in which higher-priority vertices require higher-quality connectivity between them. Multi-priority variants of the Steiner tree problem have been studied in prior literature but this generalization is much less studied for other sparsification problems. In this paper, we define a generalized multi-priority problem and present a rounding-up approach that can be used for a variety of graph sparsifications. Our analysis provides a systematic way to compute approximate solutions to multi-priority variants of a wide range of graph sparsification problems given access to a single-priority subroutine.

cs.DS↗

Lattice models and super telescoping formula

In this paper, we introduce the super telescoping formula, a natural generalization of well-known telescoping formula. We explore various aspects of the formula including its origin and the telescoping cancellations emerging from symmetric patterns. We also show that the super telescoping formula leads to the construction of exactly solvable lattice models with interesting partition functions.

math-ph↗

Inversion and Symmetries of the Star Transform

The star transform is a generalized Radon transform mapping a function of two variables to its integrals along "star-shaped" trajectories, which consist of a finite number of rays emanating from a common vertex. Such operators appear in mathematical models of various imaging modalities based on scattering of elementary particles. The paper presents a comprehensive study of the inversion of the star transform. We describe the necessary and sufficient conditions for invertibility of the star transform, introduce a new inversion formula and discuss its stability properties. As an unexpected bonus of our approach, we prove a conjecture from algebraic geometry about the zero sets of elementary symmetric polynomials.

math-ph↗

Generalized V-line transforms in 2D vector tomography

We study the inverse problem of recovering a vector field in $\mathbb{R}^2$ from a set of new generalized $V$-line transforms in three different ways. First, we introduce the longitudinal and transverse $V$-line transforms for vector fields in $\mathbb{R}^2$. We then give an explicit characterization of their respective kernels and show that they are complements of each other. We prove invertibility of each transform modulo their kernels and combine them to reconstruct explicitly the full vector field. In the second method, we combine the longitudinal and transverse V-line transforms with their corresponding first moment transforms and recover the full vector field from either pair. We show that the available data in each of these setups can be used to derive the signed V-line transform of both scalar component of the vector field, and use the known inversion of the latter. The final major result of this paper is the derivation of an exact closed form formula for reconstruction of the full vector field in $\mathbb{R}^2$ from its star transform with weights. We solve this problem by relating the star transform of the vector field to the ordinary Radon transform of the scalar components of the field.

math.CA↗

Graph Spanners: A Tutorial Review

This tutorial review provides a guiding reference to researchers who want to have an overview of the large body of literature about graph spanners. It reviews the current literature covering various research streams about graph spanners, such as different formulations, sparsity and lightness results, computational complexity, dynamic algorithms, and applications. As an additional contribution, we offer a list of open problems on graph spanners.

cs.DM↗

Multi-Level Graph Sketches via Single-Level Solvers

Given an undirected weighted graph $G(V,E)$, a constrained sketch over a terminal set $T\subset V$ is a subgraph $G'$ that connects the terminal vertices while satisfying a given set of constraints. Examples include Steiner trees (preserving connectivity among $T$) and subsetwise spanners (preserving shortest path distances up to a stretch factor). Multi-level constrained terminal sketches are generalizations in which terminal vertices require different levels or grades of service and each terminal pair is connected with edges of at least the minimum required level of the two terminals. This paper gives a flexible procedure for computing a broad class of multi-level graph sketches, which encompasses multi-level graph spanners, Steiner trees, and $k$--connected subgraphs as a few special cases. The proposed procedure is modular, i.e., it relies on availability of a single-level solver module (be it an oracle or approximation algorithm). One key result is that an $\ell$--level constrained terminal sketch can be computed with $\log\ell$ queries of the solver module while producing feasible solutions with approximation guarantees independent of $\ell$. Additionally, a new polynomial time algorithm for computing a subsetwise spanner is proposed. We show that for $k\in\N$, $\eps>0$, and $T\subset V$, there is a subsetwise $(2k-1)(1+\eps)$--spanner with total weight $O(|T|^\frac1kW(\ST(G,T)))$, where $W(\ST(G,T))$ is the weight of the Steiner tree of $G$ over the subset $T$. This is the first algorithm and weight guarantee for a multiplicative subsetwise spanner for nonplanar graphs. Numerical experiments are also done to illustrate the performance of the proposed algorithms.

cs.DM↗

Approximation algorithms and an integer program for multi-level graph spanners

Given a weighted graph $G(V,E)$ and $t \ge 1$, a subgraph $H$ is a \emph{$t$--spanner} of $G$ if the lengths of shortest paths in $G$ are preserved in $H$ up to a multiplicative factor of $t$. The \emph{subsetwise spanner} problem aims to preserve distances in $G$ for only a subset of the vertices. We generalize the minimum-cost subsetwise spanner problem to one where vertices appear on multiple levels, which we call the \emph{multi-level graph spanner} (MLGS) problem, and describe two simple heuristics. Applications of this problem include road/network building and multi-level graph visualization, especially where vertices may require different grades of service. We formulate a 0--1 integer linear program (ILP) of size $O(|E||V|^2)$ for the more general minimum \emph{pairwise spanner problem}, which resolves an open question by Sigurd and Zachariasen on whether this problem admits a useful polynomial-size ILP. We extend this ILP formulation to the MLGS problem, and evaluate the heuristic and ILP performance on random graphs of up to 100 vertices and 500 edges.

cs.DM↗

The V-line transform with some generalizations and cone differentiation

The paper studies various properties of the V-line transform (VLT) in the plane and conical Radon transform (CRT) in $\mathbb{R}^n$. VLT maps a function to a family of its integrals along trajectories made of two rays emanating from a common point. The CRT considered in this paper maps a function to a set of its integrals over surfaces of polyhedral cones. These types of operators appear in mathematical models of single scattering optical tomography, Compton camera imaging and other applications. We derive new explicit inversion formulae for VLT and CRT, as well as proving some previously known results using more intuitive geometric ideas. Using our inversion formula for VLT, we describe the range of that transformation when applied to a fairly broad class of functions and prove some support theorems. The efficiency of our method is demonstrated on several numerical examples. As an auxiliary result that plays a big role in this article, we derive a generalization of the Fundamental Theorem of Calculus, which we call Cone Differentiation Theorem.

math.CA↗