arXiv · 2602.17974
Recursive Sketched Interpolation: Efficient Hadamard Products of Tensor Trains
Abstract
The Hadamard product of two tensors in the tensor-train (TT) format is a fundamental operation across various applications, such as TT-based function multiplication for nonlinear differential equations or convolutions. However, conventional methods for computing this product typically scale as at least $\mathcal{O}(\chi^4)$ with respect to the TT bond dimension (TT-rank) $\chi$, creating a severe computational bottleneck in practice. By combining randomized tensor-train sketching with slice selection via interpolative decomposition, we introduce Recursive Sketched Interpolation (RSI), a ``scale product'' algorithm that computes the Hadamard product of TTs at a computational cost of $\mathcal{O}(\chi^3)$. Benchmarks across various TT scenarios demonstrate that RSI offers superior scalability compared to traditional methods while maintaining comparable accuracy. We generalize RSI to compute more complex operations, including Hadamard products of multiple TTs and other element-wise nonlinear mappings, without increasing the complexity beyond $\mathcal{O}(\chi^3)$.
Explore related subjects
Keep this discovery
Zhaonan Meng, Yuehaw Khoo, Jiajia Li, E. Miles Stoudenmire. 2026-02-20. Recursive Sketched Interpolation: Efficient Hadamard Products of Tensor Trains. https://arxiv.org/abs/2602.17974
Cite the original work for its findings. Save a collection to share your selection of sources.