arXiv · 2506.15488
Minimizing Communication for Parallel Symmetric Tensor Times Same Vector Computation
Abstract
In this article, we focus on the parallel communication cost of multiplying the same vector along two modes of a $3$-dimensional symmetric tensor. This is a key computation in the higher-order power method for determining eigenpairs of a $3$-dimensional symmetric tensor and in gradient-based methods for computing a symmetric CP decomposition. We establish communication lower bounds that determine how much data movement is required to perform the specified computation in parallel. The core idea of the proof relies on extending a key geometric inequality for $3$-dimensional symmetric computations. We demonstrate that the communication lower bounds are tight by presenting an optimal algorithm where the data distribution is a natural extension of the triangle block partition scheme for symmetric matrices to 3-dimensional symmetric tensors.
Explore related subjects
Keep this discovery
Hussam Al Daas, Grey Ballard, Laura Grigori, Suraj Kumar, Kathryn Rouse, Mathieu Vérité. 2025-06-18. Minimizing Communication for Parallel Symmetric Tensor Times Same Vector Computation. https://arxiv.org/abs/2506.15488
Cite the original work for its findings. Save a collection to share your selection of sources.