A new Algorithm for Overcomplete Tensor Decomposition based on Sums-of-Squares Optimisation

Abstract

In this thesis, a new class of algorithms based on Sums of Squares Programming is developed. These allow to reduce a degree-$d$ homogeneous polynomial $T = \sum_{i = 1}^m \langle a_i, X \rangle^d $ to a quadratic form being close to a rank-$1$ form via a low-degree reduction polynomial $W\in\sum \mathbb{R}[X]^2$. $W$ can be thought of as a `weight function' attaining high values on merely one of the components $a_i$. The component can then be extracted by running an eigenvalue decomposition on the quadratic form $\sum_{i=1}^m W(a_i) \langle a_i, X \rangle^2$.