SearcharxivSearch

arXiv subjects

Sara Marziali

Publications and source records attributed to Sara Marziali.

3 recordsLinked to original sources

Neural Learning of Fast Matrix Multiplication Algorithms: A StrassenNet Approach

Fast matrix multiplication can be described as searching for low-rank decompositions of the matrix--multiplication tensor. We design a neural architecture, \textsc{StrassenNet}, which reproduces the Strassen algorithm for $2\times 2$ multiplication. Across many independent runs the network always converges to a rank-$7$ tensor, thus numerically recovering Strassen's optimal algorithm. We then train the same architecture on $3\times 3$ multiplication with rank $r\in\{19,\dots,23\}$. Our experiments reveal a clear numerical threshold: models with $r=23$ attain significantly lower validation error than those with $r\le 22$, suggesting that $r=23$ could actually be the smallest effective rank of the matrix multiplication tensor $3\times 3$. We also sketch an extension of the method to border-rank decompositions via an $\varepsilon$--parametrisation and report preliminary results consistent with the known bounds for the border rank of the $3\times 3$ matrix--multiplication tensor.

math.AG

Waring decompositions of special binomials

We determine the Waring rank of homogeneous polynomials of the form $x^ky^kz^k + \ell^{3k}$ where $\ell$ is a linear form. The result is based on the study of the Hilbert function and the resolution of special configurations of points in $\mathbb{P}^2$. As a byproduct of our result, we show that the monomial $x^ky^kz^k$ does not have irredundant decompositions of length $(k+1)^2 +1$.

math.AG

Product of Tensors and Description of Networks

Any kind of network can be naturally represented by a Directed Acyclic Graph (DAG); additionally, activation functions can determine the reaction of each node of the network with respect to the signal(s) incoming. We study the characterization of the signal distribution in a network under the lens of tensor algebra. More specifically, we describe every activation function as tensor distributions with respect to the nodes, called \textit{activation tensors}. The distribution of the signal is encoded in the \textit{total tensor} of the network. We formally prove that the total tensor can be obtained by computing the \textit{Batthacharya-Mesner Product} (BMP), an $n$-ary operation for tensors of order $n$, on the set of the activation tensors properly ordered and processed via two basic operations, that we call \textit{blow} and \textit{forget}. Our theoretical framework can be validated through the related code developed in Python.

math.AG