SearcharxivSearch

arXiv subjects

Julia Lindberg

Publications and source records attributed to Julia Lindberg.

At least 19 recordsLinked to original sources

Algebraic Distance Optimization in Polyhedral Norms

We consider the distance minimization problem to a real algebraic variety $X \subseteq \RR^n$ when the metric is induced by a polyhedral norm. Each point in the variety has a Voronoi cell whose geometry depends on the normal space at the point and the inner normal fan of the polyhedral ball. For codimension-one varieties, we decompose $X$ into sets of points whose Voronoi cones have the same dimension, which is the expected dimension of their Voronoi cell. We prove that this decomposition is a stratification of $X$ and that each strata is a semialgebraic set. We conclude by giving an algebraic description of the medial axis, which is the locus of points whose minimal distance to $X$ is achieved at more than one point on $X$.

math.AG

Reinforcement Learning for Power-Flow Network Analysis

The power flow equations are non-linear multivariate equations that describe the relationship between power injections and bus voltages of electric power networks. Given a network topology, we are interested in finding network parameters with many equilibrium points. This corresponds to finding instances of the power flow equations with many real solutions. Current state-of-the art algorithms in computational algebra are not capable of answering this question for networks involving more than a small number of variables. To remedy this, we design a probabilistic reward function that gives a good approximation to this root count, and a state-space that mimics the space of power flow equations. We derive the average root count for a Gaussian model, and use this as a baseline for our RL agents. The agents discover instances of the power flow equations with many more solutions than the average baseline. This demonstrates the potential of RL for power-flow network design and analysis as well as the potential for RL to contribute meaningfully to problems that involve complex non-linear algebra or geometry. \footnote{Author order alphabetic, all authors contributed equally.

cs.LG

Efficient Tensor Decomposition via Moment Matrix Extension

Motivated by a flurry of recent work on efficient tensor decomposition algorithms, we show that the celebrated moment matrix extension algorithm of Brachat, Comon, Mourrain, and Tsigaridas for symmetric tensor canonical polyadic (CP) decomposition can be made efficient under the right conditions. We first show that the crucial property determining the complexity of the algorithm is the regularity of a target decomposition. This allows us to reduce the complexity of the vanilla algorithm, while also unifying results from previous works. We then show that for tensors in $S^d\mathbb{C}^{n+1}$ with $d$ even, low enough regularity can reduce finding a symmetric tensor decomposition to solving a system of linear equations. For order-$4$ tensors we prove that generic tensors of rank up to $r=2n+1$ can be decomposed efficiently via moment matrix extension, exceeding the rank threshold allowed by simultaneous diagonalization. We then formulate a conjecture that states for generic order-$4$ tensors of rank $r=O(n^2)$ the induced linear system is sufficient for efficient tensor decomposition, matching the asymptotics of existing algorithms and in fact improving the leading coefficient. Towards this conjecture we give computer assisted proofs that the statement holds for $n=2, \dots, 17$. Next we demonstrate that classes of nonidentifiable tensors can be decomposed efficiently via the moment matrix extension algorithm, bypassing the usual need for uniqueness of decomposition. Of particular interest is the class of monomials, for which the extension algorithm is not only efficient but also improves on existing theory by explicitly parameterizing the space of decompositions. Code for implementations of the efficient algorithm for generic tensors and monomials are provided, along with several numerical examples.

math.AG

Tropical Bisectors and Carlini-Wagner Attacks

Pasque et al. showed that using a tropical symmetric metric as an activation function in the last layer can improve the robustness of convolutional neural networks (CNNs) against state-of-the-art attacks, including the Carlini-Wagner attack. This improvement occurs when the attacks are not specifically adapted to the non-differentiability of the tropical layer. Moreover, they showed that the decision boundary of a tropical CNN is defined by tropical bisectors. In this paper, we explore the combinatorics of tropical bisectors and analyze how the tropical embedding layer enhances robustness against Carlini-Wagner attacks. We prove an upper bound on the number of linear segments the decision boundary of a tropical CNN can have. We then propose a refined version of the Carlini-Wagner attack, specifically tailored for the tropical architecture. Computational experiments with MNIST and LeNet5 showcase our attacks improved success rate.

cs.LG

Method of moments for Gaussian mixtures: Implementation and benchmarks

Gaussian mixture models are universal approximators in the sense that any smooth density can be approximated arbitrarily well with a Gaussian mixture model with enough components. Due to their broad expressive power, Gaussian mixture models appear in many applications. As a result, algebraic parameter recovery for Gaussian mixture models from data is a valuable contribution to multiple fields. Our work documents performance of the method of moments for high dimensional Gaussian mixtures. We outline the method of moments, and selections of moments and their corresponding polynomials that work well for parameter recovery in practice. Our main contribution puts these ideas into practice with an implementation as a julia package, GMMParameterEstimation, as well as computational benchmarks.

stat.CO

On the typical and atypical solutions to the Kuramoto equations

The Kuramoto model is a dynamical system that models the interaction of coupled oscillators. There has been much work to effectively bound the number of equilibria to the Kuramoto model for a given network. By formulating the Kuramoto equations as a system of algebraic equations, we first relate the complex root count of the Kuramoto equations to the combinatorics of the underlying network by showing that the complex root count is generically equal to the normalized volume of the corresponding adjacency polytope of the network. We then give explicit algebraic conditions under which this bound is strict and show that there are networks where the Kuramoto equations have infinitely many equilibria.

math.AG

Estimating Gaussian mixtures using sparse polynomial moment systems

The method of moments is a classical statistical technique for density estimation that solves a system of moment equations to estimate the parameters of an unknown distribution. A fundamental question critical to understanding identifiability asks how many moment equations are needed to get finitely many solutions and how many solutions there are. We answer this question for classes of Gaussian mixture models using the tools of polyhedral geometry. In addition, we show that a generic Gaussian $k$-mixture model is identifiable from its first $3k+2$ moments. Using these results, we present a homotopy algorithm that performs parameter recovery for high dimensional Gaussian mixture models where the number of paths tracked scales linearly in the dimension.

stat.ME

The algebraic degree of sparse polynomial optimization

We study a broad class of polynomial optimization problems whose constraints and objective functions exhibit sparsity patterns. We give two characterizations of the number of critical points to these problems, one as a mixed volume and one as an intersection product on a toric variety. As a corollary, we obtain a convex geometric interpretation of polar degrees, a classical invariant of algebraic varieties, as well as Euclidean distance degrees. Furthermore, we prove the BKK generality of Lagrange systems in many instances.

math.AG

Implementing real polyhedral homotopy

We implement a real polyhedral homotopy method using three functions. The first function provides a certificate that our real polyhedral homotopy is applicable to a given system; the second function generates binomial systems for a start system; the third function outputs target solutions from the start system obtained by the second function. This work realizes the theoretical contributions in \cite{ergur2019polyhedral} as easy to use functions, allowing for further investigation into real homotopy algorithms.

math.AG

Symmetric Hyperbolic Polynomials

Hyperbolic polynomials have been of recent interest due to applications in a wide variety of fields. We seek to better understand these polynomials in the case when they are symmetric, i.e. invariant under all permutations of variables. We give a complete characterization of the set of symmetric hyperbolic polynomials of degree 3, and a large class of symmetric hyperbolic polynomials of degree 4. For a class of polynomials, which we call hook-shaped, we relate symmetric hyperbolic polynomials to a class of linear maps of univariate polynomials preserving hyperbolicity, and give evidence toward a beautiful characterization of all such hook-shaped symmetric hyperbolic polynomials. We show that hyperbolicity cones of a class of symmetric hyperbolic polynomials, including all symmetric hyperbolic cubics, are spectrahedral. Finally, we connect testing hyperbolicity of a symmetric polynomial to the degree principle for symmetric nonnegative polynomials.

math.AG

Invariants of SDP exactness in quadratic programming

In this paper we study the Shor relaxation of quadratic programs by fixing a feasible set and considering the space of objective functions for which the Shor relaxation is exact. We first give conditions under which this region is invariant under the choice of generators defining the feasible set. We then describe this region when the feasible set is invariant under the action of a subgroup of the general linear group. We conclude by applying these results to quadratic binary programs. We give an explicit description of objective functions where the Shor relaxation is exact and use this knowledge to design an algorithm that produces candidate solutions for binary quadratic programs.

math.OC

The symmetric geometric rank of symmetric tensors

Inspired by recent work of Kopparty-Moshkovitz-Zuiddam and motivated by problems in combinatorics and hypergraphs, we introduce the notion of the symmetric geometric rank of a symmetric tensor. This quantity is equal to the codimension of the singular locus of the hypersurface associated to the tensor. We first derive fundamental properties of the symmetric geometric rank. Then, we study the space of symmetric tensors of prescribed symmetric geometric rank, which are spaces of homogeneous polynomials whose corresponding hypersurfaces have a singular locus of bounded codimension.

math.AG

A polyhedral homotopy algorithm for computing critical points of polynomial programs

In this paper we propose a method that uses Lagrange multipliers and numerical algebraic geometry to find all critical points, and therefore globally solve, polynomial optimization problems. We design a polyhedral homotopy algorithm that explicitly constructs an optimal start system, circumventing the typical bottleneck associated with polyhedral homotopy algorithms. The correctness of our algorithm follows from intersection theoretic computations of the algebraic degree of polynomial optimization programs and relies on explicitly solving the tropicalization of a corresponding Lagrange system. We present experiments that demonstrate the superiority of our algorithm over traditional homotopy continuation algorithms.

math.OC

Real circles tangent to 3 conics

In this paper we study circles tangent to conics. We show there are generically $184$ complex circles tangent to three conics in the plane and we characterize the real discriminant of the corresponding polynomial system. We give an explicit example of $3$ conics with $136$ real circles tangent to them. We conjecture that 136 is the maximal number of real circles. Furthermore, we implement a hill-climbing algorithm to find instances of conics with many real circles, and we introduce a machine learning model that, given three real conics, predicts the number of circles tangent to these three conics.

math.AG

Deploying Enhanced Speech Feature Decreased Audio Complaints at SVT Play VOD Service

At Public Service Broadcaster SVT in Sweden, background music and sounds in programs have for many years been one of the most common complaints from the viewers. The most sensitive group are people with hearing disabilities, but many others also find background sounds annoying. To address this problem SVT has added Enhanced Speech, a feature with lower background noise, to a number of TV programs in VOD service SVT Play. As a result, when the number of programs with the Enhanced Speech feature increased, the level of audio complaints to customer service decreased. The Enhanced Speech feature got the rating 8.3/10 in a survey with 86 participants. The rating for possible future usage was 9.0/10. In this article we describe this feature's design and development process, as well as its technical specification, limitations and future development opportunities.

cs.SD

The maximum likelihood degree of sparse polynomial systems

We consider statistical models arising from the common set of solutions to a sparse polynomial system with general coefficients. The maximum likelihood degree counts the number of critical points of the likelihood function restricted to the model. We prove the maximum likelihood degree of a sparse polynomial system is determined by its Newton polytopes and equals the mixed volume of a related Lagrange system of equations.

math.AG

Using Geographic Load Shifting to Reduce Carbon Emissions

An increasing focus on the electricity use and carbon emissions associated with computing has lead to pledges by major cloud computing companies to lower their carbon footprint. Data centers have a unique ability to shift computing load between different geographical locations, giving rise to geographic load flexibility that can be employed to reduce carbon emissions. In this paper, we present a model where data centers shift load independently of the ISOs. We first consider the impact of load shifting guided by locational marginal carbon emissions, denoted by $λ_{\text{CO}_2}$, a sensitivity metric that measures the impact of incremental load shifts. Relative to previous models for data center load shifting, the presented model improves accuracy and include more realistic assumptions regarding the operation of both data centers and the electricity market. Further, we introduce a new benchmark model in which data centers have access to the full information about the power system and can identify optimal shifts for the current time period. We demonstrate the efficacy of our model on the IEEE RTS GMLC system using 5 minute load and generation data for an entire year. Our results show that the proposed accuracy improvements for the shifting model based on $λ_{\text{CO}_2}$ are highly effective, leading to results that outperform the benchmark model.

eess.SY

Solving Parameterized Polynomial Systems with Decomposable Projections

The Galois group of a parameterized polynomial system of equations encodes the structure of the solutions. This monodromy group acts on the set of solutions for a general set of parameters, that is, on the fiber of a projection from the incidence variety of parameters and solutions onto the space of parameters. When this projection is decomposable, the Galois group is imprimitive, and we show that the structure can be exploited for computational improvements. Furthermore, we develop a new algorithm for solving these systems based on a suitable trace test. We illustrate our method on examples in statistics, kinematics, and benchmark problems in computational algebra. In particular, we resolve a conjecture on the number of solutions of the moment system associated to a mixture of Gaussian distributions.

math.AG