SearcharxivSearch

arXiv subjects

Dan Edidin

Publications and source records attributed to Dan Edidin.

At least 19 recordsLinked to original sources

The generalized method of moments is (almost) statistically efficient in low-SNR Gaussian latent-variable models

We study estimation in the low signal-to-noise ratio (SNR) regime for a broad class of Gaussian latent-variable models, including Gaussian mixtures and orbit recovery problems. We show that, in this regime, the generalized method-of-moments (GMoM) matches the first-order asymptotic efficiency of maximum likelihood. In particular, if the moment features are chosen up to the minimal local order required for identification and are weighted optimally, then the resulting GMoM estimator has the same leading asymptotic covariance as the maximum-likelihood estimator. Our analysis shows that, in low SNR, this equivalence is governed by a layered local geometry: different directions become informative at different moment orders, partitioning the space into layers with distinct SNR scalings. We prove that the observed Fisher information and the GMoM information operator admit matching layerwise expansions across these layers. As a consequence, in the low-SNR regime, GMoM provides a statistically efficient alternative to maximum likelihood, while preserving the computational advantages of moment-based estimation.

math.ST

Projected multi-reference alignment

Motivated by structural biology applications, we study the projected multi-reference alignment (MRA) model, in which an unknown signal is observed through noisy samples, each generated by applying a random cyclic shift followed by a fixed projection. The projection merges reflection-symmetric index pairs, thereby discarding orientation information. The goal is to recover the dihedral orbit of the signal. We prove that in the high-noise regime, the first three moments of the projected observations determine a generic dihedral orbit. The main mechanism is a reduction, at the moment level, from projected MRA to the reflection-invariant phase-coupling structure of dihedral MRA. In Fourier-cosine coordinates adapted to the projection, the first moment determines the mean component, the second moment determines the Fourier magnitudes, and selected third moments yield the cosine phase-coupling relations appearing in the dihedral bispectrum. These relations lead to a constructive recovery scheme from moments up to order three. We complement the population theory with finite-sample experiments comparing expectation--maximization (EM), direct moment optimization, and direct Fourier-cosine moment optimization. The results show that, in the high-noise regime, both EM and direct moment optimization are consistent with the predicted third-moment sample-complexity scaling $n \gtrsim \sigma^6$, where $n$ is the number of observations and $\sigma^2$ is the noise variance.

eess.SP

Euclidean distance geometry and the orthogonal beltway problem

The orthogonal beltway problem is the problem of recovering the $\mathrm{O}(n)$-orbit of a $\delta$-function supported at a finite number of points in $\r^n$ from its auto-correlation or, equivalently, second moment. It was introduced as a generalization of the classical beltway problem in X-ray crystallography and was motivated by cryo-electron microscopy. In this paper we prove that if $m > n$, then the $\mathrm{O}(n)$-orbit of generic binary signal supported at $m$ points where at least $\ell$ of them have equal magnitude can be recovered from its auto-correlation. We also provide a connection to Euclidean distance geometry and prove, as a corollary of our main theorem, that if $m > n$, then the $\mathrm{O}(n)$-orbit of a generic collection of $m$ points on the sphere $S^{n-1}$ can be recovered from their unlabeled interpoint distances. We take advantage of the parallels to Euclidean distance geometry and develop a polynomial-time reconstruction algorithm for recovering the $\O(n)$-orbits of binary $\delta$-functions from their second-moment data when at least one of the points has distinct magnitude. In $\mathbb{R}^3$, the complexity of our algorithm is bounded from above by $O(m^8)$ but we show that in practice the complexity is much lower. We also demonstrate that the algorithm is robust to low levels of noise. Finally, we extend our algorithm to successfully perform recovery when all the support vectors lie on a common sphere, and in this case we match the time complexity of $O(m^8)$.

math.MG

Group-invariant moments under tomographic projections

Let $f:\mathbb{R}^n\to\mathbb{R}$ be an unknown object, and suppose the observations are tomographic projections of randomly rotated copies of $f$ of the form $Y = P(R\cdot f)$, where $R$ is Haar-uniform in $\mathrm{SO}(n)$ and $P$ is the projection onto an $m$-dimensional subspace, so that $Y:\mathbb{R}^m\to\mathbb{R}$. We prove that, whenever $d\le m$, the $d$-th order moment of the projected data determines the full $d$-th order Haar-orbit moment of $f$, independently of the ambient dimension $n$. We further provide an explicit algorithmic procedure for recovering the latter from the former. As a consequence, any identifiability result for the unprojected model based on the $d$-th order group-invariant moment extends directly to the tomographic setting at the same moment order. In particular, for $n=3$, $m=2$, and $d=2$, our result recovers a classical result in the cryo-EM literature: the covariance of the 2D projection images determines the second order rotationally invariant moment of the underlying 3D object.

eess.SP

Provable orbit recovery over SO(3) from the non-uniform second moment

We study the recovery of an unknown three-dimensional band-limited signal from multiple noisy observations that are randomly rotated by latent elements of SO(3), where the rotations are drawn from an unknown, non-uniform distribution. Because the rotations are unobserved, only the signal orbit under the rotation group can be recovered. We show that the signal orbit and the rotation distribution are jointly identifiable from the first and second moments. This yields an improved high-noise sample complexity that scales quadratically with the noise variance, rather than cubically as in the uniform-rotation case. We further develop a provable, computationally efficient reconstruction algorithm that recovers the 3-D signal by successively solving a sequence of well-conditioned linear systems. The algorithm is validated through extensive numerical experiments. Our results provide a principled and tractable framework for high-noise 3-D orbit recovery, with potential relevance to cryo-electron microscopy and cryo-electron tomography modeling, where molecules are observed in unknown orientations.

eess.SP

Orbit recovery under the rigid motions group

We study the orbit recovery problem under the rigid-motion group SE(n), where the objective is to reconstruct an unknown signal from multiple noisy observations subjected to unknown rotations and translations. This problem is fundamental in signal processing, computer vision, and structural biology. Our main theoretical contribution is bounding the sample complexity of this problem. We show that if the d-th order moment under the rotation group SO(n) uniquely determines the signal orbit, then orbit recovery under SE(n) is achievable with $N\gtrsim \sigma^{2d+4}$ samples as the noise variance $\sigma^2 \to \infty$. The key technical insight is that the d-th order SO(n) moments can be explicitly recovered from (d+2)-order SE(n) autocorrelations, enabling us to transfer known results from the rotation-only setting to the rigid-motion case. We further harness this result to derive a matching bound to the sample complexity of the multi-target detection model that serves as an abstract framework for electron-microscopy-based technologies in structural biology, such as single-particle cryo-electron microscopy (cryo-EM) and cryo-electron tomography (cryo-ET). Beyond theory, we present a provable computational pipeline for rigid-motion orbit recovery in three dimensions. Starting from rigid-motion autocorrelations, we extract the SO(3) moments and demonstrate successful reconstruction of a 3-D macromolecular structure. Importantly, this algorithmic approach is valid at any noise level, suggesting that even very small macromolecules, long believed to be inaccessible using structural biology electron-microscopy-based technologies, may, in principle, be reconstructed given sufficient data.

cs.IT

Pure-State Quantum Tomography with Minimal Rank-One POVMs

Quantum state tomography seeks to reconstruct an unknown state from measurement statistics. A finite measurement (POVM) is \emph{pure-state informationally complete} (PSI-Complete) if the outcome probabilities determine any pure state up to a global phase. We study \emph{rank-one} POVMs that are minimally sufficient for this task. We call such a POVM \emph{vital} if it is PSI-Complete but every proper subcollection is not PSI-Complete. We prove sharp upper bounds on the size of vital rank-one POVMs in dimension \(n\): the size is at most \(\binom{n+1}{2}\) over \(\mathbb{R}\) and at most \(n^{2}\) over \(\mathbb{C}\), and we give constructions that attain these bounds. In the real case, we further exhibit a connection to block designs: whenever \(w \mid n(n-1)\), an \((n,w,w-1)\) design produces a vital rank-one POVM with \(n + n(n-1)/w\) outcomes. We provide explicit constructions for \(w=2,n-1\), and \(n\).

quant-ph

Orbit recovery for spherical functions

Orbit recovery is a central problem in both mathematics and applied sciences, with important applications to structural biology. This paper focuses on recovering generic orbits of functions on ${\mathbb R}^{n}$ and the sphere $S^{n-1}$ under the rotation action of $SO(n)$. Specifically, we demonstrate that invariants of degree three (called the bispectrum) suffice to recover generic orbits of functions in finite-dimensional approximations of $L^2({\mathbb R}^n)$ obtained by band-limiting the spherical component and discretizing the radial direction. In particular, our main result explicitly bounds the number of samples in the radial direction required for recovery from the degree three invariants. From an application perspective, the most important case is $SO(3)$, which arises in many scientific fields, and in particular, plays a central role in leading structural biology applications such as cryo-electron tomography and cryo-electron microscopy. Our result for $SO(3)$ states that considering three spherical shells (i.e., samples in the radial direction) is sufficient to recover generic orbits, which verifies an implicit conjecture made in a paper of Bandeira et al. Our proof technique provides an explicit, computationally efficient algorithm to recover the signal by successively solving systems of linear equations. We implemented this algorithm and demonstrated its effectiveness on three protein structures.

math.NA

The stability of generalized phase retrieval problem over compact groups

The generalized phase retrieval problem over compact groups aims to recover a set of matrices -- representing an unknown signal -- from their associated Gram matrices. This framework generalizes the classical phase retrieval problem, which reconstructs a signal from the magnitudes of its Fourier transform, to a richer setting involving non-abelian compact groups. In this broader context, the unknown phases in Fourier space are replaced by unknown orthogonal matrices that arise from the action of a compact group on a finite-dimensional vector space. This problem is primarily motivated by advances in electron microscopy to determining the 3D structure of biological macromolecules from highly noisy observations. To capture realistic assumptions from machine learning and signal processing, we model the signal as belonging to one of several broad structural families: a generic linear subspace, a sparse representation in a generic basis, the output of a generic ReLU neural network, or a generic low-dimensional manifold. Our main result shows that, for a prior of sufficiently low dimension, the generalized phase retrieval problem not only admits a unique solution (up to inherent group symmetries), but also satisfies a bi-Lipschitz property. This implies robustness to both noise and model mismatch -- an essential requirement for practical use, especially when measurements are severely corrupted by noise. These findings provide theoretical support for a wide class of scientific problems under modern structural assumptions, and they offer strong foundations for developing robust algorithms in high-noise regimes.

eess.SP

Orbit recovery from invariants of low degree in representations of finite groups

Motivated by applications to equivariant neural networks and cryo-electron microscopy we consider the problem of recovering the generic orbit in a representation of a finite group from invariants of low degree. The main result proved here is that invariants of degree at most three separate generic orbits in the regular representation of a finite group defined over any infinite field. This answers a question posed in a 2023 ACHA paper of Bandeira et. al. We also discuss this problem for subregular representations of the dihedral and symmetric groups.

math.RT

The generalized phase retrieval problem over compact groups

The classical phase retrieval problem involves estimating a signal from its Fourier magnitudes (power spectrum) by leveraging prior information about the desired signal. This paper extends the problem to compact groups, addressing the recovery of a set of matrices from their Gram matrices. In this broader context, the missing phases in Fourier space are replaced by missing unitary or orthogonal matrices arising from the action of a compact group on a finite-dimensional vector space. This generalization is driven by applications in multi-reference alignment and single-particle cryo-electron microscopy, a pivotal technology in structural biology. We define the generalized phase retrieval problem over compact groups and explore its underlying algebraic structure. We survey recent results on the uniqueness of solutions, focusing on the significant class of semialgebraic priors. Furthermore, we present a family of algorithms inspired by classical phase retrieval techniques. Finally, we propose a conjecture on the stability of the problem based on bi-Lipschitz analysis, supported by numerical experiments.

eess.SP

The reflection invariant bispectrum: signal recovery in the dihedral model

We study the problem of signal recovery in the dihedral multi-reference alignment (MRA) model, where a signal is observed under random actions of the dihedral group and corrupted by additive noise. While previous has shown that cyclic invariants of degree three (the bispectrum) suffice to recover generic signals up to circular shift, the dihedral setting introduces new challenges due to the groups non-abelian structure. In particular reflections prevent the diagonalization of the third moment tensor in the Fourier basis, making classical bispectrum techniques inapplicable. In this work we prove that the orbit of the generic signal in the $n$-dimensional standard representation of the then $2n$-element dihedral group $D_{n}$ is uniquely determined by invariant tensors of degree at most three. This resolves an open question in the literature and establishes that the sample complexity for dihedral MRA with uniform distribution is $\omega(\sigma^6)$ matching the cyclic case. While frequency marching becomes computationally impractical in the dihedral setting, we show numerically that a simple optimization algorithm reliably recovers the signal from third order moments, even with random initialization.

math.AC

A transversality theorem for semi-algebraic sets with application to signal recovery from the second moment and cryo-EM

Semi-algebraic priors are ubiquitous in signal processing and machine learning. Prevalent examples include a) linear models where the signal lies in a low-dimensional subspace; b) sparse models where the signal can be represented by only a few coefficients under a suitable basis; and c) a large family of neural network generative models. In this paper, we prove a transversality theorem for semi-algebraic sets in orthogonal or unitary representations of groups: with a suitable dimension bound, a generic translate of any semi-algebraic set is transverse to the orbits of the group action. This, in turn, implies that if a signal lies in a low-dimensional semi-algebraic set, then it can be recovered uniquely from measurements that separate orbits. As an application, we consider the implications of the transversality theorem to the problem of recovering signals that are translated by random group actions from their second moment. As a special case, we discuss cryo-EM: a leading technology to constitute the spatial structure of biological molecules, which serves as our prime motivation. In particular, we derive explicit bounds for recovering a molecular structure from the second moment under a semi-algebraic prior and deduce information-theoretic implications. We also obtain information-theoretic bounds for three additional applications: factoring Gram matrices, multi-reference alignment, and phase retrieval. Finally, we deduce bounds for designing permutation invariant separators in machine learning.

cs.IT

The beltway problem over orthogonal groups

The classical beltway problem entails recovering a set of points from their unordered pairwise distances on the circle. This problem can be viewed as a special case of the crystallographic phase retrieval problem of recovering a sparse signal from its periodic autocorrelation. Based on this interpretation, and motivated by cryo-electron microscopy, we suggest a natural generalization to orthogonal groups: recovering a sparse signal, up to an orthogonal transformation, from its autocorrelation over the orthogonal group. If the support of the signal is collision-free, we bound the number of solutions to the beltway problem over orthogonal groups, and prove that this bound is exactly one when the support of the signal is radially collision-free (i.e., the support points have distinct magnitudes). We also prove that if the pairwise products of the signal's weights are distinct, then the autocorrelation determines the signal uniquely, up to an orthogonal transformation. We conclude the paper by considering binary signals and show that in this case, the collision-free condition need not be sufficient to determine signals up to orthogonal transformation.

eess.SP

The $K$-theory of the moduli stacks $\mathcal{M}_2$ and $\overline{\mathcal{M}}_2$

We compute the integral Grothendieck rings of the moduli stacks, $\mathcal{M}_2$, $\overline{\mathcal{M}}_2$ of smooth and stable curves of genus two respectively. We compute $K_0(\mathcal{M}_2)$ by using the presentation of $\mathcal{M}_2$ as a global quotient stack given by Vistoli. To compute the Grothendieck ring $K_0(\overline{\mathcal{M}}_2)$ we decompose $\overline{\mathcal{M}}_2$ as $\Delta_1$ and its complement $\overline{\mathcal{M}}_2 \setminus \Delta_1$ and use their presentations as quotient stacks given by Larson to compute their Grothendieck rings. We show that they are torsion-free and this, together with the Riemann-Roch isomorphism allows to ultimately give a presentation for the integral Grothendieck ring $K_0(\overline{\mathcal{M}}_2)$.

math.AG

Phase retrieval with semi-algebraic and ReLU neural network priors

The key ingredient to retrieving a signal from its Fourier magnitudes, namely, to solve the phase retrieval problem, is an effective prior on the sought signal. In this paper, we study the phase retrieval problem under the prior that the signal lies in a semi-algebraic set. This is a very general prior as semi-algebraic sets include linear models, sparse models, and ReLU neural network generative models. The latter is the main motivation of this paper, due to the remarkable success of deep generative models in a variety of imaging tasks, including phase retrieval. We prove that almost all signals in R^N can be determined from their Fourier magnitudes, up to a sign, if they lie in a (generic) semi-algebraic set of dimension N/2. The same is true for all signals if the semi-algebraic set is of dimension N/4. We also generalize these results to the problem of signal recovery from the second moment in multi-reference alignment models with multiplicity free representations of compact groups. This general result is then used to derive improved sample complexity bounds for recovering band-limited functions on the sphere from their noisy copies, each acted upon by a random element of SO(3).

eess.SP

The generic crystallographic phase retrieval problem

In this paper we consider the problem of recovering a signal $x \in \mathbb{R}^N$ from its power spectrum assuming that the signal is sparse with respect to a generic basis for $\mathbb{R}^N$. Our main result is that if the sparsity level is at most $\sim\! N/2$ in this basis then the generic sparse vector is uniquely determined up to sign from its power spectrum. We also prove that if the sparsity level is $\sim\! N/4$ then every sparse vector is determined up to sign from its power spectrum. Analogous results are also obtained for the power spectrum of a vector in $\mathbb{C}^N$ which extend earlier results of Wang and Xu \cite{arXiv:1310.0873}.

math.FA

Orbit recovery for band-limited functions

We study the third moment for functions on arbitrary compact Lie groups. We use techniques of representation theory to generalize the notion of band-limited functions in classical Fourier theory to functions on the compact groups $SU(n), SO(n), Sp(n)$. We then prove that for generic band-limited functions the third moment or, its Fourier equivalent, the bispectrum determines the function up to translation by a single unitary matrix. Moreover, if $G=SU(n)$ or $G=SO(2n+1)$ we prove that the third moment determines the $G$-orbit of a band-limited function. As a corollary we obtain a large class of finite-dimensional representations of these groups for which the third moment determines the orbit of a generic vector. When $G=SO(3)$ this gives a result relevant to cryo-EM which was our original motivation for studying this problem.

cs.IT