Searcharxiv⌕ Search

arXiv subjects

Frederic J. N. Jorgensen

Publications and source records attributed to Frederic J. N. Jorgensen.

3 recordsLinked to original sources

Exact affine conditioning beyond Gaussians: a unique characterization of the ensemble Kalman update

The analysis step of the stochastic ensemble Kalman filter, called the ensemble Kalman update (EnKU), is widely used for approximating posterior distributions in inverse problems and data assimilation. The EnKU approximates the posterior distribution $π_{X\mid Y=y_\star}$ by pushing forward the joint distribution $(X,Y)\simπ$ through an affine map $L^{\mathrm{EnKU}}_{π,y_\star}(x,y)$ that depends only on the covariance structure of $π$ and the observation $y_\star$. While the EnKU yields the exact posterior for Gaussian $π$ in the mean-field, this property alone does not uniquely determine the EnKU. In fact, there are infinitely many affine maps $L_{π, y_\star}$ that achieve such exact conditioning. In this paper, we offer a novel characterization of the EnKU among all such affine maps. We first exhaustively characterize the set ${E}^{\mathrm{EnKU}}$ of joint distributions for which the EnKU yields exact conditioning, showing that it is much larger than the set of Gaussians. Next, we show that except for a small class of highly symmetric distributions within ${E}^{\mathrm{EnKU}}$, the EnKU is the {unique} exact affine conditioning map. Further, we characterize the largest possible set of distributions ${F}$ for which a distribution-dependent, weakly observation-dependent, affine map exists, a class of transports that naturally includes the EnKU. We show that ${F}={E}^{\mathrm{EnKU}}\cup{S}_{\mathrm{nl-dec}}$ with a small symmetry class ${S}_{\mathrm{nl-dec}}$, meaning that for affine conditioning beyond the Gaussian setting, the EnKU has an exact set that is essentially maximally large.

math.ST↗

Quantitative Wasserstein Propagation of Chaos for Transport Ensemble Filters

We develop a general probabilistic framework for analyzing propagation of chaos in transport ensemble filters (TEFs), a broad class of interacting particle systems that are used to approximate the sequence of state distributions in hidden Markov models given a history of observations. This class of transport-based filtering algorithms includes the widely used ensemble Kalman filter (EnKF), based on affine updates at each filtering step, as well as the ensemble stochastic map filter (EnSMF), which employs nonlinear updates. For this class, we identify the limiting mean-field dynamics. We then establish non-asymptotic, high-probability, pathwise Wasserstein convergence of the interacting particle system to an i.i.d. ensemble drawn from this mean-field limit at the Monte Carlo rate. Convergence to the mean-field law itself follows with the usual dimension-dependent empirical Wasserstein rate. The proof combines a synchronous coupling construction with stability of moments and tails under conditioning, together with quantitative estimates for the propagation of the underlying dynamics through the interacting particle system. Applying our theory to both the EnKF and the EnSMF yields the first non-asymptotic, high-probability convergence guarantees for TEFs.

math.ST↗

Fundamental Bounds and Efficient Estimation for Dead-Time-Constrained Event Detection, with Application to Single-Photon Lidar

We develop an asymptotic statistical theory for parameter estimation from a class of non-i.i.d. periodic binary event-detection processes subject to nonparalyzable dead time and gating, which we call "dead-time event detection" (DED) processes. Such processes arise in single-photon lidar, fluorescence lifetime imaging, X-ray astronomy, and particle or radiation flux measurements in nuclear physics, where each detection renders the radiation/particle detector inactive for a recovery interval. Our theory quantifies how dead time and gating affect the fundamental lower bounds of estimation and identifies practical estimators that attain these bounds. First, we identify a sufficient statistic, showing in particular that activation counts can carry statistically useful information discarded by conventional histogramming hardware. We then prove local asymptotic normality and derive the corresponding Fisher-information rate, thereby obtaining fundamental lower bounds for estimation from DED processes. We prove that the maximum likelihood estimator (MLE), widely used in DED applications, attains these lower bounds. Since computing the MLE typically requires solving a nonconvex optimization problem, we also propose Le Cam one-step estimators, which attain the same asymptotic bounds with only a single local correction rather than iterative optimization. We illustrate the validity of our asymptotic theory and the practical usefulness of one-step estimators through the example of single-photon lidar in both simulations and real-data experiments.

eess.SP↗