Searcharxiv⌕ Search

arXiv subjects

Xinying Mao

Publications and source records attributed to Xinying Mao.

2 recordsLinked to original sources

Enhancing Exploration in Ensemble Kalman Inversion via Covariance Inflation and Projected Dropout

Ensemble Kalman inversion (EKI) is a derivative-free and parallelizable method for parameter estimation in Bayesian inverse problems involving expensive forward models. It adapts Kalman filtering by repeatedly assimilating the observation data through an artificial dynamical system with identity state evolution and the parameter-to-observation map as its observation operator. However, its performance can be limited by ensemble collapse and confinement to the affine span of the initial ensemble. We propose an exploration-enhanced EKI framework that combines multiplicative covariance inflation with a projected-dropout correction of the ensemble mean. Inflation helps maintain ensemble spread, while projected dropout enables the mean to explore directions beyond the initial affine span. For linear inverse problems, we provide a discrete-time, finite-ensemble analysis of the resulting method and prove the least-squares objective converges exponentially to its minimum in expectation. Within the initial ensemble subspace, the contraction factor is independent of the conditioning of the inverse problem, and the limiting ensemble covariance provides a low-rank representation of the posterior covariance. Experiments on ill-conditioned linear systems, 100-dimensional nonlinear benchmarks, and a PDE-constrained barotropic flow inverse problem demonstrate the effectiveness of the proposed method.

math.NA↗

Adaptive Exponential Integration for Stable Gaussian Mixture Black-Box Variational Inference

Black-box variational inference (BBVI) with Gaussian mixture families offers a flexible approach for approximating complex posterior distributions without requiring gradients of the target density. However, standard numerical optimization methods often suffer from instability and inefficiency. We develop a stable and efficient framework that combines three key components: (1) affine-invariant preconditioning via natural gradient formulations, (2) an exponential integrator that unconditionally preserves the positive definiteness of covariance matrices, and (3) adaptive time stepping to ensure stability and to accommodate distinct warm-up and convergence phases. The proposed approach has natural connections to manifold optimization and mirror descent. For Gaussian posteriors, we prove exponential convergence in the noise-free setting and almost-sure convergence under Monte Carlo estimation, rigorously justifying the necessity of adaptive time stepping. Numerical experiments on multimodal distributions, Neal's multiscale funnel, and a PDE-based Bayesian inverse problem for Darcy flow demonstrate the effectiveness of the proposed method.

cs.LG↗