SearcharxivSearch

arXiv subjects

Muhammad Fuady Emzir

Publications and source records attributed to Muhammad Fuady Emzir.

2 recordsLinked to original sources

A Bayesian Update Method for Exponential Family Projection Filters with Non-Conjugate Likelihoods

The projection filter is one of the approximations to the solution of the optimal filtering problem. It approximates the filtering density by projecting the dynamics of the square-root filtering density onto the tangent space of the square-root parametric density manifold. While the projection filters for exponential and mixture families with continuous measurement processes have been well studied, the continuous-discrete projection filtering algorithm for non-conjugate priors has received less attention. In this paper, we introduce a simple Riemannian optimization method to be used for the Bayesian update step in the continuous-discrete projection filter for exponential families. Specifically, we show that the Bayesian update can be formulated as an optimization problem of $\alpha$-R\'enyi divergence, where the corresponding Riemannian gradient can be easily computed. We demonstrate the effectiveness of the proposed method via two highly non-Gaussian Bayesian update problems.

math.OC

Multidimensional Projection Filters via Automatic Differentiation and Sparse-Grid Integration

The projection filter is a technique for approximating the solutions of optimal filtering problems. In projection filters, the Kushner--Stratonovich stochastic partial differential equation that governs the propagation of the optimal filtering density is projected to a manifold of parametric densities, resulting in a finite-dimensional stochastic differential equation. Despite the fact that projection filters are capable of representing complicated probability densities, their current implementations are limited to Gaussian family or unidimensional filtering applications. This work considers a combination of numerical integration and automatic differentiation to construct projection filter algorithms for more generic problems. Specifically, we provide a detailed exposition of this combination for the manifold of the exponential family, and show how to apply the projection filter to multidimensional cases. We demonstrate numerically that based on comparison to a finite-difference solution to the Kushner--Stratonovich equation and a bootstrap particle filter with systematic resampling, the proposed algorithm retains an accurate approximation of the filtering density while requiring a comparatively low number of quadrature points. Due to the sparse-grid integration and automatic differentiation used to calculate the expected values of the natural statistics and the Fisher metric, the proposed filtering algorithms are highly scalable. They therefore are suitable to many applications in which the number of dimensions exceeds the practical limit of particle filters, but where the Gaussian-approximations are deemed unsatisfactory.

math.OC