Searcharxiv⌕ Search

arXiv subjects

Ibrahim Hoteit

Publications and source records attributed to Ibrahim Hoteit.

28 records · Page 2Linked to original sources

Ensemble Kalman filtering with a divided state-space strategy for coupled data assimilation problems

This study considers the data assimilation problem in coupled systems, which consists of two components (sub-systems) interacting with each other through certain coupling terms. A straightforward way to tackle the assimilation problem in such systems is to concatenate the states of the sub-systems into one augmented state vector, so that a standard ensemble Kalman filter (EnKF) can be directly applied. In this work we present a divided state-space estimation strategy, in which data assimilation is carried out with respect to each individual sub-system, involving quantities from the sub-system itself and correlated quantities from other coupled sub-systems. On top of the divided state-space estimation strategy, we also consider the possibility to run the sub-systems separately. Combining these two ideas, a few variants of the EnKF are derived. The introduction of these variants is mainly inspired by the current status and challenges in coupled data assimilation problems, and thus might be of interest from a practical point of view. Numerical experiments with a multi-scale Lorentz 96 model are conducted to evaluate the performance of these variants against that of the conventional EnKF. In addition, specific for coupled data assimilation problems, two prototypes of extensions of the presented methods are also developed in order to achieve a trade-off between efficiency and accuracy.

physics.ao-ph↗

Ensemble Kalman filtering with residual nudging: an extension to state estimation problems with nonlinear observation operators

The ensemble Kalman filter (EnKF) is an efficient algorithm for many data assimilation problems. In certain circumstances, however, divergence of the EnKF might be spotted. In previous studies, the authors proposed an observation-space-based strategy, called residual nudging, to improve the stability of the EnKF when dealing with linear observation operators. The main idea behind residual nudging is to monitor and, if necessary, adjust the distances (misfits) between the real observations and the simulated ones of the state estimates, in the hope that by doing so one may be able to obtain better estimation accuracy. In the present study, residual nudging is extended and modified in order to handle nonlinear observation operators. Such extension and modification result in an iterative filtering framework that, under suitable conditions, is able to achieve the objective of residual nudging for data assimilation problems with nonlinear observation operators. The 40 dimensional Lorenz 96 model is used to illustrate the performance of the iterative filter. Numerical results show that, while a normal EnKF may diverge with nonlinear observation operators, the proposed iterative filter remains stable and leads to reasonable estimation accuracy under various experimental settings.

physics.ao-ph↗

Continuity in time of solutions of a phase-field model

A phase field model proposed by G. Caginalp for the description of phase changes in materials is under consideration. It is assumed that the medium is located in a container with heat conductive walls that are not subjected to phase changes. Therefore, the temperature variable is defined both in the medium and wall regions, whereas the phase variable is only considered in the medium part. The case of Lipschitz domains in two and three dimensions is studied. We show that the temperature and phase variables are continuous in time functions with values in $L^2$ and $H^1$, respectively, provided that the initial values of them are from $L^2$ and $H^1$, respectively. Moreover, continuous dependence of solutions on the initial data and boundary conditions is proved.

math.FA↗

Covariance inflation in the ensemble Kalman filter: a residual nudging perspective and some implications

This note examines the influence of covariance inflation on the distance between the measured observation and the simulated (or predicted) observation with respect to the state estimate. In order for the aforementioned distance to be bounded in a certain interval, some sufficient conditions are derived, indicating that the covariance inflation factor should be bounded in a certain interval, and that the inflation bounds are related to the maximum and minimum eigenvalues of certain matrices. Implications of these analytic results are discussed, and a numerical experiment is presented to verify the validity of our analysis.

physics.ao-ph↗

Efficient particle filtering through residual nudging

We introduce an auxiliary technique, called residual nudging, to the particle filter to enhance its performance in cases that it performs poorly. The main idea of residual nudging is to monitor, and if necessary, adjust the residual norm of a state estimate in the observation space so that it does not exceed a pre-specified threshold. We suggest a rule to choose the pre-specified threshold, and construct a state estimate accordingly to achieve this objective. Numerical experiments suggest that introducing residual nudging to a particle filter may (substantially) improve its performance, in terms of filter accuracy and/or stability against divergence, especially when the particle filter is implemented with a relatively small number of particles.

physics.ao-ph↗

Ensemble Kalman filtering with residual nudging

Covariance inflation and localization are two important techniques that are used to improve the performance of the ensemble Kalman filter (EnKF) by (in effect) adjusting the sample covariances of the estimates in the state space. In this work an additional auxiliary technique, called residual nudging, is proposed to monitor and, if necessary, adjust the residual norms of state estimates in the observation space. In an EnKF with residual nudging, if the residual norm of an analysis is larger than a pre-specified value, then the analysis is replaced by a new one whose residual norm is no larger than a pre-specified value. Otherwise the analysis is considered as a reasonable estimate and no change is made. A rule for choosing the pre-specified value is suggested. Based on this rule, the corresponding new state estimates are explicitly derived in case of linear observations. Numerical experiments in the 40-dimensional Lorenz 96 model show that introducing residual nudging to an EnKF may improve its accuracy and/or enhance its stability against filter divergence, especially in the small ensemble scenario.

physics.ao-ph↗

Particle Kalman Filtering: A Nonlinear Bayesian Framework for Ensemble Kalman Filters

This paper investigates an approximation scheme of the optimal nonlinear Bayesian filter based on the Gaussian mixture representation of the state probability distribution function. The resulting filter is similar to the particle filter, but is different from it in that, the standard weight-type correction in the particle filter is complemented by the Kalman-type correction with the associated covariance matrices in the Gaussian mixture. We show that this filter is an algorithm in between the Kalman filter and the particle filter, and therefore is referred to as the particle Kalman filter (PKF). In the PKF, the solution of a nonlinear filtering problem is expressed as the weighted average of an "ensemble of Kalman filters" operating in parallel. Running an ensemble of Kalman filters is, however, computationally prohibitive for realistic atmospheric and oceanic data assimilation problems. For this reason, we consider the construction of the PKF through an "ensemble" of ensemble Kalman filters (EnKFs) instead, and call the implementation the particle EnKF (PEnKF). We show that different types of the EnKFs can be considered as special cases of the PEnKF. Similar to the situation in the particle filter, we also introduce a re-sampling step to the PEnKF in order to reduce the risk of weights collapse and improve the performance of the filter. Numerical experiments with the strongly nonlinear Lorenz-96 model are presented and discussed.

physics.data-an↗

Robust ensemble filtering and its relation to covariance inflation in the ensemble Kalman filter

We propose a robust ensemble filtering scheme based on the $H_{\infty}$ filtering theory. The optimal $H_{\infty}$ filter is derived by minimizing the supremum (or maximum) of a predefined cost function, a criterion different from the minimum variance used in the Kalman filter. By design, the $H_{\infty}$ filter is more robust than the Kalman filter, in the sense that the estimation error in the $H_{\infty}$ filter in general has a finite growth rate with respect to the uncertainties in assimilation, except for a special case that corresponds to the Kalman filter. The original form of the $H_{\infty}$ filter contains global constraints in time, which may be inconvenient for sequential data assimilation problems. Therefore we introduce a variant that solves some time-local constraints instead, and hence we call it the time-local $H_{\infty}$ filter (TLHF). By analogy to the ensemble Kalman filter (EnKF), we also propose the concept of ensemble time-local $H_{\infty}$ filter (EnTLHF). We outline the general form of the EnTLHF, and discuss some of its special cases. In particular, we show that an EnKF with certain covariance inflation is essentially an EnTLHF. In this sense, the EnTLHF provides a general framework for conducting covariance inflation in the EnKF-based methods. We use some numerical examples to assess the relative robustness of the TLHF/EnTLHF in comparison with the corresponding KF/EnKF method.

physics.data-an↗

Scaled unscented transform Gaussian sum filter: theory and application

In this work we consider the state estimation problem in nonlinear/non-Gaussian systems. We introduce a framework, called the scaled unscented transform Gaussian sum filter (SUT-GSF), which combines two ideas: the scaled unscented Kalman filter (SUKF) based on the concept of scaled unscented transform (SUT), and the Gaussian mixture model (GMM). The SUT is used to approximate the mean and covariance of a Gaussian random variable which is transformed by a nonlinear function, while the GMM is adopted to approximate the probability density function (pdf) of a random variable through a set of Gaussian distributions. With these two tools, a framework can be set up to assimilate nonlinear systems in a recursive way. Within this framework, one can treat a nonlinear stochastic system as a mixture model of a set of sub-systems, each of which takes the form of a nonlinear system driven by a known Gaussian random process. Then, for each sub-system, one applies the SUKF to estimate the mean and covariance of the underlying Gaussian random variable transformed by the nonlinear governing equations of the sub-system. Incorporating the estimations of the sub-systems into the GMM gives an explicit (approximate) form of the pdf, which can be regarded as a "complete" solution to the state estimation problem, as all of the statistical information of interest can be obtained from the explicit form of the pdf ... This work is on the construction of the Gaussian sum filter based on the scaled unscented transform.

physics.data-an↗