Real-time forecasting of chaotic dynamics from sparse data and autoencoders

Abstract

The real-time prediction of chaotic systems requires a nonlinear-reduced order model (ROM) to forecast the dynamics, and a stream of data from sensors to update the ROM. Data-driven ROMs are typically built with a two-step strategy: data compression in a lower-dimensional latent space, and prediction of the temporal dynamics on it. To achieve real-time prediction, however, there are two challenges to overcome: (i) ROMs of chaotic systems can become numerically unstable; and (ii) sensors' data are sparse, i.e., partial, and noisy. To overcome these challenges, we propose a three-step strategy: (i) a convolutional autoencoder (CAE) compresses the system's state onto a lower-dimensional latent space; (ii) a latent ROM (echo state network, ESN), which is formulated as a state-space model, predicts the temporal evolution on the latent space; and (iii) sequential data assimilation based on the Ensemble Kalman filter (EnKF) adaptively corrects the latent ROM by assimilating noisy and sparse measurements. This provides a numerically stable method (DA-CAE-ESN), which corrects itself every time that data becomes available from sensors. The DA-CAE-ESN is tested on spatio-temporally chaotic partial differential equations: the Kuramoto-Sivashinsky equation, and a two-dimensional Navier-Stokes equation (Kolmogorov flow). We show that the method provides accurate and stable forecasts across different levels of noise, sparsity, and sampling rates. As a by-product, the DA-CAE-ESN acts as a localization strategy that mitigates spurious correlations, which arise when applying the EnKF to high-dimensional systems. The DA-CAE-ESN provides a numerically stable method to perform real-time predictions, which opens opportunities for deploying data-driven latent models.