Searcharxiv⌕ Search

arXiv subjects

Traian Iliescu

Publications and source records attributed to Traian Iliescu.

At least 55 records · Page 3Linked to original sources

A long short-term memory embedding for hybrid uplifted reduced order models

In this paper, we introduce an uplifted reduced order modeling (UROM) approach through the integration of standard projection based methods with long short-term memory (LSTM) embedding. Our approach has three modeling layers or components. In the first layer, we utilize an intrusive projection approach to model dynamics represented by the largest modes. The second layer consists of an LSTM model to account for residuals beyond this truncation. This closure layer refers to the process of including the residual effect of the discarded modes into the dynamics of the largest scales. However, the feasibility of generating a low rank approximation tails off for higher Kolmogorov $n$-width systems due to the underlying nonlinear processes. The third uplifting layer, called super-resolution, addresses this limited representation issue by expanding the span into a larger number of modes utilizing the versatility of LSTM. Therefore, our model integrates a physics-based projection model with a memory embedded LSTM closure and an LSTM based super-resolution model. In several applications, we exploit the use of Grassmann manifold to construct UROM for unseen conditions. We performed numerical experiments by using the Burgers and Navier-Stokes equations with quadratic nonlinearity. Our results show robustness of the proposed approach in building reduced order models for parameterized systems and confirm the improved trade-off between accuracy and efficiency.

physics.flu-dyn↗

Closure Learning for Nonlinear Model Reduction Using Deep Residual Neural Network

Developing accurate, efficient, and robust closure models is essential in the construction of reduced order models (ROMs) for realistic nonlinear systems, which generally require drastic ROM mode truncations. We propose a deep residual neural network (ResNet) closure learning framework for ROMs of nonlinear systems. The novel ResNet-ROM framework consists of two steps: (i) In the first step, we use ROM projection to filter the given nonlinear PDE and construct a filtered ROM. This filtered ROM is low-dimensional, but is not closed (because of the PDE nonlinearity). (ii) In the second step, we use ResNet to close the filtered ROM, i.e., to model the interaction between the resolved and unresolved ROM modes. We emphasize that in the new ResNet-ROM framework, data is used only to complement classical physical modeling (i.e., only in the closure modeling component), not to completely replace it. We also note that the new ResNet-ROM is built on general ideas of spatial filtering and deep learning and is independent of (restrictive) phenomenological arguments, e.g., of eddy viscosity type. The numerical experiments for the 1D Burgers equation show that the ResNet-ROM is significantly more accurate than the standard projection ROM. The new ResNet-ROM is also more accurate and significantly more efficient than other modern ROM closure models.

physics.flu-dyn↗

Data-Driven Correction Reduced Order Models for the Quasi-Geostrophic Equations: A Numerical Investigation

This paper investigates the recently introduced data-driven correction reduced order model (DDC-ROM) in the numerical simulation of the quasi-geostrophic equations. The DDC-ROM uses available data to model the correction term that is generally used to represent the missing information in low-dimensional ROMs. Physical constraints are added to the DDC-ROM to create the constrained data-driven correction reduced order model (CDDC-ROM) in order to further improve its accuracy and stability. Finally, the DDC-ROM is tested on time intervals that are longer than the time interval over which it was trained. The numerical investigation shows that, for low-dimensional ROMs, both the DDC-ROM and CDDC-ROM perform better than the standard Galerkin ROM (G-ROM) and the CDDC-ROM provides the best results.

physics.flu-dyn↗

A non-intrusive reduced order modeling framework for quasi-geostrophic turbulence

In this study, we present a non-intrusive reduced order modeling (ROM) framework for large-scale quasi-stationary systems. The framework proposed herein exploits the time series prediction capability of long short-term memory (LSTM) recurrent neural network such that: (i) in the training phase, the LSTM model is trained on the modal coefficients extracted from the high-resolution data using proper orthogonal decomposition (POD) transform, and (ii) in the testing phase, the trained model predicts the modal coefficients for the total time recursively based on the initial time history. To illustrate the predictive performance of the proposed framework, the mean flow fields and time series response of the field values are reconstructed from the predicted modal coefficients by using an inverse POD transform. As a representative benchmark test case, we consider a two-dimensional quasi-geostrophic (QG) ocean circulation model which, in general, displays an enormous range of fluctuating spatial and temporal scales. We first illustrate that the conventional Galerkin projection based ROM of such systems requires a high number of POD modes to obtain a stable flow physics. In addition, ROM-GP does not seem to capture the intermittent bursts appearing in the dynamics of the first few most energetic modes. However, the proposed non-intrusive ROM framework based on LSTM (ROM-LSTM) yields a stable solution even for a small number of POD modes. We also observe that the ROM-LSTM model is able to capture quasi-periodic intermittent bursts accurately, and yields a stable and accurate mean flow dynamics using the time history of a few previous time states, denoted as the lookback time-window in this paper. Our findings suggest that the proposed ROM framework is capable of predicting noisy nonlinear fluid flows in an extremely efficient way compared to the conventional projection based ROM.

cs.CE↗

Continuous Data Assimilation Reduced Order Models of Fluid Flow

We propose, analyze, and test a novel continuous data assimilation reduced order model (DA-ROM) for simulating incompressible flows. While ROMs have a long history of success on certain problems with recurring dominant structures, they tend to lose accuracy on more complicated problems and over longer time intervals. Meanwhile, continuous data assimilation (DA) has recently been used to improve accuracy and, in particular, long time accuracy in fluid simulations by incorporating measurement data into the simulation. This paper synthesizes these two ideas, in an attempt to address inaccuracies in ROM by applying DA, especially over long time intervals and when only inaccurate snapshots are available. We prove that with a properly chosen nudging parameter, the proposed DA-ROM algorithm converges exponentially fast in time to the true solution, up to discretization and ROM truncation errors. Finally, we propose a strategy for nudging adaptively in time, by adjusting dissipation arising from the nudging term to better match true solution energy. Numerical tests confirm all results, and show that the DA-ROM strategy with adaptive nudging can be highly effective at providing long time accuracy in ROMs.

math.NA↗

An Artificial Compression Reduced Order Model

We propose a novel artificial compression, reduced order model (AC-ROM) for the numerical simulation of viscous incompressible fluid flows. The new AC-ROM provides approximations not only for velocity, but also for pressure, which is needed to calculate forces on bodies in the flow and to connect the simulation parameters with pressure data. The new AC-ROM does not require that the velocity-pressure ROM spaces satisfy the inf-sup (Ladyzhenskaya-Babuska-Brezzi) condition and its basis functions are constructed from data that are not required to be weakly-divergence free. We prove error estimates for the reduced basis discretization of the AC-ROM. We also investigate numerically the new AC-ROM in the simulation of a two-dimensional flow between offset cylinders.

math.NA↗

Long-Time Reynolds Averaging of Reduced Order Models for Fluid Flows: Preliminary Results

We perform a theoretical and numerical investigation of the time-average of energy exchange among modes of Reduced Order Models (ROMs) of fluid flows. We are interested in the statistical equilibrium problem, and especially in the possible forward and backward average transfer of energy among ROM basis functions (modes). We consider two types of ROM modes: eigenfunctions of the Stokes operator and Proper Orthogonal Decomposition (POD) modes. We prove analytical results for both types of ROM modes and we highlight the differences between them. We also investigate numerically whether the time-average energy exchange between POD modes is positive. To this end, we utilize the one-dimensional Burgers equation as a simplified mathematical model, which is commonly used in ROM tests. The main conclusion of our numerical study is that, for long enough time intervals, the time-average energy exchange from low index POD modes to high index POD modes is positive, as predicted by our theoretical results.

math.AP↗

Commutation Error in Reduced Order Modeling of Fluid Flows

For reduced order models (ROMs) of fluid flows, we investigate theoretically and computationally whether differentiation and ROM spatial filtering commute, i.e., whether the commutation error (CE) is nonzero. We study the CE for the Laplacian and two ROM filters: the ROM projection and the ROM differential filter. Furthermore, when the CE is nonzero, we investigate whether it has any significant effect on ROMs that are constructed by using spatial filtering. As numerical tests, we use the Burgers equation with viscosities $ν=10^{-1}$ and $ν=10^{-3}$ and a 2D flow past a circular cylinder at Reynolds numbers $Re=1$ and $Re=100$. Our investigation shows that: (i) the CE exists, and (ii) the CE has a significant effect on ROM development for low Reynolds numbers, but not so much for higher Reynolds numbers.

math.NA↗

A Leray regularized ensemble-proper orthogonal decomposition method for parameterized convection-dominated flows

Partial differential equations (PDEs) are often dependent on input quantities which are inherently uncertain. To quantify this uncertainty, these PDEs must be solved over a large ensemble of parameters. Even for a single realization this can a computationally intensive process. In the case of flows governed by the Navier-Stokes equations, an efficient method has been devised for computing an ensemble of solutions. To further reduce the computational cost of this method, an ensemble proper orthogonal decomposition (POD) method was recently proposed. The main contribution of this work is the introduction of POD spatial filtering for ensemble-POD methods. The POD spatial filter makes possible the construction of the Leray ensemble-POD model, which is a regularized reduced order model for the numerical simulation of convection-dominated flows. The Leray ensemble-POD model employs the POD spatial filter to smooth (regularize) the convection term in the Navier-Stokes equations and greatly diminishes the numerical inaccuracies produced by the ensemble-POD method in the numerical simulation of convection-dominated flows. Specifically, for the numerical simulation of a convection-dominated two-dimensional flow between two offset cylinders, we show that the Leray ensemble-POD method yields accurate results, whereas the ensemble-POD is highly inaccurate. The second contribution of this work is a new numerical discretization of the variable viscosity ensemble algorithm in which the average viscosity is replaced with the maximum viscosity. It is shown that this new numerical discretization is significantly more stable than those in current use. Furthermore, error estimates for the novel Leray ensemble-POD algorithm with this new numerical discretization are also proven.

math.NA↗

Numerical Analysis of the Leray Reduced Order Model

Standard ROMs generally yield spurious numerical oscillations in the simulation of convection-dominated flows. Regularized ROMs use explicit ROM spatial filtering to decrease these spurious numerical oscillations. The Leray ROM is a recently introduced regularized ROM that utilizes explicit ROM spatial filtering of the convective term in the Navier-Stokes equations. This paper presents the numerical analysis of the finite element discretization of the Leray ROM. Error estimates for the ROM differential filter, which is the explicit ROM spatial filter used in the Leray ROM, are proved. These ROM filtering error estimates are then used to prove error estimates for the Leray ROM. Finally, both the ROM filtering error estimates and the Leray ROM error estimates are numerically investigated in the simulation of the two-dimensional Navier-Stokes equations with an analytic solution.

math.NA↗

Regularized Reduced Order Models for a Stochastic Burgers Equation

In this paper, we study the numerical stability of reduced order models for convection-dominated stochastic systems in a relatively simple setting: a stochastic Burgers equation with linear multiplicative noise. Our preliminary results suggest that, in a convection-dominated regime, standard reduced order models yield inaccurate results in the form of spurious numerical oscillations. To alleviate these oscillations, we use the Leray reduced order model, which increases the numerical stability of the standard model by smoothing (regularizing) the convective term with an explicit spatial filter. The Leray reduced order model yields significantly better results than the standard reduced order model and is more robust with respect to changes in the strength of the noise.

physics.flu-dyn↗

An Evolve-Then-Filter Regularized Reduced Order Model

In this paper, we propose a new evolve-then-filter reduced order model (EF-ROM). This is a regularized ROM (Reg-ROM), which aims at the numerical stabilization of proper orthogonal decomposition (POD) ROMs for convection-dominated flows. We also consider the Leray ROM (L-ROM). These two Reg-ROMs use explicit ROM spatial filtering to smooth (regularize) various terms in the ROMs. Two spatial filters are used: a POD projection onto a POD subspace (Proj) and a new POD differential filter (DF). The four Reg-ROM/filter combinations are tested in the numerical simulation of the three-dimensional flow past a circular cylinder at a Reynolds number $Re=1000$. Overall, the most accurate Reg-ROM/filter combination is EF-ROM-DF. Furthermore, the spatial filter has a higher impact on the Reg-ROM than the regularization used. Indeed, the DF generally yields better results than Proj for both the EF-ROM and L-ROM. Finally, the CPU times of the four Reg-ROM/filter combinations are orders of magnitude lower than the CPU time of the DNS.

physics.flu-dyn↗

Approximate Deconvolution Reduced Order Modeling

This paper proposes a large eddy simulation reduced order model(LES-ROM) framework for the numerical simulation of realistic flows. In this LES-ROM framework, the proper orthogonal decomposition(POD) is used to define the ROM basis and a POD differential filter is used to define the large ROM structures. An approximate deconvolution(AD) approach is used to solve the ROM closure problem and develop a new AD-ROM. This AD-ROM is tested in the numerical simulation of the one-dimensional Burgers equation with a small diffusion coefficient(10^{-3})

physics.flu-dyn↗

Disperse two-phase flows, with applications to geophysical problems

In this paper we study the motion of a fluid with several dispersed particles whose concentration is very small (smaller than $10^{-3}$), with possible applications to problems coming from geophysics, meteorology, and oceanography. We consider a very dilute suspension of heavy particles in a quasi-incompressible fluid (low Mach number). In our case the Stokes number is small and --as pointed out in the theory of multiphase turbulence-- we can use an Eulerian model instead of a Lagrangian one. The assumption of low concentration allows us to disregard particle--particle interactions, but we take into account the effect of particles on the fluid (two-way coupling). In this way we can study the physical effect of particle inertia (and not only passive tracers), with a model similar to the Boussinesq equations. The resulting model is used in both direct numerical simulations and large eddy simulations of a dam-break (lock-exchange) problem, which is a well-known academic test case. Keywords: Dilute suspensions, Eulerian models, direct and large eddy simulations, slightly compressible flows, dam-break (lock-exchange) problem.

physics.ao-ph↗

A stabilized proper orthogonal decomposition reduced-order model for large scale quasigeostrophic ocean circulation

In this paper, a stabilized proper orthogonal decomposition (POD) reduced-order model (ROM) is presented for the barotropic vorticity equation. We apply the POD-ROM model to mid-latitude simplified oceanic basins, which are standard prototypes of more realistic large-scale ocean dynamics. A mode dependent eddy viscosity closure scheme is used to model the effects of the discarded POD modes. A sensitivity analysis with respect to the free eddy viscosity stabilization parameter is performed for various POD-ROMs with different numbers of POD modes. The POD-ROM results are validated against the Munk layer resolving direct numerical simulations using a fully conservative fourth-order Arakawa scheme. A comparison with the standard Galerkin POD-ROM without any stabilization is also included in our investigation. Significant improvements in the accuracy over the standard Galerkin model are shown for a four-gyre ocean circulation problem. This first step in the numerical assessment of the POD-ROM shows that it could represent a computationally efficient tool for large scale oceanic simulations over long time intervals.

physics.flu-dyn↗

A posteriori analysis of low-pass spatial filters for approximate deconvolution large eddy simulations of homogeneous incompressible flows

The goal of this paper is twofold: first, it investigates the effect of low-pass spatial filters for approximate deconvolution large eddy simulation (AD-LES) of turbulent incompressible flows. Second, it proposes the hyper-differential filter as a means of increasing the accuracy of the AD-LES model without increasing the computational cost. Box filters, Padé filters, and differential filters with a wide range of parameters are studied in the AD-LES framework. The AD-LES model, in conjunction with these spatial filters, is tested in the numerical simulation of the three-dimensional Taylor-Green vortex problem. The numerical results are benchmarked against direct numerical simulation (DNS) data. An under-resolved numerical simulation is also used for comparison purposes. Four criteria are used to investigate the AD-LES model equipped with these spatial filters: (i) the time series of the volume-averaged enstrophy; (ii) the volume-averaged third-order structure function; (iii) the $L^2$-norm of the velocity and vorticity errors; and (iv) the volume-averaged velocity and vorticity correlation coefficients. According to these criteria, the numerical results yield the following two conclusions: first, the AD-LES model equipped with any of these spatial filters yields accurate results at a fraction of the computational cost of DNS. Second, the most accurate results are obtained with the hyper-differential filter, followed by the differential filter. We demonstrate that the results highly depend on the selection of the filtering procedure. Although a careful parameter choice makes each class of filters used in this study competitive, it seems that filters whose transfer function resembles that of the Fourier cut-off filter (such as the hyper-differential filters) tend to perform best.

physics.flu-dyn↗

A Two-Level Finite Element Discretization of the Streamfunction Formulation of the Stationary Quasi-Geostrophic Equations of the Ocean

In this paper we proposed a two-level finite element discretization of the nonlinear stationary quasi-geostrophic equations, which model the wind driven large scale ocean circulation. Optimal error estimates for the two-level finite element discretization were derived. Numerical experiments for the two-level algorithm with the Argyris finite element were also carried out. The numerical results verified the theoretical error estimates and showed that, for the appropriate scaling between the coarse and fine mesh sizes, the two-level algorithm significantly decreases the computational time of the standard one-level algorithm.

math.NA↗