SearcharxivSearch

arXiv subjects

Traian Iliescu

Publications and source records attributed to Traian Iliescu.

At least 19 recordsLinked to original sources

Learning Long-Term Stable Operator Inference Reduced-Order Models of Fluid Flows through Online Spatial Filtering

This paper introduces an online evolve--filter--relax (EFR) strategy for long-term stability of Operator Inference (OpInf) reduced-order models (ROMs) of complex fluid flow simulations. The main novelty of the new EFR-OpInf strategy is the use of online (i.e., at the learned ROM online evaluation level) spatial filtering inspired from large eddy simulation to significantly improve long-term stability and predictive performance of standard OpInf. Furthermore, the EFR-OpInf strategy reduces, and in some cases even eliminates, the need for standard $L^2$ regularization, while providing physical interpretability for the OpInf hyperparameters. The EFR-OpInf framework is modular, readily integrated into existing OpInf workflows, and accommodates a user-selected ROM filtering strategy. We demonstrate the EFR-OpInf's effectiveness using a fully non-intrusive projection-based ROM filter, a ROM differential filter, and a hybrid projection-differential ROM filter. The new EFR-OpInf models are evaluated on a high-Péclet-number convection--diffusion--reaction problem that embeds the variation in one parameter and two unsteady Navier--Stokes problems that focus on predictions beyond a training horizon: a transitional two-dimensional flow past a cylinder and a three-dimensional turbulent minimal channel flow. Across these three scenarios, EFR-OpInf can reduce prediction errors by up to an order of magnitude relative to standard OpInf. Moreover, EFR-OpInf remains stable over long prediction horizons in cases where standard OpInf diverges. Depending on the ROM filter used, EFR-OpInf's computational cost is comparable to that of standard OpInf.

math.NA

Digital Twins in Coronary Artery Disease: A Mathematical Roadmap

The combination of data and models, enhanced by AI methodologies, leads to the paradigm called Digital Twins. This concept is expected to bring unprecedented support to personalized medicine. The combination of mathematical and numerical models with diagnostic devices that provide patient-specific knowledge in a bidirectional framework can be a formidable decision support for clinicians. In this paper, we consider some mathematical aspects of constructing a Digital Twin to prevent and treat Coronary Artery Disease. The keywords for the bidirectional communication between twins in our system are (i) Data Assimilation and (ii) Probabilistic Graphic Models. In particular, a quantity of paramount interest in the evaluation and prognosis of Coronary Artery Disease is the Wall Shear Stress, i.e., the tangential component of normal stress on the arterial wall. By considering steps for the personalization and the synthesis of Wall Shear Stress estimation, we propose a mathematical roadmap for constructing a Digital Twin system that could help prevent infarcts, one of the most lethal diseases in the world.

math.NA

StabOp: A Data-Driven Stabilization Operator for Reduced Order Modeling

Spatial filters have played a central role in large eddy simulation and, more recently, in reduced order model (ROM) stabilization for convection-dominated flows. Nevertheless, important open questions remain: in under-resolved regimes, which filter is most suitable for a given stabilization or closure model? Moreover, once a filter is selected, how should its parameters, such as the filter radius, be determined? Addressing these questions is essential for the reliable design and performance of filter-based stabilization strategies. To answer these questions, we propose a novel strategy that differs fundamentally from current filter-based approaches: we replace traditional spatial filters with a data-driven stabilization operator (StabOp) that yields accurate results for a given resolution, quantity of interest, and stabilization strategy. Although the new StabOp can be used for both classical discretizations and ROMs, and for different types of filter-based stabilization or closure, for clarity we focus on ROMs and the Leray stabilization. To build the new StabOp, we postulate its model form as a linear, quadratic, or nonlinear mapping, and then solve a PDE-constrained optimization problem to minimize a given loss function. Using the resulting StabOp in the Leray ROM (L-ROM) yields a new stabilized ROM, StabOp-L-ROM. To assess the StabOp-L-ROM, we compare it with the L-ROM and the standard ROM in numerical simulations of four flows: 2D flow past a cylinder at Re=500, lid-driven cavity at Re=10000, 3D flow past a hemisphere at Re=2200, and minimal channel flow at Re=5000. Our numerical results show that the StabOp-L-ROM can be orders of magnitude more accurate than the classical L-ROM tuned with an optimal filter radius in the predictive regime. Furthermore, while the new StabOp smooths the input flow fields, its smoothing mechanism differs from that of classical spatial filters.

physics.flu-dyn

New Feedback Control and Adaptive Evolve-Filter-Relax Regularization for the Navier-Stokes Equations in the Convection-Dominated Regime

We propose, analyze, and investigate numerically a novel feedback control strategy for high Reynolds number flows. For both the continuous and the discrete (finite element) settings, we prove that the new strategy yields accurate results for high Reynolds numbers that were not covered by current results. We also show that the new feedback control yields more accurate results than the current control approaches in marginally-resolved numerical simulations of a two-dimensional flow past a circular cylinder at Reynolds numbers $Re=1000$. We note, however, that for realistic control parameters, the stabilizing effect of the new feedback control strategy is not sufficient in the convection-dominated regime. Our second contribution is the development of an adaptive evolve-filter-relax (aEFR) regularization that stabilizes marginally-resolved simulations in the convection-dominated regime and increases the accuracy of the new feedback control in realistic parameter settings. For the finite element setting, we prove that the novel feedback control equipped with the new aEFR method yields accurate results for high Reynolds numbers. Furthermore, our numerical investigation shows that the new strategy yields accurate results for reduced order models that dramatically decrease the size of the feedback control problem.

math.NA

Defining Foundation Models for Computational Science: A Call for Clarity and Rigor

The widespread success of foundation models in natural language processing and computer vision has inspired researchers to extend the concept to scientific machine learning and computational science. However, this position paper argues that as the term "foundation model" is an evolving concept, its application in computational science is increasingly used without a universally accepted definition, potentially creating confusion and diluting its precise scientific meaning. In this paper, we address this gap by proposing a formal definition of foundation models in computational science, grounded in the core values of generality, reusability, and scalability. We articulate a set of essential and desirable characteristics that such models must exhibit, drawing parallels with traditional foundational methods, like the finite element and finite volume methods. Furthermore, we introduce the Data-Driven Finite Element Method (DD-FEM), a framework that fuses the modular structure of classical FEM with the representational power of data-driven learning. We demonstrate how DD-FEM addresses many of the key challenges in realizing foundation models for computational science, including scalability, adaptability, and physics consistency. By bridging traditional numerical methods with modern AI paradigms, this work provides a rigorous foundation for evaluating and developing novel approaches toward future foundation models in computational science.

cs.LG

Verifiability and Limit Consistency of Eddy Viscosity Large Eddy Simulation Reduced Order Models

Large eddy simulation reduced order models (LES-ROMs) are ROMs that leverage LES ideas (e.g., filtering and closure modeling) to construct accurate and efficient ROMs for convection-dominated (e.g., turbulent) flows. Eddy viscosity (EV) ROMs (e.g., Smagorinsky ROM (S-ROM)) are LES-ROMs whose closure model consists of a diffusion-like operator in which the viscosity depends on the ROM velocity. We propose the Ladyzhenskaya ROM (L-ROM), which is a generalization of the S-ROM. Furthermore, we prove two fundamental numerical analysis results for the new L-ROM and the classical S-ROM: (i) We prove the verifiability of the L-ROM and S-ROM, i.e, that the ROM error is bounded (up to a constant) by the ROM closure error. (ii) We introduce the concept of ROM limit consistency (in a discrete sense), and prove that the L-ROM and S-ROM are limit consistent, i.e., that as the ROM dimension approaches the rank of the snapshot matrix, $d$, and the ROM lengthscale goes to zero, the ROM solution converges to the \emph{``true solution"}, i.e., the solution of the $d$-dimensional ROM. Finally, we illustrate numerically the verifiability and limit consistency of the new L-ROM and S-ROM in two under-resolved convection-dominated problems that display sharp gradients: (i) the 1D Burgers equation with a small diffusion coefficient; and (ii) the 2D lid-driven cavity flow at Reynolds number $Re=15,000$.

physics.flu-dyn

Data-driven Optimization for the Evolve-Filter-Relax regularization of convection-dominated flows

Numerical stabilization techniques are often employed in under-resolved simulations of convection-dominated flows to improve accuracy and mitigate spurious oscillations. Specifically, the evolve--filter--relax (EFR) algorithm is a framework which consists in evolving the solution, applying a filtering step to remove high-frequency noise, and relaxing through a convex combination of filtered and original solutions. The stability and accuracy of the EFR solution strongly depend on two parameters, the filter radius $δ$ and the relaxation parameter $χ$. Standard choices for these parameters are usually fixed in time, and related to the full order model setting, i.e., the grid size for $δ$ and the time step for $χ$. The key novelties with respect to the standard EFR approach are: (i) time-dependent parameters $δ(t)$ and $χ(t)$, and (ii) data-driven adaptive optimization of the parameters in time, considering a fully-resolved simulation as reference. In particular, we propose three different classes of optimized-EFR (Opt-EFR) strategies, aiming to optimize one or both parameters. The new Opt-EFR strategies are tested in the under-resolved simulation of a turbulent flow past a cylinder at $Re=1000$. The Opt-EFR proved to be more accurate than standard approaches by up to 99$\%$, while maintaining a similar computational time. In particular, the key new finding of our analysis is that such accuracy can be obtained only if the optimized objective function includes: (i) a global metric (as the kinetic energy), and (ii) spatial gradients' information.

math.NA

Symbolic Regression of Data-Driven Reduced Order Model Closures for Under-Resolved, Convection-Dominated Flows

Data-driven closures correct the standard reduced order models (ROMs) to increase their accuracy in under-resolved, convection-dominated flows. There are two types of data-driven ROM closures in current use: (i) structural, with simple ansatzes (e.g., linear or quadratic); and (ii) machine learning-based, with neural network ansatzes. We propose a novel symbolic regression (SR) data-driven ROM closure strategy, which combines the advantages of current approaches and eliminates their drawbacks. As a result, the new data-driven SR closures yield ROMs that are interpretable, parsimonious, accurate, generalizable, and robust. To compare the data-driven SR-ROM closures with the structural and machine learning-based ROM closures, we consider the data-driven variational multiscale ROM framework and two under-resolved, convection-dominated test problems: the flow past a cylinder and the lid-driven cavity flow at Reynolds numbers Re = 10000, 15000, and 20000. This numerical investigation shows that the new data-driven SR-ROM closures yield more accurate and robust ROMs than the structural and machine learning ROM closures.

math.NA

Variational Multiscale Evolve and Filter Strategies for Convection-Dominated Flows

The evolve-filter (EF) model is a filter-based numerical stabilization for under-resolved convection-dominated flows. EF is a simple, modular, and effective strategy for both full-order models (FOMs) and reduced-order models (ROMs). It is well-known, however, that when the filter radius is too large, EF can be overdiffusive and yield inaccurate results. To alleviate this, EF is usually supplemented with a relaxation step. The relaxation parameter, however, is very sensitive with respect to the model parameters. In this paper, we propose a novel strategy to alleviate the EF overdiffusivity for a large filter radius. Specifically, we leverage the variational multiscale (VMS) framework to separate the large resolved scales from the small resolved scales in the evolved velocity, and we use the filtered small scales to correct the large scales. Furthermore, in the new VMS-EF strategy, we use two different ways to decompose the evolved velocity: the VMS Evolve-Filter-Filter-Correct (VMS-EFFC) and the VMS Evolve-Postprocess-Filter-Correct (VMS-EPFC) algorithms. The new VMS-based algorithms yield significantly more accurate results than the standard EF in both the FOM and the ROM simulations of a flow past a cylinder at Reynolds number Re = 1000.

math.NA

A Priori Error Bounds and Parameter Scalings for the Time Relaxation Reduced Order Model

The a priori error analysis of reduced order models (ROMs) for fluids is relatively scarce. In this paper, we take a step in this direction and conduct numerical analysis of the recently introduced time relaxation ROM (TR-ROM), which uses spatial filtering to stabilize ROMs for convection-dominated flows. Specifically, we prove stability, an a priori error bound, and parameter scalings for the TR-ROM. Our numerical investigation shows that the theoretical convergence rate and the parameter scalings with respect to ROM dimension and filter radius are recovered numerically. In addition, the parameter scaling can be used to extrapolate the time relaxation parameter to other ROM dimensions and filter radii. Moreover, the parameter scaling with respect to filter radius is also observed in the predictive regime.

math.NA

A Priori Error Bounds for the Approximate Deconvolution Leray Reduced Order Model

The approximate deconvolution Leray reduced order model (ADL-ROM) uses spatial filtering to increase the ROM stability, and approximate deconvolution to increase the ROM accuracy. In the under-resolved numerical simulation of convection-dominated flows, ADL-ROM was shown to be significantly more stable than the standard ROM, and more accurate than the Leray ROM. In this paper, we prove a priori error bounds for the approximate deconvolution operator and ADL-ROM. To our knowledge, these are the first numerical analysis results for approximate deconvolution in a ROM context. We illustrate these numerical analysis results in the numerical simulation of convection-dominated flows.

math.NA

A Priori Error Bounds for POD-ROMs for Fluids: A Brief Survey

Galerkin reduced order models (ROMs), e.g., based on proper orthogonal decomposition (POD) or reduced basis methods, have achieved significant success in the numerical simulation of fluid flows. The ROM numerical analysis, however, is still being developed. In this paper, we take a step in this direction and present a survey of a priori error bounds, with a particular focus on POD-based ROMs. Specifically, we outline the main components of ROM a priori error bounds, emphasize their practical importance, and discuss significant contributions to a priori error bounds for ROMs for fluids.

math.NA

Bridging Large Eddy Simulation and Reduced Order Modeling of Convection-Dominated Flows through Spatial Filtering: Review and Perspectives

Reduced order models (ROMs) have achieved a lot of success in reducing the computational cost of traditional numerical methods across many disciplines. For convection-dominated (e.g., turbulent) flows, however, standard ROMs generally yield inaccurate results, usually affected by spurious oscillations. Thus, ROMs are usually equipped with numerical stabilization or closure models to account for the effect of the discarded modes. The literature on ROM closures and stabilizations is large and growing fast. In this paper, we focus on one particular type of ROM closures and stabilizations that are inspired by Large Eddy Simulation (LES). These ROMs, which we call LES-ROMs, are extremely easy to implement, very efficient, and accurate. Carefully tuned LES-ROMs can accurately capture the average physical quantities of interest in challenging convection-dominated flows in many applications. LES-ROM are constructed by leveraging spatial filtering, i.e., the same principle used to build classical LES models. This ensures a modeling consistency between LES-ROMs and the approaches that generated the data used to train them. It also ``bridges'' two distinct research fields (LES and ROMs), disconnected until now. This paper is a review of LES-ROMs. It starts with a description of a versatile LES strategy called evolve-filter-relax (EFR) that has been successfully used as a full order method. We then show how the EFR strategy, and spatial filtering in general, can be leveraged to construct LES-ROMs. Several applications of LES-ROMs are presented. Finally, we draw conclusions and outline several research directions and open questions in the LES-ROM development. While we do not claim this review to be comprehensive, we certainly hope it serves as a brief and friendly introduction to this exciting research area, which has a lot of potential in practical numerical simulation of convection-dominated flows.

physics.flu-dyn

A Time-Relaxation Reduced Order Model for the Turbulent Channel Flow

Reg-ROMs are stabilization strategies that leverage spatial filtering to alleviate the spurious numerical oscillations generally displayed by the classical G-ROM in under-resolved numerical simulations of turbulent flows. In this paper, we propose a new Reg-ROM, the time-relaxation ROM (TR-ROM), which filters the marginally resolved scales. We compare the new TR-ROM with the two other Reg-ROMs in current use, i.e., the L-ROM and the EFR-ROM, in the numerical simulation of the turbulent channel flow at $Re_τ = 180$ and $Re_τ = 395$ in both the reproduction and the predictive regimes. For each Reg-ROM, we investigate two different filters: (i) the differential filter (DF), and (ii) a new higher-order algebraic filter (HOAF). In our numerical investigation, we monitor the Reg-ROM performance for the ROM dimension, $N$, and the filter order. We also perform sensitivity studies of the three Reg-ROMs for the time interval, relaxation parameter, and filter radius. The numerical results yield the following conclusions: (i) All three Reg-ROMs are significantly more accurate than the G-ROM and (ii) more accurate than the ROM projection, representing the best theoretical approximation of the training data in the given ROM space. (iii) With the optimal parameter values, the TR-ROM is more accurate than the other two Reg-ROMs in all tests. (iv) For most $N$ values, DF yields the most accurate results for all three Reg-ROMs. (v) The optimal parameters trained in the reproduction regime are also optimal for the predictive regime for most $N$ values. (vi) All three Reg-ROMs are sensitive to the filter radius and the filter order, and the EFR-ROM and the TR-ROM are sensitive to the relaxation parameter. (vii) The optimal range for the filter radius and the effect of relaxation parameter are similar for the two $\rm Re_τ$ values.

math.NA

Approximate Deconvolution Leray Reduced Order Model for Convection-Dominated Flows

In this paper, we propose a novel ROM stabilization strategy for under-resolved convection-dominated flows, the approximate deconvolution Leray ROM (ADL-ROM). The new ADL-ROM introduces AD as a new means to increase the accuracy of the classical Leray ROM (L-ROM) without degrading its numerical stability. We also introduce two new AD ROM strategies: the Tikhonov and van Cittert methods. Our numerical investigation for convection-dominated systems shows that, when the filter radius is relatively large, the new ADL-ROM is more accurate than the standard L-ROM. Furthermore, the new ADL-ROM is less sensitive with respect to model parameters than L-ROM.

math.NA

Residual Data-Driven Variational Multiscale Reduced Order Models for Parameter Dependent Problems

In this paper, we investigate the modeling of sub-scale components of proper orthogonal decomposition reduced order models (POD-ROMs) of convection-dominated flows. We propose ROM closure models that depend on the ROM residual. We illustrate the new residual-based data-driven ROM closure within the variational multiscale (VMS) framework and investigate it in the numerical simulation of a one-dimensional parameter-dependent convection-dominated convection-diffusion problem. For comparison purposes, we also investigate a streamline-upwind Petrov-Galerkin (SUPG) ROM stabilization strategy and the standard Galerkin ROM (G-ROM). Our numerical investigation shows that the new residual-based data-driven VMS-ROM is more accurate than both the standard G-ROM and the SUPG-ROM.

physics.flu-dyn

Residual-based stabilized reduced-order models of the transient convection-diffusion-reaction equation obtained through discrete and continuous projection

Galerkin and Petrov-Galerkin projection-based reduced-order models (ROMs) of transient partial differential equations are typically obtained by performing a dimension reduction and projection process that is defined at either the spatially continuous or spatially discrete level. In both cases, it is common to add stabilization to the resulting ROM to increase the stability and accuracy of the method; the addition of stabilization is particularly common for advection-dominated systems when the ROM is under-resolved. While these two approaches can be equivalent in certain settings, differing techniques have emerged in both contexts. This work outlines these two approaches within the setting of finite element method (FEM) discretizations (in which case a duality exists between the continuous and discrete levels) of the convection-diffusion-reaction equation, and compares residual-based stabilization techniques that have been developed in both contexts. In the spatially continuous case, we examine the Galerkin, streamline upwind Petrov-Galerkin (SUPG), Galerkin/least-squares (GLS), and adjoint (ADJ) stabilization methods. For the GLS and ADJ methods, we examine formulations constructed from both the "discretize-then-stabilize" technique and the space-time technique. In the spatially discrete case, we examine the Galerkin, least-squares Petrov-Galerkin (LSPG), and adjoint Petrov-Galerkin (APG) methods. We summarize existing analyses for these methods, and provide numerical experiments, which demonstrate that residual-based stabilized methods developed via continuous and discrete processes yield substantial improvements over standard Galerkin methods when the underlying FEM model is under-resolved.

math.NA

Hybrid Data-Driven Closure Strategies for Reduced Order Modeling

In this paper, we propose hybrid data-driven ROM closures for fluid flows. These new ROM closures combine two fundamentally different strategies: (i) purely data-driven ROM closures, both for the velocity and the pressure; and (ii) physically based, eddy viscosity data-driven closures, which model the energy transfer in the system. The first strategy consists in the addition of closure/correction terms to the governing equations, which are built from the available data. The second strategy includes turbulence modeling by adding eddy viscosity terms, which are determined by using machine learning techniques. The two strategies are combined for the first time in this paper to investigate a two-dimensional flow past a circular cylinder at Re=50000. Our numerical results show that the hybrid data-driven ROM is more accurate than both the purely data-driven ROM and the eddy viscosity ROM.

math.NA