Searcharxiv⌕ Search

arXiv subjects

Paolo Zunino

Publications and source records attributed to Paolo Zunino.

At least 19 recordsLinked to original sources

Physics-Informed Learning of Microvascular Flow Models using Graph Neural Networks

The simulation of microcirculatory blood flow in realistic vascular architectures poses significant challenges due to the multiscale nature of the problem and the topological complexity of capillary networks. In this work, we propose a novel deep learning-based reduced-order modeling strategy, leveraging Graph Neural Networks (GNNs) trained on synthetic microvascular graphs to approximate hemodynamic quantities on anatomically realistic domains. Our method combines algorithms for synthetic vascular generation with a physics-informed training procedure that integrates graph topological information and local flow dynamics. To ensure the physical reliability of the learned surrogates, we incorporate a physics-informed loss functional derived from the governing equations, allowing enforcement of mass conservation and rheological constraints. The resulting GNN architecture demonstrates robust generalization capabilities across diverse network configurations. On the general-purpose test networks, the GNN reconstructs pressure, physical axial velocity recovered from the transformed model output, and hematocrit fields; on the cortical networks, the present quantitative validation is restricted to pressure. Although specific to the solver implementations and hardware used, the reported wall-clock comparisons show low-latency inference after training that may be useful in repeated-query workflows built on existing organ-scale graph-reduced solvers. This work establishes a new class of graph-based surrogate models for microvascular flow, grounded in physical laws and equipped with inductive biases that mirror mass conservation and rheological models, opening new directions for real-time inference in vascular modeling and biomedical applications.

math.NA↗

Multiscale Mixed-Dimensional Simulation via Domain Decomposition and Non-Intrusive Neural Model Order Reduction

Many computational models arising in science and engineering exhibit a multiscale structure that makes the assembly or direct solution of the global problem computationally prohibitive. Domain Decomposition (DD) methods overcome this limitation by replacing the global problem with a sequence of coupled local problems, whose iterative solution reconstructs the global response. This work introduces a method in the family of Domain Decomposition Reduced Order Models (DD-ROMs), based on the observation that DD naturally localizes not only the solution operator but also its geometric and parametric dependence. The central idea is that DD transforms a globally intractable solution map into a family of locally representable operators learnable from affordable local data after identification with a common reference configuration, a concept that we formalize through the notion of local representability. Non-intrusive neural surrogates are then trained to approximate the fine-scale local operations and embedded into the iterative solver. The training algorithm is based on a cascaded strategy designed to match the distributions encountered by the deployed surrogate iteration. We interpret the resulting DD method as a perturbed fixed-point iteration and establish that the global error remains bounded by the surrogate approximation error. The framework is instantiated for mixed-dimensional elliptic problems coupling three-dimensional bulk domains with embedded one-dimensional inclusions, using a two-level non-overlapping Robin-Robin method. Numerical experiments show that the resulting DD-ROM is stable, achieves accurate approximation on unseen microscale geometries and features good scalability properties with respect to the number of subdomains, scaling to large size global problems while avoiding fine-scale operator assembly and local high-fidelity solvers in the online stage.

math.NA↗

Model reduction of parametric ordinary differential equations via autoencoders: representation properties and convergence analysis

We propose a reduced-order modeling approach for nonlinear, parameter-dependent ordinary differential equations (ODE). Dimensionality reduction is achieved using nonlinear maps represented by autoencoders. The resulting low-dimensional ODE is then solved using standard integration in time schemes, and the high-dimensional solution is reconstructed from the low-dimensional one. We investigate the architecture of neural networks for constructing effective autoencoders that hold necessary properties to reconstruct the input manifold with exact representation capabilities. We study the convergence of the reduced-order model to the high-fidelity one. Numerical experiments show the robustness and accuracy of our approach in different scenarios, highlighting its effectiveness in highly complex and nonlinear settings without sacrificing accuracy. Moreover, we examine how the reduction influences the stability properties of the reconstructed high-dimensional solution.

math.NA↗

Mathematical modeling and sensitivity analysis of hypoxia-activated drugs

Hypoxia-activated prodrugs offer a promising strategy for targeting oxygen-deficient regions in solid tumors, which are often resistant to conventional therapies. However, modeling their behavior is challenging because of the complex interplay between oxygen availability, drug activation, and cell survival. In this work, we develop a multiscale and mixed-dimensional model that couples spatially resolved drug and oxygen transport with pharmacokinetics and pharmacodynamics to simulate the cellular response. The model integrates blood flow, oxygen diffusion and consumption, drug delivery, and metabolism. To reduce computational cost, we mitigate the global nonlinearity through a one-way coupling of the multiscale and mixed/dimensional models with a reduced 0D model for the drug metabolism. The global sensitivity analysis is then used to identify key parameters influencing drug activation and therapeutic outcome. This approach enables efficient simulation and supports the design of optimized hypoxia-targeted therapies.

math.NA↗

Neural Preconditioning via Krylov Subspace Geometry

We propose a geometry-aware strategy for training neural preconditioners tailored to parametrized linear systems arising from the discretization of mixed-dimensional partial differential equations (PDEs). These systems are typically ill-conditioned because of the presence of embedded lower-dimensional structures and are solved using Krylov subspace methods. Our approach yields an approximation of the inverse operator employing a learning algorithm consisting of a two-stage training framework: an initial static pre-training phase, based on residual minimization, followed by a dynamic fine-tuning phase that incorporates solver convergence dynamics into training via a novel loss functional. This dynamic loss is defined by the principal angles between the residuals and the Krylov subspaces. It is evaluated using a differentiable implementation of the Flexible GMRES algorithm, which enables backpropagation through both the Arnoldi process and Givens rotations. The resulting neural preconditioner is explicitly optimized to improve early-stage convergence and reduce iteration counts in a family of 3D-1D mixed-dimensional problems with geometric variability of the 1D domain. Numerical experiments show that our solver-aligned approach significantly improves convergence rate, robustness, and generalization.

math.NA↗

Numerical Solution of Mixed-Dimensional PDEs Using a Neural Preconditioner

Mixed-dimensional partial differential equations (PDEs) are characterized by coupled operators defined on domains of varying dimensions and pose significant computational challenges due to their inherent ill-conditioning. Moreover, the computational workload increases considerably when attempting to accurately capture the behavior of the system under significant variations or uncertainties in the low-dimensional structures such as fractures, fibers, or vascular networks, due to the inevitable necessity of running multiple simulations. In this work, we present a novel preconditioning strategy that leverages neural networks and unsupervised operator learning to design an efficient preconditioner specifically tailored to a class of 3D-1D mixed-dimensional PDEs. The proposed approach is capable of generalizing to varying shapes of the 1D manifold without retraining, making it robust to changes in the 1D graph topology. Moreover, thanks to convolutional neural networks, the neural preconditioner can adapt over a range of increasing mesh resolutions of the discrete problem, enabling us to train it on low resolution problems and deploy it on higher resolutions. Numerical experiments validate the effectiveness of the preconditioner in accelerating convergence in iterative solvers, demonstrating its appeal and limitations over traditional methods. This study lays the groundwork for applying neural network-based preconditioning techniques to a broader range of coupled multi-physics systems.

math.NA↗

Recurrent Deep Kernel Learning of Dynamical Systems

Digital twins require computationally-efficient reduced-order models (ROMs) that can accurately describe complex dynamics of physical assets. However, constructing ROMs from noisy high-dimensional data is challenging. In this work, we propose a data-driven, non-intrusive method that utilizes stochastic variational deep kernel learning (SVDKL) to discover low-dimensional latent spaces from data and a recurrent version of SVDKL for representing and predicting the evolution of latent dynamics. The proposed method is demonstrated with two challenging examples -- a double pendulum and a reaction-diffusion system. Results show that our framework is capable of (i) denoising and reconstructing measurements, (ii) learning compact representations of system states, (iii) predicting system evolution in low-dimensional latent spaces, and (iv) quantifying modeling uncertainties.

cs.LG↗

Deep orthogonal decomposition: a continuously adaptive data-driven approach to model order reduction

We develop a novel deep learning technique, termed Deep Orthogonal Decomposition (DOD), for dimensionality reduction and reduced order modeling of parameter dependent partial differential equations. The approach consists in the construction of a deep neural network model that approximates the solution manifold through a continuously adaptive local basis. In contrast to global methods, such as Principal Orthogonal Decomposition (POD), the adaptivity allows the DOD to overcome the Kolmogorov barrier, making the approach applicable to a wide spectrum of parametric problems. Furthermore, due to its hybrid linear-nonlinear nature, the DOD can accommodate both intrusive and nonintrusive techniques, providing highly interpretable latent representations and tighter control on error propagation. For this reason, the proposed approach stands out as a valuable alternative to other nonlinear techniques, such as deep autoencoders. The methodology is discussed both theoretically and practically, evaluating its performances on problems featuring nonlinear PDEs, singularities, and parametrized geometries.

math.NA↗

Application of Deep Learning Reduced-Order Modeling for Single-Phase Flow in Faulted Porous Media

We apply reduced-order modeling (ROM) techniques to single-phase flow in faulted porous media, accounting for changing rock properties and fault geometry variations using a radial basis function mesh deformation method. This approach benefits from a mixed-dimensional framework that effectively manages the resulting non-conforming mesh. To streamline complex and repetitive calculations such as sensitivity analysis and solution of inverse problems, we utilize the Deep Learning Reduced Order Model (DL-ROM). This non-intrusive neural network-based technique is evaluated against the traditional Proper Orthogonal Decomposition (POD) method across various scenarios, demonstrating DL-ROM's capacity to expedite complex analyses with promising accuracy and efficiency.

math.NA↗

Deep learning enhanced cost-aware multi-fidelity uncertainty quantification of a computational model for radiotherapy

Forward uncertainty quantification (UQ) for partial differential equations is a many-query task that requires a significant number of model evaluations. The objective of this work is to mitigate the computational cost of UQ for a 3D-1D multiscale computational model of microcirculation. To this purpose, we present a deep learning enhanced multi-fidelity Monte Carlo (DL-MFMC) method that integrates the information of a multiscale full-order model (FOM) with that coming from a deep learning enhanced non-intrusive projection-based reduced order model (ROM). The latter is constructed by leveraging on proper orthogonal decomposition (POD) and mesh-informed neural networks (previously developed by the authors and co-workers), integrating diverse architectures that approximate POD coefficients while introducing fine-scale corrections for the microstructures. The DL-MFMC approach provides a robust estimator of specific quantities of interest and their associated uncertainties, with optimal management of computational resources. In particular, the computational budget is efficiently divided between training and sampling, ensuring a reliable estimation process suitably exploiting the ROM speed-up. Here, we apply the DL-MFMC technique to accelerate the estimation of biophysical quantities regarding oxygen transfer and radiotherapy outcomes. Compared to classical Monte Carlo methods, the proposed approach shows remarkable speed-ups and a substantial reduction of the overall computational cost.

math.NA↗

Reduced Lagrange multiplier approach for non-matching coupling of mixed-dimensional domains

Many physical problems involving heterogeneous spatial scales, such as the flow through fractured porous media, the study of fiber-reinforced materials, or the modeling of the small circulation in living tissues -- just to mention a few examples -- can be described as coupled partial differential equations defined in domains of heterogeneous dimensions that are embedded into each other. This formulation is a consequence of geometric model reduction techniques that transform the original problems defined in complex three-dimensional domains into more tractable ones. The definition and the approximation of coupling operators suitable for this class of problems is still a challenge. We develop a general mathematical framework for the analysis and the approximation of partial differential equations coupled by non-matching constraints across different dimensions, focusing on their enforcement using Lagrange multipliers. In this context, we address in abstract and general terms the well-posedness, stability, and robustness of the problem with respect to the smallest characteristic length of the embedded domain. We also address the numerical approximation of the problem and we discuss the inf-sup stability of the proposed numerical scheme for some representative configuration of the embedded domain. The main message of this work is twofold: from the standpoint of the theory of mixed-dimensional problems, we provide general and abstract mathematical tools to formulate coupled problems across dimensions. From the practical standpoint of the numerical approximation, we show the interplay between the mesh characteristic size, the dimension of the Lagrange multiplier space, and the size of the inclusion in representative configurations interesting for applications. The latter analysis is complemented with illustrative numerical examples.

math.NA↗

Deep learning based reduced order modeling of Darcy flow systems with local mass conservation

We propose a new reduced order modeling strategy for tackling parametrized Partial Differential Equations (PDEs) with linear constraints, in particular Darcy flow systems in which the constraint is given by mass conservation. Our approach employs classical neural network architectures and supervised learning, but it is constructed in such a way that the resulting Reduced Order Model (ROM) is guaranteed to satisfy the linear constraints exactly. The procedure is based on a splitting of the PDE solution into a particular solution satisfying the constraint and a homogenous solution. The homogeneous solution is approximated by mapping a suitable potential function, generated by a neural network model, onto the kernel of the constraint operator; for the particular solution, instead, we propose an efficient spanning tree algorithm. Starting from this paradigm, we present three approaches that follow this methodology, obtained by exploring different choices of the potential spaces: from empirical ones, derived via Proper Orthogonal Decomposition (POD), to more abstract ones based on differential complexes. All proposed approaches combine computational efficiency with rigorous mathematical interpretation, thus guaranteeing the explainability of the model outputs. To demonstrate the efficacy of the proposed strategies and to emphasize their advantages over vanilla black-box approaches, we present a series of numerical experiments on fluid flows in porous media, ranging from mixed-dimensional problems to nonlinear systems. This research lays the foundation for further exploration and development in the realm of model order reduction, potentially unlocking new capabilities and solutions in computational geosciences and beyond.

math.NA↗

On the latent dimension of deep autoencoders for reduced order modeling of PDEs parametrized by random fields

Deep Learning is having a remarkable impact on the design of Reduced Order Models (ROMs) for Partial Differential Equations (PDEs), where it is exploited as a powerful tool for tackling complex problems for which classical methods might fail. In this respect, deep autoencoders play a fundamental role, as they provide an extremely flexible tool for reducing the dimensionality of a given problem by leveraging on the nonlinear capabilities of neural networks. Indeed, starting from this paradigm, several successful approaches have already been developed, which are here referred to as Deep Learning-based ROMs (DL-ROMs). Nevertheless, when it comes to stochastic problems parameterized by random fields, the current understanding of DL-ROMs is mostly based on empirical evidence: in fact, their theoretical analysis is currently limited to the case of PDEs depending on a finite number of (deterministic) parameters. The purpose of this work is to extend the existing literature by providing some theoretical insights about the use of DL-ROMs in the presence of stochasticity generated by random fields. In particular, we derive explicit error bounds that can guide domain practitioners when choosing the latent dimension of deep autoencoders. We evaluate the practical usefulness of our theory by means of numerical experiments, showing how our analysis can significantly impact the performance of DL-ROMs.

cs.LG↗

Nonlinear model order reduction for problems with microstructure using mesh informed neural networks

Many applications in computational physics involve approximating problems with microstructure, characterized by multiple spatial scales in their data. However, these numerical solutions are often computationally expensive due to the need to capture fine details at small scales. As a result, simulating such phenomena becomes unaffordable for many-query applications, such as parametrized systems with multiple scale-dependent features. Traditional projection-based reduced order models (ROMs) fail to resolve these issues, even for second-order elliptic PDEs commonly found in engineering applications. To address this, we propose an alternative nonintrusive strategy to build a ROM, that combines classical proper orthogonal decomposition (POD) with a suitable neural network (NN) model to account for the small scales. Specifically, we employ sparse mesh-informed neural networks (MINNs), which handle both spatial dependencies in the solutions and model parameters simultaneously. We evaluate the performance of this strategy on benchmark problems and then apply it to approximate a real-life problem involving the impact of microcirculation in transport phenomena through the tissue microenvironment.

math.NA↗

Robust Preconditioning of mixed-dimensional PDEs on 3d-1d domains coupled with Lagrange multipliers

In the context of micro-circulation, the coexistence of two distinct length scales - the vascular radius and the tissue/organ scale - with a substantial difference in magnitude, poses significant challenges. To handle slender inclusions and simplify the geometry involved, a technique called topological dimensionality reduction is employed, which suppresses manifold dimensions associated with the smaller characteristic length. However, the resulting discretized system's algebraic structure presents a challenge in constructing efficient solution algorithms. This chapter addresses this challenge by developing a robust preconditioner for the 3d-1d problem using the operator preconditioning technique. Robustness of the preconditioner is demonstrated with respect to problem parameters, except for the vascular radius. The vascular radius, as demonstrated, plays a fundamental role in mathematical well-posedness of the problem and the preconditioner's effectiveness.

math.NA↗

Mesh-Informed Neural Networks for Operator Learning in Finite Element Spaces

Thanks to their universal approximation properties and new efficient training strategies, Deep Neural Networks are becoming a valuable tool for the approximation of mathematical operators. In the present work, we introduce Mesh-Informed Neural Networks (MINNs), a class of architectures specifically tailored to handle mesh based functional data, and thus of particular interest for reduced order modeling of parametrized Partial Differential Equations (PDEs). The driving idea behind MINNs is to embed hidden layers into discrete functional spaces of increasing complexity, obtained through a sequence of meshes defined over the underlying spatial domain. The approach leads to a natural pruning strategy which enables the design of sparse architectures that are able to learn general nonlinear operators. We assess this strategy through an extensive set of numerical experiments, ranging from nonlocal operators to nonlinear diffusion PDEs, where MINNs are compared against more traditional architectures, such as classical fully connected Deep Neural Networks, but also more recent ones, such as DeepONets and Fourier Neural Operators. Our results show that MINNs can handle functional data defined on general domains of any shape, while ensuring reduced training times, lower computational costs, and better generalization capabilities, thus making MINNs very well-suited for demanding applications such as Reduced Order Modeling and Uncertainty Quantification for PDEs.

math.NA↗

Uncertainty quantification for nonlinear solid mechanics using reduced order models with Gaussian process regression

Uncertainty quantification (UQ) tasks, such as sensitivity analysis and parameter estimation, entail a huge computational complexity when dealing with input-output maps involving the solution of nonlinear differential problems, because of the need to query expensive numerical solvers repeatedly. Projection-based reduced order models (ROMs), such as the Galerkin-reduced basis (RB) method, have been extensively developed in the last decades to overcome the computational complexity of high fidelity full order models (FOMs), providing remarkable speedups when addressing UQ tasks related with parameterized differential problems. Nonetheless, constructing a projection-based ROM that can be efficiently queried usually requires extensive modifications to the original code, a task which is non-trivial for nonlinear problems, or even not possible at all when proprietary software is used. Non-intrusive ROMs - which rely on the FOM as a black box - have been recently developed to overcome this issue. In this work, we consider ROMs exploiting proper orthogonal decomposition to construct a reduced basis from a set of FOM snapshots, and Gaussian process regression (GPR) to approximate the RB projection coefficients. Two different approaches, namely a global GPR and a tensor-decomposition-based GPR, are explored on a set of 3D time-dependent solid mechanics examples. Finally, the non-intrusive ROM is exploited to perform global sensitivity analysis (relying on both screening and variance-based methods) and parameter estimation (through Markov chain Monte Carlo methods), showing remarkable computational speedups and very good accuracy compared to high-fidelity FOMs.

math.NA↗

Approximation bounds for convolutional neural networks in operator learning

Recently, deep Convolutional Neural Networks (CNNs) have proven to be successful when employed in areas such as reduced order modeling of parametrized PDEs. Despite their accuracy and efficiency, the approaches available in the literature still lack a rigorous justification on their mathematical foundations. Motivated by this fact, in this paper we derive rigorous error bounds for the approximation of nonlinear operators by means of CNN models. More precisely, we address the case in which an operator maps a finite dimensional input $\boldsymbolμ\in\mathbb{R}^{p}$ onto a functional output $u_{\boldsymbolμ}:[0,1]^{d}\to\mathbb{R}$, and a neural network model is used to approximate a discretized version of the input-to-output map. The resulting error estimates provide a clear interpretation of the hyperparameters defining the neural network architecture. All the proofs are constructive, and they ultimately reveal a deep connection between CNNs and the Fourier transform. Finally, we complement the derived error bounds by numerical experiments that illustrate their application.

math.NA↗