arXiv subjects

Ehsan Haghighat

Publications and source records attributed to Ehsan Haghighat.

At least 19 recordsLinked to original sources

arXiv2026

Learning and Inferring Multiphase Flow Dynamics in Porous Media using Scientific Machine Learning: Application to the "FluidFlower" CO2 Injection Experiment

Accurate prediction and parameter identification of multiphase flow in porous media remain central challenges in geological carbon dioxide storage due to strong nonlinearities, high-dimensional parameter spaces, and limited observational data. We present a machine learning framework that integrates surrogate modeling and Bayesian inference to enable efficient forward prediction and inverse parameter estimation for CO2-brine flows in geological media. The approach is demonstrated using the "FluidFlower" experimental rig, a controlled laboratory system that provides high-resolution, time-resolved observations of CO2 migration in heterogeneous porous media. A convolutional neural network surrogate is trained on high-fidelity numerical simulations to learn the evolution of CO2 saturation and dissolved CO2 concentration fields over a wide range of multiphase flow properties. The trained surrogate is embedded within a Markov chain Monte Carlo framework for parameter inference conditioned on experimental observations. Results show that the surrogate accurately captures large-scale CO2 plume migration, dissolution dynamics, and multiphase flow behavior while providing orders-of-magnitude acceleration compared to traditional simulations. Embedding the surrogate within a Bayesian framework enables computationally tractable exploration of the parameter space and reveals both identifiable and non-identifiable parameter combinations that produce similar plume behavior. By leveraging spatially and temporally resolved full-field observations, the framework substantially improves agreement between simulations and experiments compared to previous manual calibrations based on limited plume-scale metrics. Analysis using progressively increasing observation horizons further shows that observations become more informative once the plume interacts with geological features such as faults and sealing layers.

physics.geo-ph↗

arXiv2025

STONet: A neural operator for modeling solute transport in micro-cracked reservoirs

In this work, we introduce a novel neural operator, the Solute Transport Operator Network (STONet), to efficiently model contaminant transport in micro-cracked porous media. STONet's model architecture is specifically designed for this problem and uniquely integrates an enriched DeepONet structure with a transformer-based multi-head attention mechanism, enhancing performance without incurring additional computational overhead compared to existing neural operators. The model combines different networks to encode heterogeneous properties effectively and predict the rate of change of the concentration field to accurately model the transport process. The training data is obtained using finite element (FEM) simulations by random sampling of micro-fracture distributions and applied pressure boundary conditions, which capture diverse scenarios of fracture densities, orientations, apertures, lengths, and balance of pressure-driven to density-driven flow. Our numerical experiments demonstrate that, once trained, STONet achieves accurate predictions, with relative errors typically below 1% compared with FEM simulations while reducing runtime by approximately two orders of magnitude. This type of computational efficiency facilitates building digital twins for rapid assessment of subsurface contamination risks and optimization of environmental remediation strategies. The data and code for the paper will be published at https://github.com/ehsanhaghighat/STONet.

cs.LG↗

arXiv2024

LatticeGraphNet: A two-scale graph neural operator for simulating lattice structures

This study introduces a two-scale Graph Neural Operator (GNO), namely, LatticeGraphNet (LGN), designed as a surrogate model for costly nonlinear finite-element simulations of three-dimensional latticed parts and structures. LGN has two networks: LGN-i, learning the reduced dynamics of lattices, and LGN-ii, learning the mapping from the reduced representation onto the tetrahedral mesh. LGN can predict deformation for arbitrary lattices, therefore the name operator. Our approach significantly reduces inference time while maintaining high accuracy for unseen simulations, establishing the use of GNOs as efficient surrogate models for evaluating mechanical responses of lattices and structures.

cs.LG↗

arXiv2023

An enrichment approach for enhancing the expressivity of neural operators with applications to seismology

The Eikonal equation plays a central role in seismic wave propagation and hypocenter localization, a crucial aspect of efficient earthquake early warning systems. Despite recent progress, real-time earthquake localization remains challenging due to the need to learn a generalizable Eikonal operator. We introduce a novel deep learning architecture, Enriched-DeepONet (En-DeepONet), addressing the limitations of current operator learning models in dealing with moving-solution operators. Leveraging addition and subtraction operations and a novel `root' network, En-DeepONet is particularly suitable for learning such operators and achieves up to four orders of magnitude improved accuracy without increased training cost. We demonstrate the effectiveness of En-DeepONet in earthquake localization under variable velocity and arrival time conditions. Our results indicate that En-DeepONet paves the way for real-time hypocenter localization for velocity models of practical interest. The proposed method represents a significant advancement in operator learning that is applicable to a gamut of scientific problems, including those in seismology, fracture mechanics, and phase-field problems.

cs.LG↗

arXiv2023

Machine Learning-Enabled Precision Position Control and Thermal Regulation in Advanced Thermal Actuators

With their unique combination of characteristics - an energy density almost 100 times that of human muscle, and a power density of 5.3 kW/kg, similar to a jet engine's output - Nylon artificial muscles stand out as particularly apt for robotics applications. However, the necessity of integrating sensors and controllers poses a limitation to their practical usage. Here we report a constant power open-loop controller based on machine learning. We show that we can control the position of a nylon artificial muscle without external sensors. To this end, we construct a mapping from a desired displacement trajectory to a required power using an ensemble encoder-style feed-forward neural network. The neural controller is carefully trained on a physics-based denoised dataset and can be fine-tuned to accommodate various types of thermal artificial muscles, irrespective of the presence or absence of hysteresis.

cs.RO↗

arXiv2023

An efficient phase-field model of shear fractures using deviatoric stress split

We propose a phase-field model of shear fractures using the deviatoric stress decomposition (DSD). This choice allows us to use general three-dimensional Mohr-Coulomb's (MC) failure function for formulating the relations and evaluating peak and residual stresses. We apply the model to a few benchmark problems of shear fracture and strain localization and report remarkable performance. Our model is able to capture conjugate failure modes under biaxial compression test and for the slope stability problem, a challenging task for most models of geomechanics.

cs.CE↗

arXiv2022

Constitutive model characterization and discovery using physics-informed deep learning

Classically, the mechanical response of materials is described through constitutive models, often in the form of constrained ordinary differential equations. These models have a very limited number of parameters, yet, they are extremely efficient in reproducing complex responses observed in experiments. Additionally, in their discretized form, they are computationally very efficient, often resulting in a simple algebraic relation, and therefore they have been extensively used within large-scale explicit and implicit finite element models. However, it is very challenging to formulate new constitutive models, particularly for materials with complex microstructures such as composites. A recent trend in constitutive modeling leverages complex neural network architectures to construct complex material responses where a constitutive model does not yet exist. Whilst very accurate, they suffer from two deficiencies. First, they are interpolation models and often do poorly in extrapolation. Second, due to their complex architecture and numerous parameters, they are inefficient to be used as a constitutive model within a large-scale finite element model. In this study, we propose a novel approach based on the physics-informed learning machines for the characterization and discovery of constitutive models. Unlike data-driven constitutive models, we leverage foundations of elastoplasticity theory as regularization terms in the total loss function to find parametric constitutive models that are also theoretically sound. We demonstrate that our proposed framework can efficiently identify the underlying constitutive model describing different datasets from the von Mises family.

cs.LG↗

arXiv2022

Inverse modeling of nonisothermal multiphase poromechanics using physics-informed neural networks

We propose a solution strategy for parameter identification in multiphase thermo-hydro-mechanical (THM) processes in porous media using physics-informed neural networks (PINNs). We employ a dimensionless form of the THM governing equations that is particularly well suited for the inverse problem, and we leverage the sequential multiphysics PINN solver we developed in previous work. We validate the proposed inverse-modeling approach on multiple benchmark problems, including Terzaghi's isothermal consolidation problem, Barry-Mercer's isothermal injection-production problem, and nonisothermal consolidation of an unsaturated soil layer. We report the excellent performance of the proposed sequential PINN-THM inverse solver, thus paving the way for the application of PINNs to inverse modeling of complex nonlinear multiphysics problems.

cs.LG↗

arXiv2022

Energy-based error bound of physics-informed neural network solutions in elasticity

An energy-based a posteriori error bound is proposed for the physics-informed neural network solutions of elasticity problems. An admissible displacement-stress solution pair is obtained from a mixed form of physics-informed neural networks, and the proposed error bound is formulated as the constitutive relation error defined by the solution pair. Such an error estimator provides an upper bound of the global error of neural network discretization. The bounding property, as well as the asymptotic behavior of the physics-informed neural network solutions, are studied in a demonstrating example.

math.NA↗

arXiv2022

Physics-informed neural network solution of thermo-hydro-mechanical (THM) processes in porous media

Physics-Informed Neural Networks (PINNs) have received increased interest for forward, inverse, and surrogate modeling of problems described by partial differential equations (PDE). However, their application to multiphysics problem, governed by several coupled PDEs, present unique challenges that have hindered the robustness and widespread applicability of this approach. Here we investigate the application of PINNs to the forward solution of problems involving thermo-hydro-mechanical (THM) processes in porous media, which exhibit disparate spatial and temporal scales in thermal conductivity, hydraulic permeability, and elasticity. In addition, PINNs are faced with the challenges of the multi-objective and non-convex nature of the optimization problem. To address these fundamental issues, we: (1)~rewrite the THM governing equations in dimensionless form that is best suited for deep-learning algorithms; (2)~propose a sequential training strategy that circumvents the need for a simultaneous solution of the multiphysics problem and facilitates the task of optimizers in the solution search; and (3)~leverage adaptive weight strategies to overcome the stiffness in the gradient flow of the multi-objective optimization problem. Finally, we apply this framework to the solution of several synthetic problems in 1D and~2D.

cs.LG↗

arXiv2021

Physics-informed neural network simulation of multiphase poroelasticity using stress-split sequential training

Physics-informed neural networks (PINNs) have received significant attention as a unified framework for forward, inverse, and surrogate modeling of problems governed by partial differential equations (PDEs). Training PINNs for forward problems, however, pose significant challenges, mainly because of the complex non-convex and multi-objective loss function. In this work, we present a PINN approach to solving the equations of coupled flow and deformation in porous media for both single-phase and multiphase flow. To this end, we construct the solution space using multi-layer neural networks. Due to the dynamics of the problem, we find that incorporating multiple differential relations into the loss function results in an unstable optimization problem, meaning that sometimes it converges to the trivial null solution, other times it moves very far from the expected solution. We report a dimensionless form of the coupled governing equations that we find most favourable to the optimizer. Additionally, we propose a sequential training approach based on the stress-split algorithms of poromechanics. Notably, we find that sequential training based on stress-split performs well for different problems, while the classical strain-split algorithm shows an unstable behaviour similar to what is reported in the context of finite element solvers. We use the approach to solve benchmark problems of poroelasticity, including Mandel's consolidation problem, Barry-Mercer's injection-production problem, and a reference two-phase drainage problem. The Python-SciANN codes reproducing the results reported in this manuscript will be made publicly available at https://github.com/sciann/sciann-applications.

cs.LG↗

arXiv2021

A Physics Informed Neural Network Approach to Solution and Identification of Biharmonic Equations of Elasticity

We explore an application of the Physics Informed Neural Networks (PINNs) in conjunction with Airy stress functions and Fourier series to find optimal solutions to a few reference biharmonic problems of elasticity and elastic plate theory. Biharmonic relations are fourth-order partial differential equations (PDEs) that are challenging to solve using classical numerical methods, and have not been addressed using PINNs. Our work highlights a novel application of classical analytical methods to guide the construction of efficient neural networks with the minimal number of parameters that are very accurate and fast to evaluate. In particular, we find that enriching feature space using Airy stress functions can significantly improve the accuracy of PINN solutions for biharmonic PDEs.

cs.LG↗

arXiv2021

Solving the Eikonal equation for compressional and shear waves in anisotropic media using peridynamic differential operator

The traveltime of compressional (P) and shear (S) waves have proven essential in many applications of earthquake and exploration seismology. An accurate and efficient traveltime computation for P and S waves is crucial for the success of these applications. However, solutions to the Eikonal equation with a complex phase velocity field in anisotropic media is challenging. The Eikonal equation is a first-order, hyperbolic, nonlinear partial differential equation (PDE) that represents the high-frequency asymptotic approximation of the wave equation. The fast marching and sweeping methods are commonly used due to their efficiency in numercally solving Eikonal equation. However, these methods suffer from numerical inaccuracy in anisotropic media with sharp heterogeneity, irregular surface topography and complex phase velocity fields. This study presents a new method to solving the Eikonal equation by employing the peridynamic differential operator (PDDO). The PDDO provides the nonlocal form of the Eikonal equation by introducing an internal length parameter (horizon) and a weight function with directional nonlocality. The operator is immune to discontinuities in the form sharp changes in field or model variables and invokes the direction of traveltime in a consistent manner. The weight function controls the degree of association among points within the horizon. Solutions are constructed in a consistent manner without upwind assumptions through simple discretization. The capability of this approach is demonstrated by considering different types of Eikonal equations on complex velocity models in anisotropic media. The examples demonstrate its unconditional numerical stability and results compare well with the reference solutions.

physics.comp-ph↗

arXiv2021

Physics-Informed Neural Network for Modelling the Thermochemical Curing Process of Composite-Tool Systems During Manufacture

We present a Physics-Informed Neural Network (PINN) to simulate the thermochemical evolution of a composite material on a tool undergoing cure in an autoclave. In particular, we solve the governing coupled system of differential equations -- including conductive heat transfer and resin cure kinetics -- by optimizing the parameters of a deep neural network (DNN) using a physics-based loss function. To account for the vastly different behaviour of thermal conduction and resin cure, we design a PINN consisting of two disconnected subnetworks, and develop a sequential training algorithm that mitigates instability present in traditional training methods. Further, we incorporate explicit discontinuities into the DNN at the composite-tool interface and enforce known physical behaviour directly in the loss function to improve the solution near the interface. We train the PINN with a technique that automatically adapts the weights on the loss terms corresponding to PDE, boundary, interface, and initial conditions. Finally, we demonstrate that one can include problem parameters as an input to the model -- resulting in a surrogate that provides real-time simulation for a range of problem settings -- and that one can use transfer learning to significantly reduce the training time for problem settings similar to that of an initial trained model. The performance of the proposed PINN is demonstrated in multiple scenarios with different material thicknesses and thermal boundary conditions.

cs.LG↗

arXiv2021

Deep learning for solution and inversion of structural mechanics and vibrations

Deep learning has been the most popular machine learning method in the last few years. In this chapter, we present the application of deep learning and physics-informed neural networks concerning structural mechanics and vibration problems. Demonstration problems involve de-noising data, solution to time-dependent ordinary and partial differential equations, and characterizing the system's response for a given data.

cs.LG↗

arXiv2021

A holistic approach to computing first-arrival traveltimes using neural networks

Since the original algorithm by John Vidale in 1988 to numerically solve the isotropic eikonal equation, there has been tremendous progress on the topic addressing an array of challenges including improvement of the solution accuracy, incorporation of surface topography, adding more accurate physics by accounting for anisotropy/attenuation in the medium, and speeding up computations using multiple CPUs and GPUs. Despite these advances, there is no mechanism in these algorithms to carry on information gained by solving one problem to the next. Moreover, these approaches may breakdown for certain complex forms of the eikonal equation, requiring approximation methods to estimate the solution. Therefore, we seek an alternate approach to address the challenge in a holistic manner, i.e., a method that not only makes it simpler to incorporate topography, allow accounting for any level of complexity in physics, benefiting from computational speedup due to the availability of multiple CPUs or GPUs, but also able to transfer knowledge gained from solving one problem to the next. We develop an algorithm based on the emerging paradigm of physics-informed neural network to solve various forms of the eikonal equation. We show how transfer learning and surrogate modeling can be used to speed up computations by utilizing information gained from prior solutions. We also propose a two-stage optimization scheme to expedite the training process in presence of sharper heterogeneity in the velocity model. Furthermore, we demonstrate how the proposed approach makes it simpler to incorporate additional physics and other features in contrast to conventional methods that took years and often decades to make these advances. Such an approach not only makes the implementation of eikonal solvers much simpler but also puts us on a much faster path to progress.

physics.comp-ph↗

arXiv2021

PINNeik: Eikonal solution using physics-informed neural networks

The eikonal equation is utilized across a wide spectrum of science and engineering disciplines. In seismology, it regulates seismic wave traveltimes needed for applications like source localization, imaging, and inversion. Several numerical algorithms have been developed over the years to solve the eikonal equation. However, these methods require considerable modifications to incorporate additional physics, such as anisotropy, and may even breakdown for certain complex forms of the eikonal equation, requiring approximation methods. Moreover, they suffer from computational bottleneck when repeated computations are needed for perturbations in the velocity model and/or the source location, particularly in large 3D models. Here, we propose an algorithm to solve the eikonal equation based on the emerging paradigm of physics-informed neural networks (PINNs). By minimizing a loss function formed by imposing the eikonal equation, we train a neural network to output traveltimes that are consistent with the underlying partial differential equation. We observe sufficiently high traveltime accuracy for most applications of interest. We also demonstrate how the proposed algorithm harnesses machine learning techniques like transfer learning and surrogate modeling to speed up traveltime computations for updated velocity models and source locations. Furthermore, we use a locally adaptive activation function and adaptive weighting of the terms in the loss function to improve convergence rate and solution accuracy. We also show the flexibility of the method in incorporating medium anisotropy and free-surface topography compared to conventional methods that require significant algorithmic modifications. These properties of the proposed PINN eikonal solver are highly desirable in obtaining a flexible and efficient forward modeling engine for seismological applications.

physics.comp-ph↗

arXiv2021

PINNtomo: Seismic tomography using physics-informed neural networks

Seismic traveltime tomography using transmission data is widely used to image the Earth's interior from global to local scales. In seismic imaging, it is used to obtain velocity models for subsequent depth-migration or full-waveform inversion. In addition, cross-hole tomography has been successfully applied for a variety of applications, including mineral exploration, reservoir monitoring, and CO2 injection and sequestration. Conventional tomography techniques suffer from a number of limitations, including the use of a smoothing regularizer that is agnostic to the physics of wave propagation. Here, we propose a novel tomography method to address these challenges using developments in the field of scientific machine learning. Using seismic traveltimes observed at seismic stations covering part of the computational model, we train neural networks to approximate the traveltime factor and the velocity fields, subject to the physics-informed regularizer formed by the factored eikonal equation. This allows us to better compensate for the ill-posedness of the tomography problem compared to conventional methods and results in a number of other attractive features, including computational efficiency. We show the efficacy of the proposed method and its capabilities through synthetic tests for surface seismic and cross-hole geometries. Contrary to conventional techniques, we find the performance of the proposed method to be agnostic to the choice of the initial velocity model.

physics.comp-ph↗