arXiv subjects

Celia Reina

Publications and source records attributed to Celia Reina.

At least 19 recordsLinked to original sources

arXiv2026

Structure-preserving uncertainty quantification for GENERIC dynamics

Structure-preserving machine learning embeds physical structure directly into model architectures, yet uncertainty quantification (UQ) for such hard-constrained models remains limited because standard UQ methods may violate the encoded admissibility conditions, require architectural modifications, or impose substantial computational costs. In this work, we propose Structure-Preserving Epistemic Neural Networks (S-PENNs), a general framework for UQ in scientific machine learning models with hard architectural constraints, and instantiate it for GENERIC (General Equation for Non-Equilibrium Reversible-Irreversible Coupling) dynamics. S-PENNs preserve the structural constraints of a pretrained model by attaching lightweight epinets to its constrained components, ensuring that every sampled realization remains physically admissible by construction. When applied to GENERIC dynamics, such a proposed framework yields thermodynamically consistent rollouts that preserve the first and second laws. Furthermore, we combine S-PENNs with split conformal prediction as a post-hoc calibration method to produce prediction intervals with finite-sample marginal coverage guarantees. We validate S-PENNs on three numerical examples: a harmonic oscillator coupled to a heat bath and an idealized chemical motor, both governed by ODEs, and a one-dimensional viscoplastic model governed by PDEs. Across all three examples, S-PENNs produce thermodynamically consistent stochastic realizations and well-calibrated prediction intervals while reducing the computational cost by about one to three orders of magnitude compared to deep ensembles. Although the present study focuses on GENERIC dynamics, S-PENNs can be extended more broadly to scientific machine learning models in computational mechanics with either hard or soft constraints.

cs.LG↗

arXiv2026

Nonlinear GENERIC-Embedded Neural Networks (N-GENNs): Learning GENERIC dynamics with non-quadratic dissipation potentials

We introduce Nonlinear GENERIC-Embedded Neural Networks (N-GENNs), a deep learning framework for discovering evolution equations of systems governed by the nonlinear GENERIC formalism (General Equation for Non-Equilibrium Reversible-Irreversible Coupling). Such systems exhibit coupled conservative and dissipative dynamics, and can be described via the superposition of a Hamiltonian flow and a generalized gradient flow. In contrast to existing approaches, our formulation incorporates generalized gradient flows via convex dissipation potentials, enabling the identification of a broader class of thermodynamically consistent dynamics, including systems with non-quadratic dissipation potentials. Thermodynamic structure is strongly enforced by construction through suitable reparameterizations of both the reversible operator and the dissipation potential, ensuring exact compliance with the first and second laws of thermodynamics. We validate the proposed approach on three representative examples: a harmonic oscillator coupled to a heat bath, an idealized chemical motor, and a one-dimensional viscoplastic model of Perzyna type. These results demonstrate the method's ability to accurately infer thermodynamically consistent models from data for systems incorporating both conservative and nonlinear dissipative dynamics.

physics.comp-ph↗

arXiv2025

On a structure preserving closure of Langevin dynamics

Given a particle system obeying overdamped Langevin dynamics, we demonstrate that it is always possible to construct a thermodynamically consistent macroscopic model which obeys a gradient flow with respect to its non-equilibrium free energy. To do so, we significantly extend the recent Stochastic Thermodynamics with Internal Variables (STIV) framework, a method for producing macroscopic thermodynamic models far-from-equilibrium from the underlying mesoscopic dynamics and an approximate probability density of states parameterized with so-called internal variables. Though originally explored for Gaussian probability distributions, we here allow for an arbitrary choice of the approximate probability density while retaining a gradient flow dynamics. This greatly extends its range of applicability and automatically ensures consistency with the second law of thermodynamics, without the need for secondary verification. We demonstrate numerical convergence, in the limit of increasing internal variables, to the true probability density of states for both a multi-modal relaxation problem, a protein diffusing on a strand of DNA, and for an externally driven particle in a periodic landscape. Finally, we provide a reformulation of STIV with the quasi-equilibrium approximations in terms of the averages of observables of the mesostate, and show that these, too, obey a gradient flow.

cond-mat.stat-mech↗

arXiv2025

SPIEDiff: robust learning of long-time macroscopic dynamics from short-time particle simulations with quantified epistemic uncertainty

The data-driven discovery of long-time macroscopic dynamics and thermodynamics of dissipative systems with particle fidelity is hampered by significant obstacles. These include the strong time-scale limitations inherent to particle simulations, the non-uniqueness of the thermodynamic potentials and operators from given macroscopic dynamics, and the need for efficient uncertainty quantification. This paper introduces Statistical-Physics Informed Epistemic Diffusion Models (SPIEDiff), a machine learning framework designed to overcome these limitations in the context of purely dissipative systems by leveraging statistical physics, conditional diffusion models, and epinets. We evaluate the proposed framework on stochastic Arrhenius particle processes and demonstrate that SPIEDiff can accurately uncover both thermodynamics and kinetics, while enabling reliable long-time macroscopic predictions using only short-time particle simulation data. SPIEDiff can deliver accurate predictions with quantified uncertainty in minutes, drastically reducing the computational demand compared to direct particle simulations, which would take days or years in the examples considered. Overall, SPIEDiff offers a robust and trustworthy pathway for the data-driven discovery of thermodynamic models.

cs.LG↗

arXiv2025

Integrated Experiment and Simulation Co-Design: A Key Infrastructure for Predictive Mesoscale Materials Modeling

The design of structural & functional materials for specialized applications is being fueled by rapid advancements in materials synthesis, characterization, manufacturing, with sophisticated computational materials modeling frameworks that span a wide spectrum of length & time scales in the mesoscale between atomistic & continuum approaches. This is leading towards a systems-based design methodology that will replace traditional empirical approaches, embracing the principles of the Materials Genome Initiative. However, several gaps remain in this framework as it relates to advanced structural materials:(1) limited availability & access to high-fidelity experimental & computational datasets, (2) lack of co-design of experiments & simulation aimed at computational model validation,(3) lack of on-demand access to verified and validated codes for simulation and for experimental analyses, & (4) limited opportunities for workforce training and educational outreach. These shortcomings stifle major innovations in structural materials design. This paper describes plans for a community-driven research initiative that addresses current gaps based on best-practice recommendations of leaders in mesoscale modeling, experimentation & cyberinfrastructure obtained at an NSF-sponsored workshop dedicated to this topic. The proposal is to create a hub for Mesoscale Experimentation and Simulation co-Operation (hMESO)-that will (I) provide curation and sharing of models, data, & codes, (II) foster co-design of experiments for model validation with systematic uncertainty quantification, & (III) provide a platform for education & workforce development. It will engage experimental & computational experts in mesoscale mechanics and plasticity, along with mathematicians and computer scientists with expertise in algorithms, data science, machine learning, & large-scale cyberinfrastructure initiatives.

cond-mat.mtrl-sci↗

arXiv2025

EVODMs: variational learning of PDEs for stochastic systems via diffusion models with quantified epistemic uncertainty

We present Epistemic Variational Onsager Diffusion Models (EVODMs), a machine learning framework that integrates Onsager's variational principle with diffusion models to enable thermodynamically consistent learning of free energy and dissipation potentials (and associated evolution equations) from noisy, stochastic data in a robust manner. By further combining the model with Epinets, EVODMs quantify epistemic uncertainty with minimal computational cost. The framework is validated through two examples: (1) the phase transformation of a coiled-coil protein, modeled via a stochastic partial differential equation, and (2) a lattice particle process (the symmetric simple exclusion process) modeled via Kinetic Monte Carlo simulations. In both examples, we aim to discover the thermodynamic potentials that govern their dynamics in the deterministic continuum limit. EVODMs demonstrate a superior accuracy in recovering free energy and dissipation potentials from noisy data, as compared to traditional machine learning frameworks. Meanwhile, the epistemic uncertainty is quantified efficiently via Epinets and knowledge distillation. This work highlights EVODMs' potential for advancing data-driven modeling of non-equilibrium phenomena and uncertainty quantification for stochastic systems.

physics.comp-ph↗

arXiv2025

Bridging statistical mechanics and thermodynamics away from equilibrium: a data-driven approach for learning internal variables and their dynamics

Thermodynamics with internal variables is a common approach in continuum mechanics to model inelastic (i.e., non-equilibrium) material behavior. While this approach is computationally and theoretically attractive, it currently lacks a well-established statistical mechanics foundation. As a result, internal variables are typically chosen phenomenologically and lack a direct link to the underlying physics which hinders the predictability of the theory. To address these challenges, we propose a machine learning approach that is consistent with the principles of statistical mechanics and thermodynamics. The proposed approach leverages the following techniques (i) the information bottleneck (IB) method to ensure that the learned internal variables are functions of the microstates and are capable of capturing the salient feature of the microscopic distribution; (ii) conditional normalizing flows to represent arbitrary probability distributions of the microscopic states as functions of the state variables; and (iii) Variational Onsager Neural Networks (VONNs) to guarantee thermodynamic consistency and Markovianity of the learned evolution equations. The resulting framework, called IB-VONNs, is tested on two problems of colloidal systems, governed at the microscale by overdamped Langevin dynamics. The first one is a prototypical model for a colloidal particle in an optical trap, which can be solved analytically, and thus ideal to verify the framework. The second problem is a one-dimensional phase-transforming system, whose macroscopic description still lacks a statistical mechanics foundation under general conditions. The results in both cases indicate that the proposed machine learning strategy can indeed bridge statistical mechanics and thermodynamics with internal variables away from equilibrium.

cond-mat.stat-mech↗

arXiv2024

A statistical mechanics derivation and implementation of non-conservative phase field models for front propagation in elastic media

Over the past several decades, phase field modeling has been established as a standard simulation technique for mesoscopic science, allowing for seamless boundary tracking of moving interfaces and relatively easy coupling to other physical phenomena. However, despite its widespread success, phase field modeling remains largely driven by phenomenological justifications except in a handful of instances. In this work, we leverage a recently developed statistical mechanics framework for non-equilibrium phenomena, called Stochastic Thermodynamics with Internal Variables (STIV), to provide the first derivation of a phase field model for front propagation in a one dimensional elastic medium without appeal to phenomenology or fitting to experiments or simulation data. In the resulting model, the variables obey a gradient flow with respect to a non-equilibrium free energy, although notably, the dynamics of the strain and phase variables are coupled, and while the free energy functional is non-local in the phase field variable, it deviates from the traditional Landau-Ginzburg form. Moreover, in the systems analyzed here, the model accurately captures stress induced nucleation of transition fronts without the need to incorporate additional physics. We find that the STIV phase field model compares favorably to Langevin simulations of the microscopic system and we provide two numerical implementations enabling one to simulate arbitrary interatomic potentials.

cond-mat.stat-mech↗

arXiv2023

Statistical-Physics-Informed Neural Networks (Stat-PINNs): A Machine Learning Strategy for Coarse-graining Dissipative Dynamics

Machine learning, with its remarkable ability for retrieving information and identifying patterns from data, has emerged as a powerful tool for discovering governing equations. It has been increasingly informed by physics, and more recently by thermodynamics, to further uncover the thermodynamic structure underlying the evolution equations, i.e., the thermodynamic potentials driving the system and the operators governing the kinetics. However, despite its great success, the inverse problem of thermodynamic model discovery from macroscopic data is in many cases non-unique, meaning that multiple pairs of potentials and operators can give rise to the same macroscopic dynamics, which significantly hinders the physical interpretability of the learned models. In this work, we propose a machine learning framework, named as Statistical-Physics-Informed Neural Networks (Stat-PINNs), which further encodes knowledge from statistical mechanics and resolves this non-uniqueness issue for the first time. The framework is here developed for purely dissipative isothermal systems. It only uses data from short-time particle simulations to learn the thermodynamic structure, which can be used to predict long-time macroscopic evolutions. We demonstrate the approach for particle systems with Arrhenius-type interactions, common to a wide range of phenomena, such as defect diffusion in solids, surface absorption and chemical reactions. Stat-PINNs can successfully recover the known analytic solution for the case with long-range interaction and discover the hitherto unknown potential and operator governing the short-range interaction cases. We compare our results with an analogous approach that solely excludes statistical mechanics, and observe that, in addition to recovering the unique thermodynamic structure, statistical mechanics relations can increase the robustness and predictability of the learning strategy.

cond-mat.stat-mech↗

arXiv2023

A statistical mechanics framework for constructing non-equilibrium thermodynamic models

Far-from-equilibrium phenomena are critical to all natural and engineered systems, and essential to biological processes responsible for life. For over a century and a half, since Carnot, Clausius, Maxwell, Boltzmann, and Gibbs, among many others, laid the foundation for our understanding of equilibrium processes, scientists and engineers have dreamed of an analogous treatment of non-equilibrium systems. But despite tremendous efforts, a universal theory of non-equilibrium behavior akin to equilibrium statistical mechanics and thermodynamics has evaded description. Several methodologies have proved their ability to accurately describe complex non-equilibrium systems at the macroscopic scale, but their accuracy and predictive capacity is predicated on either phenomenological kinetic equations fit to microscopic data, or on running concurrent simulations at the particle level. Instead, we provide a framework for deriving stand-alone macroscopic thermodynamics models directly from microscopic physics without fitting in overdamped Langevin systems. The only necessary ingredient is a functional form for a parameterized, approximate density of states, in analogy to the assumption of a uniform density of states in the equilibrium microcanonical ensemble. We highlight this framework's effectiveness by deriving analytical approximations for evolving mechanical and thermodynamic quantities in a model of coiled-coil proteins and double stranded DNA, thus producing, to the authors' knowledge, the first derivation of the governing equations for a phase propagating system under general loading conditions without appeal to phenomenology. The generality of our treatment allows for application to any system described by Langevin dynamics with arbitrary interaction energies and external driving, including colloidal macromolecules, hydrogels, and biopolymers.

cond-mat.stat-mech↗

arXiv2021

Variational Onsager Neural Networks (VONNs): A thermodynamics-based variational learning strategy for non-equilibrium PDEs

We propose a thermodynamics-based learning strategy for non-equilibrium evolution equations based on Onsager's variational principle, which allows to write such PDEs in terms of two potentials: the free energy and the dissipation potential. Specifically, these two potentials are learned from spatio-temporal measurements of macroscopic observables via proposed neural network architectures that strongly enforce the satisfaction of the second law of thermodynamics. The method is applied to three distinct physical processes aimed at highlighting the robustness and versatility of the proposed approach. These include (i) the phase transformation of a coiled-coil protein, characterized by a non-convex free-energy density; (ii) the one-dimensional dynamic response of a three-dimensional viscoelastic solid, which leverages the variational formulation as a tool for obtaining reduced order models; and (iii) linear and nonlinear diffusion models, characterized by a lack of uniqueness of the free energy and dissipation potentials. These illustrative examples showcase the possibility of learning partial differential equations through their variational action density (i.e., a function instead), by leveraging the thermodynamic structure intrinsic to mechanical and multiphysics problems.

math-ph↗

arXiv2021

Second-order fast-slow dynamics of non-ergodic Hamiltonian systems: Thermodynamic interpretation and simulation

A class of fast-slow Hamiltonian systems with potential $U_\varepsilon$ describing the interaction of non-ergodic fast and slow degrees of freedom is studied. The parameter $\varepsilon$ indicates the typical timescale ratio of the fast and slow degrees of freedom. It is known that the Hamiltonian system converges for $\varepsilon\to0$ to a homogenised Hamiltonian system. We study the situation where $\varepsilon$ is small but positive. First, we rigorously derive the second-order corrections to the homogenised (slow) degrees of freedom. They can be decomposed into explicitly given terms that oscillate rapidly around zero and terms that trace the average motion of the corrections, which are given as the solution to an inhomogeneous linear system of differential equations. Then, we analyse the energy of the fast degrees of freedom expanded to second-order from a thermodynamic point of view. In particular, we define and expand to second-order a temperature, an entropy and external forces and show that they satisfy to leading-order, as well as on average to second-order, thermodynamic energy relations akin to the first and second law of thermodynamics. Finally, we analyse for a specific fast-slow Hamiltonian system the second-order asymptotic expansion of the slow degrees of freedom from a numerical point of view. Their approximation quality for short and long time frames and their total computation time are compared with those of the solution to the original fast-slow Hamiltonian system of similar accuracy.

math-ph↗

arXiv2021

Predicting the unobserved: a statistical mechanics framework for non-equilibrium material response with quantified uncertainty

Can far-from-equilibrium material response under arbitrary loading be inferred from equilibrium data and vice versa? Can the effect of element transmutation on mechanical behavior be predicted? Remarkably, such extrapolations are possible in principle for systems governed by stochastic differential equations, thanks to a set of exact relations between probability densities for trajectories derived from the path integral formalism [1, 2, 3]. In this article, we systematically investigate inferences (in the form of ensemble-averages) drawn on system/process S based on stochastic trajectory data of system/process S~, with quantified uncertainty, to directly address the aforementioned questions. Interestingly, such inferences and their associated uncertainty do not require any simulations or experiments of S. The results are exemplified over two illustrative examples by means of numerical simulations: a one-dimensional system as a prototype for polymers and biological macromolecules, and a two-dimensional glassy system. In principle, the approach can be pushed to the extreme case where S~ is simply comprised of Brownian trajectories, i.e., equilibrium non-interacting particles, and S is a complex interacting system driven far from equilibrium. In practice, however, the "further" S~ is from S, the greater the uncertainty in the predictions, for a fixed number of realizations of system S~.

cond-mat.stat-mech↗

arXiv2018

How to find the evolution operator of dissipative PDEs from particle fluctuations?

Dissipative processes abound in most areas of sciences and can often be abstractly written as $\partial_t z = K(z) δS(z)/δz$, which is a gradient flow of the entropy $S$. Although various techniques have been developed to compute the entropy, the calculation of the operator $K$ from underlying particle models is a major long-standing challenge. Here, we show that discretizations of diffusion operators $K$ can be numerically computed from particle fluctuations via an infinite-dimensional fluctuation-dissipation relation, provided the particles are in local equilibrium with Gaussian fluctuations. A salient feature of the method is that $K$ can be fully pre-computed, enabling macroscopic simulations of arbitrary admissible initial data, without any need of further particle simulations. We test this coarse-graining procedure for a zero-range process in one space dimension and obtain an excellent agreement with the analytical solution for the macroscopic density evolution. This example serves as a blueprint for a new multiscale paradigm, where full dissipative evolution equations --- and not only parameters --- can be numerically computed from particles.

math-ph↗

arXiv2018

Computing diffusivities from particle models out of equilibrium

A new method is proposed to numerically extract the diffusivity of a (typically nonlinear) diffusion equation from underlying stochastic particle systems. The proposed strategy requires the system to be in local equilibrium and have Gaussian fluctuations but is otherwise allowed to undergo arbitrary out of equilibrium evolutions. This could be potentially relevant for particle data obtained from experimental applications. The key idea underlying the method is that finite, yet large, particle systems formally obey stochastic partial differential equations of gradient flow type satisfying a fluctuation-dissipation relation. The strategy is here applied to three classic particle models, namely independent random walkers, a zero range process and a symmetric simple exclusion process in one space dimension, to allow the comparison with analytic solutions.

cond-mat.stat-mech↗

arXiv2015

Entropy production and the geometry of dissipative evolution equations

Purely dissipative evolution equations are often cast as gradient flow structures, $\dot{\mathbf{z}}=K(\mathbf{z})DS(\mathbf{z})$, where the variable $\mathbf{z}$ of interest evolves towards the maximum of a functional $S$ according to a metric defined by an operator $K$. While the functional often follows immediately from physical considerations (e.g., the thermodynamic entropy), the operator $K$ and the associated geometry does not necessarily so (e.g., Wasserstein geometry for diffusion). In this paper, we present a variational statement in the sense of maximum entropy production that directly delivers a relationship between the operator $K$ and the constraints of the system. In particular, the Wasserstein metric naturally arises here from the conservation of mass or energy, and depends on the Onsager resistivity tensor, which, itself, may be understood as another metric, as in the Steepest Entropy Ascent formalism. This new variational principle is exemplified here for the simultaneous evolution of conserved and non-conserved quantities in open systems. It thus extends the classical Onsager flux-force relationships and the associated variational statement to variables that do not have a flux associated to them. We further show that the metric structure $K$ is intimately linked to the celebrated Freidlin-Wentzell theory of stochastically perturbed gradient flows, and that the proposed variational principle encloses an infinite-dimensional fluctuation-dissipation statement.

math-ph↗

arXiv2015

Computational homogenization of heterogeneous media under dynamic loading

A variational coarse-graining framework for heterogeneous media is developed that allows for a seamless transition from the traditional static scenario to a arbitrary loading conditions, including inertia effects and body forces. The strategy is formulated in the spirit of computational homogenization methods (FE$^2$) and is based on the discrete version of Hill's averaging results recently derived by the authors. In particular, the traditional static multiscale scheme is proved here to be equivalent to a direct homogenization of the principle of minimum potential energy and to hold exactly under a finite element discretization. This perspective provides a unifying variational framework for the FE$^2$ method, in the static setting, with Dirichlet or Neumann boundary conditions on the representative volume element; and it directly manifests the approximate duality of the effective strain energy density obtained with these two types of boundary conditions in the sense of Legendre transformation. Its generalization to arbitrary loading conditions and material constitutive relations is then immediate through the incremental minimum formulation of the dynamic problem à la Radovitzky and Ortiz (1999), which, in the discrete setting, is in full analogy to the static problem. These theoretical developments are then translated into an efficient multiscale FE$^2$ computational strategy for the homogenization of a microscopic explicit dynamics scheme, with two noteworthy properties. Firstly, each time incremental problem can be solved exactly with a single Newton-Raphson iteration with a constant Hessian, regardless of the specific non-linearities or history-dependence of the micro-constituents' behavior. Secondly, the scheme concurrently solves for the microscopic and macroscopic degrees of freedom, in contrast to standard approaches based on sequential or nested minimizations.

cond-mat.mtrl-sci↗

arXiv2015

Discrete averaging relations for micro to macro transition

The well-known Hill's averaging theorems for stresses and strains as well as the so-called Hill-Mandel principle of macrohomogeneity are essential ingredients for the coupling and the consistency between the micro and macro scales in multiscale finite element procedures (FE$^2$). We show in this paper that these averaging relations hold exactly under standard finite element discretizations, even if the stress field is discontinuous across elements and the standard proofs based on the divergence theorem are no longer suitable. The discrete averaging results are derived for the three classical types of boundary conditions (affine displacement, periodic and uniform traction boundary conditions) using the properties of the shape functions and the weak form of the microscopic equilibrium equations. The analytical proofs are further verified numerically through a simple finite element simulation of an irregular representative volume element undergoing large deformations. Furthermore, the proofs are extended to include the effects of body forces and inertia, and the results are consistent with those in the smooth continuum setting. This work provides a solid foundation to apply Hill's averaging relations in multiscale finite element methods without introducing an additional error in the scale transition due to the discretization.

cond-mat.mtrl-sci↗