arXiv subjects

Reese E. Jones

Publications and source records attributed to Reese E. Jones.

At least 19 recordsLinked to original sources

arXiv2026

A hierarchy of thermodynamics learning frameworks for inelastic constitutive modeling

Recent advances in physics-augmented neural networks have enabled thermodynamically consistent data-driven constitutive modeling of complex inelastic materials. Most existing approaches, however, implicitly adopt a specific thermodynamic framework and embed structural assumptions such as normality, dual dissipation potentials, or other structure from manually constructed models directly into the learning architecture. Consequently, differences in predictive performance may arise not only from data or network design, but also from the underlying theoretical assumptions. In this work, we present a unified comparison of several thermodynamically consistent inelastic modeling frameworks from a machine learning perspective. We consider internal-variable formulations with dissipation potential, generalized standard materials, and metriplectic structures, and we analyze their structural assumptions, admissible dependencies, convexity requirements, and implications for dissipation and evolution. Each framework is implemented within a common neural potential architecture based on invariant representations and neural ordinary differential equations. This unified setting ensures that performance differences can be attributed to thermodynamic structure rather than architectural variation. The models are trained and evaluated on three representative inelastic datasets generated from high-fidelity representative volume element simulations: an elastoplastic alloy, a viscoelastic composite, and a rate-dependent crystal plasticity polycrystal. By isolating the role of thermodynamic structure, we assess how restrictions such as duality, normality, operator-based evolution, and convexity influence learnability, expressiveness, stability, and generalization.

cond-mat.mtrl-sci↗

arXiv2026

Interval and fuzzy physics-augmented neural networks (iPANN and fPANN) for uncertainty quantification and propagation in constitutive modeling

Constitutive modeling under uncertainty remains a central challenge for reliable mechanics simulations, particularly when the available stress-deformation data are sparse, noisy, or heterogeneous. We propose interval and fuzzy physics-augmented neural networks (iPANNs and fPANNs) for uncertainty-aware hyperelastic constitutive modeling. iPANNs learn sparse lower, mean, and upper free energy density branches whose stresses, obtained by automatic differentiation, ultimately enclose noisy stress observations. In contrast to this deterministic interval description, fPANNs embed the learned iPANN branches into a fuzzy-set representation through alpha-cut interpolation, yielding a nested family of admissible responses. iPANNs and fPANNs encode mechanistic constraints - preserving objectivity, consistency and promoting polyconvexity - and smoothed L0 regularization promotes interpretable energy representations. The bound models are trained through a two-stage transfer-learning procedure in which a sparse mean constitutive response is learned first and then fine-tuned into lower and upper energy branches. We evaluate the framework on synthetic isotropic hyperelastic data with heteroscedastic noise, varying random realizations, shifted noise means, and varying noise magnitudes. The results show that the learned bounds enclose noisy stress observations while generalizing to the test set. Further, we examine the propagation of uncertainty through the mean, upper and lower bound predictions of the learned iPANN models in a finite element setting. The proposed framework provides a compact, physics-consistent route for distribution-free aleatoric uncertainty quantification in hyperelastic constitutive modeling, and propagation in downstream finite element simulations.

cs.LG↗

arXiv2026

Multiscale topology optimization of compressible and nearly incompressible anisotropic hyperelastic structures using physics-augmented neural networks

Multiscale topology optimization (TO) of hyperelastic materials remains computationally prohibitive due to the repeated solution of microscale boundary value problems. In this work, we present a concurrent multiscale topology optimization framework that overcomes this limitation by leveraging physics-augmented neural networks (PANNs) as surrogate constitutive models. The proposed approach enables the simultaneous optimization of macroscale material distribution and microscale descriptors, within a unified nonlinear finite strain setting. The surrogate models are constructed using input-specific neural networks (ISNNs) that enforce key physical principles directly within the architecture, including convexity and material symmetry through invariant-based representations and structural tensors. This ensures thermodynamic consistency and numerical stability while accurately representing homogenized anisotropic hyperelastic responses. The trained PANNs replace the microscale boundary value problem and provide efficient evaluations of stresses and consistent tangent moduli using analytical first and second derivatives of the neural network, enabling tractable large-scale multiscale optimization. The framework is demonstrated on representative microstructures exhibiting transversely isotropic, cubic anisotropic, and nearly incompressible isotropic behavior. The results show that the proposed method captures complex multiscale interactions and enables physically meaningful spatial tailoring of material properties, while significantly reducing computational cost compared to classical FE$^2$ approaches. These findings establish PANNs as a powerful tool for high-fidelity multiscale topology optimization of nonlinear anisotropic materials.

cs.CE↗

arXiv2025

GenUQ: Predictive Uncertainty Estimates via Generative Hyper-Networks

Operator learning is a recently developed generalization of regression to mappings between functions. It promises to drastically reduce expensive numerical integration of PDEs to fast evaluations of mappings between functional states of a system, i.e., surrogate and reduced-order modeling. Operator learning has already found applications in several areas such as modeling sea ice, combustion, and atmospheric physics. Recent approaches towards integrating uncertainty quantification into the operator models have relied on likelihood based methods to infer parameter distributions from noisy data. However, stochastic operators may yield actions from which a likelihood is difficult or impossible to construct. In this paper, we introduce, GenUQ, a measure-theoretic approach to UQ that avoids constructing a likelihood by introducing a generative hyper-network model that produces parameter distributions consistent with observed data. We demonstrate that GenUQ outperforms other UQ methods in three example problems, recovering a manufactured operator, learning the solution operator to a stochastic elliptic PDE, and modeling the failure location of porous steel under tension.

cs.LG↗

arXiv2025

A physics-augmented neural network framework for modeling and detecting thermo-visco-plastic behavior

Although considerable attention has been devoted to the development of models for isothermal, rate-independent plasticity, many high-consequence performance assessments involve viscoplastic processes that generate substantial heat. In addition, materials may transit from a nearly isothermal, rate-independent regime to a viscous, temperature-dependent regime during these processes, which makes modeling more challenging. In this work, we develop a physics-augmented neural network (PANN) framework for modeling general temperature-dependent, rate-dependent inelastic processes firmly based on physical principles, including the second law of thermodynamics and coordinate equivariance. These embedded properties are enabled by a number of architectural innovations in the structure and training of an input convex and potential-based neural ordinary differential equation framework. The resulting neural network models are capable of representing a wide spectrum of rate- and temperature-dependence ranging from isothermal, rate-independent elastic-plastic phenomenology to rate-dependent fully viscous inelastic behavior, as we demonstrate. We also show that the framework is capable of modeling complex microstructural inelasticity and predicting the conversion of plastic work to heating when calibrated to stress-temperature observations.

cond-mat.mtrl-sci↗

arXiv2025

Thermodynamically Consistent Hybrid and Permutation-Invariant Neural Yield Functions for Anisotropic Plasticity

Plastic anisotropy in metals remains challenging to model. This is partly because conventional phenomenological yield criteria struggle to combine a highly descriptive, flexible representation with constraints, such as convexity, dictated by thermodynamic consistency. To address this gap, we employ architecturally-constrained neural networks and develop two data-driven frameworks: (i) a hybrid model that augments the Hill yield criterion with an Input Convex Neural Network (ICNN) to get an anisotropic yield function representation in the six-dimensional stress space and (ii) a permutation-invariant input convex neural network (PI-ICNN) that learns an isotropic yield function representation in the principal stress space and embeds anisotropy through linear stress transformations. We calibrate the proposed frameworks on a sparse Al-7079 extrusion experimental dataset comprising 12 uniaxial samples with measured yield stresses and Lankford ratios. To test the robustness of each framework, nine datasets were generated using k-fold cross-validation. These datasets were then used to quantitatively compare Hill-48, Yld2004-18p, pure ICNNs, the hybrid approach, and the PI-ICNN frameworks. While ICNNs and hybrid approaches can almost perfectly fit the training data, they exhibit significant over-fitting, resulting in high validation and test losses. In contrast, both PI-ICNN frameworks demonstrate better generalization capabilities, even outperforming Yld2004-18p on the validation and test data. These results demonstrate that PI-ICNNs unify physics-based constraints with the flexibility of neural networks, enabling the accurate prediction of both yield loci and Lankford ratios from minimal data. The approach opens a path toward rapid, thermodynamically consistent constitutive models for advanced forming simulations and future exploration of coupled hardening or microstructure-informed design.

cs.CE↗

arXiv2025

A General, Automated Method for Building Structural Tensors of Arbitrary Order for Anisotropic Function Representations

We present a general, constructive procedure to find the basis for tensors of arbitrary order subject to linear constraints by transforming the problem to that of finding the nullspace of a linear operator. The proposed method utilizes standard numerical linear algebra techniques that are highly optimized and well-behaved. Our primary applications are in mechanics where modulus tensors and so-called structure tensors can be used to characterize anisotropy of functional dependencies on other inputs such as strain. Like modulus tensors, structure tensors are defined by their invariance to transformations by symmetry group generators but have more general applicability. The fully automated method is an alternative to classical, more intuition-reliant methods such as the Pipkin-Rivlin polynomial integrity basis construction. We demonstrate the utility of the procedure by: (a) enumerating elastic modulus tensors for common symmetries, and (b) finding the lowest-order structure tensors that can represent all common point groups/crystal classes. Furthermore, we employ these results in two calibration problems using neural network models following classical function representation theory: (a) learning the symmetry class and orientation of a hyperelastic material given stress-strain data, and (b) representing strain-dependent anisotropy of the stress response of a soft matrix-stiff fiber composite in a sequence of uniaxial loadings. These two examples demonstrate the utility of the method in model selection and calibration by: (a) determining structural tensors of a selected order across multiple symmetry groups, and (b) determining a basis for a given group that allows the characterization of all subgroups. Using a common order in both cases allows sparse regression to operate on a common function representation to select the best-fit symmetry group for the data.

math-ph↗

arXiv2025

Physics Augmented Machine Learning Discovery of Composition-Dependent Constitutive Laws for 3D Printed Digital Materials

Multi-material 3D printing, particularly through polymer jetting, enables the fabrication of digital materials by mixing distinct photopolymers at the micron scale within a single build to create a composite with tunable mechanical properties. This work presents an integrated experimental and computational investigation into the composition-dependent mechanical behavior of 3D printed digital materials. We experimentally characterize five formulations, combining soft and rigid UV-cured polymers under uniaxial tension and torsion across three strain and twist rates. The results reveal nonlinear and rate-dependent responses that strongly depend on composition. To model this behavior, we develop a physics-augmented neural network (PANN) that combines a partially input convex neural network (pICNN) for learning the composition-dependent hyperelastic strain energy function with a quasi-linear viscoelastic (QLV) formulation for time-dependent response. The pICNN ensures convexity with respect to strain invariants while allowing non-convex dependence on composition. To enhance interpretability, we apply $L_0$ sparsification. For the time-dependent response, we introduce a multilayer perceptron (MLP) to predict viscoelastic relaxation parameters from composition. The proposed model accurately captures the nonlinear, rate-dependent behavior of 3D printed digital materials in both uniaxial tension and torsion, achieving high predictive accuracy for interpolated material compositions. This approach provides a scalable framework for automated, composition-aware constitutive model discovery for multi-material 3D printing.

cs.LG↗

arXiv2025

Differentiable neural network representation of multi-well, locally-convex potentials

Multi-well potentials are ubiquitous in science, modeling phenomena such as phase transitions, dynamic instabilities, and multimodal behavior across physics, chemistry, and biology. In contrast to non-smooth minimum-of-mixture representations, we propose a differentiable and convex formulation based on a log-sum-exponential (LSE) mixture of input convex neural network (ICNN) modes. This log-sum-exponential input convex neural network (LSE-ICNN) provides a smooth surrogate that retains convexity within basins and allows for gradient-based learning and inference. A key feature of the LSE-ICNN is its ability to automatically discover both the number of modes and the scale of transitions through sparse regression, enabling adaptive and parsimonious modeling. We demonstrate the versatility of the LSE-ICNN across diverse domains, including mechanochemical phase transformations, microstructural elastic instabilities, conservative biological gene circuits, and variational inference for multimodal probability distributions. These examples highlight the effectiveness of the LSE-ICNN in capturing complex multimodal landscapes while preserving differentiability, making it broadly applicable in data-driven modeling, optimization, and physical simulation.

stat.ML↗

arXiv2025

Uncertainty quantification of neural network models of evolving processes via Langevin sampling

We propose a scalable, approximate inference hypernetwork framework for a general model of history-dependent processes. The flexible data model is based on a neural ordinary differential equation (NODE) representing the evolution of internal states together with a trainable observation model subcomponent. The posterior distribution corresponding to the data model parameters (weights and biases) follows a stochastic differential equation with a drift term related to the score of the posterior that is learned jointly with the data model parameters. This Langevin sampling approach offers flexibility in balancing the computational budget between the evaluation cost of the data model and the approximation of the posterior density of its parameters. We demonstrate performance of the ensemble sampling hypernetwork on chemical reaction and material physics data and compare it to standard variational inference.

cs.LG↗

arXiv2025

A Direct-adjoint Approach for Material Point Model Calibration with Application to Plasticity

This paper proposes a new approach for the calibration of material parameters in local elastoplastic constitutive models. The calibration is posed as a constrained optimization problem, where the constitutive model evolution equations for a single material point serve as constraints. The objective function quantifies the mismatch between the stress predicted by the model and corresponding experimental measurements. To improve calibration efficiency, a novel direct-adjoint approach is presented to compute the Hessian of the objective function, which enables the use of second-order optimization algorithms. Automatic differentiation is used for gradient and Hessian computations. Two numerical examples are employed to validate the Hessian matrices and to demonstrate that the Newton-Raphson algorithm consistently outperforms gradient-based algorithms such as L-BFGS-B.

cs.CE↗

arXiv2025

Input Specific Neural Networks

The black-box nature of neural networks limits the ability to encode or impose specific structural relationships between inputs and outputs. While various studies have introduced architectures that ensure the network's output adheres to a particular form in relation to certain inputs, the majority of these approaches impose constraints on only a single set of inputs. This paper introduces a novel neural network architecture, termed the Input Specific Neural Network (ISNN), which extends this concept by allowing scalar-valued outputs to be subject to multiple constraints. Specifically, the ISNN can enforce convexity in some inputs, non-decreasing monotonicity combined with convexity with respect to others, and simple non-decreasing monotonicity or arbitrary relationships with additional inputs. The paper presents two distinct ISNN architectures, along with equations for the first and second derivatives of the output with respect to the inputs. These networks are broadly applicable. In this work, we restrict their usage to solving problems in computational mechanics. In particular, we show how they can be effectively applied to fitting data-driven constitutive models. We then embed our trained data-driven constitutive laws into a finite element solver where significant time savings can be achieved by using explicit manual differentiation using the derived equations as opposed to automatic differentiation. We also show how ISNNs can be used to learn structural relationships between inputs and outputs via a binary gating mechanism. Particularly, ISNNs are employed to model an anisotropic free energy potential to get the homogenized macroscopic response in a decoupled multiscale setting, where the network learns whether or not the potential should be modeled as polyconvex, and retains only the relevant layers while using the minimum number of inputs.

cs.LG↗

arXiv2025

An attention-based neural ordinary differential equation framework for modeling inelastic processes

To preserve strictly conservative behavior as well as model the variety of dissipative behavior displayed by solid materials, we propose a significant enhancement to the internal state variable-neural ordinary differential equation (ISV-NODE) framework. In this data-driven, physics-constrained modeling framework internal states are inferred rather than prescribed. The ISV-NODE consists of: (a) a stress model dependent, on observable deformation and inferred internal state, and (b) a model of the evolution of the internal states. The enhancements to ISV-NODE proposed in this work are multifold: (a) a partially input convex neural network stress potential provides polyconvexity in terms of observed strain and inferred state, and (b) an internal state flow model uses common latent features to inform novel attention-based gating and drives the flow of internal state only in dissipative regimes. We demonstrated that this architecture can accurately model dissipative and conservative behavior across an isotropic, isothermal elastic-viscoelastic-elastoplastic spectrum with three exemplars.

cond-mat.mtrl-sci↗

arXiv2024

Condensed Stein Variational Gradient Descent for Uncertainty Quantification of Neural Networks

We propose a Stein variational gradient descent method to concurrently sparsify, train, and provide uncertainty quantification of a complexly parameterized model such as a neural network. It employs a graph reconciliation and condensation process to reduce complexity and increase similarity in the Stein ensemble of parameterizations. Therefore, the proposed condensed Stein variational gradient (cSVGD) method provides uncertainty quantification on parameters, not just outputs. Furthermore, the parameter reduction speeds up the convergence of the Stein gradient descent as it reduces the combinatorial complexity by aligning and differentiating the sensitivity to parameters. These properties are demonstrated with an illustrative example and an application to a representation problem in solid mechanics.

cs.LG↗

arXiv2024

Improving the performance of Stein variational inference through extreme sparsification of physically-constrained neural network models

Most scientific machine learning (SciML) applications of neural networks involve hundreds to thousands of parameters, and hence, uncertainty quantification for such models is plagued by the curse of dimensionality. Using physical applications, we show that $L_0$ sparsification prior to Stein variational gradient descent ($L_0$+SVGD) is a more robust and efficient means of uncertainty quantification, in terms of computational cost and performance than the direct application of SGVD or projected SGVD methods. Specifically, $L_0$+SVGD demonstrates superior resilience to noise, the ability to perform well in extrapolated regions, and a faster convergence rate to an optimal solution.

cs.LG↗

arXiv2024

Multiscale simulation of spatially correlated microstructure via a latent space representation

When deformation gradients act on the scale of the microstructure of a part due to geometry and loading, spatial correlations and finite-size effects in simulation cells cannot be neglected. We propose a multiscale method that accounts for these effects using a variational autoencoder to encode the structure-property map of the stochastic volume elements making up the statistical description of the part. In this paradigm the autoencoder can be used to directly encode the microstructure or, alternatively, its latent space can be sampled to provide likely realizations. We demonstrate the method on three examples using the common additively manufactured material AlSi10Mg in: (a) a comparison with direct numerical simulation of the part microstructure, (b) a push forward of microstructural uncertainty to performance quantities of interest, and (c) a simulation of functional gradation of a part with stochastic microstructure.

cond-mat.mtrl-sci↗

arXiv2024

Polyconvex neural network models of thermoelasticity

Machine-learning function representations such as neural networks have proven to be excellent constructs for constitutive modeling due to their flexibility to represent highly nonlinear data and their ability to incorporate constitutive constraints, which also allows them to generalize well to unseen data. In this work, we extend a polyconvex hyperelastic neural network framework to thermo-hyperelasticity by specifying the thermodynamic and material theoretic requirements for an expansion of the Helmholtz free energy expressed in terms of deformation invariants and temperature. Different formulations which a priori ensure polyconvexity with respect to deformation and concavity with respect to temperature are proposed and discussed. The physics-augmented neural networks are furthermore calibrated with a recently proposed sparsification algorithm that not only aims to fit the training data but also penalizes the number of active parameters, which prevents overfitting in the low data regime and promotes generalization. The performance of the proposed framework is demonstrated on synthetic data, which illustrate the expected thermomechanical phenomena, and existing temperature-dependent uniaxial tension and tension-torsion experimental datasets.

cond-mat.soft↗

arXiv2024

Equivariant graph convolutional neural networks for the representation of homogenized anisotropic microstructural mechanical response

Composite materials with different microstructural material symmetries are common in engineering applications where grain structure, alloying and particle/fiber packing are optimized via controlled manufacturing. In fact these microstructural tunings can be done throughout a part to achieve functional gradation and optimization at a structural level. To predict the performance of particular microstructural configuration and thereby overall performance, constitutive models of materials with microstructure are needed. In this work we provide neural network architectures that provide effective homogenization models of materials with anisotropic components. These models satisfy equivariance and material symmetry principles inherently through a combination of equivariant and tensor basis operations. We demonstrate them on datasets of stochastic volume elements with different textures and phases where the material undergoes elastic and plastic deformation, and show that the these network architectures provide significant performance improvements.

cond-mat.mtrl-sci↗