SearcharxivSearch

arXiv subjects

Brian Wetton

Publications and source records attributed to Brian Wetton.

14 recordsLinked to original sources

Error whitening: Why Gauss-Newton outperforms Newton

The Gauss-Newton matrix is widely viewed as a positive semidefinite approximation of the Hessian, yet mounting empirical evidence shows that Gauss-Newton descent outperforms Newton's method. We adopt a function space perspective to analyze this phenomenon. We show that the generalized Gauss-Newton (GGN) matrix projects the Newton direction in function space onto the model's tangent space, while a Jacobian-only variant obtained by applying the least squares Gauss-Newton matrix to non-least squares losses projects the function space loss gradient onto this same tangent space. Both projections eliminate distortions from the model's parameterization. Specifically, the evolution of the prediction-target mismatch depends on the model's parameterization through the matrix $JJ^\top$ where $J$ is the Jacobian of the model with respect to its parameters. The projections effectively replace $JJ^\top$ with the identity. We call this effect error whitening. Once the parameterization is removed, the prediction-target mismatch evolves according to dynamics dictated by the structure of the loss and the projection produced by the optimizer. Error whitening is a special property of Gauss-Newton descent that rigorously distinguishes it from Newton's method. We empirically demonstrate that Gauss-Newton optimizers follow the theoretically predicted function space dynamics and outperforms Newton's method, Adam, and Muon across case studies spanning supervised learning, physics-informed deep learning, and approximate dynamic programming.

cs.LG

Gradient Flows of Interfacial Energies: Curvature Agents and Incompressibility

We present a framework for the gradient flow of sharp-interface surface energies that couple to embedded curvature active agents. We use a penalty method to develop families of locally incompressible gradient flows that couple interface stretching or compression to local flux of interfacial mass. We establish the convergence of the penalty method to an incompressible flow both formally for a broad family of surface energies and rigorously for a more narrow class of surface energies. We present an analysis, including a $Γ$-limit, of an Allen-Cahn type model for a coupled surface agent curvature energy.

math.AP

Learning the P2D Model for Lithium-Ion Batteries with SOH Detection

Lithium ion batteries are widely used in many applications. Battery management systems control their optimal use and charging and predict when the battery will cease to deliver the required output on a planned duty or driving cycle. Such systems use a simulation of a mathematical model of battery performance. These models can be electrochemical or data-driven. Electrochemical models for batteries running at high currents are mathematically and computationally complex. In this work, we show that a well-regarded electrochemical model, the Pseudo Two Dimensional (P2D) model, can be replaced by a computationally efficient Convolutional Neural Network (CNN) surrogate model fit to accurately simulated data from a class of random driving cycles. We demonstrate that a CNN is an ideal choice for accurately capturing Lithium ion concentration profiles. Additionally, we show how the neural network model can be adjusted to correspond to battery changes in State of Health (SOH).

cs.LG

Quasisteady patterns in interfaces: Folding and Faceting

We present a systematic derivation of the gradient flows associated to a broad class of interfacial energies, emphasizing the relation between intrinsic and extrinsic variations of the interface. We show that the intrinsic variables formulation brings the gradient flow into alignment with the traditional analysis of quasi-steady dynamical systems defined on a stationary domain. Gradient flows are derived for model systems which exhibit quasi-steady pattern formation including coarsening among faceted interfaces and nonlocal interactions that model membrane self-adhesion and self-avoidance.

math.AP

Benchmark Computation of Morphological Complexity in the Functionalized Cahn-Hilliard Gradient Flow

Reductions of the self-consistent mean field theory model of amphiphilic molecules in solvent can lead to a singular family of functionalized Cahn-Hilliard energies. We modify these energies, mollifying the singularities to stabilize the computation of the gradient flows and develop a series of benchmark problems that emulate the "morphological complexity" observed in experiments. These benchmarks investigate the delicate balance between the rate of absorption of amphiphilic material onto an interface and a least energy mechanism to disperse the arriving mass. The result is a trichotomy of responses in which two-dimensional interfaces either lengthen by a regularized motion against curvature, undergo pearling bifurcations, or split directly into networks of interfaces. We evaluate a number of schemes that use second order BDF2-type time stepping coupled with Fourier pseudo-spectral spatial discretization. The BDF2-type schemes are either based on a fully implicit time discretization with a PSD nonlinear solver, or upon IMEX, SAV, ETD approaches. All schemes use a fixed local truncation error target with adaptive time-stepping to achieve the error target. Each scheme requires proper "preconditioning" to achieve robust performance that can enhance efficiency by several orders of magnitude.

physics.comp-ph

Equivalent formulations of the oxygen depletion problem, other implicit free boundary value problems, and implications for numerical approximation

The Oxygen Depletion problem is an implicit free boundary value problem. The dynamics allow topological changes in the free boundary. We show several mathematical formulations of this model from the literature and give a new formulation based on a gradient flow with constraint. All formulations are shown to be equivalent. We explore the possibilities for the numerical approximation of the problem that arise from the different formulations. We show a convergence result for an approximation based on the gradient flow with constraint formulation that applies to the general dynamics including topological changes. More general (vector, higher order) implicit free boundary value problems are discussed. Several open problems are described.

math.AP

A fast solver for the pseudo-two-dimensional model of lithium-ion batteries

The pseudo-two-dimensional (P2D) model is a complex mathematical model that can capture the electrochemical processes in Li-ion batteries. However, the model also brings a heavy computational burden. Many simplifications to the model have been introduced in the literature to reduce the complexity. We present a method for fast computation of the P2D model which can be used when simplifications are not accurate enough. By rearranging the calculations, we reduce the complexity of the linear algebra problem. We also employ automatic differentiation, using an open source package JAX for robustness, while also allowing easy implementation of changes to coefficient expressions. The method alleviates the computational bottleneck in P2D models without compromising accuracy.

physics.app-ph

Slow Migration of Brine Inclusions in First-Year Sea Ice

We derive a thermodynamically consistent model for phase change in sea ice by adding salt to the framework introduced by Penrose and Fife. Taking the salt entropy relative to the liquid water molar fraction provides a transparent mechanism for salt rejection under ice formation. We identify slow varying coordinates, including salt density relative to liquid water molarity weighted by latent heat, and use multiscale analysis to derive a quasi-equilibrium Stefan-type problem via a sharp interface scaling. The singular limit is under-determined and the leading order system is closed by imposing local conservation of salt under interface perturbation. The quasi-steady system determines interface motion as balance of curvature, temperature gradient, and salt density. We resolve this numerically for axisymmetric surfaces and show that the thermal gradients typical of arctic sea ice can have a decisive impact on the mode of pinch-off of cylindrical brine inclusions and on the size distribution of the resultant spherical shapes. The density and distribution of inclusion sizes is a key component of sea ice albedo which factors into global climate models.

math.DS

Asymptotic Behaviour of Time Stepping Methods for Phase Field Models

Adaptive time stepping methods for metastable dynamics of the Allen Cahn and Cahn Hilliard equations are investigated in the spatially continuous, semi-discrete setting. We analyse the performance of a number of first and second order methods, formally predicting step sizes required to satisfy specified local truncation error $σ$ in the limit of small order parameter $ε\rightarrow 0$ during meta-stable dynamics. The formal predictions are made under stability assumptions that include the preservation of the asymptotic structure of the diffuse interface, a concept we call profile fidelity. In this setting, definite statements about the relative behaviour of time stepping methods can be made. Some methods, including all so-called energy stable methods but also some fully implicit methods, require asymptotically more time steps than others.The formal analysis is confirmed in computational studies. We observe that some provably energy stable methods popular in the literature perform worse than some more standard schemes. We show further that when Backward Euler is applied to meta-stable Allen Cahn dynamics, the energy decay and profile fidelity properties for these discretizations are preserved for much larger time steps than previous analysis would suggest. The results are established asymptotically for general interfaces, with a rigorous proof for radial interfaces. It is shown analytically and computationally that for most reaction terms, Eyre type time stepping performs asymptotically worse due to loss of profile fidelity.

math.NA

Mathematical model for substitutional binary diffusion in solids

In this paper we detail the mechanisms that drive substitutional binary diffusion and derive appropriate governing equations. We focus on the one-dimensional case with insulated boundary conditions. Asymptotic expansions are used in order to simplify the problem. We are able to obtain approximate analytical solutions in two distinct cases: the two species diffuse at similar rates, and the two species have largely different diffusion rates. A numerical solution for the full problem is also described.

cond-mat.stat-mech

Cellular automaton model for substitutional binary diffusion in solids

In this paper we use the cellular automaton (CA) approach to model one-dimensional binary diffusion in solids. Employing a very simple state change rule we define an asynchronous CA model and take its continuum limit to obtain the governing equations of the problem. We show that in the limit where the number of cells tends to infinity the CA model approaches a continuous model derived in previous work. Thus, showing that the CA approach provides a new, simple method to study and model binary diffusion.

physics.comp-ph

A Comparison of Fick and Maxwell-Stefan Diffusion Formulations in PEMFC Cathode Gas Diffusion Layers

This paper explores the mathematical formulations of Fick and Maxwell-Stefan diffusion in the context of polymer electrolyte membrane fuel cell cathode gas diffusion layers. Formulations of diffusion combined with mass-averaged Darcy flow are considered for three component gases. Fick formulations can be considered as approximations of Maxwell-Stefan in a certain sense. For this application, the formulations can be compared computationally in a simple, one dimensional setting. We observe that the predictions of the formulations are very similar, despite their seemingly different structure. Analytic insight is given to the result. In addition, it is seen that for both formulations, diffusion laws are small perturbations from bulk flow. The work is also intended as a reference to multi-component gas diffusion formulations in the fuel cell setting.

physics.flu-dyn

Residual Velocities in Steady Free Boundary Value Problems of Vector Laplacian Type

This paper describes a technique to determine the linear well-posedness of a general class of vector elliptic problems that include a steady interface, to be determined as part of the problem, that separates two subdomains. The interface satisfies mixed Dirichlet and Neumann conditions. We consider ``2+2'' models, meaning two independent variables respectively on each subdomain. The governing equations are taken to be vector Laplacian, to be able to make analytic progress. The interface conditions can be classified into four large categories, and we concentrate on the one with most physical interest. The well-posedness criteria in this case are particularly clear. In many physical cases, the movement of the interface in time-dependent situations can be reduced to a normal motion proportional to the residual in one of the steady state interface conditions (the elliptic interior problems and the other interface conditions are satisfied at each time). If only the steady state is of interest, one can consider using other residuals for the normal velocity. Our analysis can be extended to give insight into choosing residual velocities that have superior numerical properties. Hence, in the second part, we discuss an iterative method to solve free boundary problems. The advantages of the correctly chosen, non-physical residual velocities are demonstrated in a numerical example, based on a simplified model of two-phase flow with phase change in porous media.

math.NA

Numerical Methods for Coupled Surface and Grain Boundary Motion

We study the coupled surface and grain boundary motion in a bicrystal in the context of the "quarter loop" geometry. Two types of physics motions are involved in this model: motion by mean curvature and motion by surface diffusion. The goal is finding a formulation that can describe the coupled motion and has good numerical behavior when discretized. Two formulations are proposed in this paper. One of them is given by a mixed order parabolic system and the other is given by Partial Differential Algebraic Equations. The parabolic formulation constitutes several parabolic equations which model the two normal direction motions separately. The performance of this formulation is good for a short time simulation. It performs even better by adding an extra term to adjust the tangential velocity of grid points. The PDAE formulation preserves the scaled arc length property and performs much better with no need to add an adjusting term. Both formulations are proven to be well-posed in a simpler setting and are solved by finite difference methods.

math.NA