SearcharxivSearch

arXiv subjects

Emmanuel Franck

Publications and source records attributed to Emmanuel Franck.

At least 19 recordsLinked to original sources

Non-linear control variate in {\delta}f particle-in-cell methods using symplectic neural networks

We present a novel {\delta}f particle-in-cell (PIC) method for the kinetic simulation of electrostatic plasmas in which the bulk density, acting as a control variate, is evolved using symplectic neural networks (SympNets). The SympNets are used as an approximation of the backward flow and trained using the particle trajectories. We introduce a periodic variant of the SympNet architecture that encodes the spatial periodicity of the problem into the network itself. We validate the approach with numerical results in 1D1V and 3D3V for the Vlasov-Poisson system.

physics.comp-ph

Implementation of a shooting technique for quantum optimal control on spin qudits

High-fidelity quantum control is a cornerstone of scalable quantum technologies. We introduce a shooting-based optimization framework that generates smooth, experimentally realistic control pulses for implementing quantum gates in discrete quantum systems. Through numerical simulations on realistic architectures inspired by single-molecule magnets, we demonstrate that our method efficiently decomposes target quantum operations into electric pulse sequences while outperforming the widely used GRAPE algorithm.

quant-ph

Neural non-canonical Hamiltonian dynamics for long-time simulations

This work focuses on learning non-canonical Hamiltonian dynamics from data, where long-term predictions require the preservation of structure both in the learned model and in numerical schemes. Previous research focused on either facet, respectively with a potential-based architecture and with degenerate variational integrators, but new issues arise when combining both. In experiments, the learnt model is sometimes numerically unstable due to the gauge dependency of the scheme, rendering long-time simulations impossible. In this paper, we identify this problem and propose two different training strategies to address it, either by directly learning the vector field or by learning a time-discrete dynamics through the scheme. Several numerical test cases assess the ability of the methods to learn complex physical dynamics, like the guiding center from gyrokinetic plasma physics.

cs.LG

Higher-order methods of radiative transfer in simulations of the epoch of reionisation: Pn versus M1

In current cosmological simulations, the radiative transfer modules generally rely on the M1 approximation, which has some glaring flaws related to its fluid-like behaviour, such as spurious pseudo-sources and loss of directionality when radiation fronts from different directions collide. Pn, another moment-based model used in other fields of physics, may correct these issues. We aim at testing out Pn in an astrophysical setting and compare it to M1, in order to see if it can indeed correct M1's flaws. Also, we want to use Pn's solutions to better pinpoint M1 errors. We implement a Pn radiation transport method and couple it to a photo-thermo-chemistry module to account for the interaction of ionising radiation with the Hydrogen gas, and benchmark it using tests for radiative transfer models comparison in astrophysics as defined in arXiv:astro-ph/0603199. We find that high order P_n (e.g. P9) indeed correct M1's flaws, while faring as well or even better in some aspects in the tests, in particular when directionality is important or colliding radiation fronts occur. By comparing P9 and M1 radiation fields in an idealised and cosmological test case, we highlight a new, thus far unreported artefact of M_1, the 'dark sombrero'. A dark sombrero appears as a spherical photon-deficit shell around the source. The photon density in dark sombreros can be underestimated by a factor up to 2-3. They occur in regions where a source's radiation field connects with that of another source or group of sources. These basic properties (position and amplitude) of the dark sombreros may depend on the sources' relative intensities, positions, spatial resolution, although we have not been able to test this in detail in this study.

astro-ph.CO

Reduced Particle in Cell method for the Vlasov-Poisson system using auto-encoder and Hamiltonian neural

Hamiltonian particle-based simulations of plasma dynamics are inherently computationally intensive, primarily due to the large number of particles required to obtain accurate solutions. This challenge becomes even more acute in many-query contexts, where numerous simulations must be conducted across a range of time and parameter values. Consequently, it is essential to construct reduced order models from such discretizations to significantly lower computational costs while ensuring validity across the specified time and parameter domains. Preserving the Hamiltonian structure in these reduced models is also crucial, as it helps maintain long-term stability. In this paper, we introduce a nonlinear, non-intrusive, data-driven model order reduction method for the 1D-1V Vlasov--Poisson system, discretized using a Hamiltonian Particle-In-Cell scheme. Our approach relies on a two-step projection framework: an initial linear projection based on the Proper Symplectic Decomposition, followed by a nonlinear projection learned via an autoencoder neural network. The reduced dynamics are then modeled using a Hamiltonian neural network. The offline phase of the method is split into two stages: first, constructing the linear projection using full-order model snapshots; second, jointly training the autoencoder and the Hamiltonian neural network to simultaneously learn the encoder-decoder mappings and the reduced dynamics. We validate the proposed method on several benchmarks, including Landau damping and two-stream instability. The results show that our method has better reduction properties than standard linear Hamiltonian reduction methods.

math.NA

Neural semi-Lagrangian method for high-dimensional advection-diffusion problems

This work is devoted to the numerical approximation of high-dimensional advection-diffusion equations. It is well-known that classical methods, such as the finite volume method, suffer from the curse of dimensionality, and that their time step is constrained by a stability condition. The semi-Lagrangian method is known to overcome the stability issue, while recent time-discrete neural network-based approaches overcome the curse of dimensionality. In this work, we propose a novel neural semi-Lagrangian method that combines these last two approaches. It relies on projecting the initial condition onto a finite-dimensional neural space, and then solving an optimization problem, involving the backwards characteristic equation, at each time step. It is particularly well-suited for implementation on GPUs, as it is fully parallelizable and does not require a mesh. We provide rough error estimates present several high-dimensional numerical experiments to assess the performance of our approach, and compare it to other neural methods.

math.NA

Enriching continuous Lagrange finite element approximation spaces using neural networks

In this work, we present a study combining two approaches in the context of solving PDEs: the continuous finite element method (FEM) and more recent techniques based on neural networks. In recent years, physics-informed neural networks (PINNs) have become particularly interesting for rapidly solving PDEs, especially in high dimensions. However, their lack of accuracy can be a significant drawback in this context, hence the interest in combining them with FEM, for which error estimates are already known. The complete pipeline proposed here consists in modifying the classical FEM approximation spaces by taking information from a prior, chosen as the prediction of a neural network. On the one hand, this combination improves and certifies the prediction of neural networks, to obtain a fast and accurate solution. On the other hand, error estimates are proven, showing that such strategies outperform classical ones by a factor that depends only on the quality of the prior. We validate our approach with numerical results performed on parametric problems with 1D, 2D and 3D geometries. These experiments demonstrate that to achieve a given accuracy, a coarser mesh can be used with our enriched FEM compared to the standard FEM, leading to reduced computational time, particularly for parametric problems.

math.NA

Structural schemes for hamiltonian systems

We present an adaptation of the so-called structural method \cite{CMM23} for Hamiltonian systems, and redesign the method for this specific context, which involves two coupled differential systems. Structural schemes decompose the problem into two sets of equations: the physical equations, which describe the local dynamics of the system, and the structural equations, which only involve the discretization on a very compact stencil. They have desirable properties, such as unconditional stability or high-order accuracy. We first give a general description of the scheme for the scalar case (which corresponds to e.g. spring-mass interactions or pendulum motion), before extending the technique to the vector case (treating e.g. the $n$-body system). The scheme is also written in the case of a non-separable system (e.g. a charged particle in an electromagnetic field). We give numerical evidence of the method's efficiency, its capacity to preserve invariant quantities such as the total energy, and draw comparisons with the traditional symplectic methods.

math.NA

Volume-preserving geometric shape optimization of the Dirichlet energy using variational neural networks

In this work, we explore the numerical solution of geometric shape optimization problems using neural network-based approaches. This involves minimizing a numerical criterion that includes solving a partial differential equation with respect to a domain, often under geometric constraints like a constant volume. We successfully develop a proof of concept using a flexible and parallelizable methodology to tackle these problems. We focus on a prototypal problem: minimizing the so-called Dirichlet energy with respect to the domain under a volume constraint, involving Poisson's equation in $\mathbb{R}^2$. We use variational neural networks to approximate the solution to Poisson's equation on a given domain, and represent the shape through a neural network that approximates a volume-preserving transformation from an initial shape to an optimal one. These processes are combined in a single optimization algorithm that minimizes the Dirichlet energy. A significant advantage of this approach is its inherent parallelizability, which makes it easy to handle the addition of parameters. Additionally, it does not rely on shape derivative or adjoint calculations. Our approach is tested on Dirichlet and Robin boundary conditions, parametric right-hand sides, and extended to Bernoulli-type free boundary problems. The source code for solving the shape optimization problem is open-source and freely available.

math.OC

Generalizing the SINDy approach with nested neural networks

Symbolic Regression (SR) is a widely studied field of research that aims to infer symbolic expressions from data. A popular approach for SR is the Sparse Identification of Nonlinear Dynamical Systems (SINDy) framework, which uses sparse regression to identify governing equations from data. This study introduces an enhanced method, Nested SINDy, that aims to increase the expressivity of the SINDy approach thanks to a nested structure. Indeed, traditional symbolic regression and system identification methods often fail with complex systems that cannot be easily described analytically. Nested SINDy builds on the SINDy framework by introducing additional layers before and after the core SINDy layer. This allows the method to identify symbolic representations for a wider range of systems, including those with compositions and products of functions. We demonstrate the ability of the Nested SINDy approach to accurately find symbolic expressions for simple systems, such as basic trigonometric functions, and sparse (false but accurate) analytical representations for more complex systems. Our results highlight Nested SINDy's potential as a tool for symbolic regression, surpassing the traditional SINDy approach in terms of expressivity. However, we also note the challenges in the optimization process for Nested SINDy and suggest future research directions, including the designing of a more robust methodology for the optimization process. This study proves that Nested SINDy can effectively discover symbolic representations of dynamical systems from data, offering new opportunities for understanding complex systems through data-driven methods.

math.NA

Accelerating the convergence of Newton's method for nonlinear elliptic PDEs using Fourier neural operators

It is well known that Newton's method can have trouble converging if the initial guess is too far from the solution. Such a problem particularly occurs when this method is used to solve nonlinear elliptic partial differential equations (PDEs) discretized via finite differences. This work focuses on accelerating Newton's method convergence in this context. We seek to construct a mapping from the parameters of the nonlinear PDE to an approximation of its discrete solution, independently of the mesh resolution. This approximation is then used as an initial guess for Newton's method. To achieve these objectives, we elect to use a Fourier neural operator (FNO). The loss function is the sum of a data term (i.e., the comparison between known solutions and outputs of the FNO) and a physical term (i.e., the residual of the PDE discretization). Numerical results, in one and two dimensions, show that the proposed initial guess accelerates the convergence of Newton's method by a large margin compared to a naive initial guess, especially for highly nonlinear and anisotropic problems, with larger gains on coarse grids.

math.NA

Hamiltonian reduction using a convolutional auto-encoder coupled to an Hamiltonian neural network

The reduction of Hamiltonian systems aims to build smaller reduced models, valid over a certain range of time and parameters, in order to reduce computing time. By maintaining the Hamiltonian structure in the reduced model, certain long-term stability properties can be preserved. In this paper, we propose a non-linear reduction method for models coming from the spatial discretization of partial differential equations: it is based on convolutional auto-encoders and Hamiltonian neural networks. Their training is coupled in order to simultaneously learn the encoder-decoder operators and the reduced dynamics. Several test cases on non-linear wave dynamics show that the method has better reduction properties than standard linear Hamiltonian reduction methods.

math.NA

Optimal scenario for road evacuation in an urban environment

How to free a road from vehicle traffic as efficiently as possible and in a given time, in order to allow for example the passage of emergency vehicles? We are interested in this question which we reformulate as an optimal control problem. We consider a macroscopic road traffic model on networks, semi-discretized in space and decide to give ourselves the possibility to control the flow at junctions. Our target is to smooth the traffic along a given path within a fixed time. A parsimony constraint is imposed on the controls, in order to ensure that the optimal strategies are feasible in practice. We perform an analysis of the resulting optimal control problem, proving the existence of an optimal control and deriving optimality conditions, which we rewrite as a single functional equation. We then use this formulation to derive a new mixed algorithm interpreting it as a mix between two methods: a descent method combined with a fixed point method allowing global perturbations. We verify with numerical experiments the efficiency of this method on examples of graphs, first simple, then more complex. We highlight the efficiency of our approach by comparing it to standard methods. We propose an open source code implementing this approach in the Julia language.

math.OC

Approximately well-balanced Discontinuous Galerkin methods using bases enriched with Physics-Informed Neural Networks

This work concerns the enrichment of Discontinuous Galerkin (DG) bases, so that the resulting scheme provides a much better approximation of steady solutions to hyperbolic systems of balance laws. The basis enrichment leverages a prior - an approximation of the steady solution - which we propose to compute using a Physics-Informed Neural Network (PINN). To that end, after presenting the classical DG scheme, we show how to enrich its basis with a prior. Convergence results and error estimates follow, in which we prove that the basis with prior does not change the order of convergence, and that the error constant is improved. To construct the prior, we elect to use parametric PINNs, which we introduce, as well as the algorithms to construct a prior from PINNs. We finally perform several validation experiments on four different hyperbolic balance laws to highlight the properties of the scheme. Namely, we show that the DG scheme with prior is much more accurate on steady solutions than the DG scheme without prior, while retaining the same approximation quality on unsteady solutions.

math.NA

An optimal control deep learning method to design artificial viscosities for Discontinuous Galerkin schemes

In this paper, we propose a method for constructing a neural network viscosity in order to reduce the non-physical oscillations generated by high-order Discontiuous Galerkin (DG) methods. To this end, the problem is reformulated as an optimal control problem for which the control is the viscosity function and the cost function involves comparison with a reference solution after several compositions of the scheme. The learning process is strongly based on gradient backpropagation tools. Numerical simulations show that the artificial viscosities constructed in this way are just as good or better than those used in the literatur

math.NA

A neural network closure for the Euler-Poisson system based on kinetic simulations

This work deals with the modeling of plasmas, which are charged-particle fluids. Thanks to machine leaning, we construct a closure for the one-dimensional Euler-Poisson system valid for a wide range of collision regimes. This closure, based on a fully convolutional neural network called V-net, takes as input the whole spatial density, mean velocity and temperature and predicts as output the whole heat flux. It is learned from data coming from kinetic simulations of the Vlasov-Poisson equations. Data generation and preprocessings are designed to ensure an almost uniform accuracy over the chosen range of Knudsen numbers (which parametrize collision regimes). Finally, several numerical tests are carried out to assess validity and flexibility of the whole pipeline.

math.NA

An analysis of over-relaxation in kinetic approximation

The over-relaxation approach is an alternative to the Jin-Xin relaxation method (Jin and Xin [1]) in order to apply the equilibrium source term in a more precise way (Coulette et al. [2, 3]). This is also a key ingredient of the Lattice-Boltzmann method for achieving second order accuracy (Dellar [4]). In this work we provide an analysis of the over-relaxation kinetic scheme. We compute its equivalent equation, which is particularly useful for devising stable boundary conditions for the hidden kinetic variables.

math.AP

High-order implicit palindromic discontinuous Galerkin method for kinetic-relaxation approximation

We construct a high order discontinuous Galerkin method for solving general hyperbolic systems of conservation laws. The method is CFL-less, matrix-free, has the complexity of an explicit scheme and can be of arbitrary order in space and time. The construction is based on: (a) the representation of the system of conservation laws by a kinetic vectorial representation with a stiff relaxation term; (b) a matrix-free, CFL-less implicit discontinuous Galerkin transport solver; and (c) a stiffly accurate composition method for time integration. The method is validated on several one-dimensional test cases. It is then applied on two-dimensional and three-dimensional test cases: flow past a cylinder, magnetohydrodynamics and multifluid sedimentation.

math.AP