SearcharxivSearch

arXiv subjects

Jean-Michel Tucny

Publications and source records attributed to Jean-Michel Tucny.

9 recordsLinked to original sources

Randomness and signal propagation in physics-informed neural networks (PINNs): A neural PDE perspective

Physics-informed neural networks (PINNs) often exhibit weight matrices that appear statistically random after training, yet their implications for signal propagation and stability remain unsatisfactorily understood, let alone the interpretability. In this work, we analyze the spectral and statistical properties of trained PINN weights using viscous and inviscid variants of the one-dimensional Burgers' equation, and show that the learned weights reside in a high-entropy regime consistent with predictions from random matrix theory. To investigate the dynamical consequences of such weight structures, we study the evolution of signal features inside a network through the lens of neural partial differential equations (neural PDEs). We show that random and structured weight matrices can be associated with specific discretizations of neural PDEs, and that the numerical stability of these discretizations governs the stability of signal propagation through the network. In particular, explicit unstable schemes lead to degraded signal evolution, whereas stable implicit and higher-order schemes yield well-behaved dynamics for the same underlying neural PDE. Our results offer an explicit example of how numerical stability and network architecture shape signal propagation in deep networks, in relation to random matrix and neural PDE descriptions in PINNs.

cs.LG

Is the end of Insight in Sight ?

The rise of deep learning challenges the longstanding scientific ideal of insight - the human capacity to understand phenomena by uncovering underlying mechanisms. In many modern applications, accurate predictions no longer require interpretable models, prompting debate about whether explainability is a realistic or even meaningful goal. From our perspective in physics, we examine this tension through a concrete case study: a physics-informed neural network (PINN) trained on a rarefied gas dynamics problem governed by the Boltzmann equation. Despite the system's clear structure and well-understood governing laws, the trained network's weights resemble Gaussian-distributed random matrices, with no evident trace of the physical principles involved. This suggests that deep learning and traditional simulation may follow distinct cognitive paths to the same outcome - one grounded in mechanistic insight, the other in statistical interpolation. Our findings raise critical questions about the limits of explainable AI and whether interpretability can - or should-remain a universal standard in artificial reasoning.

physics.comp-ph

Physics-Informed Neural Networks for microflows: Rarefied Gas Dynamics in Cylinder Arrays

Accurate prediction of rarefied gas dynamics is crucial for optimizing flows through microelectromechanical systems, air filtration devices, and shale gas extraction. Traditional methods, such as discrete velocity and direct simulation Monte Carlo (DSMC), demand intensive memory and computation, especially for microflows in non-convex domains. Recently, physics-informed neural networks emerged as a meshless and adaptable alternative for solving non-linear partial differential equations. We trained a PINN using a limited number of DSMC-generated rarefied gas microflows in the transition regime with Knudsen number from 0.1 to 3, incorporating continuity and Cauchy momentum exchange equations in the loss function. The PINN achieved under 2 percent error on these residuals and effectively filtered DSMC intrinsic statistical noise. Predictions remained strong for a tested flow field with Kn equal to 0.7, and showed limited extrapolation performance on a flow field with Kn equal to 5 with a local overshoot of about 20 percent, while maintaining physical consistency. Notably, each DSMC field required about 20 hours on 4 graphics processing units (GPU), while the PINN training took less than 2 hours on one GPU, with evaluations under 2 seconds.

physics.comp-ph

Minimal droplet shape representation in experimental microfluidics using Fourier series and autoencoders

We introduce a two-step, fully reversible process designed to project the outer shape of a generic droplet onto a lower-dimensional space. The initial step involves representing the droplet's shape as a Fourier series. Subsequently, the Fourier coefficients are reduced to lower-dimensional vectors by using autoencoder models. The exploitation of the domain knowledge of the droplet shapes allows us to map generic droplet shapes to just 2D space in contrast to previous direct methods involving autoencoders that could map it on minimum 8D space. This 6D reduction in the dimensionality of the droplet's description opens new possibilities for applications, such as automated droplet generation via reinforcement learning, the analysis of droplet shape evolution dynamics and the prediction of droplet breakup. Our findings underscore the benefits of incorporating domain knowledge into autoencoder models, highlighting the potential for increased accuracy in various other scientific disciplines.

physics.flu-dyn

Droplet shape representation using Fourier series and autoencoders

The shape of liquid droplets in air plays an important role in aerodynamic behavior and combustion dynamics of miniaturized propulsion systems such as microsatellites and small drones. Their precise manipulation can yield optimal efficiency in such systems. It is desired to have a minimal representation of droplet shapes using as few parameters to automate shape manipulation using self-learning algorithms, such as reinforcement learning. In this paper, we use a neural compression algorithm to represent, with only two parameters, elliptical and bullet-shaped droplets initially represented with 200 points (400 real numbers) at the droplet boundary. The mapping of many to two points is achieved in two stages. Initially, a Fourier series is formulated to approximate the contour of the droplet. Subsequently, the coefficients of this Fourier series are condensed to lower dimensions utilizing a neural network with a bottleneck architecture. Finally, 5000 synthetically generated droplet shapes were used to train the neural network. With a two real numbers representation, the recovered droplet shapes had excellent overlap with the original ones, with a mean square error 10^-3. Hence, this method compresses the droplet contour to merely two numerical parameters via a fully reversible process, a crucial feature for rendering learning algorithms computationally tractable.

physics.flu-dyn

Can physical information aid the generalization ability of Neural Networks for hydraulic modeling?

Application of Neural Networks to river hydraulics is fledgling, despite the field suffering from data scarcity, a challenge for machine learning techniques. Consequently, many purely data-driven Neural Networks proved to lack predictive capabilities. In this work, we propose to mitigate such problem by introducing physical information into the training phase. The idea is borrowed from Physics-Informed Neural Networks which have been recently proposed in other contexts. Physics-Informed Neural Networks embed physical information in the form of the residual of the Partial Differential Equations (PDEs) governing the phenomenon and, as such, are conceived as neural solvers, i.e. an alternative to traditional numerical solvers. Such approach is seldom suitable for environmental hydraulics, where epistemic uncertainties are large, and computing residuals of PDEs exhibits difficulties similar to those faced by classical numerical methods. Instead, we envisaged the employment of Neural Networks as neural operators, featuring physical constraints formulated without resorting to PDEs. The proposed novel methodology shares similarities with data augmentation and regularization. We show that incorporating such soft physical information can improve predictive capabilities.

cs.LG

Measuring arrangement and size distributions of flowing droplets in microchannels through deep learning

In microfluidic systems, droplets undergo intricate deformations as they traverse flow-focusing junctions, posing a challenging task for accurate measurement, especially during short transit times. This study investigates the physical behavior of droplets within dense emulsions in diverse microchannel geometries, specifically focusing on the impact of varying opening angles within the primary channel and injection rates of fluid components. Employing a sophisticated droplet tracking tool based on deep-learning techniques, we analyze multiple frames from flow-focusing experiments to quantitatively characterize droplet deformation in terms of ratio between maximum width and height and propensity to form liquid with hexagonal crystalline order. Our findings reveal the existence of an optimal opening angle where shape deformations are minimal and crystal-like arrangement is maximal. Variations of fluid injection rates are also found to affect size and packing fraction of the emulsion in the exit channel. This paper offers insights into deformations, size and structure of fluid emulsions relative to microchannel geometry and other flow-related parameters captured through machine learning, with potential implications for the design of microchips utilized in cellular transport and tissue engineering applications.

physics.flu-dyn

Learning of viscosity functions in rarefied gas flows with physics-informed neural networks

The prediction non-equilibrium transport phenomena in disordered media is a difficult problem for conventional numerical methods. An example of a challenging problem is the prediction of gas flow fields through porous media in the rarefied regime, where resolving the six-dimensional Boltzmann equation or its numerical approximations is computationally too demanding. Physics-informed neural networks (PINNs) have been recently proposed as an alternative to conventional numerical methods, but remain very close to the Boltzmann equation in terms of mathematical formulation. Furthermore, there has been no systematic study of neural network designs on the performance of PINNs. In this work, PINNs are employed to predict the velocity field of a rarefied gas flow in a slit at increasing Knudsen numbers according to a generalized Stokes phenomenological model using an effective viscosity function. We found that activation functions with limited smoothness result in orders of magnitude larger errors than infinitely differentiable functions and that the AdamW is by far the best optimizer for this inverse problem. The design was found to be robust from Knudsen numbers ranging from 0.1 to 10. Our findings stand as a first step towards the use of PINNs to investigate the dynamics of non-equilibrium flows in complex geometries.

physics.flu-dyn

Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications

Tracking droplets in microfluidics is a challenging task. The difficulty arises in choosing a tool to analyze general microfluidic videos to infer physical quantities. The state-of-the-art object detector algorithm You Only Look Once (YOLO) and the object tracking algorithm Simple Online and Realtime Tracking with a Deep Association Metric (DeepSORT) are customizable for droplet identification and tracking. The customization includes training YOLO and DeepSORT networks to identify and track the objects of interest. We trained several YOLOv5 and YOLOv7 models and the DeepSORT network for droplet identification and tracking from microfluidic experimental videos. We compare the performance of the droplet tracking applications with YOLOv5 and YOLOv7 in terms of training time and time to analyze a given video across various hardware configurations. Despite the latest YOLOv7 being 10% faster, the real-time tracking is only achieved by lighter YOLO models on RTX 3070 Ti GPU machine due to additional significant droplet tracking costs arising from the DeepSORT algorithm. This work is a benchmark study for the YOLOv5 and YOLOv7 networks with DeepSORT in terms of the training time and inference time for a custom dataset of microfluidic droplets.

cs.CV