SearcharxivSearch

arXiv subjects

Mickaël Delcey

Publications and source records attributed to Mickaël Delcey.

6 recordsLinked to original sources

DNA Language Models: An Assessment of Pre-Training for Fine-Tuning Tasks

Recent breakthroughs in foundation models and Large Language Models (LLMs) have introduced new opportunities for studying and decoding genomic sequences. Several state-of-the-art approaches, such as DNABERT2, rely on transformer-based architectures, while others, such as ConvNova, still build upon more conventional convolutional models. However, systematic benchmark comparisons across these methods remain scarce. Given that transformer-based models require extensive and costly pretraining, it is crucial to evaluate whether their performance gains justify this overhead. Moreover, LLMs such as DNABERT2 typically rely on Byte Pair Encoding (BPE) tokenization, whose relevance for DNA sequence representation is still debated within the genomics community. In this work, we investigate three key questions: (i) do transformer-based models provide sufficient improvements on fine-tuning tasks upon heavy pretraining, (ii) what is the actual contribution of pretraining in this setting, and (iii) how does BPE tokenization impact performance on genomics-related tasks?

q-bio.GN

Rheological Parameter Identification in Granular Materials Using Physics-Informed Neural Networks

Physics-Informed Neural Networks (PINNs) have recently emerged as a promising tool for fluid dynamics, particularly for flow reconstruction and parameter identification. In the context of granular media, accurately estimating rheological parameters remains a major challenge, as it typically requires complex and costly experimental setups. In this work, we propose a PINN-based approach to identify key rheological parameters of granular materials using a simple experiment: the granular column collapse. A proof of concept is presented using synthetic data, where the PINN is trained to infer the flow fields while simultaneously recovering the rheological parameters. Beyond parameter identification, the method also enables reconstruction of the pressure field, which is difficult to access experimentally. The results highlight the potential of PINNs for data-driven rheometry of granular materials and open perspectives for future applications with real experimental data.

cond-mat.dis-nn

Quantitative Assessment of PINN Inference on Experimental Data for Gravity Currents Flows

In this paper, we apply Physics Informed Neural Networks (PINNs) to infer velocity and pressure field from Light Attenuation Technique (LAT) measurements for gravity current induced by lock-exchange. In a PINN model, physical laws are embedded in the loss function of a neural network, such that the model fits the training data but is also constrained to reduce the residuals of the governing equations. PINNs are able to solve ill-posed inverse problems training on sparse and noisy data, and therefore can be applied to real engineering applications. The noise robustness of PINNs and the model parameters are investigated in a 2 dimensions toy case on a lock-exchange configuration, employing synthetic data. Then we train a PINN with experimental LAT measurements and quantitatively compare the velocity fields inferred to Particle Image Velocimetry (PIV) measurements performed simultaneously on the same experiment.The results state that accurate and useful quantities can be derived from a PINN model trained on real experimental data which is encouraging for a better description of gravity currents.

physics.flu-dyn

Identification of Settling Velocity with Physics Informed Neural Networks For Sediment Laden Flows

Physics-Informed Neural Networks (PINNs) have shown great potential in the context of fluid dynamics simulations, particularly in reconstructing flow fields and identifying key parameters. In this study, we explore the application of PINNs to recover the dimensionless settling velocity for sedimentation flow. The flow involves sediment-laden fresh water overlying salt water, which is described by Navier-Stokes equations coupled with sediment concentration and salinity transport equations. Two cases are investigated: one where the training data contains the salinity and sediment concentration fields, and another where it contains the velocity field. For both cases, we investigate several flow regimes and show that the model is capable of inferring the unknown parameter and reconstructing the hydrodynamic field of the flow. The quality of the model inference is assessed by comparing it with numerical simulations from a high-fidelity semi-Lagrangian solver. We demonstrate the model's robustness to noise by training it with data corrupted by noise of varying magnitudes, highlighting the potential of PINNs for real-world applications.

physics.flu-dyn

Physics-informed neural networks for gravity currents reconstruction from limited data

The present work investigates the use of physics-informed neural networks (PINNs) for the 3D reconstruction of unsteady gravity currents from limited data. In the PINN context, the flow fields are reconstructed by training a neural network whose objective function penalizes the mismatch between the network predictions and the observed data and embeds the underlying equations using automatic differentiation. This study relies on a high-fidelity numerical experiment of the canonical lock-exchange configuration. This allows us to benchmark quantitatively the PINNs reconstruction capabilities on several training databases that mimic state-of-the-art experimental measurement techniques for density and velocity. Notably, spatially averaged density measurements by light attenuation technique (LAT) are employed for the training procedure. An optimal experimental setup for flow reconstruction by PINNs is proposed according to two criteria : the implementation complexity and the accuracy of the inferred fields.

physics.flu-dyn

Origin of vibrational wavepacket dynamics in Fe carbene photosensitizer determined with femtosecond X-ray emission and scattering

Disentangling the dynamics of electrons and nuclei during nonadiabatic molecular transformations remains a considerable experimental challenge. Here we have investigated photoinduced electron transfer dynamics following a metal-to-ligand charge-transfer (MLCT) excitation of the [Fe(bmip)2]2+ photosensitizer, where bmip = 2,6-bis(3-methyl-imidazole-1- ylidine)-pyridine, with simultaneous femtosecond-resolution Fe Kα and K\b{eta} X-ray Emission Spectroscopy (XES) and Wide Angle X-ray Scattering (WAXS). This measurement clearly shows temporal oscillations in the XES and WAXS difference signals with the same 278 fs period oscillation. The oscillatory signal originates from an Fe-ligand stretching mode vibrational wavepacket on a triplet metal-centered (3MC) excited state surface. The vibrational wavepacket is created by 40% of the excited population that undergoes electron transfer from the non-equilibrium MLCT excited state to the 3MC excited state with a 110 fs time constant, while the other 60% relaxes to a 3MLCT excited state in parallel. The sensitivity of the Kα XES spectrum to molecular structure results from core-level vibronic coupling, due to a 0.7% average Fe-ligand bond length difference in the lowest energy geometry of the 1s and 2p core-ionized states. These results highlight the importance of vibronic effects in time-resolved XES experiments and demonstrate the role of metal-centered excited states in the electronic excited state relaxation dynamics of an Fe carbene photosensitizer.

physics.chem-ph