SearcharxivSearch

arXiv subjects

Marco Eckhoff

Publications and source records attributed to Marco Eckhoff.

16 recordsLinked to original sources

RuNNer 2.0: A Software Suite for High-Dimensional Neural Network Potentials

We present RuNNer 2.0, the "Ruhr University Neural Network energy representation", a highly optimized software suite for training and evaluating high-dimensional neural network potentials (HDNNPs) of the second, third, and fourth generation. Long-range electrostatics and charge equilibration (QEq) for the description of non-local charge transfer in fourth-generation (4G) HDNNPs are accelerated by quasi-linear-scaling plane-wave methods, reducing QEq computational complexity from $\mathcal{O}(N^3)$ to $\mathcal{O}(N\log^2 N)$ such that linear or quasi-linear scaling is achieved across all HDNNP generations. An optimized memory management strategy eliminates the training overhead traditionally associated with long-range interactions, allowing 4G-HDNNPs to be trained with the same efficiency as their local counterparts. Developed in modern Fortran (2003/2008 standards), combined with a hybrid MPI/OpenMP parallelization scheme, RuNNer 2.0 has been designed to run efficiently in any CPU environment, from cost-effective local workstations to massive HPC clusters. Its modular library architecture facilitates straightforward binding to external simulation software; native interfaces to LAMMPS and the Atomic Simulation Environment (ASE) provide full access to all its features, including built-in committee-based uncertainty quantification. The high efficiency and scalability of the RuNNer 2.0 ecosystem are demonstrated through detailed benchmarks.

physics.chem-ph

QDK/Chemistry: A Modular Toolkit for Quantum Chemistry Applications

We present QDK/Chemistry, a software toolkit for quantum chemistry workflows targeting quantum computers. The toolkit addresses a key challenge in the field: while quantum algorithms for chemistry have matured considerably, the infrastructure connecting classical electronic structure calculations to quantum circuit execution remains fragmented. QDK/Chemistry provides this infrastructure through a modular architecture that separates data representations from computational methods, enabling researchers to compose workflows from interchangeable components. In addition to providing native implementations of targeted algorithms in the quantum-classical pipeline, the toolkit builds upon and integrates with widely used open-source quantum chemistry packages and quantum computing frameworks through a plugin system, allowing users to combine methods from different sources without modifying workflow logic. This paper describes the design philosophy, current capabilities, and role of QDK/Chemistry as a foundation for reproducible quantum chemistry experiments.

quant-ph

How to use quantum computers for biomolecular free energies

Free energy calculations are at the heart of physics-based analyses of biochemical processes. They allow us to quantify molecular recognition mechanisms, which determine a wide range of biological phenomena from how cells send and receive signals to how pharmaceutical compounds can be used to treat diseases. Quantitative and predictive free energy calculations require computational models that accurately capture both the varied and intricate electronic interactions between molecules as well as the entropic contributions from motions of these molecules and their aqueous environment. However, accurate quantum-mechanical energies and forces can only be obtained for small atomistic models, not for large biomacromolecules. Here, we demonstrate how to consistently link accurate quantum-mechanical data obtained for substructures to the overall potential energy of biomolecular complexes by machine learning in an integrated algorithm. We do so using a two-fold quantum embedding strategy where the innermost quantum cores are treated at a very high level of accuracy. We demonstrate the viability of this approach for the molecular recognition of a ruthenium-based anticancer drug by its protein target, applying traditional quantum chemical methods. As such methods scale unfavorable with system size, we analyze requirements for quantum computers to provide highly accurate energies that impact the resulting free energies. Once the requirements are met, our computational pipeline FreeQuantum is able to make efficient use of the quantum computed energies, thereby enabling quantum computing enhanced modeling of biochemical processes. This approach combines the exponential speedups of quantum computers for simulating interacting electrons with modern classical simulation techniques that incorporate machine learning to model large molecules.

quant-ph

Lifelong Machine Learning Potentials for Chemical Reaction Network Explorations

Recent developments in computational chemistry facilitate the automated quantum chemical exploration of chemical reaction networks for the in-silico prediction of synthesis pathways, yield, and selectivity. However, the underlying quantum chemical energy calculations require vast computational resources, limiting these explorations severely in practice. Machine learning potentials (MLPs) offer a solution to increase computational efficiency, while retaining the accuracy of reliable first-principles data used for their training. Unfortunately, MLPs will be limited in their generalization ability within chemical (reaction) space, if the underlying training data are not representative for a given application. Within the framework of automated reaction network exploration, where new reactants or reagents composed of any elements from the periodic table can be introduced, this lack of generalizability will be the rule rather than the exception. Here, we therefore evaluate the benefits of the lifelong MLP concept in this context. Lifelong MLPs push their adaptability by efficient continual learning of additional data. We propose an improved learning algorithm for lifelong adaptive data selection yielding efficient integration of new data while previous expertise is preserved. In this way, we can reach chemical accuracy in reaction search trials.

physics.chem-ph

Machine Learning Enhanced Calculation of Quantum-Classical Binding Free Energies

Binding free energies are a key element in understanding and predicting the strength of protein--drug interactions. While classical free energy simulations yield good results for many purely organic ligands, drugs including transition metal atoms often require quantum chemical methods for an accurate description. We propose a general and automated workflow that samples the potential energy surface with hybrid quantum mechanics/molecular mechanics (QM/MM) calculations and trains a machine learning (ML) potential on the QM energies and forces to enable efficient alchemical free energy simulations. To represent systems including many different chemical elements efficiently and to account for the different description of QM and MM atoms, we propose an extension of element-embracing atom-centered symmetry functions for QM/MM data as an ML descriptor. The ML potential approach takes electrostatic embedding and long-range electrostatics into account. We demonstrate the applicability of the workflow on the well-studied protein--ligand complex of myeloid cell leukemia 1 and the inhibitor 19G and on the anti-cancer drug NKP1339 acting on the glucose-regulated protein 78.

physics.chem-ph

Hierarchical quantum embedding by machine learning for large molecular assemblies

We present a quantum-in-quantum embedding strategy coupled to machine learning potentials to improve on the accuracy of quantum-classical hybrid models for the description of large molecules. In such hybrid models, relevant structural regions (such as those around reaction centers or pockets for binding of host molecules) can be described by a quantum model that is then embedded into a classical molecular-mechanics environment. However, this quantum region may become so large that only approximate electronic structure models are applicable. To then restore accuracy in the quantum description, we here introduce the concept of quantum cores within the quantum region that are amenable to accurate electronic structure models due to their limited size. Huzinaga-type projection-based embedding, for example, can deliver accurate electronic energies obtained with advanced electronic structure methods. The resulting total electronic energies are then fed into a transfer learning approach that efficiently exploits the higher-accuracy data to improve on a machine learning potential obtained for the original quantum-classical hybrid approach. We explore the potential of this approach in the context of a well-studied protein-ligand complex for which we calculate the free energy of binding using alchemical free energy and non-equilibrium switching simulations.

physics.chem-ph

NEAR: A Training-Free Pre-Estimator of Machine Learning Model Performance

Artificial neural networks have been shown to be state-of-the-art machine learning models in a wide variety of applications, including natural language processing and image recognition. However, building a performant neural network is a laborious task and requires substantial computing power. Neural Architecture Search (NAS) addresses this issue by an automatic selection of the optimal network from a set of potential candidates. While many NAS methods still require training of (some) neural networks, zero-cost proxies promise to identify the optimal network without training. In this work, we propose the zero-cost proxy \textit{Network Expressivity by Activation Rank} (NEAR). It is based on the effective rank of the pre- and post-activation matrix, i.e., the values of a neural network layer before and after applying its activation function. We demonstrate the cutting-edge correlation between this network score and the model accuracy on NAS-Bench-101 and NATS-Bench-SSS/TSS. In addition, we present a simple approach to estimate the optimal layer sizes in multi-layer perceptrons. Furthermore, we show that this score can be utilized to select hyperparameters such as the activation function and the neural network weight initialization scheme.

cs.LG

SCINE -- Software for Chemical Interaction Networks

The software for chemical interaction networks (SCINE) project aims at pushing the frontier of quantum chemical calculations on molecular structures to a new level. While calculations on individual structures as well as on simple relations between them e.g., as given by an intrinsic reaction coordinate) have become routine in chemistry, new developments have pushed the frontier in the field to high-throughput calculations. Chemical relations may be created by a search for specific molecular properties in a molecular design attempt or they can be defined by a set of elementary reaction steps that form a chemical reaction network. The software modules of SCINE have been designed to facilitate such studies. The features of the modules are (i) general applicability of the applied methodologies ranging from electronic structure (no restriction to specific elements of the periodic table) to microkinetic modeling (with little restrictions on molecularity), full modularity so that SCINE modules can also be applied as stand-alone programs or be exchanged for external software packages that fulfill a similar purpose (to increase options for computational campaigns and to provide alternatives in case of tasks that are hard or impossible to accomplish with certain programs), (ii) high stability and autonomous operations so that control and steering by an operator is as easy as possible, and (iii) easy embedding into complex heterogeneous environments for molecular structures taken individually or in the context of a reaction network. A graphical user interface unites all modules and ensures interoperability. All components of the software have been made available open source and free of charge.

physics.chem-ph

CoRe Optimizer: An All-in-One Solution for Machine Learning

The optimization algorithm and its hyperparameters can significantly affect the training speed and resulting model accuracy in machine learning applications. The wish list for an ideal optimizer includes fast and smooth convergence to low error, low computational demand, and general applicability. Our recently introduced continual resilient (CoRe) optimizer has shown superior performance compared to other state-of-the-art first-order gradient-based optimizers for training lifelong machine learning potentials. In this work we provide an extensive performance comparison of the CoRe optimizer and nine other optimization algorithms including the Adam optimizer and resilient backpropagation (RPROP) for diverse machine learning tasks. We analyze the influence of different hyperparameters and provide generally applicable values. The CoRe optimizer yields best or competitive performance in every investigated application, while only one hyperparameter needs to be changed depending on mini-batch or batch learning.

cs.LG

Lifelong Machine Learning Potentials

Machine learning potentials (MLPs) trained on accurate quantum chemical data can retain the high accuracy, while inflicting little computational demands. On the downside, they need to be trained for each individual system. In recent years, a vast number of MLPs has been trained from scratch because learning additional data typically requires to train again on all data to not forget previously acquired knowledge. Additionally, most common structural descriptors of MLPs cannot represent efficiently a large number of different chemical elements. In this work, we tackle these problems by introducing element-embracing atom-centered symmetry functions (eeACSFs) which combine structural properties and element information from the periodic table. These eeACSFs are a key for our development of a lifelong machine learning potential (lMLP). Uncertainty quantification can be exploited to transgress a fixed, pre-trained MLP to arrive at a continuously adapting lMLP, because a predefined level of accuracy can be ensured. To extend the applicability of an lMLP to new systems, we apply continual learning strategies to enable autonomous and on-the-fly training on a continuous stream of new data. For the training of deep neural networks, we propose the continual resilient (CoRe) optimizer and incremental learning strategies relying on rehearsal of data, regularization of parameters, and the architecture of the model.

cs.LG

Insights into lithium manganese oxide-water interfaces using machine learning potentials

Unraveling the atomistic and the electronic structure of solid-liquid interfaces is the key to the design of new materials for many important applications, from heterogeneous catalysis to battery technology. Density functional theory (DFT) calculations can in principle provide a reliable description of such interfaces, but the high computational costs severely restrict the accessible time and length scales. Here, we report machine learning-driven simulations of various interfaces between water and lithium manganese oxide (Li$_x$Mn$_2$O$_4$), an important electrode material in lithium ion batteries and a catalyst for the oxygen evolution reaction. We employ a high-dimensional neural network potential (HDNNP) to compute the energies and forces several orders of magnitude faster than DFT without loss in accuracy. In addition, a high-dimensional neural network for spin prediction (HDNNS) is utilized to analyze the electronic structure of the manganese ions. Combining these methods, a series of interfaces is investigated by large-scale molecular dynamics. The simulations allow us to gain insights into a variety of properties like the dissociation of water molecules, proton transfer processes, and hydrogen bonds, as well as the geometric and electronic structure of the solid surfaces including the manganese oxidation state distribution, Jahn-Teller distortions, and electron hopping.

cond-mat.mtrl-sci

High-Dimensional Neural Network Potentials for Magnetic Systems Using Spin-Dependent Atom-Centered Symmetry Functions

Machine learning potentials have emerged as a powerful tool to extend the time and length scales of first principles-quality simulations. Still, most machine learning potentials cannot distinguish different electronic spin orientations and thus are not applicable to materials in different magnetic states. Here, we propose spin-dependent atom-centered symmetry functions as a new type of descriptor taking the atomic spin degrees of freedom into account. When used as input for a high-dimensional neural network potential (HDNNP), accurate potential energy surfaces of multicomponent systems describing multiple magnetic states can be constructed. We demonstrate the performance of these magnetic HDNNPs for the case of manganese oxide, MnO. We show that the method predicts the magnetically distorted rhombohedral structure in excellent agreement with density functional theory and experiment. Its efficiency allows to determine the Néel temperature considering structural fluctuations, entropic effects, and defects. The method is general and is expected to be useful also for other types of systems like oligonuclear transition metal complexes.

physics.comp-ph

Predicting Oxidation and Spin States by High-Dimensional Neural Networks: Applications to Lithium Manganese Oxide Spinels

Lithium ion batteries often contain transition metal oxides like Li$_{x}$Mn$_2$O$_4$ ($0\leq x\leq2$). Depending on the Li content different ratios of Mn$^\text{III}$ to Mn$^\text{IV}$ ions are present. In combination with electron hopping the Jahn-Teller distortions of the Mn$^\text{III}$O$_6$ octahedra can give rise to complex phenomena like structural transitions and conductance. While for small model systems oxidation and spin states can be determined using density functional theory (DFT), the investigation of dynamical phenomena by DFT is too demanding. Previously, we have shown that a high-dimensional neural network potential can extend molecular dynamics (MD) simulations of Li$_{x}$Mn$_2$O$_4$ to nanosecond time scales, but these simulations did not provide information about the electronic structure. Here we extend the use of neural networks to the prediction of atomic oxidation and spin states. The resulting high-dimensional neural network is able to predict the spins of the Mn ions with an error of only 0.03 $\hbar$. We find that the Mn e$_\text{g}$ electrons are correctly conserved and that the number of Jahn-Teller distorted Mn$^\text{III}$O$_6$ octahedra is predicted precisely for different Li loadings. A charge ordering transition is observed between 280 and 300 K, which matches resistivity measurements. Moreover, the activation energy of the electron hopping conduction above the phase transition is predicted to be 0.18 eV deviating only 0.02 eV from experiment. This work demonstrates that machine learning is able to provide an accurate representation of both, the geometric and the electronic structure dynamics of Li$_x$Mn$_2$O$_4$, on time and length scales that are not accessible by ab initio MD.

cond-mat.mtrl-sci

Closing the gap between theory and experiment for lithium manganese oxide spinels using a high-dimensional neural network potential

Many positive electrode materials in lithium ion batteries include transition metals which are difficult to describe by electronic structure methods like density functional theory (DFT) due to the presence of multiple oxidation states. A prominent example is the lithium manganese oxide spinel Li$_x$Mn$_2$O$_4$ with $0\leq x\leq2$. While DFT, employing the local hybrid functional PBE0r, provides a reliable description, the need for extended computer simulations of large structural models remains a significant challenge. Here, we close this gap by constructing a DFT-based high-dimensional neural network potential (HDNNP) providing accurate energies and forces at a fraction of the computational costs. As different oxidation states and the resulting Jahn-Teller distortions represent a new level of complexity for HDNNPs, the potential is carefully validated by performing X-ray diffraction experiments. We demonstrate that the HDNNP provides atomic level details and is able to predict a series of properties like the lattice parameters and expansion with increasing Li content or temperature, the orthorhombic to cubic transition, the lithium diffusion barrier, and the phonon frequencies. We show that for understanding these properties access to large time and length scales as enabled by the HDNNP is essential to close the gap between theory and experiment.

cond-mat.mtrl-sci

A criticial view on e$_g$ occupancy as a descriptor for oxygen evolution catalytic activity in LiMn$_2$O$_4$ nanoparticles

We investigate the effect of the surface electronic structure and composition of LiMn$_2$O$_4$ nanoparticles on the electrocatalytic oxygen evolution reaction (OER). Scanning transmission electron microscopy (STEM) electron energy loss spectroscopy (EELS) studies combined with density functional theory (DFT) based simulations of the EEL spectra reveal in pristine nanoparticles a 4 nm thick surface layer with reduced average Mn oxidation state and increased Mn concentration. This is attributed to Mn$^{2+}$ partially replacing Li$^+$ at the tetrahedral sites of the spinel lattice accompanied by Mn 3d-state filling of octahedrally coordinated Mn. During electrocatalytic OER cycling, this near-surface tetrahedral Mn is leached out, thereby increasing the oxidation state of octahedrally coordinated Mn. Using rotating ring-disc electrode (RRDE) based detection of O and Mn during the OER, we show that the oxygen evolution remains constant while the Mn$^{2+}$ is removed, revealing that near-surface tetrahedrally coordinated Mn has no effect on the OER activity of LiMn$_2$O$_4$. This is surprising since the e$_g$ occupancy of Mn in octahedral sites, which is widely used as a descriptor of OER activity, changes significantly in the surface layer during cycling. The fact that e$_g$ emptying fails to correlate with OER activity here indicates that octahedral cation valence is not a fundamental measure of activity, either because the active surface state is not affected by tetrahedral Mn or because other details of the band structure or metal-oxygen bonding character, more strongly regulate the rate-limiting steps for OER.

cond-mat.mtrl-sci

A Hybrid Density Functional Theory Benchmark Study on Lithium Manganese Oxides

The lithium manganese oxide spinel Li$_x$Mn$_2$O$_4$, with $0\leq x\leq 2$, is an important example for cathode materials in lithium ion batteries. However, an accurate description of Li$_x$Mn$_2$O$_4$ by first-principles methods like density functional theory is far from trivial due to its complex electronic structure, with a variety of energetically close electronic and magnetic states. It was found that the local density approximation as well as the generalized gradient approximation (GGA) are unable to describe Li$_x$Mn$_2$O$_4$ correctly. Here, we report an extensive benchmark for different Li$_x$Mn$_y$O$_z$ systems using the hybrid functionals PBE0 and HSE06, as well as the recently introduced local hybrid functional PBE0r. We find that all of these functionals yield energetic, structural, electronic, and magnetic properties in good agreement with experimental data. The notable benefit of the PBE0r functional, which relies on on-site Hartree-Fock exchange only, is a much reduced computational effort that is comparable to GGA functionals. Furthermore, the Hartree-Fock mixing factors in PBE0r are smaller than in PBE0, which improves the results for (lithium) manganese oxides. The investigation of Li$_x$Mn$_2$O$_4$ shows that two Mn oxidation states, +III and +IV, coexist. The Mn$^\text{III}$ ions are in the high-spin state and the corresponding MnO$_6$ octahedra are Jahn-Teller distorted. The ratio between Mn$^\text{III}$ and Mn$^\text{IV}$ and thus the electronic structure changes with the Li content while no major structural changes occur in the range from $x=0$ to $1$. This work demonstrates that the PBE0r functional provides an equally accurate and efficient description of the investigated Li$_x$Mn$_y$O$_z$ systems.

cond-mat.mtrl-sci