arXiv subjects

Linfeng Zhang

Publications and source records attributed to Linfeng Zhang.

At least 289 records · Page 16Linked to original sources

arXiv2022

Ab-initio study of interacting fermions at finite temperature with neural canonical transformation

We present a variational density matrix approach to the thermal properties of interacting fermions in the continuum. The variational density matrix is parametrized by a permutation equivariant many-body unitary transformation together with a discrete probabilistic model. The unitary transformation is implemented as a quantum counterpart of neural canonical transformation, which incorporates correlation effects via a flow of fermion coordinates. As the first application, we study electrons in a two-dimensional quantum dot with an interaction-induced crossover from Fermi liquid to Wigner molecule. The present approach provides accurate results in the low-temperature regime, where conventional quantum Monte Carlo methods face severe difficulties due to the fermion sign problem. The approach is general and flexible for further extensions, thus holds the promise to deliver new physical results on strongly correlated fermions in the context of ultracold quantum gases, condensed matter, and warm dense matter physics.

cond-mat.str-el↗

arXiv2022

Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation

Remarkable achievements have been attained with Generative Adversarial Networks (GANs) in image-to-image translation. However, due to a tremendous amount of parameters, state-of-the-art GANs usually suffer from low efficiency and bulky memory usage. To tackle this challenge, firstly, this paper investigates GANs performance from a frequency perspective. The results show that GANs, especially small GANs lack the ability to generate high-quality high frequency information. To address this problem, we propose a novel knowledge distillation method referred to as wavelet knowledge distillation. Instead of directly distilling the generated images of teachers, wavelet knowledge distillation first decomposes the images into different frequency bands with discrete wavelet transformation and then only distills the high frequency bands. As a result, the student GAN can pay more attention to its learning on high frequency bands. Experiments demonstrate that our method leads to 7.08 times compression and 6.80 times acceleration on CycleGAN with almost no performance drop. Additionally, we have studied the relation between discriminators and generators which shows that the compression of discriminators can promote the performance of compressed generators.

cs.CV↗

arXiv2022

Machine-learning interatomic potential for molecular dynamics simulation of ferroelectric KNbO3 perovskite

Ferroelectric perovskites have been ubiquitously applied in piezoelectric devices for decades, among which, eco-friendly lead-free (K,Na)NbO3-based materials have been recently demonstrated to be an excellent candidate for sustainable development. Molecular dynamics is a versatile theoretical calculation approach for the investigation of the dynamical properties of ferroelectric perovskites. However, molecular dynamics simulation of ferroelectric perovskites has been limited to simple systems, since the conventional construction of interatomic potential is rather difficult and inefficient. In the present study, we construct a machine-learning interatomic potential of KNbO3 (as a representative system of (K,Na)NbO3) by using a deep neural network model. Including first-principles calculation data into the training dataset ensures the quantum-mechanics accuracy of the interatomic potential. The molecular dynamics based on machine-learning interatomic potential shows good agreement with the first-principles calculations, which can accurately predict multiple fundamental properties, e.g., atomic force, energy, elastic properties, and phonon dispersion. In addition, the interatomic potential exhibits satisfactory performance in the simulation of domain wall and temperature-dependent phase transition. The construction of interatomic potential based on machine learning could potentially be transferred to other ferroelectric perovskites and consequently benefits the theoretical study of ferroelectrics.

cond-mat.mtrl-sci↗

arXiv2022

Deep Potentials for Materials Science

To fill the gap between accurate (and expensive) ab initio calculations and efficient atomistic simulations based on empirical interatomic potentials, a new class of descriptions of atomic interactions has emerged and been widely applied; i.e., machine learning potentials (MLPs). One recently developed type of MLP is the Deep Potential (DP) method. In this review, we provide an introduction to DP methods in computational materials science. The theory underlying the DP method is presented along with a step-by-step introduction to their development and use. We also review materials applications of DPs in a wide range of materials systems. The DP Library provides a platform for the development of DPs and a database of extant DPs. We discuss the accuracy and efficiency of DPs compared with ab initio methods and empirical potentials.

cond-mat.mtrl-sci↗

arXiv2022

Neural network representation of electronic structure from $ab$ $initio$ molecular dynamics

Despite their rich information content, electronic structure data amassed at high volumes in $ab$ $initio$ molecular dynamics simulations are generally under-utilized. We introduce a transferable high-fidelity neural network representation of such data in the form of tight-binding Hamiltonians for crystalline materials. This predictive representation of $ab$ $initio$ electronic structure, combined with machine-learning boosted molecular dynamics, enables efficient and accurate electronic evolution and sampling. When applied to a one-dimension charge-density wave material, carbyne, we are able to compute the spectral function and optical conductivity in the canonical ensemble. The spectral functions evaluated during soliton-antisoliton pair annihilation process reveal significant renormalization of low-energy edge modes due to retarded electron-lattice coupling beyond the Born-Oppenheimer limit. The availability of an efficient and reusable surrogate model for the electronic structure dynamical system will enable calculating many interesting physical properties, paving way to previously inaccessible or challenging avenues in materials modeling.

cond-mat.mtrl-sci↗

arXiv2022

A deep potential model with long-range electrostatic interactions

Machine learning models for the potential energy of multi-atomic systems, such as the deep potential (DP) model, make possible molecular simulations with the accuracy of quantum mechanical density functional theory, at a cost only moderately higher than that of empirical force fields. However, the majority of these models lack explicit long-range interactions and fail to describe properties that derive from the Coulombic tail of the forces. To overcome this limitation we extend the DP model by approximating the long-range electrostatic interaction between ions (nuclei+core electrons) and valence electrons with that of distributions of spherical Gaussian charges located at ionic and electronic sites. The latter are rigorously defined in terms of the centers of the maximally localized Wannier distributions, whose dependence on the local atomic environment is modeled accurately by a deep neural network. In the deep potential long-range (DPLR) model, the electrostatic energy of the Gaussian charge system is added to short-range interactions that are represented as in the standard DP model. The resulting potential energy surface is smooth and possesses analytical forces and virial. Missing effects in the standard DP scheme are recovered, improving on accuracy and predictive power. By including long-range electrostatics, DPLR correctly extrapolates to large systems the potential energy surface learned from quantum mechanical calculations on smaller systems. We illustrate the approach with three examples, the potential energy profile of the water dimer, the free energy of interaction of a water molecule with a liquid water slab, and the phonon dispersion curves of the NaCl crystal.

physics.chem-ph↗

arXiv2022

Universal approximation of symmetric and anti-symmetric functions

We consider universal approximations of symmetric and anti-symmetric functions, which are important for applications in quantum physics, as well as other scientific and engineering computations. We give constructive approximations with explicit bounds on the number of parameters with respect to the dimension and the target accuracy $ε$. While the approximation still suffers from the curse of dimensionality, to the best of our knowledge, these are the first results in the literature with explicit error bounds for functions with symmetry or anti-symmetry constraints.

math.NA↗

arXiv2022

Structural Phase Transitions in SrTiO3 from Deep Potential Molecular Dynamics

Strontium titanate (SrTiO3) is regarded as an essential material for oxide electronics. One of its many remarkable features is subtle structural phase transition, driven by antiferrodistortive lattice mode, from a high-temperature cubic phase to a low-temperature tetragonal phase. Classical molecular dynamics (MD) simulation is an efficient technique to reveal atomistic features of phase transition, but its application is often limited by the accuracy of empirical interatomic potentials. Here, we develop an accurate deep potential (DP) model of SrTiO3 based on a machine learning method using data from first-principles density functional theory (DFT) calculations. The DP model has DFT-level accuracy, capable of performing efficient MD simulations and accurate property predictions. Using the DP model, we investigate the temperature-driven cubic-to-tetragonal phase transition and construct the in-plane biaxial strain-temperature phase diagram of SrTiO3. The simulations demonstrate that strain-induced ferroelectric phase is characterized by two order parameters, ferroelectric distortion and antiferrodistortion, and the ferroelectric phase transition has both displacive and order-disorder characters. This works lays the foundation for the development of accurate DP models of other complex perovskite materials.

cond-mat.mtrl-sci↗

arXiv2022

Extending the limit of molecular dynamics with ab initio accuracy to 10 billion atoms

High-performance computing, together with a neural network model trained from data generated with first-principles methods, has greatly boosted applications of \textit{ab initio} molecular dynamics in terms of spatial and temporal scales on modern supercomputers. Previous state-of-the-art can achieve $1-2$ nanoseconds molecular dynamics simulation per day for 100-million atoms on the entire Summit supercomputer. In this paper, we have significantly reduced the memory footprint and computational time by a comprehensive approach with both algorithmic and system innovations. The neural network model is compressed by model tabulation, kernel fusion, and redundancy removal. Then optimizations such as acceleration of customized kernel, tabulation of activation function, MPI+OpenMP parallelization are implemented on GPU and ARM architectures. Testing results of the copper system show that the optimized code can scale up to the entire machine of both Fugaku and Summit, and the corresponding system size can be extended by a factor of $134$ to an unprecedented $17$ billion atoms. The strong scaling of a $13.5$-million atom copper system shows that the time-to-solution can be 7 times faster, reaching $11.2$ nanoseconds per day. This work opens the door for unprecedentedly large-scale molecular dynamics simulations based on {\it ab initio} accuracy and can be potentially utilized in studying more realistic applications such as mechanical properties of metals, semiconductor devices, batteries, etc. The optimization techniques detailed in this paper also provide insight for relevant high-performance computing applications.

cs.DC↗

arXiv2021

Efficient sampling of high-dimensional free energy landscapes using adaptive reinforced dynamics

Enhanced sampling methods such as metadynamics and umbrella sampling have become essential tools for exploring the configuration space of molecules and materials. At the same time, they have long faced a number of issues such as the inefficiency when dealing with a large number of collective variables (CVs) or systems with high free energy barriers. In this work, we show that with \redc{the clustering and adaptive tuning techniques}, the reinforced dynamics (RiD) scheme can be used to efficiently explore the configuration space and free energy landscapes with a large number of CVs or systems with high free energy barriers. We illustrate this by studying various representative and challenging examples. Firstly we demonstrate the efficiency of adaptive RiD compared with other methods, and construct the 9-dimensional free energy landscape of peptoid trimer which has energy barriers of more than 8 kcal/mol. We then study the folding of the protein chignolin using 18 CVs. In this case, both the folding and unfolding rates are observed to be equal to 4.30~$μs^{-1}$. Finally, we propose a protein structure refinement protocol based on RiD. This protocol allows us to efficiently employ more than 100 CVs for exploring the landscape of protein structures and it gives rise to an overall improvement of 14.6 units over the initial Global Distance Test-High Accuracy (GDT-HA) score.

physics.chem-ph↗

arXiv2021

Heat transport in liquid water from first-principles and deep-neural-network simulations

We compute the thermal conductivity of water within linear response theory from equilibrium molecular dynamics simulations, by adopting two different approaches. In one, the potential energy surface (PES) is derived on the fly from the electronic ground state of density functional theory (DFT) and the corresponding analytical expression is used for the energy flux. In the other, the PES is represented by a deep neural network (DNN) trained on DFT data, whereby the PES has an explicit local decomposition and the energy flux takes a particularly simple expression. By virtue of a gauge invariance principle, established by Marcolongo, Umari, and Baroni, the two approaches should be equivalent if the PES were reproduced accurately by the DNN model. We test this hypothesis by calculating the thermal conductivity, at the GGA (PBE) level of theory, using the direct formulation and its DNN proxy, finding that both approaches yield the same conductivity, in excess of the experimental value by approximately 60%. Besides being numerically much more efficient than its direct DFT counterpart, the DNN scheme has the advantage of being easily applicable to more sophisticated DFT approximations, such as meta-GGA and hybrid functionals, for which it would be hard to derive analytically the expression of the energy flux. We find in this way, that a DNN model, trained on meta-GGA (SCAN) data, reduce the deviation from experiment of the predicted thermal conductivity by about 50%, leaving the question open as to whether the residual error is due to deficiencies of the functional, to a neglect of nuclear quantum effects in the atomic dynamics, or, likely, to a combination of the two.

cond-mat.mtrl-sci↗

arXiv2021

Deep Learning Inter-atomic Potential for Thermal and Phonon Behaviour of Silicon Carbide with Quantum Accuracy

Silicon carbide (SiC) is an essential material for next generation semiconductors and components for nuclear plants. It's applications are strongly dependent on its thermal conductivity, which is highly sensitive to microstructures. Molecular dynamics (MD) simulation is the most used methods to address thermal transportation mechanisms in devices or microstructures of nano-meters. However, the implementation of MD is limited in SiC because of lacking accurate inter-atomic potentials. In this work, using the Deep Potential (DP) methodology, we developed two inter-atomic potentials (DP-IAPs) for SiC based on two adaptively generated datasets within the density functional approximations at the local density and the generalized gradient levels. These two DP-IAPs manifest their speed with quantum accuracy in lattice dynamics simulations as well as scattering rate analysis of phonon transportation. Combining with molecular dynamics simulations, the thermal transport and mechanical properties were systematically investigated. The presented methodology and the inter-atomic potentials pave the way for a systematic approach to model heat transport in SiC related devices using multiscale modelling.

cond-mat.mtrl-sci↗

arXiv2021

A Generalizable Machine-learning Potential of Ag-Au Nanoalloys and its Application on Surface Reconstruction, Segregation and Diffusion

Owing to the excellent catalysis properties of Ag-Au binary nanoalloy, nanostructured Ag-Au, such as Ag-Au nanoparticles and nanopillars, have been under intense investigation. To achieve high accuracy in molecular simulations of the Ag-Au nanoalloys, the surface properties are required to be modeled with first-principles precision. In this work, we propose a generalizable machine-learning interatomic potential for the Ag-Au nanoalloys based on deep neural networks, trained from a database constructed with the first-principle calculations. This potential is highlighted by the accurate prediction of Au (111) surface reconstruction and the segregation of Au towards the Ag-Au nanoalloy surface, where the empirical force field failed in both cases. Moreover, regarding the adsorption and diffusion of adatoms on surfaces, the overall performance of our potential is better than the empirical force fields. We stress that the reported surface properties are blind to the potential modeling in the sense that none of the surface configurations is explicitly included in the training database, therefore, the reported potential is expected to have a strong ability of generalization to a wide range of properties and to play a key role in the investigation of nanostructured Ag-Au evolution, where the accurate descriptions of free surfaces are necessary.

cond-mat.mtrl-sci↗

arXiv2021

DeePKS-kit: a package for developing machine learning-based chemically accurate energy and density functional models

We introduce DeePKS-kit, an open-source software package for developing machine learning based energy and density functional models. DeePKS-kit is interfaced with PyTorch, an open-source machine learning library, and PySCF, an ab initio computational chemistry program that provides simple and customized tools for developing quantum chemistry codes. It supports the DeePHF and DeePKS methods. In addition to explaining the details in the methodology and the software, we also provide an example of developing a chemically accurate model for water clusters.

physics.chem-ph↗

arXiv2021

Modeling liquid water by climbing up Jacob's ladder in density functional theory facilitated by using deep neural network potentials

Within the framework of Kohn-Sham density functional theory (DFT), the ability to provide good predictions of water properties by employing a strongly constrained and appropriately normed (SCAN) functional has been extensively demonstrated in recent years. Here, we further advance the modeling of water by building a more accurate model on the fourth rung of Jacob's ladder with the hybrid functional, SCAN0. In particular, we carry out both classical and Feynman path-integral molecular dynamics calculations of water with the SCAN0 functional and the isobaric-isothermal ensemble. In order to generate the equilibrated structure of water, a deep neural network potential is trained from the atomic potential energy surface based on ab initio data obtained from SCAN0 DFT calculations. For the electronic properties of water, a separate deep neural network potential is trained using the Deep Wannier method based on the maximally localized Wannier functions of the equilibrated trajectory at the SCAN0 level. The structural, dynamic, and electric properties of water were analyzed. The hydrogen-bond structures, density, infrared spectra, diffusion coefficients, and dielectric constants of water, in the electronic ground state, are computed using a large simulation box and long simulation time. For the properties involving electronic excitations, we apply the GW approximation within many-body perturbation theory to calculate the quasiparticle density of states and bandgap of water. Compared to the SCAN functional, mixing exact exchange mitigates the self-interaction error in the meta-generalized-gradient approximation and further softens liquid water towards the experimental direction. For most of the water properties, the SCAN0 functional shows a systematic improvement over the SCAN functional.

physics.chem-ph↗

arXiv2021

Accurate Deep Potential model for the Al-Cu-Mg alloy in the full concentration space

Combining first-principles accuracy and empirical-potential efficiency for the description of the potential energy surface (PES) is the philosopher's stone for unraveling the nature of matter via atomistic simulation. This has been particularly challenging for multi-component alloy systems due to the complex and non-linear nature of the associated PES. In this work, we develop an accurate PES model for the Al-Cu-Mg system by employing Deep Potential (DP), a neural network based representation of the PES, and DP Generator (DP-GEN), a concurrent-learning scheme that generates a compact set of ab initio data for training. The resulting DP model gives predictions consistent with first-principles calculations for various binary and ternary systems on their fundamental energetic and mechanical properties, including formation energy, equilibrium volume, equation of state, interstitial energy, vacancy and surface formation energy, as well as elastic moduli. Extensive benchmark shows that the DP model is ready and will be useful for atomistic modeling of the Al-Cu-Mg system within the full range of concentration.

cond-mat.mtrl-sci↗

arXiv2021

The Phase Diagram of a Deep Potential Water Model

Using the Deep Potential methodology, we construct a model that reproduces accurately the potential energy surface of the SCAN approximation of density functional theory for water, from low temperature and pressure to about 2400 K and 50 GPa, excluding the vapor stability region. The computational efficiency of the model makes it possible to predict its phase diagram using molecular dynamics. Satisfactory overall agreement with experimental results is obtained. The fluid phases, molecular and ionic, and all the stable ice polymorphs, ordered and disordered, are predicted correctly, with the exception of ice III and XV that are stable in experiments, but metastable in the model. The evolution of the atomic dynamics upon heating, as ice VII transforms first into ice VII$''$ and then into an ionic fluid, reveals that molecular dissociation and breaking of the ice rules coexist with strong covalent fluctuations, explaining why only partial ionization was inferred in experiments.

physics.chem-ph↗

arXiv2021

Deep Potential generation scheme and simulation protocol for the Li10GeP2S12-type superionic conductors

It has been a challenge to accurately simulate Li-ion diffusion processes in battery materials at room temperature using {\it ab initio} molecular dynamics (AIMD) due to its high computational cost. This situation has changed drastically in recent years due to the advances in machine learning-based interatomic potentials. Here we implement the Deep Potential Generator scheme to \textit{automatically} generate interatomic potentials for LiGePS-type solid-state electrolyte materials. This increases our ability to simulate such materials by several orders of magnitude without sacrificing {\it ab initio} accuracy. Important technical aspects like the statistical error and size effects are carefully investigated. We further establish a reliable protocol for accurate computation of Li-ion diffusion processes at experimental conditions, by investigating important technical aspects like the statistical error and size effects. Such a protocol and the automated workflow allow us to screen materials for their relevant properties with much-improved efficiency. By using the protocol and automated workflow developed here, we obtain the diffusivity data and activation energies of Li-ion diffusion that agree well with the experiment. Our work paves the way for future investigation of Li-ion diffusion mechanisms and optimization of Li-ion conductivity of solid-state electrolyte materials.

physics.comp-ph↗