arXiv subjects

Zongrui Pei

Publications and source records attributed to Zongrui Pei.

12 recordsLinked to original sources

arXiv2026

Machine Learning for High-Entropy Catalysts: Methods and Applications

High-entropy alloys (HEAs) exhibit exceptional catalytic performance in various reactions due to their high configurational entropy, synergistic elemental effects, tunable electronic structures, and excellent structural stability. However, the vast compositional space of HEA catalysts makes traditional experimental and theoretical design costly and inefficient. In recent years, data-driven machine learning (ML) methods have emerged as powerful tools for studying HEAs in catalysis. Through predictive models and ML surrogates, researchers can decipher the intricate composition-structure-performance relationships of these materials. In addition, by leveraging large language models (LLMs) for knowledge extraction, hypothesis generation and validation, and as a foundation to build integrated design workflows, ML approaches can significantly accelerate the design of novel HEA catalysts. This review systematically summarizes the latest methodological advances and applications of ML methods for HEAs in catalysis, discusses the challenges, and offers insights into future research directions to support the rational design and efficient development of catalysts.

cond-mat.mtrl-sci↗

arXiv2026

Towards Computational Microscope of Chemical Order-Disorder via ML-Accelerated Monte Carlo Simulation

Tailoring the performance of next-generation high entropy materials requires a deep understanding of the competition between entropy-driven random solid solution and enthalpy-driven chemical ordering. Investigating such order and disorder complexity demands atomistic simulations that achieve high accuracy, efficiency, and generalizability across vast spatial, temporal, and especially chemical scales. While machine learning (ML) interatomic potentials have transformed molecular dynamics, they remain limited in capturing diffusion-driven chemical evolution over long timescales. The recently introduced SMC-X method brings exciting opportunities. Realizing its full potential requires a comprehensive study, which is the focus of this work. To assess model performance, we systematically benchmark invariant and equivariant architectures using a density functional theory dataset of more than 10,000 configurations spanning seven elements: Fe, Co, Ni, Al, Ti, Ta, and V. To understand the roles of pairwise and higher-order interactions, we decouple their contributions across chemical space using an explainable machine learning approach. We also examine the impact of lattice relaxation by comparing models trained on datasets with and without structural relaxation. Our results clarify how to choose ML surrogate models for Monte Carlo simulations, bridge the gap between theory and experiment, and lay a foundation for establishing ML-accelerated Monte Carlo as a computational microscope for chemical complexity.

cond-mat.mtrl-sci↗

arXiv2025

Statistical physics for artificial neural networks

The 2024 Nobel Prize in Physics was awarded for pioneering contributions at the intersection of artificial neural networks (ANNs) and spin-glass physics, underscoring the profound connections between these fields. The topological similarities between ANNs and Ising-type models, such as the Sherrington-Kirkpatrick model, reveal shared structures that bridge statistical physics and machine learning. In this perspective, we explore how concepts and methods from statistical physics, particularly those related to glassy and disordered systems like spin glasses, are applied to the study and development of ANNs. We discuss the key differences, common features, and deep interconnections between spin glasses and neural networks while highlighting future directions for this interdisciplinary research. Special attention is given to the synergy between spin-glass studies and neural network advancements and the challenges that remain in statistical physics for ANNs. Finally, we examine the transformative role that quantum computing could play in addressing these challenges and propelling this research frontier forward.

cond-mat.dis-nn↗

arXiv2025

Revealing Nanostructures in High-Entropy Alloys via Machine-Learning Accelerated Scalable Monte Carlo Simulation

The computational cost of traditional first-principles method quickly becomes prohibitively expensive as the number of atoms increases. This challenge is further amplified by the need to evaluate finite-temperature properties with Monte Carlo (MC) simulations, which is inherently challenging to parallelize due to sequential Markov chain updates. Here, we introduce Scalable Monte Carlo (SMC), an efficient MC simulation method that overcomes the parallelization bottlenecks in conventional MC simulation, reducing the computational complexity of a MC sweep from quadratic to linear. We present a GPU implementation of the SMC method, SMC-GPU, which simultaneously harnesses the thousands of processing cores on a GPU to accelerate the computation. By adopting a data-driven workflow that surrogates the computationally expensive density functional theory (DFT) with ML models, we demonstrate that SMC-GPU is capable of simulating systems of more than one-billion atoms, while maintaining the accuracy of first-principles methods. Using this unprecedented capability, we performed billion-atom MC simulations to investigate the nanostructure evolution of two important high-entropy alloys (HEAs), FeCoNiAlTi and MoNbTaW, in which the nanostructures are believed to be responsible for their superb mechanical properties. Our results reveal a rich diversity of nanostructures, including nanoparticles (NP), 3D-connected NP, and disorder protected nanophases. We quantitatively analyze the size, composition, and morphology of the nanostructures, as well as directly simulate the atom-probe-tomography (APT) needle. The results align well with available experimental observations. This work underscores the promising potential of leveraging large-scale MC simulation to explore the largely uncharted territory of nanostructure evolution in HEAs.

cond-mat.mtrl-sci↗

arXiv2025

Quantum and Hybrid Machine-Learning Models for Materials-Science Tasks

Quantum computing has become increasingly practical in solving real-world problems due to advances in hardware and algorithms. In this paper, we aim to design and estimate quantum machine learning and hybrid quantum-classical models in a few practical materials science tasks, i.e., predicting stacking fault energies and solutes that can ductilize magnesium. To this end, we adopt two different representative quantum algorithms, i.e., quantum support vector machines (QSVM) and quantum neural networks (QNN), and adjust them to our application scenarios. We systematically test the performance with respect to the hyperparameters of selected ansatzes. We identify a few combinations of hyperparameters that yield validation scores of approximately 90\% for QSVM and hybrid QNN in both tasks. Eventually, we construct quantum models with optimized parameters for regression and classification that predict targeted solutes based on the elemental volumes, electronegativities, and bulk moduli of chemical elements.

quant-ph↗

arXiv2025

Language Models for Materials Discovery and Sustainability: Progress, Challenges, and Opportunities

Significant advancements have been made in one of the most critical branches of artificial intelligence: natural language processing (NLP). These advancements are exemplified by the remarkable success of OpenAI's GPT-3.5/4 and the recent release of GPT-4.5, which have sparked a global surge of interest akin to an NLP gold rush. In this article, we offer our perspective on the development and application of NLP and large language models (LLMs) in materials science. We begin by presenting an overview of recent advancements in NLP within the broader scientific landscape, with a particular focus on their relevance to materials science. Next, we examine how NLP can facilitate the understanding and design of novel materials and its potential integration with other methodologies. To highlight key challenges and opportunities, we delve into three specific topics: (i) the limitations of LLMs and their implications for materials science applications, (ii) the creation of a fully automated materials discovery pipeline, and (iii) the potential of GPT-like tools to synthesize existing knowledge and aid in the design of sustainable materials.

cond-mat.mtrl-sci↗

arXiv2025

Riemann zeros and the KKR determinant

We transform the counting function for the Riemann zeros into a Korringa-Kohn-Rostoker (KKR) determinant, assisted by Krein's theorem. This is based on our observation that the function derived from a few methods can all be recast into two terms: one corresponds to the scattering phase, and the other is similar to structure constants related to the Green function. We also discuss the possible physical realizations. Our method provides a new physical pathway towards the solution of the Riemann hypothesis.

quant-ph↗

arXiv2025

Comparative study of the ansätze in quantum language models

Quantum language models are the alternative to classical language models, which borrow concepts and methods from quantum machine learning and computational linguistics. While several quantum natural language processing (QNLP) methods and frameworks exist for text classification and generation, there is a lack of systematic study to compare the performance across various ansätze, in terms of their hyperparameters and classical and quantum methods to implement them. Here, we evaluate the performance of quantum natural language processing models based on these ansätze at different levels in text classification tasks. We perform a comparative study and optimize the QNLP models by fine-tuning several critical hyperparameters. Our results demonstrate how the balance between simplification and expressivity affects model performance. This study provides extensive data to improve our understanding of QNLP models and opens the possibility of developing better QNLP algorithms.

quant-ph↗

arXiv2024

Roadmap on Data-Centric Materials Science

Science is and always has been based on data, but the terms "data-centric" and the "4th paradigm of" materials research indicate a radical change in how information is retrieved, handled and research is performed. It signifies a transformative shift towards managing vast data collections, digital repositories, and innovative data analytics methods. The integration of Artificial Intelligence (AI) and its subset Machine Learning (ML), has become pivotal in addressing all these challenges. This Roadmap on Data-Centric Materials Science explores fundamental concepts and methodologies, illustrating diverse applications in electronic-structure theory, soft matter theory, microstructure research, and experimental techniques like photoemission, atom probe tomography, and electron microscopy. While the roadmap delves into specific areas within the broad interdisciplinary field of materials science, the provided examples elucidate key concepts applicable to a wider range of topics. The discussed instances offer insights into addressing the multifaceted challenges encountered in contemporary materials research.

cond-mat.mtrl-sci↗

arXiv2023

Machine learning-enabled tomographic imaging of chemical short-range atomic ordering

In solids, chemical short-range order (CSRO) refers to the self-organisation of atoms of certain species occupying specific crystal sites. CSRO is increasingly being envisaged as a lever to tailor the mechanical and functional properties of materials. Yet quantitative relationships between properties and the morphology, number density, and atomic configurations of CSRO domains remain elusive. Herein, we showcase how machine learning-enhanced atom probe tomography (APT) can mine the near-atomically resolved APT data and jointly exploit the technique's high elemental sensitivity to provide a 3D quantitative analysis of CSRO in a CoCrNi medium-entropy alloy. We reveal multiple CSRO configurations, with their formation supported by state-of-the-art Monte-Carlo simulations. Quantitative analysis of these CSROs allows us to establish relationships between processing parameters and physical properties. The unambiguous characterization of CSRO will help refine strategies for designing advanced materials by manipulating atomic-scale architectures.

cond-mat.mtrl-sci↗

arXiv2022

Machine Learning for High-entropy Alloys: Progress, Challenges and Opportunities

High-entropy alloys (HEAs) have attracted extensive interest due to their exceptional mechanical properties and the vast compositional space for new HEAs. However, understanding their novel physical mechanisms and then using these mechanisms to design new HEAs are confronted with their high-dimensional chemical complexity, which presents unique challenges to (i) the theoretical modeling that needs accurate atomic interactions for atomistic simulations and (ii) constructing reliable macro-scale models for high-throughput screening of vast amounts of candidate alloys. Machine learning (ML) sheds light on these problems with its capability to represent extremely complex relations. This review highlights the success and promising future of utilizing ML to overcome these challenges. We first introduce the basics of ML algorithms and application scenarios. We then summarize the state-of-the-art ML models describing atomic interactions and atomistic simulations of thermodynamic and mechanical properties. Special attention is paid to phase predictions, planar-defect calculations, and plastic deformation simulations. Next, we review ML models for macro-scale properties, such as lattice structures, phase formations, and mechanical properties. Examples of machine-learned phase-formation rules and order parameters are used to illustrate the workflow. Finally, we discuss the remaining challenges and present an outlook of research directions, including uncertainty quantification and ML-guided inverse materials design.

cond-mat.mtrl-sci↗

arXiv2021

Neural network based order parameter for phase transitions and its applications in high-entropy alloys

Phase transition is one of the most important phenomena in nature and plays a central role in materials design. All phase transitions are characterized by suitable order parameters, including the order-disorder phase transition. However, finding a representative order parameter for complex systems is nontrivial, such as for high-entropy alloys. Given variational autoencoder's (VAE) strength of reducing high dimensional data into few principal components, here we coin a new concept of "VAE order parameter". We propose that the Manhattan distance in the VAE latent space can serve as a generic order parameter for order-disorder phase transitions. The physical properties of the order parameter are quantitatively interpreted and demonstrated by multiple refractory high-entropy alloys. Assisted by it, a generally applicable alloy design concept is proposed by mimicking the nature mixing of elements. Our physically interpretable "VAE order parameter" lays the foundation for the understanding of and alloy design by chemical ordering.

cond-mat.mtrl-sci↗