Searcharxiv⌕ Search

arXiv subjects

Xiaonan Wang

Publications and source records attributed to Xiaonan Wang.

36 records · Page 2Linked to original sources

MatWheel: Addressing Data Scarcity in Materials Science Through Synthetic Data

Data scarcity and the high cost of annotation have long been persistent challenges in the field of materials science. Inspired by its potential in other fields like computer vision, we propose the MatWheel framework, which train the material property prediction model using the synthetic data generated by the conditional generative model. We explore two scenarios: fully-supervised and semi-supervised learning. Using CGCNN for property prediction and Con-CDVAE as the conditional generative model, experiments on two data-scarce material property datasets from Matminer database are conducted. Results show that synthetic data has potential in extreme data-scarce scenarios, achieving performance close to or exceeding that of real samples in all two tasks. We also find that pseudo-labels have little impact on generated data quality. Future work will integrate advanced models and optimize generation conditions to boost the effectiveness of the materials data flywheel.

cs.LG↗

Accelerating High-Efficiency Organic Photovoltaic Discovery via Pretrained Graph Neural Networks and Generative Reinforcement Learning

Organic photovoltaic (OPV) materials offer a promising avenue toward cost-effective solar energy utilization. However, optimizing donor-acceptor (D-A) combinations to achieve high power conversion efficiency (PCE) remains a significant challenge. In this work, we propose a framework that integrates large-scale pretraining of graph neural networks (GNNs) with a GPT-2 (Generative Pretrained Transformer 2)-based reinforcement learning (RL) strategy to design OPV molecules with potentially high PCE. This approach produces candidate molecules with predicted efficiencies approaching 21\%, although further experimental validation is required. Moreover, we conducted a preliminary fragment-level analysis to identify structural motifs recognized by the RL model that may contribute to enhanced PCE, thus providing design guidelines for the broader research community. To facilitate continued discovery, we are building the largest open-source OPV dataset to date, expected to include nearly 3,000 donor-acceptor pairs. Finally, we discuss plans to collaborate with experimental teams on synthesizing and characterizing AI-designed molecules, which will provide new data to refine and improve our predictive and generative models.

cs.LG↗

Adapting Network Information into Semantics for Generalizable and Plug-and-Play Multi-Scenario Network Diagnosis

Leverage large language model (LLM) to refer the fault is considered to be a potential solution for intelligent network fault diagnosis. However, how to represent network information in a paradigm that can be understood by LLMs has always been a core issue that has puzzled scholars in the field of network intelligence. To address this issue, we propose LLM-based Network Semantic Generation (LNSG) algorithm, which integrates semanticization and symbolization methods to uniformly describe the entire multi-modal network information. Based on the LNSG and LLMs, we present NetSemantic, a plug-and-play, data-independent, network information semantic fault diagnosis framework. It enables rapid adaptation to various network environments and provides efficient fault diagnosis capabilities. Experimental results demonstrate that NetSemantic excels in network fault diagnosis across various complex scenarios in a zero-shot manner.

cs.NI↗

ErgoChat: a Visual Query System for the Ergonomic Risk Assessment of Construction Workers

In the construction sector, workers often endure prolonged periods of high-intensity physical work and prolonged use of tools, resulting in injuries and illnesses primarily linked to postural ergonomic risks, a longstanding predominant health concern. To mitigate these risks, researchers have applied various technological methods to identify the ergonomic risks that construction workers face. However, traditional ergonomic risk assessment (ERA) techniques do not offer interactive feedback. The rapidly developing vision-language models (VLMs), capable of generating textual descriptions or answering questions about ergonomic risks based on image inputs, have not yet received widespread attention. This research introduces an interactive visual query system tailored to assess the postural ergonomic risks of construction workers. The system's capabilities include visual question answering (VQA), which responds to visual queries regarding workers' exposure to postural ergonomic risks, and image captioning (IC), which generates textual descriptions of these risks from images. Additionally, this study proposes a dataset designed for training and testing such methodologies. Systematic testing indicates that the VQA functionality delivers an accuracy of 96.5%. Moreover, evaluations using nine metrics for IC and assessments from human experts indicate that the proposed approach surpasses the performance of a method using the same architecture trained solely on generic datasets. This study sets a new direction for future developments in interactive ERA using generative artificial intelligence (AI) technologies.

cs.CV↗

KULTURE Bench: A Benchmark for Assessing Language Model in Korean Cultural Context

Large language models have exhibited significant enhancements in performance across various tasks. However, the complexity of their evaluation increases as these models generate more fluent and coherent content. Current multilingual benchmarks often use translated English versions, which may incorporate Western cultural biases that do not accurately assess other languages and cultures. To address this research gap, we introduce KULTURE Bench, an evaluation framework specifically designed for Korean culture that features datasets of cultural news, idioms, and poetry. It is designed to assess language models' cultural comprehension and reasoning capabilities at the word, sentence, and paragraph levels. Using the KULTURE Bench, we assessed the capabilities of models trained with different language corpora and analyzed the results comprehensively. The results show that there is still significant room for improvement in the models' understanding of texts related to the deeper aspects of Korean culture.

cs.CL↗

Enhanced forecasting of stock prices based on variational mode decomposition, PatchTST, and adaptive scale-weighted layer

The significant fluctuations in stock index prices in recent years highlight the critical need for accurate forecasting to guide investment and financial strategies. This study introduces a novel composite forecasting framework that integrates variational mode decomposition (VMD), PatchTST, and adaptive scale-weighted layer (ASWL) to address these challenges. Utilizing datasets of four major stock indices--SP500, DJI, SSEC, and FTSE--from 2000 to 2024, the proposed method first decomposes the raw price series into intrinsic mode functions (IMFs) using VMD. Each IMF is then modeled with PatchTST to capture temporal patterns effectively. The ASWL module is applied to incorporate scale information, enhancing prediction accuracy. The final forecast is derived by aggregating predictions from all IMFs. The VMD-PatchTST-ASWL framework demonstrates significant improvements in forecasting accuracy compared to traditional models, showing robust performance across different indices. This innovative approach provides a powerful tool for stock index price forecasting, with potential applications in various financial analysis and investment decision-making contexts.

cs.LG↗

Integrating Chemistry Knowledge in Large Language Models via Prompt Engineering

This paper presents a study on the integration of domain-specific knowledge in prompt engineering to enhance the performance of large language models (LLMs) in scientific domains. A benchmark dataset is curated to encapsulate the intricate physical-chemical properties of small molecules, their drugability for pharmacology, alongside the functional attributes of enzymes and crystal materials, underscoring the relevance and applicability across biological and chemical domains.The proposed domain-knowledge embedded prompt engineering method outperforms traditional prompt engineering strategies on various metrics, including capability, accuracy, F1 score, and hallucination drop. The effectiveness of the method is demonstrated through case studies on complex materials including the MacMillan catalyst, paclitaxel, and lithium cobalt oxide. The results suggest that domain-knowledge prompts can guide LLMs to generate more accurate and relevant responses, highlighting the potential of LLMs as powerful tools for scientific discovery and innovation when equipped with domain-specific prompts. The study also discusses limitations and future directions for domain-specific prompt engineering development.

cs.CL↗

An Artificial Intelligence (AI) workflow for catalyst design and optimization

In the pursuit of novel catalyst development to address pressing environmental concerns and energy demand, conventional design and optimization methods often fall short due to the complexity and vastness of the catalyst parameter space. The advent of Machine Learning (ML) has ushered in a new era in the field of catalyst optimization, offering potential solutions to the shortcomings of traditional techniques. However, existing methods fail to effectively harness the wealth of information contained within the burgeoning body of scientific literature on catalyst synthesis. To address this gap, this study proposes an innovative Artificial Intelligence (AI) workflow that integrates Large Language Models (LLMs), Bayesian optimization, and an active learning loop to expedite and enhance catalyst optimization. Our methodology combines advanced language understanding with robust optimization strategies, effectively translating knowledge extracted from diverse literature into actionable parameters for practical experimentation and optimization. In this article, we demonstrate the application of this AI workflow in the optimization of catalyst synthesis for ammonia production. The results underscore the workflow's ability to streamline the catalyst development process, offering a swift, resource-efficient, and high-precision alternative to conventional methods.

physics.chem-ph↗

Dissimilar thermal transport properties in $κ$-Ga$_2$O$_3$ and $β$-Ga$_2$O$_3$ revealed by machine-learning homogeneous nonequilibrium molecular dynamics simulations

The lattice thermal conductivity (LTC) of Ga$_2$O$_3$ is an important property due to the challenge in the thermal management of high-power devices. We develop machine-learned neuroevolution potentials for single-crystalline $β$-Ga$_2$O$_3$ and $κ$-Ga$_2$O$_3$, and apply them to perform homogeneous nonequilibrium molecular dynamics simulations to predict their LTCs. The LTC of $β$-Ga$_2$O$_3$ was determined to be 10.3 $\pm$ 0.2 W/(m K), 19.9 $\pm$ 0.2 W/(m K), and 12.6 $\pm$ 0.2 W/(m K) along [100], [010], and [001], respectively, aligning with previous experimental measurements. For the first time, we predict the LTC of $κ$-Ga$_2$O$_3$ along [100], [010], and [001] to be 4.5 $\pm$ 0.0 W/(m K), 3.9 $\pm$ 0.0 W/(m K), and 4.0 $\pm$ 0.1 W/(m K), respectively, showing a nearly isotropic thermal transport property. The reduced LTC of $κ$-Ga$_2$O$_3$ versus $β$-Ga$_2$O$_3$ stems from its restricted low-frequency phonons up to 5 THz. Furthermore, we find that the $β$ phase exhibits a typical temperature dependence slightly stronger than $\sim T^{-1}$, whereas the $κ$ phase shows a weaker temperature dependence, ranging from $\sim T^{-0.5}$ to $\sim T^{-0.7}$.

cond-mat.mtrl-sci↗

A Heterogeneous Parallel Non-von Neumann Architecture System for Accurate and Efficient Machine Learning Molecular Dynamics

This paper proposes a special-purpose system to achieve high-accuracy and high-efficiency machine learning (ML) molecular dynamics (MD) calculations. The system consists of field programmable gate array (FPGA) and application specific integrated circuit (ASIC) working in heterogeneous parallelization. To be specific, a multiplication-less neural network (NN) is deployed on the non-von Neumann (NvN)-based ASIC (SilTerra 180 nm process) to evaluate atomic forces, which is the most computationally expensive part of MD. All other calculations of MD are done using FPGA (Xilinx XC7Z100). It is shown that, to achieve similar-level accuracy, the proposed NvN-based system based on low-end fabrication technologies (180 nm) is 1.6x faster and 10^2-10^3x more energy efficiency than state-of-the-art vN based MLMD using graphics processing units (GPUs) based on much more advanced technologies (12 nm), indicating superiority of the proposed NvN-based heterogeneous parallel architecture.

cs.LG↗

CXL over Ethernet: A Novel FPGA-based Memory Disaggregation Design in Data Centers

Memory resources in data centers generally suffer from low utilization and lack of dynamics. Memory disaggregation solves these problems by decoupling CPU and memory, which currently includes approaches based on RDMA or interconnection protocols such as Compute Express Link (CXL). However, the RDMA-based approach involves code refactoring and higher latency. The CXL-based approach supports native memory semantics and overcomes the shortcomings of RDMA, but is limited within rack level. In addition, memory pooling and sharing based on CXL products are currently in the process of early exploration and still take time to be available in the future. In this paper, we propose the CXL over Ethernet approach that the host processor can access the remote memory with memory semantics through Ethernet. Our approach can support native memory load/store access and extends the physical range to cross server and rack levels by taking advantage of CXL and RDMA technologies. We prototype our approach with one server and two FPGA boards with 100 Gbps network and measure the memory access latency. Furthermore, we optimize the memory access path by using data cache and congestion control algorithm in the critical path to further lower access latency. The evaluation results show that the average latency for the server to access remote memory is 1.97 μs, which is about 37% lower than the baseline latency in the industry. The latency can be further reduced to 415 ns with cache block and hit access on FPGA.

cs.AR↗

Topological Phases on Quantum Trees

In this work, we present a theory for topological phases for quantum systems on tree graphs. Conventionally, topological phases of matter have been studied in regular lattices, but also in quasicrystals and amorphous settings. We consider specific generalizations of regular tree graphs, and explore their topological properties. Unlike conventional systems, infinite quantum trees are not finite-dimensional, allowing for novel phenomena. We find a proliferation of topological zero modes present throughout the entire system, indicating that the bulk also acts as a boundary. We then go on to show that only three symmetry classes host stable topological phases in contrast to the usual five symmetry classes per dimension. Finally, we introduce what we call the Su-Schrieffer-Heeger tree which is topologically non-trivial even in the absence of inner degrees of freedom and does not possess any gapped trivial phases. We realize this system in an electronic circuit and show that our theory matches with experiments.

cond-mat.mes-hall↗

Reliable and Broad-range Layer Identification of Au-assisted Exfoliated Large Area MoS$_2$ and WS$_2$ Using Reflection Spectroscopic Fingerprints

The emerging Au-assisted exfoliation technique provides a wealth of large-area and high-quality ultrathin two-dimensional (2D) materials compared with traditional tape-based exfoliation. Fast, damage-free, and reliable determination of the layer number of such 2D films is essential to study layer-dependent physics and promote device applications. Here, an optical method has been developed for simple, high throughput, and accurate determination of the layer number for Au-assisted exfoliated MoS$_2$ and WS$_2$ films in a broad thickness range. The method is based on quantitative analysis of layer-dependent white light reflection spectra, revealing that the reflection peak intensity can be used as a clear indicator for determining the layer number. The simple yet robust method will facilitate the fundamental study on layer-dependent optical, electrical, and thermal properties and device applications of 2D materials. The technique can also be readily combined with photoluminescence and Raman spectroscopies to study other layer-dependent physical properties of 2D materials.

cond-mat.mtrl-sci↗

An invertible crystallographic representation for general inverse design of inorganic crystals with targeted properties

Realizing general inverse design could greatly accelerate the discovery of new materials with user-defined properties. However, state-of-the-art generative models tend to be limited to a specific composition or crystal structure. Herein, we present a framework capable of general inverse design (not limited to a given set of elements or crystal structures), featuring a generalized invertible representation that encodes crystals in both real and reciprocal space, and a property-structured latent space from a variational autoencoder (VAE). In three design cases, the framework generates 142 new crystals with user-defined formation energies, bandgap, thermoelectric (TE) power factor, and combinations thereof. These generated crystals, absent in the training database, are validated by first-principles calculations. The success rates (number of first-principles-validated target-satisfying crystals/number of designed crystals) ranges between 7.1% and 38.9%. These results represent a significant step toward property-driven general inverse design using generative models, although practical challenges remain when coupled with experimental synthesis.

physics.comp-ph↗

A robust low data solution: dimension prediction of semiconductor nanorods

Precise control over dimension of nanocrystals is critical to tune the properties for various applications. However, the traditional control through experimental optimization is slow, tedious and time consuming. Herein a robust deep neural network-based regression algorithm has been developed for precise prediction of length, width, and aspect ratios of semiconductor nanorods (NRs). Given there is limited experimental data available (28 samples), a Synthetic Minority Oversampling Technique for regression (SMOTE-REG) has been employed for the first time for data generation. Deep neural network is further applied to develop regression model which demonstrated the well performed prediction on both the original and generated data with a similar distribution. The prediction model is further validated with additional experimental data, showing accurate prediction results. Additionally, Local Interpretable Model-Agnostic Explanations (LIME) is used to interpret the weight for each variable, which corresponds to its importance towards the target dimension, which is approved to be well correlated well with experimental observations.

cs.LG↗

Deep Learning Accelerated Gold Nanocluster Synthesis

The understanding of inorganic reactions, especially those far from the equilibrium state, is relatively limited due to their inherent complexity. Poor understandings on the underlying synthetic chemistry have constrained the design of efficient synthesis routes towards desired final products, especially those inorganic materials at atomic precision. In this work, using the synthesis of atomically precise gold nanoclusters as a demonstration platform, we have successfully developed a deep learning framework for guiding material synthesis and accelerating the whole workflow. With only 54 examples, the proposed Graph Convolutional Neural Networks (GCNN) plus Siamese Neural Networks (SNN) classification model with the basic descriptors have been trained. The capability of predicting the target synthesis results has been demonstrated with a successful experimental validation. In addition, understandings in the synthesis process can be acquired from a decision tree trained by a large amount of generated data from the well-trained classification model. This study not only provides a data-driven method accelerating gold nanocluster synthesis, but also sheds light on understanding complex inorganic materials synthesis with low data amount.

physics.comp-ph↗

Recurrent Neural Network-based Model Predictive Control for Continuous Pharmaceutical Manufacturing

The pharmaceutical industry has witnessed exponential growth in transforming operations towards continuous manufacturing to effectively achieve increased profitability, reduced waste, and extended product range. Model Predictive Control (MPC) can be applied for enabling this vision, in providing superior regulation of critical quality attributes. For MPC, obtaining a workable model is of fundamental importance, especially in the presence of complex reaction kinetics and process dynamics. Whilst physics-based models are desirable, it is not always practical to obtain one effective and fit-for-purpose model. Instead, within industry, data-driven system-identification approaches have been found to be useful and widely deployed in MPC solutions. In this work, we demonstrated the applicability of Recurrent Neural Networks (RNNs) for MPC applications in continuous pharmaceutical manufacturing. We have shown that RNNs are especially well-suited for modeling dynamical systems due to their mathematical structure and satisfactory closed-loop control performance can be yielded for MPC in continuous pharmaceutical manufacturing.

eess.SY↗

Attraction of Spiral Waves by Localized Inhomogeneities with Small-World Connections in Excitable Media

Trapping and un-trapping of spiral tips in a two-dimensional homogeneous excitable medium with local small-world connections is studied by numerical simulation. In a homogeneous medium which can be simulated with a lattice of regular neighborhood connections, the spiral wave is in the meandering regime. When changing the topology of a small region from regular connections to small-world connections, the tip of a spiral waves is attracted by the small-world region, where the average path length declines with the introduction of long distant connections. The "trapped" phenomenon also occurs in regular lattices where the diffusion coefficient of the small region is increased. The above results can be explained by the eikonal equation and the relation between core radius and diffusion coefficient.

nlin.PS↗