SearcharxivSearch

arXiv subjects

Yongtao Liu

Publications and source records attributed to Yongtao Liu.

At least 19 recordsLinked to original sources

AEcroscopyWave: Towards Self-Driving Characterization Platforms for Agentic AI

The characterization of electronic materials has traditionally been stratified into two distinct regimens: industry-scale automated systems to inspect materials for defects and ensure quality (such as in the semiconductor industry), and highly customized, operator-driven systems requiring human experts. The former offers high throughput but limited flexibility, whereas the latter is heavily bandwidth-limited but provides research-grade discovery capabilities. Recent advances in "self-driving" characterization tools offer the potential to bridge the two stratified regimes, by the creation of application program interfaces (APIs) that can control hardware, and the integration of AI methods to incorporate autonomy into the process. Here, we discuss our latest developments in AEcroscopyWave, a custom-built characterization platform for the agentic-AI era, that provides unified control of scanning probe microscopes with programmable peripheral instrumentation, highlighting the design choices that are necessary for maximizing the capability of the system and the ease of use for both human and AI agents. The benefits of making heterogeneous scientific instruments accessible, composable and usable by agents is demonstrated by test cases.

cond-mat.mtrl-sci

Simple restricted modules over the deformative Schrödinger-Virasoro algebra

This paper investigates simple restricted modules over the deformed Schrödinger-Virasoro algebra $\mathcal{G}_{λ,μ}$, which gives a complete classification of them for some $λ,μ\in\mathbb{C}$. More precisely, we provide a systematic construction of these modules, including highest weight modules and Whittaker modules, by inducing simple modules from the positive part's quotient algebras. We prove that any simple restricted $\mathcal{G}_{λ,μ}$-module satisfying certain injective conditions is isomorphic to such an induced module. As an application, we obtain some simple weak $V(c)$-modules over vertex algebras associated to $\mathcal{G}_{λ,μ}$ for some $λ,μ\in\mathbb{C}$. Note that our results include the Schrödinger-Virasoro algebra and the deformed $\mathfrak{bms}_3$ algebra as special cases, thereby improving upon some of the previously reported results of [5,Theorem 3.4] and [6,Theorem 2]. This work effectively classifies and generalizes the representation theory of the deformed family.

math.RT

Accelerating Structure-Property Relationship Discovery with Multimodal Machine Learning and Self-Driving Microscopy

Microscopy combined with local spectroscopy is widely used to correlate nanoscale structure with functional properties in materials, but conventional measurements rely heavily on human-selected sampling locations and predefined targets, limiting dataset diversity and the potential for discovery. Here, we present a framework that integrates autonomous microscopy with a dual-novelty deep kernel learning (DN-DKL) for adaptive data acquisition and a dual variational autoencoder (VAE) for representation learning. DN-DKL actively guides the microscopy toward structurally and spectroscopically novel regions, enabling efficient collection of large spectral datasets. Dual-VAE embeds local structure and spectroscopic responses into a shared latent manifold that serves as a structure-property relationship map. We applied this framework for the investigation of halide perovskite films using conductive atomic force microscopy. The results reveal distinct hysteresis behaviors that are linked to specific nanoscale structural motifs, including grain boundary junction points that show hysteresis under different bias conditions and asymmetric grain boundaries that suppress charge transport. This framework establishes a general strategy that leverages the complementary strengths of self-driving microscopy, machine learning, and human expertise to accelerate scientific discovery in functional materials.

cond-mat.mtrl-sci

Quality-Controlled Active Learning via Gaussian Processes for Robust Structure-Property Learning in Autonomous Microscopy

Autonomous experimental systems are increasingly used in materials research to accelerate scientific discovery, but their performance is often limited by low-quality, noisy data. This issue is especially problematic in data-intensive structure-property learning tasks such as Image-to-Spectrum (Im2Spec) and Spectrum-to-Image (Spec2Im) translations, where standard active learning strategies can mistakenly prioritize poor-quality measurements. We introduce a gated active learning framework that combines curiosity-driven sampling with a physics-informed quality control filter based on the Simple Harmonic Oscillator model fits, allowing the system to automatically exclude low-fidelity data during acquisition. Evaluations on a pre-acquired dataset of band-excitation piezoresponse spectroscopy (BEPS) data from PbTiO3 thin films with spatially localized noise show that the proposed method outperforms random sampling, standard active learning, and multitask learning strategies. The gated approach enhances both Im2Spec and Spec2Im by handling noise during training and acquisition, leading to more reliable forward and inverse predictions. In contrast, standard active learners often misinterpret noise as uncertainty and end up acquiring bad samples that hurt performance. Given its promising applicability, we further deployed the framework in real-time experiments on BiFeO3 thin films, demonstrating its effectiveness in real autonomous microscopy experiments. Overall, this work supports a shift toward hybrid autonomy in self-driving labs, where physics-informed quality assessment and active decision-making work hand-in-hand for more reliable discovery.

cs.LG

Beyond Scalar Objectives: Expert-Feedback-Driven Autonomous Experimentation for Scientific Discovery at the Nanoscale

Self-driving laboratories or autonomous experimentation are emerging as transformative platforms for accelerating scientific discovery. Bayesian optimization (BO) is among the most widely used machine learning frameworks for these purposes, but these BO-based frameworks rely on predefined scalar descriptors to guide experimentation. In many situations, the determination of an appropriate scalar descriptor can be challenging, and may fail to capture subtle yet scientifically important phenomena apparent to experts with interdisciplinary insight. To overcome this limitation, here we develop deep-kernel pairwise learning (DKPL), an approach for autonomous microscopy experiments which incorporates human expertise and interdisciplinary scientific knowledge into an active learning loop. Instead of relying on explicit scalar objectives, DKPL enables experts to directly evaluate which experimental output is more promising using interdisciplinary knowledge. DKPL then learns a latent utility function from these expert judgements to guide subsequent autonomous microscopy experiments. We demonstrate DKPL's performance in learning physically meaningful nanoscale structures while effectively prioritizing high-information measurement regions using an experimental model dataset with known ground truth. We further apply DKPL to analyze the character of ferroelectric domain walls, where we find DKPL capable of distinguishing between high and low characteristic domain-wall angles in bismuth ferrite, and able to discover both head-to-head and tail-to-tail domain-wall character in erbium manganite. This development establishes an approach to integrate expert knowledge into autonomous microscopy experiments and demonstrates a pathway toward expert-guided self-driving laboratories capable of addressing scientific problems beyond the limits of scalar-metrics-driven learning.

cs.LG

Human-AI Collaborative Autonomous Experimentation With Proxy Modeling for Comparative Observation

Optimization for different tasks like material characterization, synthesis, and functional properties for desired applications over multi-dimensional control parameters need a rapid strategic search through active learning such as Bayesian optimization (BO). However, such high-dimensional experimental physical descriptors are complex and noisy, from which realization of a low-dimensional mathematical scalar metrics or objective functions can be erroneous. Moreover, in traditional purely data-driven autonomous exploration, such objective functions often ignore the subtle variation and key features of the physical descriptors, thereby can fail to discover unknown phenomenon of the material systems. To address this, here we present a proxy-modelled Bayesian optimization (px-BO) via on-the-fly teaming between human and AI agents. Over the loop of BO, instead of defining a mathematical objective function directly from the experimental data, we introduce a voting system on the fly where the new experimental outcome will be compared with existing experiments, and the human agents will choose the preferred samples. These human-guided comparisons are then transformed into a proxy-based objective function via fitting Bradley-Terry (BT) model. Then, to minimize human interaction, this iteratively trained proxy model also acts as an AI agent for future surrogate human votes. Finally, these surrogate votes are periodically validated by human agents, and the corrections are then learned by the proxy model on-the-fly. We demonstrated the performance of the proposed px-BO framework into simulated and BEPS data generated from PTO sample. We find that our approach provided better control of the domain experts for an improved search over traditional data-driven exploration, thus, signifies the importance of human-AI teaming in an accelerated and meaningful material space exploration.

cs.LG

Motions of spinning particles and chaos bound in Reissner-Nordström spacetime

Previous research showed that the chaos bound proposed in \cite{MSS} can be violated under specific conditions within the scalar fields surrounding black holes. In this paper, we explore motions of spinning particles orbiting a Reissner-Nordström black hole and examine whether this bound is violated in the spinor field of this black hole. For the neutral particle, when its spin magnitude surpasses a specific threshold, the value of the exponent exceeds the surface gravity, resulting in a violation of the bound. Given a fixed total angular momentum of the particle, when its spin direction is anti-aligned with the angular momentum direction, the exponent value is greater than that when the two directions are aligned. For the charged particle, taking into account the influence of the electromagnetic force, we find that for relatively large angular momenta, although the electromagnetic force does not change the trend of the exponent's variation with respect to spin and angular momentum, and only modifies its values, it still leads to the violation. Therefore, the chaos bound violations are observed in the spinor field.

gr-qc

RFAssigner: A Generic Label Assignment Strategy for Dense Object Detection

Label assignment is a critical component in training dense object detectors. State-of-the-art methods typically assign each training sample a positive and a negative weight, optimizing the assignment scheme during training. However, these strategies often assign an insufficient number of positive samples to small objects, leading to a scale imbalance during training. To address this limitation, we introduce RFAssigner, a novel assignment strategy designed to enhance the multi-scale learning capabilities of dense detectors. RFAssigner first establishes an initial set of positive samples using a point-based prior. It then leverages a Gaussian Receptive Field (GRF) distance to measure the similarity between the GRFs of unassigned candidate locations and the ground-truth objects. Based on this metric, RFAssigner adaptively selects supplementary positive samples from the unassigned pool, promoting a more balanced learning process across object scales. Comprehensive experiments on three datasets with distinct object scale distributions validate the effectiveness and generalizability of our method. Notably, a single FCOS-ResNet-50 detector equipped with RFAssigner achieves state-of-the-art performance across all object scales, consistently outperforming existing strategies without requiring auxiliary modules or heuristics.

cs.CV

Auto-3DPFM: Automating Polarization-Vector Mapping at the Nanoscale

The functional properties of ferroelectric materials are strongly influenced by ferroelectric polarization orientation; as such, access to consistent and precise characterization of polarization vectors is of substantial importance to ferroelectrics research. Here, we develop a fully automated three-dimensional piezoresponse force microscopy (Auto-3DPFM) technique automating all essential steps in interferometric PFM for 3D polarization vector characterization, including laser alignment, tip calibration and approach, image acquisition, polarization vector reconstruction, and visualization. The automation reduces the experimental burden of ferroelectric polarization vector characterization, while the back-and-forth calibration ensures consistency and reproducibility of 3D polarization reconstruction. An algorithmic workflow is also developed to identify domain walls and calculate their characteristic angles via a spatial vector-angle-difference method, presenting one unique capability enabled by Auto-3DPFM that is not accessible with traditional PFM techniques. Beyond representing a significant step forward in 3D polarization mapping, Auto-3DPFM promises to accelerate discovery via high-throughput and autonomous characterization in ferroelectric materials research. When integrated with machine learning and adaptive sampling strategies in self-driving labs, Auto-3DPFM will serve as a valuable tool for advancing ferroelectric physics and microelectronics development.

cond-mat.mtrl-sci

Human-AI collaborative autonomous synthesis with pulsed laser deposition for remote epitaxy

Autonomous laboratories typically rely on data-driven decision-making, occasionally with human-in-the-loop oversight to inject domain expertise. Fully leveraging AI agents, however, requires tightly coupled, collaborative workflows spanning hypothesis generation, experimental planning, execution, and interpretation. To address this, we develop and deploy a human-AI collaborative (HAIC) workflow that integrates large language models for hypothesis generation and analysis, with collaborative policy updates driving autonomous pulsed laser deposition (PLD) experiments for remote epitaxy of BaTiO$_3$/graphene. HAIC accelerated the hypothesis formation and experimental design and efficiently mapped the growth space to graphene-damage. In situ Raman spectroscopy reveals that chemistry drives degradation while the highest energy plume components seed defects, identifying a low-O$_2$ pressure low-temperature synthesis window that preserves graphene but is incompatible with optimal BaTiO$_3$ growth. Thus, we show a two-step Ar/O$_2$ deposition is required to exfoliate ferroelectric BaTiO$_3$ while maintaining a monolayer graphene interlayer. HAIC stages human insight with AI reasoning between autonomous batches to drive rapid scientific progress, providing an evolution to many existing human-in-the-loop autonomous workflows.

cond-mat.mtrl-sci

Gaussian Combined Distance: A Generic Metric for Object Detection

In object detection, a well-defined similarity metric can significantly enhance model performance. Currently, the IoU-based similarity metric is the most commonly preferred choice for detectors. However, detectors using IoU as a similarity metric often perform poorly when detecting small objects because of their sensitivity to minor positional deviations. To address this issue, recent studies have proposed the Wasserstein Distance as an alternative to IoU for measuring the similarity of Gaussian-distributed bounding boxes. However, we have observed that the Wasserstein Distance lacks scale invariance, which negatively impacts the model's generalization capability. Additionally, when used as a loss function, its independent optimization of the center attributes leads to slow model convergence and unsatisfactory detection precision. To address these challenges, we introduce the Gaussian Combined Distance (GCD). Through analytical examination of GCD and its gradient, we demonstrate that GCD not only possesses scale invariance but also facilitates joint optimization, which enhances model localization performance. Extensive experiments on the AI-TOD-v2 dataset for tiny object detection show that GCD, as a bounding box regression loss function and label assignment metric, achieves state-of-the-art performance across various detectors. We further validated the generalizability of GCD on the MS-COCO-2017 and Visdrone-2019 datasets, where it outperforms the Wasserstein Distance across diverse scales of datasets. Code is available at https://github.com/MArKkwanGuan/mmdet-GCD.

cs.CV

Beyond Optimization: Exploring Novelty Discovery in Autonomous Experiments

Autonomous experiments (AEs) are transforming how scientific research is conducted by integrating artificial intelligence with automated experimental platforms. Current AEs primarily focus on the optimization of a predefined target; while accelerating this goal, such an approach limits the discovery of unexpected or unknown physical phenomena. Here, we introduce a novel framework, INS2ANE (Integrated Novelty Score-Strategic Autonomous Non-Smooth Exploration), to enhance the discovery of novel phenomena in autonomous experimentation. Our method integrates two key components: (1) a novelty scoring system that evaluates the uniqueness of experimental results, and (2) a strategic sampling mechanism that promotes exploration of under-sampled regions even if they appear less promising by conventional criteria. We validate this approach on a pre-acquired dataset with a known ground truth comprising of image-spectral pairs. We further implement the process on autonomous scanning probe microscopy experiments. INS2ANE significantly increases the diversity of explored phenomena in comparison to conventional optimization routines, enhancing the likelihood of discovering previously unobserved phenomena. These results demonstrate the potential for AE to enhance the depth of scientific discovery; in combination with the efficiency provided by AEs, this approach promises to accelerate scientific research by simultaneously navigating complex experimental spaces to uncover new phenomena.

cs.LG

Attention-Based Explainability for Structure-Property Relationships

Machine learning methods are emerging as a universal paradigm for constructing correlative structure-property relationships in materials science based on multimodal characterization. However, this necessitates development of methods for physical interpretability of the resulting correlative models. Here, we demonstrate the potential of attention-based neural networks for revealing structure-property relationships and the underlying physical mechanisms, using the ferroelectric properties of PbTiO3 thin films as a case study. Through the analysis of attention scores, we disentangle the influence of distinct domain patterns on the polarization switching process. The attention-based Transformer model is explored both as a direct interpretability tool and as a surrogate for explaining representations learned via unsupervised machine learning, enabling the identification of physically grounded correlations. We compare attention-derived interpretability scores with classical SHapley Additive exPlanations (SHAP) analysis and show that, in contrast to applications in natural language processing, attention mechanisms in materials science exhibit high efficiency in highlighting meaningful structural features.

cond-mat.mtrl-sci

Curiosity Driven Exploration to Optimize Structure-Property Learning in Microscopy

Rapidly determining structure-property correlations in materials is an important challenge in better understanding fundamental mechanisms and greatly assists in materials design. In microscopy, imaging data provides a direct measurement of the local structure, while spectroscopic measurements provide relevant functional property information. Deep kernel active learning approaches have been utilized to rapidly map local structure to functional properties in microscopy experiments, but are computationally expensive for multi-dimensional and correlated output spaces. Here, we present an alternative lightweight curiosity algorithm which actively samples regions with unexplored structure-property relations, utilizing a deep-learning based surrogate model for error prediction. We show that the algorithm outperforms random sampling for predicting properties from structures, and provides a convenient tool for efficient mapping of structure-property relationships in materials science.

cond-mat.mtrl-sci

Nonlinear Spectral Fusion Super-Resolution Fluorescence Microscopy based on Progressively Saturated Upconversion Nanoparticles

Single-beam scanning microscopy (SBSM) is one of the most robust strategies for commercial optical systems. Although structured illumination combined with Fourier-domain spatial spectrum fusion can enhance SBSM resolution beyond the diffraction limit, a sophisticated detection system is still required to optimize both effective resolution and signal-to-noise ratio.Here, we report that the diverse nonlinear responses of upconversion nanoparticles can unlock a new mode of Computational Progressively Emission Saturated Nanoscopy (CPSN), which employs a single doughnut-shaped excitation beam assisted by deep learning to simplify conventional microscopy. By modulating the excitation power, the smooth transition of the point spread function (PSF) from doughnut-shaped to Gaussian can be achieved, allowing for accessing different spatial frequency components of the sample. Then, in order to enhance time resolution, the doughnut-shaped beam at low power and the saturated Gaussian-like image were predicted by the doughnut-shaped beam at low saturation threshold based on the power dependence curve. Furthermore, a deep recursive residual network (DRRN) is employed to fusion these progressively complementary spatial frequency information into a final super-resolved image that encompasses the full frequency wwinformation. This approach can achieve high-quality super-resolution imaging with a spatial resolution of 33 nm, corresponding to 1/29th of the excitation wavelength, 55 dB of SNR ratio contracted to 7 dB in Gaussian imaging and applicable to any wavelength. The unique combination of nonlinear saturation and deep learning computational reconstruction could open a new avenue for simplifying the optical system and enhancing imaging quality in single-beam super-resolution nanoscopy.

physics.optics

Mic-hackathon 2024: Hackathon on Machine Learning for Electron and Scanning Probe Microscopy

Microscopy is a primary source of information on materials structure and functionality at nanometer and atomic scales. The data generated is often well-structured, enriched with metadata and sample histories, though not always consistent in detail or format. The adoption of Data Management Plans (DMPs) by major funding agencies promotes preservation and access. However, deriving insights remains difficult due to the lack of standardized code ecosystems, benchmarks, and integration strategies. As a result, data usage is inefficient and analysis time is extensive. In addition to post-acquisition analysis, new APIs from major microscope manufacturers enable real-time, ML-based analytics for automated decision-making and ML-agent-controlled microscope operation. Yet, a gap remains between the ML and microscopy communities, limiting the impact of these methods on physics, materials discovery, and optimization. Hackathons help bridge this divide by fostering collaboration between ML researchers and microscopy experts. They encourage the development of novel solutions that apply ML to microscopy, while preparing a future workforce for instrumentation, materials science, and applied ML. This hackathon produced benchmark datasets and digital twins of microscopes to support community growth and standardized workflows. All related code is available at GitHub: https://github.com/KalininGroup/Mic-hackathon-2024-codes-publication/tree/1.0.0.1

cond-mat.mtrl-sci

Polarization switching on the open surfaces of the wurtzite ferroelectric nitrides: ferroelectric subsystems and electrochemical reactivity

Binary ferroelectric nitrides are promising materials for information technologies and power electronics. However, polarization switching in these materials is highly unusual. From the structural perspective, polarization reversal is associated with the change of the effective polarity at the surfaces and interfaces from N-to-M terminated, suggesting strong coupling between ferroelectric and chemical phenomena. Phenomenologically, macroscopic studies demonstrate the presence of complex time dependent phenomena including wake-up. Here, we explore the polarization switching using the multidimensional high-resolution piezoresponse force microscopy (PFM) and spectroscopy, detecting both the evolution of induced ferroelectric domain, electromechanical response, and surface deformation during first-order reversal curve measurements. We demonstrate the presence of two weakly coupled ferroelectric subsystems and the bias-induced electrochemical reactivity. The observed behaviors are very similar to the recent studies of other wurtzite system but additionally include electrochemical reactivity, suggesting the universality of these behaviors for the wurtzite binary ferroelectrics. These studies suggest potential of high-resolution multimodal PFM spectroscopies to resolve complex coupled polarization dynamics in materials. Furthermore, these PFM based studies are fully consistent with the recent electron microscopy observations of the shark-teeth like ferroelectric domains in nitrides. Hence, we believe that these studies establish the universal phenomenological picture of polarization switching in binary wurtzite.

cond-mat.mtrl-sci

Ferroelastic Domain Induced Electronic Modulation in Halide Perovskites

Lead halide perovskites have emerged as promising materials for optoelectronic applications due to their exceptional properties. In the all-inorganic CsPbBr3 perovskites, ferroelastic domains formed during phase transitions enhance bulk transport and emissive efficiency. However, the microscopic mechanisms governing carrier dynamics remain poorly understood. In this study, we employ cathodoluminescence (CL) and micro-Raman spectroscopy to image and investigate the electronic properties of the ferroelastic domain walls in CsPbBr3 single crystals. CL measurements reveal a reduced emissive yield and a slight redshift in emission at the domain walls. Further, micro-Raman studies provide spatially resolved mapping of vibrational modes, exhibiting second-order phonon modes localized at the domain boundaries. Our findings suggest that electron-phonon coupling at twin domain walls plays a critical role in facilitating efficient charge separation, thereby improving the optoelectronic performance of the CsPbBr3 perovskites.

cond-mat.mtrl-sci