arXiv subjects

Esther H. R. Tsai

Publications and source records attributed to Esther H. R. Tsai.

6 recordsLinked to original sources

arXiv2026

Multi-Tool Robotics Enables In-Situ Sample Manipulation for Time-Resolved Synchrotron Measurements

The high photon flux at synchrotron beamlines allows for the measurement of fast dynamical processes. However, beamline radiation-safety protocols prohibit human intervention during X-ray experiments, limiting the ability to perform versatile real-time sample manipulations during continuous data acquisition. Here we present a robotic platform at an X-ray scattering beamline to enable real-time sample handling and processing in the experimental hutch, revealing previously inaccessible transient in-situ dynamics in perovskite thin films. This modular multi-tool robotic architecture enables in-hutch sample manipulation beyond human-access constraints, establishing a foundation for automated and autonomous synchrotron experimentation.

cond-mat.mtrl-sci↗

arXiv2026

LLM Jaggedness Unlocks Scientific Creativity

As artificial intelligence advances, models are not improving uniformly. Instead, progress unfolds in a jagged fashion, with capabilities growing unevenly across tasks, domains, and model scales. In this work, we examine this dynamic jaggedness through the lens of scientific idea generation. We introduce SciAidanBench, a benchmark of open-ended scientific questions designed to measure the scientific creativity of large language models (LLMs). Given a scientific question, models are asked to generate as many unique and coherent ideas as possible, with the total number of valid responses serving as a proxy for creative potential. Evaluating 19 base models across 8 providers (30 total variants including reasoning versions), we find that jaggedness manifests both across models and within models. First, in a cross-task comparison between general and scientific creativity, improvements in general creativity do not translate uniformly to scientific creativity, revealing divergent capability profiles across models. Second, at the prompt level, stronger models do not improve uniformly; instead, they exhibit high variability, with bursts of creativity on some questions and limited performance on others. Third, at the domain level, individual models display uneven strengths across scientific subfields, reflecting fragmented internal capability profiles. Finally, we show that this jaggedness can be harnessed. We explore mechanisms of inference-time compute, knowledge pooling, and brainstorming to combine models effectively and construct meta-model ensembles that outperform any single model. Our results position jaggedness not as a limitation, but as a resource, a structural feature of AI progress that, when understood and leveraged, can amplify LLM-driven scientific creativity.

cs.AI↗

arXiv2026

On the limits and opportunities of AI reviewers: Reviewing the reviews of Nature-family papers with 45 expert scientists

With the advancement of AI capabilities, AI reviewers are beginning to be deployed in scientific peer review, yet their capability and credibility remain in question: many scientists simply view them as probabilistic systems without the expertise to evaluate research, while other researchers are more optimistic about their readiness without concrete evidence. Understanding what AI reviewers do well, where they fall short, and what challenges remain is essential. However, existing evaluations of AI reviewers have focused on whether their verdicts match human verdicts (e.g., score alignment, acceptance prediction), which is insufficient to characterize their capabilities and limits. In this paper, we close this gap through a large-scale expert annotation study, in which 45 domain scientists in Physical, Biological, and Health Sciences spent 469 hours rating 2,960 individual criticisms (each targeting one specific aspect of a paper) from human-written and AI-generated reviews of 82 Nature-family papers on correctness, significance, and sufficiency of evidence. On a composite of all three dimensions, a reviewing agent powered by GPT-5.2 scores above each paper's top-rated human reviewer (60.0% vs. 48.2%, p = 0.009), while all three AI reviewers (including Gemini 3.0 Pro and Claude Opus 4.5) exceed the lowest-rated human across every dimension. AI reviewers' accurate criticisms are also more often rated significant and well-evidenced, and surface a distinct 26% of issues no human raises. However, AI reviewers overlap far more than humans do (21% vs. 3% for cross-reviewer pairs), and exhibit 16 recurring weaknesses humans do not share, such as limited subfield knowledge, lack of long context management over multiple files, and overly critical stance on minor issues. Overall, our results position current AI reviewers as complements to, not substitutes for, human reviewers.

cs.CL↗

arXiv2025

EnvTrace: Simulation-Based Semantic Evaluation of LLM Code via Execution Trace Alignment -- Demonstrated at Synchrotron Beamlines

Evaluating large language models (LLMs) for instrument control requires methods that go beyond standard, stateless algorithmic benchmarks, since the behavior of physical systems cannot be fully captured by unit tests alone. Here we introduce EnvTrace, a simulation-based method that evaluates execution traces to assess semantic code equivalence. EnvTrace is demonstrated with a beamline control-logic digital twin to facilitate the evaluation of instrument control code, with the digital twin itself also enabling the pre-execution validation of live experiments. Over 30 LLMs were evaluated using trace alignment to generate a multi-faceted score for functional correctness across key behavioral dimensions, showing that many top-tier models can approach human-level performance in rapid control-code generation. This is a first step toward a broader vision where LLMs and digital twins work symbiotically: LLMs providing intuitive control and agentic orchestration, and digital twins offering safe and high-fidelity environments, paving the way towards autonomous embodied AI.

cs.SE↗

arXiv2024

Crystallization of Binary Nanocrystal Superlattices and the Relevance of Short-Range Attraction

The synthesis of binary nanocrystal superlattices (BNSLs) enables the targeted integration of orthogonal physical properties, like photoluminescence and magnetism, into a single superstructure, unlocking a vast design space for multifunctional materials. Yet, the formation mechanism of BNSLs remains poorly understood, restricting the use of simulation to predict the structure and properties of the superlattices. Here, we use a combination of in situ scattering and molecular simulation to elucidate the self-assembly of two common BNSLs through emulsion templating. Our self-assembly experiments reveal that no intermediate structures precede the formation of the final binary phases, indicating that their formation proceeds through classical nucleation. Using simulations, we find that, despite the formation of AlB2 and NaZn13 typically being attributed to entropy, their self-assembly is most consistent with the nanocrystals possessing short-range interparticle attraction, which we find can dramatically accelerate nucleation kinetics in BNSLs. We also find homogenous, classical nucleation in simulation, corroborating our experiments. These results establish a robust correspondence between experiment and theory, paving the way towards a priori prediction of BNSLs.

cond-mat.mtrl-sci↗

arXiv2021

Thermal history of matrix forsterite grains from Murchison based on high-resolution tomography

Protoplanetary disks are dust- and gas-rich structures surrounding protostars. Depending on the distance from the protostar, this dust is thermally processed to different degrees and accreted to form bodies of varying chemical compositions. The primordial accretion processes occurring in the early protoplanetary disk such as chondrule formation and metal segregation are not well understood. One way to constrain them is to study the morphology and composition of forsteritic grains from the matrix of carbonaceous chondrites. Here, we present high-resolution ptychographic X-ray nanotomography and multimodal chemical micro-tomography (X-ray diffraction and X-ray fluorescence) to reveal the early history of forsteritic grains extracted from the matrix of the Murchison CM2.5 chondrite. The 3D electron density maps revealed, at unprecedented resolution (64~nm), spherical inclusions containing Fe-Ni, very little silica-rich glass and void caps (i.e., volumes where the electron density is consistent with conditions close to vacuum) trapped in forsterite. The presence of the voids along with the overall composition, petrological textures, and shrinkage calculations is consistent with the grains experiencing one or more heating events with peak temperatures close to the melting point of forsterite ($\sim$2100~K) and subsequently cooled and contracted, in agreement with chondrule-forming conditions.

astro-ph.EP↗