arXiv subjects

Ethan Holbrook

Publications and source records attributed to Ethan Holbrook.

3 recordsLinked to original sources

arXiv2026

Evaluating LLM-generated code for domain-specific languages: molecular dynamics with LAMMPS

Large language models (LLMs) are changing the way researchers interact with code and data in scientific computing. While their ability to generate general-purpose code is well established, their effectiveness in producing scientifically valid scripts for domain-specific language (DSLs) remains largely unexplored. We propose an evaluation procedure that enables domain experts to assess the validity of LLM-generated input files for LAMMPS, a widely used molecular dynamics (MD) code, without requiring deep familiarity with its syntax. The evaluation procedure combines a normalization step that produces canonical input files with an extensible parser for syntax analysis, followed by a reduced-cost execution stage and accuracy checks that isolate common errors before running costly simulations. We apply the pipeline to eight state-of-the-art LLMs across three prompts of increasing complexity. The parser pass rate has improved from 74% to 91% over the past year, but scientific accuracy on coupled multi-step workflows remains limited. Across all 80 scripts evaluated on the most complex prompt, only one was fully correct as generated. We further package the automated stages as a reusable agentic skill that LLMs can invoke during script generation; in a small-scale demonstration, this skill helped two models produce five fully correct scripts out of six across the same three prompts, including the hardest one. The pipeline highlights both the limitations of current LLMs in generating scientific DSLs and a practical path toward integrating them into domain-specific computational ecosystems.

cs.SE↗

arXiv2025

Modeling Framework to Predict Melting Dynamics at Microstructural Defects in TNT-HMX High Explosive Composites

Many high explosive (HE) formulations are composite materials whose microstructure is understood to impact functional characteristics. Interfaces are known to mediate the formation of hot spots that control their safety and initiation. To study such processes at molecular scales, we developed all-atom force fields (FFs) for Octol, a prototypical HE formulation comprised of TNT (2,4,6-trinitrotoluene) and HMX (octahydro-1,3,5,7-tetranitro-1,3,5,7-tetrazocine). We extended a FF for TNT and recasted it in a form that can be readily combined with a well-established FF for HMX. The resulting FF was extensively validated against experimental results and density functional theory calculations. We applied the new combined TNT-HMX FF to predict and rank surface and interface energies, which indicate that there is an energetic driver for coarsening of microstructural grains in TNT-HMX composites. Finally, we assess the impact of several microstructural environments on the dynamic melting of TNT crystal under ultrafast thermal loading. We find that both free surfaces and planar material interfaces are effective nucleation points for TNT melting. However, MD simulations show that TNT crystal is prone to superheating by at least 50 K on sub-nanosecond timescales and that the degree of superheating is inversely correlated with surface and interface energy. The modeling framework presented here will enable future studies on hot spot formation processes in accident scenarios that are governed by strong coupling between microstructural interfaces, material mechanics, momentum and energy transport, phase transitions, and chemistry.

cond-mat.mtrl-sci↗

arXiv2023

GPT-4 as an interface between researchers and computational software: improving usability and reproducibility

Large language models (LLMs) are playing an increasingly important role in science and engineering. For example, their ability to parse and understand human and computer languages makes them powerful interpreters and their use in applications like code generation are well-documented. We explore the ability of the GPT-4 LLM to ameliorate two major challenges in computational materials science: i) the high barriers for adoption of scientific software associated with the use of custom input languages, and ii) the poor reproducibility of published results due to insufficient details in the description of simulation methods. We focus on a widely used software for molecular dynamics simulations, the Large-scale Atomic/Molecular Massively Parallel Simulator (LAMMPS), and quantify the usefulness of input files generated by GPT-4 from task descriptions in English and its ability to generate detailed descriptions of computational tasks from input files. We find that GPT-4 can generate correct and ready-to-use input files for relatively simple tasks and useful starting points for more complex, multi-step simulations. In addition, GPT-4's description of computational tasks from input files can be tuned from a detailed set of step-by-step instructions to a summary description appropriate for publications. Our results show that GPT-4 can reduce the number of routine tasks performed by researchers, accelerate the training of new users, and enhance reproducibility.

cond-mat.mtrl-sci↗