Alexander G. Shaw | Searcharxiv

arXiv2026

Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces

AI agents may soon become capable of autonomously completing valuable, long-horizon tasks in diverse domains. Current benchmarks either do not measure real-world tasks, or are not sufficiently difficult to meaningfully measure frontier models. To this end, we present Terminal-Bench 2.0: a carefully curated hard benchmark composed of 89 tasks in computer terminal environments inspired by problems from real workflows. Each task features a unique environment, human-written solution, and comprehensive tests for verification. We show that frontier models and agents score less than 65\% on the benchmark and conduct an error analysis to identify areas for model and agent improvement. We publish the dataset and evaluation harness to assist developers and researchers in future work at https://www.tbench.ai/ .

cs.SE↗

arXiv2020

Spin dynamics and a nearly continuous magnetic phase transition in an entropy-stabilized oxide antiferromagnet

The magnetic order and the spin dynamics in the antiferromagnetic entropy-stabilized oxide (Mg$_{0.2}$Co$_{0.2}$Ni$_{0.2}$Cu$_{0.2}$Zn$_{0.2}$)O (MgO-ESO) have been studied using muon spin relaxation ($μ$SR) and inelastic neutron scattering. We find that antiferromagnetic order develops gradually in the sample volume as it is cooled below 140 K, becoming fully ordered around 100 K. The spin dynamics show a critical slowing down in the vicinity of the transition, and the magnetic order parameter grows continuously in the ordered state. These results indicate that the antiferromagnetic transition is continuous but proceeds with a Gaussian distribution of ordering temperatures. The magnetic contribution to the specific heat determined from inelastic neutron scattering likewise shows a broad feature centered around 120 K. High-resolution inelastic neutron scattering further reveals an initially gapped spectrum at low temperature which sees an increase in a quasielastic contribution upon heating until the ordering temperature.

cond-mat.mtrl-sci↗