Searcharxiv⌕ Search

arXiv subjects

Jinao Wang

Publications and source records attributed to Jinao Wang.

2 recordsLinked to original sources

Constructing Challenging Browser-Use Tasks by Controlled Environment Interventions

As browser-use agents improve, benchmarks keep pace by adding new tasks, websites, and applications. Doing so is costly, and because many factors change at once, it is unclear what makes the new tasks harder. In this work, we instead make existing tasks harder by changing the environment in which they are performed, so that difficulty becomes a programmable property of the environment. We introduce BreakingWeb, in which each task is run twice: once on an unmodified website and once under an intervention, a controlled change to the website's content, server state, network responses, or rendered page. Each intervention is reproducible, keeps the user instruction and success criterion fixed, can be detected and worked around by a competent user, and is labeled with the behavior that recovery from it mainly requires, such as verification. BreakingWeb contains $519$ task pairs on seven self-hosted websites, and each run is scored on the website's final backend state. We evaluate six strong browser-use agents, three agents that observe only screenshots, and human participants. Interventions lower the pass rates of the six browser-use agents by $22.9$ percentage points on average, and each agent fails on nearly half of the tasks it solves on the unmodified website. Humans are affected much less: their pass rate drops by $10.0$ points on the first attempt and by $5.7$ points when they repeat the task. Most failures of the six agents ($75\%$) are \emph{belief failures}, in which the agent declares the run finished although a required change was never made. Our code, data, and environments are available at https://www.breakingweb.app.

cs.CL↗

Scalable Quantum Ground State Preparation of the Heisenberg Model: A Variational Quantum Eigensolver Approach

Quantum systems have historically been formidable to simulate using classical computational methods, particularly as the system size grows. In recent years, advancements in quantum computing technology have offered new opportunities for tackling complex quantum systems, potentially enabling the study and preparation of quantum states directly on quantum processors themselves. The Variational Quantum Eigensolver (VQE) algorithm is a system composed of a quantum circuit as well as a classical optimizer that can be used to efficiently prepare interesting many-body states on the current noisy intermediate-scale quantum (NISQ) devices. We assess the efficacy and scalability of VQE by preparing the ground states of the 1D generalized Heisenberg model, a pivotal model in understanding magnetic materials. We present an ansatz capable of preparing the ground states for all possible values of the coupling, including the critical states for the anisotropic XXZ model. This paper also aims to provide insights into the precision and time consumption involved in classical and optimized sampling approaches in the calculation of expectation values. In preparing the ground state for the Heisenberg models, this paper paves the way for more efficient quantum algorithms and contributes to the broader field of condensed matter physics.

quant-ph↗