SearcharxivSearch

arXiv subjects

Qi Gao

Publications and source records attributed to Qi Gao.

At least 19 recordsLinked to original sources

UI-Mate: Advancing Open-Weight Foundation GUI Agents with In-Context Demonstrations

Foundation GUI agents can automate complex digital tasks, but deployment is hindered by scarce and biased training data, ambiguous prompts, and unreliable execution. Routine workflows rely on user-specific tools and tacit conventions, so unstated instructions can produce arbitrary variations across runs. We present UI-Mate, a foundation GUI agent that integrates an environment-grounded training stack with in-context demonstration learning. UI-Mate makes three contributions: A Scalable Environment-Grounded Training Stack: A closed-loop data engine automates task generation, environment construction, rollout, filtering, capability balancing, SFT, and online RL across massively parallel environments via unified task-verifier bundles. In-Context Demonstration Learning: A mechanism that transforms multimodal demonstrations into flexible subtask-level workflows, follows relevant demonstrated steps, and re-plans from the live interface. OSWorkerBench Benchmark and Insights: A benchmark of 100 long-horizon office tasks across 41 applications that supports instruction-only and demonstration-guided evaluation. Its demonstration resources separate a 33-task self-demo setting, built from successful strong-agent rollouts of the same targets, from a 45-task variant-demo setting, built from human recordings of related but non-identical tasks. Experiments show that UI-Mate-27B sets a new open-weight state of the art on general computer-use benchmarks, scoring 77.0% on OSWorld-Verified and 66.2% on WindowsAgentArena. On OSWorkerBench, it reaches 41.0% strict success and 76.9% progress, outperforming its Qwen3.6-27B base by 17.7 and 24.5 points. On the 33-task self-demo subset, one demonstration raises strict success from 17.2% to 35.4% and progress from 67.9% to 81.1%, substantially improving long-horizon reliability. Project page: https://ui-mate.github.io.

cs.AI

Efficient Weak-Entropy PINN for Solving Hyperbolic Conservation Laws

In recent years, neural networks have significantly advanced numerical solutions of partial differential equations (PDEs). However, solving PDEs with discontinuous solutions, such as hyperbolic conservation laws, remains challenging for neural network-based methods such as physics-informed neural networks (PINNs). Existing methods often rely on strong prior assumptions such as knowledge of discontinuity locations, or they introduce artificial smoothing terms that degrade accuracy. However, accurately solving these conservation laws and predicting the formation and propagation of discontinuities in solutions is crucial in many practical applications, including gas dynamics and traffic flow modeling. In this paper, we introduce a novel Weak-Entropy PINN (WEPINN) framework for hyperbolic conservation laws with discontinuous solutions. The method enforces the governing equations in their weak (integral) formulation and incorporates the entropy condition to select the physically admissible solution, while employing the discrete fast Fourier transform (DFFT) for efficient numerical integration. Our method is tested through extensive numerical experiments on a variety of scalar conservation laws and systems of conservation laws in one and two dimensional spaces. These experiments demonstrate that our method can accurately resolve sharp discontinuities while effectively capturing interactions between multiple shock and rarefaction waves.

math.NA

Topological properties and phase diagram of the triangular Hofstadter model with staggered flux

We study the topological properties and phase diagram of the triangular Hofstadter model with staggered flux in adjacent triangles in this work. This lattice can be used to describe the low energy physics of the twisted bilayer transition metal dichalcogenides (TMD) in a certain range of the electric displacement field between the two layers. We show that the Hofstadter spectrum of this model is generally asymmetric except at specific staggered flux $3\phi= \pi/2 \mod {\pi}$ due to an additional P symmetry at such $\phi$. Breaking the translation symmetry by dimerization lifts the P symmetry and results in rich topological phases in the system. The dimerized model with different rational external magnetic flux ${\Phi}_B = 2\pi p/q$ has phase diagram with the following common features. For even q, the dimerized model generally has three gapped regimes. The one with small dimerization has finite Chern number and the other two have zero Chern number. For odd q, the model is gapped with zero Chern number at any finite dimerization. For both q even and odd, the two regimes with zero Chern number can be further characterized by the inversion symmetry of the parametrized one-dimensional chains of the system at \phi = 0 \mod \pi/3$, and one regime is topologically non-trivial and the other is trivial. Our results may be tested in twisted bilayer TMD with weak interaction or cold atom systems in optical lattice or photonic crystals achieved in recent experiments.

cond-mat.other

EPIC-CIM: Training Convolutional Neural Networks on a Coherent Ising Machine via Equilibrium Propagation

Quantum convolutional neural networks, due to the involvement of quantum measurements and discrete quantum state evolution, face inherent training challenges associated with non-differentiable operations and discrete optimization dynamics, which make conventional gradient-based learning difficult to apply effectively. In this context, energy-based learning provides a promising alternative by reformulating network training as an energy minimization process without explicit gradient backpropagation.In this framework, input data are processed through convolutional operations, followed by quantum sampling to generate intermediate binary representations, while the output layer also relies on quantum sampling to produce final predictions. The overall network energy is composed of convolutional feature matching terms, linear coupling terms at the output layer, and global output constraint terms, enabling both parameter updates and feature evolution to be described through physically interpretable energy dynamics. Furthermore, under the equilibrium propagation mechanism, the energy difference between the free phase and the weakly clamped phase is exploited to drive parameter updates without explicit gradient computation, thereby enabling stable and consistent learning in non-differentiable and discrete spaces. While remaining consistent with classical convolutional learning theory, the proposed framework enhances interpretability and observability through quantum energy modeling, offering a unified physical perspective for efficient QCNN training and the integration of quantum computing with artificial intelligence.

quant-ph

POLAR-Bench: A Diagnostic Benchmark for Privacy-Utility Trade-offs in LLM Agents

LLM agents increasingly have access to private user data and act on the user's behalf when interacting with third-party systems. The user defines what may and must not be shared, and the agent must robustly follow that intent even when third-party systems behave adversarially. We introduce POLAR-Bench (Policy-aware adversarial Benchmark), in which a trusted model with a privacy policy and a task converses with a third-party model that adversarially probes for both task-relevant and protected attributes. Across 10 domains and 7,852 samples, we score privacy and utility by deterministic set-membership and vary privacy policy dimension and attack strategy along two orthogonal axes, producing a 5 times 5 diagnostic surface per model. Our results reveal a sharp split: current frontier models withhold over 99% of protected attributes, while smaller open-weight models in the 1--30B range, the class users most commonly run as their own trusted agent on-device or via private inference, score notably worse, with the weakest leaking over half. POLAR-Bench thus localizes where each model's intent-following breaks down, providing a foothold for privacy alignment where it matters most.

cs.AI

Multi-Pedestrian Safety Warning at Urban Intersections Use Case of Digital Twin

Digital twins (DTs) for urban transportation systems have gained increasing attention; however, their systematic evaluation in safety-critical scenarios remains limited. This paper presents a multi-pedestrian safety warning system at urban intersections enabled by a tightly coupled physical-digital twin framework. Built upon the COSMOS city-scale wireless testbed in New York City, the proposed system integrates camera and ultra-wideband (UWB), edge-cloud computing, predictive trajectory modeling, and MQTT-based communication to deliver real-time safety alerts to vulnerable road users (VRUs). The system is evaluated through both field deployment and virtual reality (VR) experiments. Results demonstrate high warning generation accuracy, localization accuracy, efficient end-to-end latency under different model configurations, and significant reductions in user response time when warnings are issued. The proposed DT framework provides a scalable, modular, and generalizable solution for real-time multi-pedestrian safety enhancement at complex urban intersections.

cs.LG

Localization phase diagram of the Hexagonal Lattice with irrational magnetic flux

We study the Hofstadter model on a hexagonal lattice with irrational magnetic flux in this work. The Hofstadter model of the square lattice with irrational flux has been solved mathematically by Avila and his collaborators in his Fields medal work. However, this theory is usually not applicable to lattices with internal degrees of freedom, such as spin or sublattice. In this work, we show that for the hexagonal lattice with only nearest neighbor hopping, the system can still be characterized by a two by two transfer matrix and solved exactly by the Avila global theory although this lattice has two sublattices. We obtained the exact localization phase diagram of the hexagonal lattice with irrational flux by this theory, which reveals three pure phases, i.e., the extended, localized and critical states but no mobility edge due to the chiral symmetry. We used the renormalization group (RG) theory to verify these results, which can determine part of the phase diagram. We then computed the fractal dimension of the remaining part numerically. The results from both the RG theory and numerical analysis confirmed the phase diagram we get from the Avila global theory. Our results can be tested in various hexagonal Moire lattices and artificial superlattices in recent experiments.

cond-mat.mes-hall

Generative Circuit Design for Quantum-Selected Configuration Interaction

Quantum-selected configuration interaction (QSCI) has emerged as a feasible approach for approximating electronic ground states on noisy quantum devices toward large-system demonstrations. In QSCI, Slater determinants are sampled from a quantum-prepared state, and the Hamiltonian is then diagonalized in the sampled subspace. To create a high-quality subspace under hardware constraints, the design of the state-preparation circuit is crucial. Here, we present a Generative Quantum Eigensolver (GQE)-based framework that optimizes ansatz structures using a Transformer policy trained on the QSCI subspace energy. We validate the framework on N2 in active spaces of up to 32 qubits. We found that the optimized circuits reach chemical precision with substantially lower gate counts than time-evolved circuits. Quantitatively, this corresponds to an average reduction of 98% in the required two-qubit gate count relative to the single-step first-order Trotterized approximation and 83% relative to the qDRIFT approximation. Furthermore, the resulting wavefunctions are competitive with heat-bath configuration interaction (HCI) in terms of compactness. In stretched-bond, strongly correlated regimes, they achieve chemical precision with subspaces that are 50% smaller than those required by HCI.

quant-ph

Project Imaging-X: A Survey of 1000+ Open-Access Medical Imaging Datasets for Foundation Model Development

Foundation models have demonstrated remarkable success across diverse domains and tasks, primarily due to the thrive of large-scale, diverse, and high-quality datasets. However, in the field of medical imaging, the curation and assembling of such medical datasets are highly challenging due to the reliance on clinical expertise and strict ethical and privacy constraints, resulting in a scarcity of large-scale unified medical datasets and hindering the development of powerful medical foundation models. In this work, we present the largest survey to date of medical image datasets, covering over 1,000 open-access datasets with a systematic catalog of their modalities, tasks, anatomies, annotations, limitations, and potential for integration. Our analysis exposes a landscape that is modest in scale, fragmented across narrowly scoped tasks, and unevenly distributed across organs and modalities, which in turn limits the utility of existing medical image datasets for developing versatile and robust medical foundation models. To turn fragmentation into scale, we propose a metadata-driven fusion paradigm (MDFP) that integrates public datasets with shared modalities or tasks, thereby transforming multiple small data silos into larger, more coherent resources. Building on MDFP, we release an interactive discovery portal that enables end-to-end, automated medical image dataset integration, and compile all surveyed datasets into a unified, structured table that clearly summarizes their key characteristics and provides reference links, offering the community an accessible and comprehensive repository. By charting the current terrain and offering a principled path to dataset consolidation, our survey provides a practical roadmap for scaling medical imaging corpora, supporting faster data discovery, more principled dataset creation, and more capable medical foundation models.

cs.CV

Auger Spectroscopy via Generative Quantum Eigensolver: A Quantum Approach to Molecular Excitations

Auger electron spectroscopy, a way of characterizing electronic structure through core-level decay processes, is widely used in materials characterization; however direct calculation from molecular geometry requires accurate treatment of many excited states, posing a challenge for classical methods. We present a hybrid quantum-classical workflow for calculating Auger spectra that combines the generative quantum eigensolver (GQE) for ground-state preparation, the quantum self-consistent equation-of-motion method for excited-state calculations, and the one-centre approximation for Auger transition rates. GQE uses a GPT-2 model to generate quantum circuits for ground-state optimization, allowing our workflow to benefit from HPC parallelization and GPU-acceleration for favourable scaling with system size. We demonstrate the validity of our workflow by calculating the Auger spectrum of water with the STO-3G basis set and demonstrating qualitative and quantitative agreement with spectra obtained using completely classical full configuration interaction calculations, from the computational literature, and from the experimental literature. We also find that for water, substituting the variational quantum eigensolver (VQE) for GQE results in near-identical spectra, but that the ground state estimator generated by GQE contains about half the total gate count as that generated by VQE.

quant-ph

Airfoil shape optimization via coherent Ising machine

Airfoil shape optimization presents a challenge where classical solvers frequently struggle with computational efficiency and local minima. In the promising paradigm of quantum computing, the coherent Ising machine (CIM), a specialized physical solver, offers acceleration capabilities. However, its native discrete binary architecture restricts the application in aerodynamic design. To bridge this gap, we propose a comprehensive framework that translates airfoil shape optimization into hardware-compliant quadratic unconstrained binary optimization formulations. We integrate high-order response surface models via the Rosenberg order reduction, enabling the CIM to capture strong nonlinearities in the aerodynamic performance response. Furthermore, we introduce a block-diagonal scalarization strategy that compose trade-off scenarios into a single optimization. Validated on the NACA 4-digit airfoil series using CIM hardware with 615 spins, the framework successfully locates the global optimum with a computational speedup of three orders of magnitude compared to the classical simulated annealing. The parallel embedding capacity allows for the extraction of an entire optimal Pareto front in a single hardware execution. This work demonstrates a viable, quantum-enhanced paradigm for engineering optimization.

quant-ph

Penguin-VL: Exploring the Efficiency Limits of VLM with LLM-based Vision Encoders

Vision Language Model (VLM) development has largely relied on scaling model size, which hinders deployment on compute-constrained mobile and edge devices such as smartphones and robots. In this work, we explore the performance limits of compact (e.g., 2B and 8B) VLMs. We challenge the prevailing practice that state-of-the-art VLMs must rely on vision encoders initialized via massive contrastive pretraining (e.g., CLIP/SigLIP). We identify an objective mismatch: contrastive learning, optimized for discrimination, enforces coarse and category-level invariances that suppress fine-grained visual cues needed for dense captioning and complex VLM reasoning. To address this issue, we present Penguin-VL, whose vision encoder is initialized from a text-only LLM. Our experiments reveal that Penguin-Encoder serves as a superior alternative to traditional contrastive pretraining, unlocking a higher degree of visual fidelity and data efficiency for multimodal understanding. Across various image and video benchmarks, Penguin-VL achieves performance comparable to leading VLMs (e.g., Qwen3-VL) in mathematical reasoning and surpasses them in tasks such as document understanding, visual knowledge, and multi-perspective video understanding. Notably, these gains are achieved with a lightweight architecture, demonstrating that improved visual representation rather than model scaling is the primary driver of performance. Our ablations show that Penguin-Encoder consistently outperforms contrastive-pretrained encoders, preserving fine-grained spatial and temporal cues that are critical for dense perception and complex reasoning. This makes it a strong drop-in alternative for compute-efficient VLMs and enables high performance in resource-constrained settings. Code: https://github.com/tencent-ailab/Penguin-VL

cs.CV

Exact and Asymptotically Complete Robust Verifications of Neural Networks via Ising Solvers

We present an Ising-compatible framework for formal neural-network robustness verification under bounded input perturbations. For piecewise-linear activations, the Exact Logarithmic PWL Model (Log-PWL) provides an exact, sound, and complete formulation with a state-optimal logarithmic encoding, reducing the binary variables per neuron from linear to information-theoretically minimal logarithmic complexity. For general bounded element-wise activations, the Asymptotic Step-Envelope Model (Step-Env) uses sound piecewise-constant envelopes whose lower and upper neuron states remain decision variables coupled to a common adversarial input. We prove that its globally optimized output bounds converge uniformly to the true network extrema as the segment width vanishes, yielding asymptotic completeness of verification. We further develop a hybrid Benders solver with output-sensitive iteration bounds, leveraging a Helly-based conflict compression theory to avoid generic exponential cut explosion. Interval pruning, certificate transfer for pruned networks, and layerwise classical--Ising partitioning further reduce spin requirements. Experiments show exact certification fidelity for piecewise-linear networks and near-reference accuracy for sigmoid networks with compact spin budgets.

cs.LG

Quantum Simulations for Extreme Ultraviolet Photolithography

A key challenge of extreme ultraviolet (EUV) lithography in semiconductor fabrication is the line edge roughness or "blur" produced by the electron cascades following absorption of a high-energy photon. Here we present quantum algorithms to compute EUV absorption and photoelectron emission spectra, which are key to predicting blur. The first is a time-domain algorithm resolving absorption at a given frequency; the second is a first-quantized plane-wave algorithm computing the photoemission spectrum via real-time dynamics that treats bound and continuum states on equal footing. For a model photoresist monomer IMePh, 92 eV absorption requires $200$ logical qubits and $10^{9}$ non-Clifford gates per circuit with $10^3$ shots, while the photoemission spectrum needs $\geq 10^{14}$ gates, $10^4$ shots, and several thousand logical qubits. These results establish high-fidelity quantum simulations as a key component to parameterize the multi-scale macroscopic models required to overcome the electron blur bottleneck in semiconductor miniaturization.

quant-ph

Kaiwu-PyTorch-Plugin: Bridging Deep Learning and Photonic Quantum Computing for Energy-Based Models and Active Sample Selection

This paper introduces the Kaiwu-PyTorch-Plugin (KPP) to bridge Deep Learning and Photonic Quantum Computing across multiple dimensions. KPP integrates the Coherent Ising Machine into the PyTorch ecosystem, addressing classical inefficiencies in Energy-Based Models. The framework facilitates quantum integration in three key aspects: accelerating Boltzmann sampling, optimizing training data via Active Sampling, and constructing hybrid architectures like QBM-VAE and Q-Diffusion. Empirical results on single-cell and OpenWebText datasets demonstrate KPPs ability to achieve SOTA performance, validating a comprehensive quantum-classical paradigm.

quant-ph

Topological constraints on the electronic band structure of hexagonal lattice in a magnetic field

The impact of projective lattice symmetry on electronic band structures has attracted significant attention in recent years, particularly in light of growing experimental studies of two-dimensional hexagonal materials in magnetic fields. Yet, most theoretical work to date has focused on the square lattice due to its relative simplicity. In this work, we investigate the role of projective lattice symmetry in a hexagonal lattice with rational magnetic flux, emphasizing the resulting topological constraints on the electronic band structure. We show that, at pi flux, the symmetry in the hexagonal lattice enforces novel Dirac band touchings at E not equal to zero, and for general rational flux it constrains the number of Dirac points at E = 0. We further analyze the symmetry-imposed constraints on the Chern numbers of both isolated gapped bands and band multiplets connected by Dirac-point touchings. Our results demonstrate that these constraints in the hexagonal lattice differ substantially from those in the square lattice.

cond-mat.mes-hall

A Giant Peanut-shaped Ultra-High-Energy Gamma-Ray Emitter Off the Galactic Plane

Ultra-high-energy (UHE), exceeding 100 TeV (10^12 electronvolts), γ-rays manifests extreme particle acceleration in astrophysical sources. Recent observations by γ-ray telescopes, particularly by the Large High Altitude Air Shower Observatory (LHAASO), have revealed a few tens of UHE sources, indicating numerous Galactic sources capable of accelerating particles to PeV (10^15 electronvolts) energies. However, discerning the dominant acceleration mechanisms (leptonic versus hadronic), the relative contributions of specific source classes, and the role of particle transport in shaping their observed emission are central goals of modern UHE astrophysics. Here we report the discovery of a giant UHE γ-ray emitter at -17.5° off the Galactic plane - a region where UHE γ-ray sources are rarely found. The emitter exhibits a distinctive asymmetric shape, resembling a giant "Peanut" spanning 0.45° \times 4.6°, indicative of anisotropic particle distribution over a large area. A highly aged millisecond pulsar (MSP) J0218+4232 is the sole candidate accelerator positionally coincident with the Peanut region. Its association with UHE γ-rays extending to 0.7 PeV, if confirmed, would provide the first evidence of a millisecond pulsar powering PeV particles. Such a finding challenges prevailing models, which posit that millisecond pulsars cannot sustain acceleration to PeV energies. The detection reveals fundamental gaps in understanding particle acceleration, cosmic-ray transport, and interstellar magnetic field effects, potentially revealing new PeV accelerator (PeVatron) classes.

astro-ph.HE

Summing Real Time Feynman Paths of Lattice Polaron with Matrix Product States

We study numerically the real time dynamics of lattice polarons by combining the Feynman path integral and the matrix product state (MPS) approach. By constructing and solving a flow equation, we show that the integrand, viewed as a multivariable function of polaron world line parameters, can be compressed as a low bond dimension MPS, thereby allowing for efficient evaluation of various dynamical observables. We establish the effectiveness of our method by benchmarking the calculated polaron spectral function in one dimension against available results. We further demonstrate its potential by presenting the polaron spectral function in two dimensions and simulating polaron diffusion in both one and two dimensions.

cond-mat.str-el