arXiv subjects

Zihao Li

Publications and source records attributed to Zihao Li.

At least 91 records · Page 5Linked to original sources

arXiv2026

MTFM: A Scalable and Alignment-free Foundation Model for Industrial Recommendation in Meituan

Industrial recommendation systems typically involve multiple scenarios, yet existing cross-domain (CDR) and multi-scenario (MSR) methods often require prohibitive resources and strict input alignment, limiting their extensibility. We propose MTFM (Meituan Foundation Model for Recommendation), a transformer-based framework that addresses these challenges. Instead of pre-aligning inputs, MTFM transforms cross-domain data into heterogeneous tokens, capturing multi-scenario knowledge in an alignment-free manner. To enhance efficiency, we first introduce a multi-scenario user-level sample aggregation that significantly enhances training throughput by reducing the total number of instances. We further integrate Grouped-Query Attention and a customized Hybrid Target Attention to minimize memory usage and computational complexity. Furthermore, we implement various system-level optimizations, such as kernel fusion and the elimination of CPU-GPU blocking, to further enhance both training and inference throughput. Offline and online experiments validate the effectiveness of MTFM, demonstrating that significant performance gains are achieved by scaling both model capacity and multi-scenario training data.

cs.IR↗

arXiv2026

UEREBot: Learning Safe Quadrupedal Locomotion under Unstructured Environments and High-Speed Dynamic Obstacles

Quadruped robots are increasingly deployed in unstructured environments. Safe locomotion in these settings requires long-horizon goal progress, passability over uneven terrain and static constraints, and collision avoidance against high-speed dynamic obstacles. A single system cannot fully satisfy all three objectives simultaneously: planning-based decisions can be too slow, while purely reactive decisions can sacrifice goal progress and passability. To resolve this conflict, we propose UEREBot (Unstructured-Environment Reflexive Evasion Robot), a hierarchical framework that separates slow planning from instantaneous reflexive evasion and coordinates them during execution. UEREBot formulates the task as a constrained optimal control problem blueprint. It adopts a spatial--temporal planner that provides reference guidance toward the goal and threat signals. It then uses a threat-aware handoff to fuse navigation and reflex actions into a nominal command, and a control barrier function shield as a final execution safeguard. We evaluate UEREBot in Isaac Lab simulation and deploy it on a Unitree Go2 quadruped equipped with onboard perception. Across diverse environments with complex static structure and high-speed dynamic obstacles, UEREBot achieves higher avoidance success and more stable locomotion while maintaining goal progress than representative baselines, demonstrating improved safety--progress trade-offs.

cs.RO↗

arXiv2026

Dynamic Mechanism Design without Monetary Transfers: A Queueing Theory Approach

We study the design of optimal allocation mechanisms in an environment where agents and goods arrive stochastically. Agents have private types that determine the principal payoff. Either agents or goods can be held in a queue at a flow cost until allocation. The principal cannot use monetary transfers, but can verify agents types at a cost. We characterize the optimal mechanism at the steady state of the system. It is a dynamic threshold mechanism in which the principal sets type thresholds for agent admission and goods allocation. These thresholds depend on the current state of the mechanism. The model applies to public programs such as public housing and grant allocation, and to allocation problems within organizations such as capital budgeting.

econ.TH↗

arXiv2026

Unveiling Traffic Wave of Linear Adaptive Cruise Control: A Second-order Macroscopic Traffic Flow Model

Traffic waves, the spatiotemporal propagation of congestion, are a key feature of traffic flow. As Adaptive Cruise Control (ACC) systems gain widespread adoption and show promise for improving both efficiency and safety, understanding how these waves evolve under ACC becomes increasingly important. Yet most existing analyses rely on steady-state metrics (e.g., equilibrium spacing) and neglect the ACC control-law parameters, such as feedback gains, that fundamentally shape higher-order traffic dynamics. To overcome this limitation, we embed the ACC control law directly into the momentum equation while retaining mass conservation law. The result is a higher-order macroscopic model whose dynamics are governed by a second-order partial differential equation equivalent to the linear ACC feedback law. Analyzing the flux Jacobian confirms that the system is strictly hyperbolic, thereby preserving anisotropy and ensuring physical consistency. The derivation also shows that traffic wave evolution depends on both the initial state and the ACC control parameters. We analyze wave-propagation characteristics, linear degeneracy, admissible discontinuities, and their connection to ACC string stability, with the corresponding derivations. Numerical experiments confirm that the second-order model yields markedly lower vehicle-pair speed deviations along wave paths than a first-order model subject to the same non-steady disturbances, underscoring both the necessity of a second-order treatment and the soundness of the proposed framework.

math.AP↗

arXiv2026

SpatialV2A: Visual-Guided High-fidelity Spatial Audio Generation

While video-to-audio generation has achieved remarkable progress in semantic and temporal alignment, most existing studies focus solely on these aspects, paying limited attention to the spatial perception and immersive quality of the synthesized audio. This limitation stems largely from current models' reliance on mono audio datasets, which lack the binaural spatial information needed to learn visual-to-spatial audio mappings. To address this gap, we introduce two key contributions: we construct BinauralVGGSound, the first large-scale video-binaural audio dataset designed to support spatially aware video-to-audio generation; and we propose a end-to-end spatial audio generation framework guided by visual cues, which explicitly models spatial features. Our framework incorporates a visual-guided audio spatialization module that ensures the generated audio exhibits realistic spatial attributes and layered spatial depth while maintaining semantic and temporal alignment. Experiments show that our approach substantially outperforms state-of-the-art models in spatial fidelity and delivers a more immersive auditory experience, without sacrificing temporal or semantic consistency. The demo page can be accessed at https://github.com/renlinjie868-web/SpatialV2A.

cs.CV↗

arXiv2026

Cyclic Modulation Control of Multi-Conflict Connected Automated Traffic

Multi-conflict traffic is ubiquitous. Connected Automated Vehicles (CAVs) offer unprecedented opportunities to enhance safety, reduce emissions, and increase throughput through precise coordination and automation. However, existing CAV strategies remain confined to specialized scenarios, such as highway on-ramp merging or single-lane roundabouts, and traditional traffic signals sacrifice efficiency for safety via rigid phasing and all-red intervals. In this paper, we present Cyclic Modulation Control of Multi-Conflict Connected Automated Traffic (CMAT), a unified, geometry-agnostic framework that embeds each conflict point into a repeating sequence of "micro-phases". Vehicles dynamically form platoons with demand-responsive sizes and negotiate time slots for occupying conflict points, enabling collision-free traversal and high intersection utilization. CMAT aims to minimize delay, guarantee safety, and accommodate arbitrary merging, diverging, and crossing patterns without manual retuning. We formalize CMAT as a mixed-integer linear programming model constructed on a directed graph abstracted from the physical intersection layout. The performance of CMAT is evaluated across a suite of multi-conflict tests, including simple two-way crossings, four-leg intersections, complex connected intersections. The results demonstrate substantial reductions in delay and significant throughput improvements compared with state-of-the-art CAV coordination methods and traditional signal timing strategies.

math.OC↗

arXiv2026

Test-Time Scaling of Reasoning Models for Machine Translation

Test-time scaling (TTS) has enhanced the performance of Reasoning Models (RMs) on various tasks such as math and coding, yet its efficacy in machine translation (MT) remains underexplored. This paper investigates whether increased inference-time computation improves translation quality. We evaluate 12 RMs across a diverse suite of MT benchmarks spanning multiple domains, examining three scenarios: direct translation, forced-reasoning extrapolation, and post-editing. Our findings show that for general-purpose RMs, TTS provides limited and inconsistent benefits for direct translation, with performance quickly plateauing. However, the effectiveness of TTS is unlocked by domain-specific fine-tuning, which aligns a model's reasoning process with task requirements, leading to consistent improvements up to an optimal, self-determined reasoning depth. We also find that forcing a model to reason beyond its natural stopping point consistently degrades translation quality. In contrast, TTS proves highly effective in a post-editing context, reliably turning self-correction into a beneficial process. These results indicate that the value of inference-time computation in MT lies not in enhancing single-pass translation with general models, but in targeted applications like multi-step, self-correction workflows and in conjunction with task-specialized models.

cs.CL↗

arXiv2025

Nearly query-optimal classical shadow estimation of unitary channels

Classical shadow estimation (CSE) is a powerful tool for learning the properties of quantum states and quantum processes. Here we consider the CSE task for quantum unitary channels. By querying an unknown unitary channel $\mathcal{U}$ multiple times in quantum experiments, the goal is to learn a classical description from which one can accurately predict many different linear properties of the channel, i.e., the expectation values of arbitrary observables measured on the output of $\mathcal{U}$ upon arbitrary input states. Based on collective measurements on multiple systems, we propose a query efficient protocol for this task, whose query complexity has a quadratic advantage over the previous best approach for this problem, and almost saturates the information-theoretic lower bound. To further enhance practicality, we also present a variant protocol using only single-copy measurements, which still offers much better query performance than previous protocols that do not use quantum memory, and can serve as a key subroutine for learning an arbitrary unknown Hamiltonian from dynamics. In addition to linear properties of unitary channels, our protocol can also be applied to simultaneously predict many non-linear properties, such as out-of-time-ordered correlators.

quant-ph↗

arXiv2025

EMMA-500: Enhancing Massively Multilingual Adaptation of Large Language Models

In this work, we introduce EMMA-500, a large-scale multilingual language model continue-trained on texts across 546 languages designed for enhanced multilingual performance, focusing on improving language coverage for low-resource languages. To facilitate continual pre-training, we compile the MaLA corpus, a comprehensive multilingual dataset enriched with curated datasets across diverse domains. Leveraging this corpus, we conduct extensive continual pre-training of the Llama 2 7B model, resulting in EMMA-500, which demonstrates robust performance across a wide collection of benchmarks, including a comprehensive set of multilingual tasks. Our results highlight the effectiveness of continual pre-training in expanding large language models' language capacity, particularly for underrepresented languages, demonstrating significant gains in cross-lingual transfer, task generalization, and language adaptability. We release the MaLA corpus, EMMA-500 model weights, scripts, and model generations.

cs.CL↗

arXiv2025

Massively Multilingual Adaptation of Large Language Models Using Bilingual Translation Data

This paper investigates a critical design decision in the practice of massively multilingual continual pre-training -- the inclusion of parallel data. Specifically, we study the impact of bilingual translation data for massively multilingual language adaptation of the Llama3 family of models to 500 languages. To this end, we construct the MaLA bilingual translation corpus, containing data from more than 2,500 language pairs. Subsequently, we develop the EMMA-500 Llama 3 suite of four massively multilingual models -- continually pre-trained from the Llama 3 family of base models extensively on diverse data mixes up to 671B tokens -- and explore the effect of continual pre-training with or without bilingual translation data. Comprehensive evaluation across 7 tasks and 12 benchmarks demonstrates that bilingual data tends to enhance language transfer and performance, particularly for low-resource languages. We open-source the MaLA corpus, EMMA-500 Llama 3 suite artefacts, code, and model generations.

cs.CL↗

arXiv2025

High-Precision Fidelity Estimation with Common Randomized Measurements

Efficient fidelity estimation of multiqubit quantum states is crucial to many applications in quantum information processing. However, to estimate the infidelity $ε$ with multiplicative precision, conventional estimation protocols require (order) $1/ε^2$ different circuits in addition to $1/ε^2$ samples, which is quite resource-intensive for high-precision fidelity estimation. Here we introduce an efficient estimation protocol by virtue of common randomized measurements (CRM) integrated with shadow estimation based on the Clifford group, which only requires $1/ε$ circuits. Moreover, in many scenarios of practical interest, in the presence of depolarizing or Pauli noise for example, our protocol only requires a constant number of circuits, irrespective of the infidelity $ε$ and the qubit number. For large and intermediate quantum systems, quite often one circuit is already sufficient. In the course of study, we clarify the performance of CRM shadow estimation based on the Clifford group and 4-designs and highlight its advantages over standard and thrifty shadow estimation.

quant-ph↗

arXiv2025

MAMMOTH-Grism: Revisiting the Mass-Metallicity Relation in Protocluster Environments at Cosmic Noon

We present one of the first measurements of the mass-metallicity relation (MZR) in multiple massive protoclusters at cosmic noon, using Hubble Space Telescope (HST) G141 slitless spectroscopy from the MAMMOTH-Grism survey. We identify 63 protocluster member galaxies across three overdense structures at $z = 2\text{-}3$ with robust detections of [OIII], H$β$, and [OII] emission. The sample spans gas-phase metallicities of $12 + \log(\text{O/H}) = 8.2\text{-}8.6$, dust-corrected H$β$-based star formation rates (SFRs) of $10$-$250\,M_\odot\,\text{yr}^{-1}$, and stellar masses of $M_\ast \sim 10^{9.4}$-$10^{10.5}\,M_\odot$, derived via spectral energy distribution fitting using deep HST and ground-based photometry. We stack spectra in five $M_\ast$ bins to obtain average metallicities and SFRs. Relative to field galaxies at similar redshifts, protocluster members show elevated SFRs at $M_\ast < 10^{10.25}\,M_\odot$ and a systematically shallower MZR: $12 + \log(\text{O/H}) = (6.96 \pm 0.13) + (0.143 \pm 0.017) \times \log(M_{\ast}/M_{\odot})$. We detect a mass-dependent environmental offset: massive protocluster galaxies are metal-poor compared to field counterparts of similar mass, whereas lower-mass systems exhibit comparable or mildly enhanced metallicities. This trend is consistent with a scenario where cold-mode accretion dilutes the interstellar medium (ISM) across the full mass range, while efficient recycling of feedback-driven outflows preferentially enriches the ISM in low-mass galaxies. Finally, we assess the dependence of metallicity offsets on local overdensity and find no significant trend, likely reflecting the survey's bias toward protocluster cores.

astro-ph.GA↗

arXiv2025

Knowledge-Grounded Agentic Large Language Models for Multi-Hazard Understanding from Reconnaissance Reports

Post-disaster reconnaissance reports contain critical evidence for understanding multi-hazard interactions, yet their unstructured narratives make systematic knowledge transfer difficult. Large language models (LLMs) offer new potential for analyzing these reports, but often generate unreliable or hallucinated outputs when domain grounding is absent. This study introduces the Mixture-of-Retrieval Agentic RAG (MoRA-RAG), a knowledge-grounded LLM framework that transforms reconnaissance reports into a structured foundation for multi-hazard reasoning. The framework integrates a Mixture-of-Retrieval mechanism that dynamically routes queries across hazard-specific databases while using agentic chunking to preserve contextual coherence during retrieval. It also includes a verification loop that assesses evidence sufficiency, refines queries, and initiates targeted searches when information remains incomplete. We construct HazardRecQA by deriving question-answer pairs from GEER reconnaissance reports, which document 90 global events across seven major hazard types. MoRA-RAG achieves up to 94.5 percent accuracy, outperforming zero-shot LLMs by 30 percent and state-of-the-art RAG systems by 10 percent, while reducing hallucinations across diverse LLM architectures. MoRA-RAG also enables open-weight LLMs to achieve performance comparable to proprietary models. It establishes a new paradigm for transforming post-disaster documentation into actionable, trustworthy intelligence for hazard resilience.

cs.CL↗

arXiv2025

Transformer Copilot: Learning from The Mistake Log in LLM Fine-tuning

Large language models are typically adapted to downstream tasks through supervised fine-tuning on domain-specific data. While standard fine-tuning focuses on minimizing generation loss to optimize model parameters, we take a deeper step by retaining and leveraging the model's own learning signals, analogous to how human learners reflect on past mistakes to improve future performance. We first introduce the concept of Mistake Log to systematically track the model's learning behavior and recurring errors throughout fine-tuning. Treating the original transformer-based model as the Pilot, we correspondingly design a Copilot model to refine the Pilot's inference performance via logits rectification. We name the overall Pilot-Copilot framework the Transformer Copilot, which introduces (i) a novel Copilot model design, (ii) a joint training paradigm where the Copilot continuously learns from the evolving Mistake Log alongside the Pilot, and (iii) a fused inference paradigm where the Copilot rectifies the Pilot's logits for enhanced generation. We provide both theoretical and empirical analyses on our new learning framework. Experiments on 12 benchmarks spanning commonsense, arithmetic, and recommendation tasks demonstrate that Transformer Copilot consistently improves performance by up to 34.5%, while introducing marginal computational overhead to Pilot models and exhibiting strong scalability and transferability. Our code is released at https://github.com/jiaruzouu/TransformerCopilot.

cs.CL↗

arXiv2025

CyPortQA: Benchmarking Multimodal Large Language Models for Cyclone Preparedness in Port Operation

As tropical cyclones intensify and track forecasts become increasingly uncertain, U.S. ports face heightened supply-chain risk under extreme weather conditions. Port operators need to rapidly synthesize diverse multimodal forecast products, such as probabilistic wind maps, track cones, and official advisories, into clear, actionable guidance as cyclones approach. Multimodal large language models (MLLMs) offer a powerful means to integrate these heterogeneous data sources alongside broader contextual knowledge, yet their accuracy and reliability in the specific context of port cyclone preparedness have not been rigorously evaluated. To fill this gap, we introduce CyPortQA, the first multimodal benchmark tailored to port operations under cyclone threat. CyPortQA assembles 2,917 realworld disruption scenarios from 2015 through 2023, spanning 145 U.S. principal ports and 90 named storms. Each scenario fuses multisource data (i.e., tropical cyclone products, port operational impact records, and port condition bulletins) and is expanded through an automated pipeline into 117,178 structured question answer pairs. Using this benchmark, we conduct extensive experiments on diverse MLLMs, including both open-source and proprietary model. MLLMs demonstrate great potential in situation understanding but still face considerable challenges in reasoning tasks, including potential impact estimation and decision reasoning.

cs.CL↗

arXiv2025

TAPOM: Task-Space Topology-Guided Motion Planning for Manipulating Elongated Object in Cluttered Environments

Robotic manipulation in complex, constrained spaces is vital for widespread applications but challenging, particularly when navigating narrow passages with elongated objects. Existing planning methods often fail in these low-clearance scenarios due to the sampling difficulties or the local minima. This work proposes Topology-Aware Planning for Object Manipulation (TAPOM), which explicitly incorporates task-space topological analysis to enable efficient planning. TAPOM uses a high-level analysis to identify critical pathways and generate guiding keyframes, which are utilized in a low-level planner to find feasible configuration space trajectories. Experimental validation demonstrates significantly high success rates and improved efficiency over state-of-the-art methods on low-clearance manipulation tasks. This approach offers broad implications for enhancing manipulation capabilities of robots in complex real-world environments.

cs.RO↗

arXiv2025

Modeling Headway in Heterogeneous and Mixed Traffic Flow: A Statistical Distribution Based on a General Exponential Function

The ability of existing headway distributions to accurately reflect the diverse behaviors and characteristics in heterogeneous traffic (different types of vehicles) and mixed traffic (human-driven vehicles with autonomous vehicles) is limited, leading to unsatisfactory goodness of fit. To address these issues, we modified the exponential function to obtain a novel headway distribution. Rather than employing Euler's number (e) as the base of the exponential function, we utilized a real number base to provide greater flexibility in modeling the observed headway. However, the proposed is not a probability function. We normalize it to calculate the probability and derive the closed-form equation. In this study, we utilized a comprehensive experiment with five open datasets: highD, exiD, NGSIM, Waymo, and Lyft to evaluate the performance of the proposed distribution and compared its performance with six existing distributions under mixed and heterogeneous traffic flow. The results revealed that the proposed distribution not only captures the fundamental characteristics of headway distribution but also provides physically meaningful parameters that describe the distribution shape of observed headways. Under heterogeneous flow on highways (i.e., uninterrupted traffic flow), the proposed distribution outperforms other candidate distributions. Under urban road conditions (i.e., interrupted traffic flow), including heterogeneous and mixed traffic, the proposed distribution still achieves decent results.

stat.AP↗

arXiv2025

Auxiliary-Free Replica Shadows: Efficient Estimation of Multiple Nonlinear Quantum Properties

Efficient estimation of nonlinear properties is a significant yet challenging task from quantum information processing to many-body physics. Current methodologies often suffer from an exponential sampling cost or require auxiliary qubits and deep quantum circuits. To address these limitations, we propose an efficient auxiliary-free replica shadow (AFRS) framework, which leverages the power of the joint entangling operation on a few input replicas while integrating the mindset of shadow estimation. We rigorously prove that AFRS can offer exponential improvements in estimation accuracy compared with the conventional shadow method, and facilitate the simultaneous estimation of various nonlinear properties, unlike the destructive swap test. Additionally, we introduce an advanced local-AFRS variant tailored to estimating local observables with constant-depth quantum circuits, significantly simplifying the experimental implementation. Our work paves the way for efficient and practical estimation of nonlinear properties on near-term quantum devices.

quant-ph↗