SearcharxivSearch

arXiv subjects

Hongfei Zhang

Publications and source records attributed to Hongfei Zhang.

At least 19 recordsLinked to original sources

FlashDrive: Flash Vision-Language-Action Inference for Autonomous Driving

Vision-Language-Action (VLA) models promise to bring end-to-end reasoning to autonomous driving, but their computational cost remains far too high for real-time control. The core challenge is structural: VLA inference is not a single bottleneck but a cascade of four. Visual encoding wastes compute on overlapping video frames; language-model prefill recomputes context that could be carried over from the previous timestep; reasoning tokens are generated serially despite low entropy; and flow-matching denoising applies uniform compute to a non-uniform velocity field. Addressing any one stage in isolation leaves the others untouched. We propose FlashDrive, an algorithm-system co-design framework that targets all four stages simultaneously. Our key insight is that each bottleneck admits a distinct, lightweight algorithmic shortcut: temporal overlap enables streaming KV-cache reuse across frames; the low per-token entropy and strong intra-block correlations of driving-domain reasoning make a non-autoregressive diffusion drafter highly effective for speculative decoding; and the velocity field's structure---sharp at the endpoints, flat in the middle---permits adaptive step caching that concentrates compute where it matters. Layered on system-level CUDA Graph compilation and kernel fusion, these techniques compound. Applied to Alpamayo 1.5-10B with W4A8 quantization, FlashDrive reduces end-to-end latency from 717ms to 151ms (4.7x) while leaving accuracy essentially unchanged: minADE6@6.4s shifts by only 0.08m, minADE1 improves, and closed-loop collision and off-road rates improve in simulation. By raising a 10B-parameter reasoning VLA from 1.4~Hz to 6.6~Hz on a single GPU, FlashDrive moves end-to-end autonomous driving substantially closer to real-time deployment.

cs.AI

Search for L4 Earth Trojan asteroids with the 2.5-meter Wide Field Survey Telescope

Earth Trojan asteroids (ETAs) are a mysterious population, and dynamically stable ETAs, if primordial, could be "living fossils" of the early solar system. To date, there are only two known ETAs, but both are temporary ETAs. The aim of our survey is to discover new temporary or stable ETAs; in the absence of detections, we derive upper limits on the population of stable ETAs. We conducted the largest wide-area survey of the Earth's L4 Lagrange point region so far using the Wide Field Survey Telescope, covering about 236.74 deg^2, corresponding to 33.24% of the probability coverage for sky regions where dynamically stable L4 ETAs are likely to reside. No new ETAs were detected in our survey. We place a cumulative upper limit of N(H < 19.1) < 19 on the stable population of objects larger than ~520 m (for an assumed albedo of 0.15). This represents the most stringent constraint on the ETA population to date.

astro-ph.EP

Cross-Modal Iteration Distillation for Robust IHD Screening: The IDNet Framework and A New Benchmark

Color Fundus Photography (CFP) offers a low-cost and non-invasive route for ischemic heart disease (IHD) screening, but current studies are limited by scarce public benchmarks and ineffective fusion of retinal images with sparse clinical variables. We propose IDNet, a multimodal framework with a Cross-Modal Distillation Aggregator (CDA) that uses learnable queries to sequentially integrate left-eye, right-eye, and clinical features, mitigating the imbalance between high-dimensional visual features and low-dimensional tabular inputs. We also construct a reproducible UK Biobank benchmark with open-source curation and quality-control pipelines, yielding 50,410 images from 25,205 subjects. On this benchmark, IDNet outperforms image-only, clinical-only, and several multimodal baselines, and CDA consistently improves multiple visual encoders as a plug-in fusion module.

cs.CV

OmniCoT: A Benchmark for Global and Multi-Step Panoramic Reasoning

Multimodal Large Language Models (MLLMs) have demonstrated promising spatial reasoning capabilities, while these abilities remain underexplored in the emerging visual modality of panoramic imagery. The full 360{\deg}$\times$180{\deg} field of view of panoramas essentially supports complex global multi-step reasoning, which is also the fundamental advantage of panoramas in applications such as embodied intelligence. However, existing panoramic benchmarks largely focus on simplistic queries that rely on local cues or single-/few-step reasoning, thereby ignoring the fundamental advantage of panoramas and failing to fully exploit their potential. To address this gap, we introduce OmniCoT, a panoramic spatial reasoning suite designed to enable MLLMs to use global evidence and perform multi-step inference across viewpoints. It includes OmniCoT-B (6.7K data) for evaluation, which measures both answer accuracy and reasoning quality, OmniCoT-Real (1K data) as a manually annotated real-world subset to quantify the Sim-to-Real gap. For training, OmniCoT-T (14.3K data) is purpose-built with structured stepwise Chain-of-Thought annotations that explicitly link intermediate reasoning steps to panoramic evidence. Based on OmniCoT-T, we introduce OmniCoT-R1 and adopt a two-stage training strategy tailored to the geometrically complex panoramic space, where Supervised Fine-tuning (SFT) anchors reasoning to panoramic evidence (e.g., bearings, proximity) and GRPO penalizes geometrically incoherent paths to consolidate global 360{\deg} spatial consistency. Through OmniCoT, we aim to recalibrate the difficulty of panoramic spatial reasoning to better align with the intrinsic capabilities of panoramic imagery, thereby fostering meaningful progress in this research area.

cs.CV

Discovery of a Featureless Tidal Disruption Event at z~1 with the Wide Field Survey Telescope

We report the discovery of tidal disruption event (TDE) WFST250820mmsw/AT2025wet by the 2.5-meter Wide Field Survey Telescope (WFST). It exhibits a blue nuclear flare throughout the observed evolution with a g-band peak magnitude ~22, which is about 3 magnitudes brighter than its host galaxy. A Keck/LRIS spectrum taken near the optical peak reveals a featureless blue continuum, with no discernible emission lines. However, its redshift can be accurately determined to be 1.037 by its host galaxy absorption lines. Blackbody fits to the multiband spectral energy distribution (SED) of AT2025wet yield a constant temperature of ~19,000K and a peak luminosity of (8.27 +0.92 -0.71)*10^44 erg s^-1 while actually the SED likely peaks at a much shorter wavelength than a 19,000K blackbody. The SED modeling of the host galaxy implies a stellar mass of ~10^11.2 M_odot and an estimated central black hole mass of ~10^8 M_odot, with no evidence of significant active galactic nucleus activity prior to the flare. All of these observations are well consistent with a featureless TDE scenario, making it the highest-redshift non-jetted TDE known to date. TDEs at such high redshift provide us a unique opportunity to explore the intrinsic SEDs of TDEs, particularly to test whether they peak in the extreme-UV regime, thereby addressing the missing energy puzzle and the origin of optical emission in TDEs. Ongoing surveys represented by WFST and the Legacy Survey of Space and Time (LSST) are expected to discover an increasing number of TDEs at higher redshifts, which will extend our census of SMBHs across redshift space and help unravel the mysteries of optical TDEs through direct probes of their UV emission.

astro-ph.HE

Panoramic Affordance Prediction

Affordance prediction serves as a critical bridge between perception and action in embodied AI. However, existing research is confined to pinhole camera models, which suffer from narrow Fields of View (FoV) and fragmented observations, often missing critical holistic environmental context. In this paper, we present the first exploration into Panoramic Affordance Prediction, utilizing 360-degree imagery to capture global spatial relationships and holistic scene understanding. To facilitate this novel task, we first introduce PAP-12K, a large-scale benchmark dataset containing over 1,000 ultra-high-resolution (12k, 11904 x 5952) panoramic images with over 12k carefully annotated QA pairs and affordance masks. Furthermore, we propose PAP, a training-free, coarse-to-fine pipeline inspired by the human foveal visual system to tackle the ultra-high resolution and severe distortion inherent in panoramic images. PAP employs recursive visual routing via grid prompting to progressively locate targets, applies an adaptive gaze mechanism to rectify local geometric distortions, and utilizes a cascaded grounding pipeline to extract precise instance-level masks. Experimental results on PAP-12K reveal that existing affordance prediction methods designed for standard perspective images suffer severe performance degradation and fail due to the unique challenges of panoramic vision. In contrast, PAP framework effectively overcomes these obstacles, significantly outperforming state-of-the-art baselines and highlighting the immense potential of panoramic perception for robust embodied intelligence.

cs.CV

DVD: Deterministic Video Depth Estimation with Generative Priors

Existing video depth estimation faces a fundamental trade-off: generative models suffer from stochastic geometric hallucinations and scale drift, while discriminative models demand massive labeled datasets to resolve semantic ambiguities. To break this impasse, we present DVD, the first framework to deterministically adapt pre-trained video diffusion models into single-pass depth regressors. Specifically, DVD features three core designs: (i) repurposing the diffusion timestep as a structural anchor to balance global stability with high-frequency details; (ii) latent manifold rectification (LMR) to mitigate regression-induced over-smoothing, enforcing differential constraints to restore sharp boundaries and coherent motion; and (iii) global affine coherence, an inherent property bounding inter-window divergence, which enables seamless long-video inference without requiring complex temporal alignment. Extensive experiments demonstrate that DVD achieves state-of-the-art zero-shot performance across benchmarks. Furthermore, DVD successfully unlocks the profound geometric priors implicit in video foundation models using 163x less task-specific data than leading baselines. Notably, we fully release our pipeline, providing the whole training suite for SOTA video depth estimation to benefit the open-source community.

cs.CV

WFST Astrometric Calibration -- I. Modeling Global Geometric Distortion with Zernike Polynomials

Accurate modeling of geometric distortion is essential for precise astrometric calibration in wide-field imaging surveys. We present a self-calibration method based on Zernike polynomials, applied to imaging data from the Wide Field Survey Telescope (WFST). Our approach constructs a global geometric distortion (GD) model from the position offsets of stars in the WFST r-band relative to Gaia DR3, achieving a median systematic uncertainty of below 10 mas for individual exposures. The correspondence between Zernike polynomials and optical aberrations reveals that the global GD of WFST is dominated by coma, inherent to the optical design, while rapid variations are likely attributed to the atmospheric dispersion corrector. Applying this method to 82 exposures from a single night (20250218), we find that the relative positions of the WFST CCDs remain stable, with standard deviations of less than 0.1 pixel in translation and 1.8 arcsec in rotation. The corrected WFST astrometric system is thereby tied to the Gaia DR3 coordinate frame, with further refinements to be presented in future work.

astro-ph.IM

WFST Supernovae in the First Year: I. Statistical Study of 16 Early-phase Type Ia Supernovae from the Pilot Survey

In this paper we present 16 early-phase type Ia supernovae (SNe Ia) discovered during the pilot survey of the 2.5-meter Wide Field Survey Telescope (WFST-PS) from March 4 to July 10, 2024, including three SNe Ia with early-excess emission features (EExSNe Ia). The discovery magnitude of the 16 WFST-PS early-phase SNe is at least 3 mag fainter than their peak brightness. A large scatter of color indices is found in approximately the first 10 days of supernova explosions, indicating diverse photometric behaviors in the early phase. Three EExSNe Ia show relatively brighter peak luminosities and longer rise time compared to those of non-EExSNe Ia. The results indicate that current theoretical models require further refinement to fully capture the early photometric evolution of SNe Ia. Based on the initial high-cadence ugr-band data from the WFST-PS survey, we emphasize that early near-ultraviolet (NUV) observations are indispensable for placing tight constraints on the explosion mechanisms and progenitor systems of SNe Ia.

astro-ph.HE

WFST Supernovae in the First Year: II. SN 2024aedt: Systematical Study of a Transitional Type Ia Supernova

We present comprehensive photometric and spectroscopic observations of a transitional type Ia SN 2024aedt, discovered by the 2.5-meter Wide Field Survey Telescope (WFST) within one day of the explosion. Its light curve is characterized by a peak absolute magnitude of $M_B = -18.49 \pm 0.03$ mag and a decline rate of $\Delta m_{15}(B) = 1.53 \pm 0.36$ mag, placing the object on the $\Delta m_{15}(B)$--$M_B$ diagram in the transition region between normal and subluminous SNe Ia. Furthermore, the early-color evolution and host galaxy environment of SN 2024aedt underscore its transitional nature, sharing properties with both normal and 91bg-like SNe Ia. Light-curve modeling with MOSFiT yields a synthesized $^{56}\mathrm{Ni}$ mass of $0.414 \pm 0.042\,M_{\odot}$ and a total ejecta mass of $0.548 \pm 0.108\,M_{\odot}$. A comparison with theoretical models suggests that the evolutionary trend can be broadly explained by both delayed-detonation (DDT) and double-detonation (DDet) scenarios while possible early-excess emissions predicted by DDet cannot be identified given the limited detections soon after the SN explosion. Although the overall spectral evolution of SN 2024aedt is similar to that of other transitional SNe Ia, the spectroscopic comparison reveals diversity in the early-phase blue-end features, which becomes more homogeneous at later phases. The result indicates the importance of early-time observations in understanding the origin of SN Ia diversity.

astro-ph.HE

WFST Supernovae in the First Year: III. Systematical Study of the Photometric Behavior of Early-phase Core-collapse Supernovae

We investigate the multiband photometric properties of seven supernovae (SNe) showing double-peaked light-curve evolution and prominent shock-cooling emission, observed by the Wide Field Survey Telescope (WFST) during its first year of operation. By jointly employing an analytic early shock-cooling model and the Arnett radioactive-diffusion model, we fit the bolometric light curves and infer ejecta masses in the range $1.1$-$2.6 M_\odot$, consistent with a transitional population between ultra-stripped supernovae (USSNe) and normal stripped-envelope supernovae (SESNe). The envelope masses are estimated to be $M_{\rm env}=0.1$-$0.4 M_\odot$, while the progenitors are constrained to be yellow or blue supergiants (YSGs/BSGs) with radii of $R=120$-$300 R_\odot$. Using empirical relations, we estimate progenitor luminosities of $L=10^{4.6}$-$10^{4.9} L_\odot$, corresponding to zero-age main-sequence (ZAMS) masses of $8$-$20 M_\odot$. Theoretical models suggest that such progenitors are more naturally produced through binary evolution channels, as single-star evolutionary pathways are unable to yield ejecta masses this low.

astro-ph.HE

Illuminating the Mass Gap Through Deep Optical Constraint on a Neutron Star Merger Candidate S250206dm

The gravitational wave (GW) event S250206dm, as the first well-localized neutron star merger candidate potentially located in the mass gap, presented a unique opportunity to probe the electromagnetic signatures from such a system. Here we report a deep, multiband search with the new 2.5-meter Wide Field Survey Telescope (WFST), covering about 64% of the localization region up to a 5-sigma limiting magnitude of 23 mag. In total, 12 potential candidates have been identified while none of them are likely related to S250206dm. This non-detection provides the most stringent constraint to date on any associated kilonova. Crucially, an AT 2017gfo-like event at 269 Mpc can be excluded by WFST observations alone. Based on ejecta mass limits, a neutron star-black hole with a large mass ratio (Q >= 3.2) is disfavored. This optical-derived constraint on the mass ratio reaches, for the first time, a precision comparable to that inferred from the GW signal. This work presents the best observation of this type of events until now, and demonstrates the power of rapid, deep follow-up observations to constrain the properties of compact binary progenitors, offering key insights into the constituents of the mass gap.

astro-ph.HE

Show, Don't Tell: Morphing Latent Reasoning into Image Generation

Text-to-image (T2I) generation has achieved remarkable progress, yet existing methods often lack the ability to dynamically reason and refine during generation--a hallmark of human creativity. Current reasoning-augmented paradigms most rely on explicit thought processes, where intermediate reasoning is decoded into discrete text at fixed steps with frequent image decoding and re-encoding, leading to inefficiencies, information loss, and cognitive mismatches. To bridge this gap, we introduce LatentMorph, a novel framework that seamlessly integrates implicit latent reasoning into the T2I generation process. At its core, LatentMorph introduces four lightweight components: (i) a condenser for summarizing intermediate generation states into compact visual memory, (ii) a translator for converting latent thoughts into actionable guidance, (iii) a shaper for dynamically steering next image token predictions, and (iv) an RL-trained invoker for adaptively determining when to invoke reasoning. By performing reasoning entirely in continuous latent spaces, LatentMorph avoids the bottlenecks of explicit reasoning and enables more adaptive self-refinement. Extensive experiments demonstrate that LatentMorph (I) enhances the base model Janus-Pro by $16\%$ on GenEval and $25\%$ on T2I-CompBench; (II) outperforms explicit paradigms (e.g., TwiG) by $15\%$ and $11\%$ on abstract reasoning tasks like WISE and IPV-Txt, (III) while reducing inference time by $44\%$ and token consumption by $51\%$; and (IV) exhibits $71\%$ cognitive alignment with human intuition on reasoning invocation.

cs.CV

Asymptotic Behavior of the Principal Eigenvalue Problems with Large Divergence-Free Drifts

In this paper, we consider the following principal eigenvalue problem with a large divergence-free drift: \begin{equation}\label{0.1} -\varepsilon\Delta \phi-2\alpha\nabla m(x)\cdot\nabla \phi+V(x)\phi=\lambda_\alpha \phi\ \,\ \text{in}\, \ H_0^1(\Omega),\tag{0.1} \end{equation} where the domain $\Omega\subset \mathbb{R}^N (N\ge 1)$ is bounded with smooth boundary $\partial\Omega$, the constants $\varepsilon>0$ and $\alpha>0$ are the diffusion and drift coefficients, respectively, and $m(x)\in C^{2}(\bar{\Omega})$, $V (x)\in C^{\gamma}(\bar{\Omega})~(0<\gamma<1)$ are given functions. For a class of divergence-free drifts where $m$ is a harmonic function in $\Omega$ and has no first integral in $H_{0}^{1}(\Omega)$, we prove the convergence of the principal eigenpair $(\lambda_\alpha, \phi)$ for (0.1) as $\alpha\rightarrow+\infty$, which addresses a special case of the open question proposed in [H. Berestycki, F. Hamel and N. Nadirashvili, CMP, 2005]. Moreover, we further investigate the refined limiting profiles of the principal eigenpair $(\lambda_\alpha, \phi)$ for (0.1) as $\alpha\rightarrow+\infty$, which display the visible effects of the large divergence-free drifts on the principal eigenpair $(\lambda_\alpha, \phi)$.

math.AP

Refined Limiting Profiles of the Principal Eigenvalue Problems with Large Advection

In this paper, we are concerned with the following eigenvalue problem with an advection term: \begin{equation}\label{0.1} \left\{ \begin{split} -\epsilon\Delta \phi-2\alpha\nabla m(x)\cdot\nabla \phi+V(x)\phi&=\lambda \phi\ \ \text{in}\ \ \Omega,\\ \phi&=0\ \ \hbox{on}\ \ \partial\Omega, ~~~\text{(0.1)} \end{split} \right. \end{equation} where $\Omega\subset\mathbb{R}^N~(N\geq1)$ satisfying $\partial\Omega\in C^{2}$ is a bounded domain and contains the origin as an interior point, the constants $\epsilon>0$ and $\alpha>0$ are the diffusive and advection coefficients, respectively, and $m(x)\in C^{2}(\bar{\Omega})$, $V (x)\in C^{\gamma}(\bar{\Omega})~(0<\gamma<1)$ are given functions. We analyze the refined limiting profiles of the principal eigenpair $(\lambda, \phi)$ for (0.1) as $\alpha\rightarrow\infty$, which display the visible effect of the large advection on $(\lambda, \phi)$. It expects that our argument is applicable to investigating the refined expansions of the general principal eigenvalue problems.

math.AP

A4-Agent: An Agentic Framework for Zero-Shot Affordance Reasoning

Affordance prediction, which identifies interaction regions on objects based on language instructions, is critical for embodied AI. Prevailing end-to-end models couple high-level reasoning and low-level grounding into a single monolithic pipeline and rely on training over annotated datasets, which leads to poor generalization on novel objects and unseen environments. In this paper, we move beyond this paradigm by proposing A4-Agent, a training-free agentic framework that decouples affordance prediction into a three-stage pipeline. Our framework coordinates specialized foundation models at test time: (1) a $\textbf{Dreamer}$ that employs generative models to visualize $\textit{how}$ an interaction would look; (2) a $\textbf{Thinker}$ that utilizes large vision-language models to decide $\textit{what}$ object part to interact with; and (3) a $\textbf{Spotter}$ that orchestrates vision foundation models to precisely locate $\textit{where}$ the interaction area is. By leveraging the complementary strengths of pre-trained models without any task-specific fine-tuning, our zero-shot framework significantly outperforms state-of-the-art supervised methods across multiple benchmarks and demonstrates robust generalization to real-world settings.

cs.CV

DualCamCtrl: Dual-Branch Diffusion Model for Geometry-Aware Camera-Controlled Video Generation

This paper presents DualCamCtrl, a novel end-to-end diffusion model for camera-controlled video generation. Recent works have advanced this field by representing camera poses as ray-based conditions, yet they often lack sufficient scene understanding and geometric awareness. DualCamCtrl specifically targets this limitation by introducing a dual-branch framework that mutually generates camera-consistent RGB and depth sequences. To harmonize these two modalities, we further propose the Semantic Guided Mutual Alignment (SIGMA) mechanism, which performs RGB-depth fusion in a semantics-guided and mutually reinforced manner. These designs collectively enable DualCamCtrl to better disentangle appearance and geometry modeling, generating videos that more faithfully adhere to the specified camera trajectories. Additionally, we analyze and reveal the distinct influence of depth and camera poses across denoising stages and further demonstrate that early and late stages play complementary roles in forming global structure and refining local details. Extensive experiments demonstrate that DualCamCtrl achieves more consistent camera-controlled video generation, with over 40\% reduction in camera motion errors compared with prior methods. Our project page: https://soyouthinkyoucantell.github.io/dualcamctrl-page/

cs.CV

TiViBench: Benchmarking Think-in-Video Reasoning for Video Generative Models

The rapid evolution of video generative models has shifted their focus from producing visually plausible outputs to tackling tasks requiring physical plausibility and logical consistency. However, despite recent breakthroughs such as Veo 3's chain-of-frames reasoning, it remains unclear whether these models can exhibit reasoning capabilities similar to large language models (LLMs). Existing benchmarks predominantly evaluate visual fidelity and temporal coherence, failing to capture higher-order reasoning abilities. To bridge this gap, we propose TiViBench, a hierarchical benchmark specifically designed to evaluate the reasoning capabilities of image-to-video (I2V) generation models. TiViBench systematically assesses reasoning across four dimensions: i) Structural Reasoning & Search, ii) Spatial & Visual Pattern Reasoning, iii) Symbolic & Logical Reasoning, and iv) Action Planning & Task Execution, spanning 24 diverse task scenarios across 3 difficulty levels. Through extensive evaluations, we show that commercial models (e.g., Sora 2, Veo 3.1) demonstrate stronger reasoning potential, while open-source models reveal untapped potential that remains hindered by limited training scale and data diversity. To further unlock this potential, we introduce VideoTPO, a simple yet effective test-time strategy inspired by preference optimization. By performing LLM self-analysis on generated candidates to identify strengths and weaknesses, VideoTPO significantly enhances reasoning performance without requiring additional training, data, or reward models. Together, TiViBench and VideoTPO pave the way for evaluating and advancing reasoning in video generation models, setting a foundation for future research in this emerging field.

cs.CV