Searcharxiv⌕ Search

arXiv subjects

Yi Yang

Publications and source records attributed to Yi Yang.

At least 217 records · Page 12Linked to original sources

UniTalking: A Unified Audio-Video Framework for Talking Portrait Generation

While state-of-the-art audio-video generation models like Veo3 and Sora2 demonstrate remarkable capabilities, their closed-source nature makes their architectures and training paradigms inaccessible. To bridge this gap in accessibility and performance, we introduce UniTalking, a unified, end-to-end diffusion framework for generating high-fidelity speech and lip-synchronized video. At its core, our framework employs Multi-Modal Transformer Blocks to explicitly model the fine-grained temporal correspondence between audio and video latent tokens via a shared self-attention mechanism. By leveraging powerful priors from a pre-trained video generation model, our framework ensures state-of-the-art visual fidelity while enabling efficient training. Furthermore, UniTalking incorporates a personalized voice cloning capability, allowing the generation of speech in a target style from a brief audio reference. Qualitative and quantitative results demonstrate that our method produces highly realistic talking portraits, achieving superior performance over existing open-source approaches in lip-sync accuracy, audio naturalness, and overall perceptual quality.

cs.CV↗

High-Performance Quantum Frequency Conversion from Ultraviolet to Telecom Band

Quantum frequency conversion (QFC) is essential for bridging the spectral gap between stationary qubits and low-loss optical communication channels. In this work, we demonstrate a short-wavelength-pumping QFC with the first-order quasi-phase matching period of 3.07 um on thin-film lithium niobate, converting ultraviolet photons to the telecom C-band. By constructing a theoretical model that correlates the normalized conversion efficiency with domain defects in the short-period phase-matched waveguide, we found the critical tolerance of domain defects along the waveguide should be $\le 2$ (excluding the ends). Based on this, we achieved a theoretical limit normalized conversion efficiency of 839%/(W*cm^2) for the fundamental guided mode through fabrication optimization. Furthermore, we propose a robust noise suppression strategy for short-wavelength pumping by utilizing the counter-tuning behaviors of difference-frequency generation and spontaneous parametric down-conversion. By combining these advances with ultra-narrowband filtering, we achieve a record-high external efficiency of 28.8% and an ultra-low noise of 35 counts per second. This high-performance QFC connecting ultraviolet and telecom bands satisfies the stringent requirements for long-lived remote ion-ion entanglement in scalable quantum networks [W.-Z. Liu et al., Nature (2026)].

quant-ph↗

The environmental dependence of mid-IR luminous dusty Supernovae

Using the Spitzer and WISE images, we discovered 42 mid-IR luminous dusty supernovae with local integral-field spectroscopy data. The observed mid-IR emission indicates the presence of newly formed dust, or pre-existing dust heated by the radiation from the supernovae or circumstellar medium interactions. We carried out a systematic analysis of the supernova host environments and their dust properties, for understanding the dust-veiled exploding stars, and whether such an intense dust production process is associated with their local environments. We find that dusty supernovae prefer the locations with higher EW(Hα), lower metallicity, and heavier host extinctions compared to typical SN types, and they show the same increasing sequence in the values of EW(Hα) and oxygen abundance from hydrogen-rich, type IIn and hydrogen-poor dusty supernovae. These differences in environmental properties of different dusty SN types indicate the diversity of their progenitors. We also found that one marginal correlation is a negative correlation between the SN dust mass and star formation rate. This means that SNe would be more mid-IR luminous and more dust-rich at the region with lower star formation rate. However, the SN dust mass show no correlation with the metallicity and the host extinction, which were thought to be key factors affecting the mass-loss history of progenitors and the CSM environment of SNe. Therefore, the dust formation process in SNe might be insensitive to metallicity and the dust condition of their host environments.

astro-ph.HE↗

Automated Identification of the Tip of the Red Giant Branch in Globular Clusters with Gaia Data

This study introduces an automated approach for identifying the tip of the red giant branch (TRGB) in globular clusters, combining astronomical data with algorithmic methods. Using a dataset of 160 globular clusters and Python scripts, we matched stellar sources with Gaia data. Our script generates color-magnitude diagrams (CMDs), and uses the local outlier factor (LOF) algorithm to remove outliers. Applying a second-degree polynomial to fit red giant branch (RGB), we identify the TRGB as the star closest to the fitted curve's endpoint. By this method, we expanded TRGB samples in global clusters to 91 with newer observational data. Our results show a decreasing trend in I-band luminosity for metallicities greater than $-$1, consistent with previous studies. The results show a robust trend fitting and the $\rm M_{I}$ of TRGB is about $-$4.02 with extremely low metallicity. Our approach enhances TRGB identification efficiency while providing valuable insights for developing automatic tools in astronomical data analysis.

astro-ph.SR↗

AT 2024wpp: the most luminous fast-evolving optical transient linked to the merger explosion of a black-hole binary

Fast blue optical transients (FBOTs) represent one of the most exotic astrophysical transients, exhibiting unusually strong emission across X-ray, optical, and radio wavelengths. Their physical origins remain highly debated, with proposed explanations ranging from stellar explosion to tidal disruption event (TDE). Here we report observations of the most luminous FBOT, AT 2024wpp whose post-peak luminosity rebrightens in X ray and becomes flattening in optical in a manner follows the decay rate characteristic of TDEs ($L_{\rm bol} \propto t^{-5/3}$). This invokes energy contribution of accretion by a central compact object, getting further corroborations from hardening of X-ray spectral index and detection of outflow inferred from the emission lines at similar phase. Detailed modeling of luminsoity evolution favors a coalesce explosion of a 34 M$_{\odot}$ Wolf-Rayet star with a 15 M$_{\odot}$ black hole (BH), demonstrating that some FBOTs may be associated with TDE of a stellar blackhole.

astro-ph.HE↗

CogFlow: Bridging Perception and Reasoning through Knowledge Internalization for Visual Mathematical Problem Solving

Despite significant progress, multimodal large language models continue to struggle with visual mathematical problem solving. Some recent works recognize that visual perception is a bottleneck in visual mathematical reasoning, but their solutions are limited to improving the extraction and interpretation of visual inputs. Notably, they all ignore the key issue of whether the extracted visual cues are faithfully integrated and properly utilized in subsequent reasoning. Motivated by this, we present CogFlow, a novel cognitive-inspired three-stage framework that incorporates a knowledge internalization stage, explicitly simulating the hierarchical flow of human reasoning: perception$\Rightarrow$internalization$\Rightarrow$reasoning. In line with this hierarchical flow, we holistically enhance all its stages. We devise Synergistic Visual Rewards to boost perception capabilities in parametric and semantic spaces, jointly improving visual information extraction from symbols and diagrams. To guarantee faithful integration of extracted visual cues into subsequent reasoning, we introduce a Knowledge Internalization Reward model in the internalization stage, bridging perception and reasoning. Moreover, we design a Visual-Gated Policy Optimization algorithm to further enforce the reasoning is grounded with the visual knowledge, preventing models seeking shortcuts that appear coherent but are visually ungrounded reasoning chains. Moreover, we contribute a new dataset MathCog for model training, which contains samples with over 120K high-quality perception-reasoning aligned annotations. Comprehensive experiments and analysis on commonly used visual mathematical reasoning benchmarks validate the superiority of the proposed CogFlow. Project page: https://shchen233.github.io/cogflow.

cs.CV↗

Mantis: A Versatile Vision-Language-Action Model with Disentangled Visual Foresight

Recent advances in Vision-Language-Action (VLA) models demonstrate that visual signals can effectively complement sparse action supervisions. However, letting VLA directly predict high-dimensional visual states can distribute model capacity and incur prohibitive training cost, while compressing visual states into more compact supervisory signals inevitably incurs information bottlenecks. Moreover, existing methods often suffer from poor comprehension and reasoning capabilities due to the neglect of language supervision. This paper introduces Mantis, a novel framework featuring a Disentangled Visual Foresight (DVF) to tackle these issues. Specifically, Mantis decouples visual foresight prediction from the backbone with the combination of meta queries and a diffusion Transformer (DiT) head. With the current visual state provided to the DiT via a residual connection, a simple next-state prediction objective enables the meta queries to automatically capture the latent actions that delineate the visual trajectory, and hence boost the learning of explicit actions. The disentanglement reduces the burden of the VLA backbone, enabling it to maintain comprehension and reasoning capabilities through language supervision. Empirically, pretrained on human manipulation videos, robot demonstrations, and image-text pairs, Mantis achieves a 96.7% success rate on LIBERO benchmark after fine-tuning, surpassing powerful baselines while exhibiting high convergence speed. Real-world evaluations show that Mantis outperforms $π_{0.5}$, a leading open-source VLA model, particularly in instruction-following capability, generalization to unseen instructions, and reasoning ability. Code and weights are released to support the open-source community.

cs.CV↗

HiMAP: History-aware Map-occupancy Prediction with Fallback

Accurate motion forecasting is critical for autonomous driving, yet most predictors rely on multi-object tracking (MOT) with identity association, assuming that objects are correctly and continuously tracked. When tracking fails due to, e.g., occlusion, identity switches, or missed detections, prediction quality degrades and safety risks increase. We present \textbf{HiMAP}, a tracking-free, trajectory prediction framework that remains reliable under MOT failures. HiMAP converts past detections into spatiotemporally invariant historical occupancy maps and introduces a historical query module that conditions on the current agent state to iteratively retrieve agent-specific history from unlabeled occupancy representations. The retrieved history is summarized by a temporal map embedding and, together with the final query and map context, drives a DETR-style decoder to produce multi-modal future trajectories. This design lifts identity reliance, supports streaming inference via reusable encodings, and serves as a robust fallback when tracking is unavailable. On Argoverse~2, HiMAP achieves performance comparable to tracking-based methods while operating without IDs, and it substantially outperforms strong baselines in the no-tracking setting, yielding relative gains of 11\% in FDE, 12\% in ADE, and a 4\% reduction in MR over a fine-tuned QCNet. Beyond aggregate metrics, HiMAP delivers stable forecasts for all agents simultaneously without waiting for tracking to recover, highlighting its practical value for safety-critical autonomy. The code is available under: https://github.com/XuYiMing83/HiMAP.

cs.CV↗

Stroke3D: Lifting 2D strokes into rigged 3D model via latent diffusion models

Rigged 3D assets are fundamental to 3D deformation and animation. However, existing 3D generation methods face challenges in generating animatable geometry, while rigging techniques lack fine-grained structural control over skeleton creation. To address these limitations, we introduce Stroke3D, a novel framework that directly generates rigged meshes from user inputs: 2D drawn strokes and a descriptive text prompt. Our approach pioneers a two-stage pipeline that separates the generation into: 1) Controllable Skeleton Generation, we employ the Skeletal Graph VAE (Sk-VAE) to encode the skeleton's graph structure into a latent space, where the Skeletal Graph DiT (Sk-DiT) generates a skeletal embedding. The generation process is conditioned on both the text for semantics and the 2D strokes for explicit structural control, with the VAE's decoder reconstructing the final high-quality 3D skeleton; and 2) Enhanced Mesh Synthesis via TextuRig and SKA-DPO, where we then synthesize a textured mesh conditioned on the generated skeleton. For this stage, we first enhance an existing skeleton-to-mesh model by augmenting its training data with TextuRig: a dataset of textured and rigged meshes with captions, curated from Objaverse-XL. Additionally, we employ a preference optimization strategy, SKA-DPO, guided by a skeleton-mesh alignment score, to further improve geometric fidelity. Together, our framework enables a more intuitive workflow for creating ready to animate 3D content. To the best of our knowledge, our work is the first to generate rigged 3D meshes conditioned on user-drawn 2D strokes. Extensive experiments demonstrate that Stroke3D produces plausible skeletons and high-quality meshes.

cs.CV↗

DM0: An Embodied-Native Vision-Language-Action Model towards Physical AI

Moving beyond the traditional paradigm of adapting internet-pretrained models to physical tasks, we present DM0, an Embodied-Native Vision-Language-Action (VLA) framework designed for Physical AI. Unlike approaches that treat physical grounding as a fine-tuning afterthought, DM0 unifies embodied manipulation and navigation by learning from heterogeneous data sources from the onset. Our methodology follows a comprehensive three-stage pipeline: Pretraining, Mid-Training, and Post-Training. First, we conduct large-scale unified pretraining on the Vision-Language Model (VLM) using diverse corpora--seamlessly integrating web text, autonomous driving scenarios, and embodied interaction logs-to jointly acquire semantic knowledge and physical priors. Subsequently, we build a flow-matching action expert atop the VLM. To reconcile high-level reasoning with low-level control, DM0 employs a hybrid training strategy: for embodied data, gradients from the action expert are not backpropagated to the VLM to preserve generalized representations, while the VLM remains trainable on non-embodied data. Furthermore, we introduce an Embodied Spatial Scaffolding strategy to construct spatial Chain-of-Thought (CoT) reasoning, effectively constraining the action solution space. Experiments on the RoboChallenge benchmark demonstrate that DM0 achieves state-of-the-art performance in both Specialist and Generalist settings on Table30.

cs.RO↗

ContextGen: Contextual Layout Anchoring for Identity-Consistent Multi-Instance Generation

Multi-instance image generation (MIG) remains a significant challenge for modern diffusion models due to key limitations in achieving precise control over object layout and preserving the identity of multiple distinct subjects. To address these limitations, we introduce ContextGen, a novel Diffusion Transformer framework for multi-instance generation that is guided by both layout and reference images. Our approach integrates two key technical contributions: a Contextual Layout Anchoring (CLA) mechanism that incorporates the composite layout image into the generation context to robustly anchor the objects in their desired positions, and Identity Consistency Attention (ICA), an innovative attention mechanism that leverages contextual reference images to ensure the identity consistency of multiple instances. To address the absence of a large-scale, high-quality dataset for this task, we introduce IMIG-100K, the first dataset to provide detailed layout and identity annotations specifically designed for Multi-Instance Generation. Extensive experiments demonstrate that ContextGen sets a new state-of-the-art, outperforming existing methods especially in layout control and identity fidelity.

cs.CV↗

Search for Axion-Like Particles in High-Magnetic-Field Pulsars with NICER

Axion-like particles (ALPs) can couple to photons in strong magnetic fields, producing characteristic fluctuations in X-ray spectra. Using data from NASA's Neutron Star Interior Composition Explorer (NICER), we analyzed three pulsars: PSR J2229+6114, PSR J1849-0001, and PSR B0531+21, to search for such features. Each spectrum was modeled with a sliding-window power-law fitting method to identify local deviations from the smooth continuum. From these analyses, we derived constraints on the axion-photon coupling constant $g_{aγγ}$ assuming dipole and quadrupole magnetic field distributions. We obtain upper limits in the range $10^{-10}$--$10^{-13}\,\mathrm{GeV}^{-1}$ for ALP masses in the $0.8$--$10~\mathrm{keV}$ region.

astro-ph.HE↗

A building block of quantum repeaters for scalable quantum networks

Quantum networks, integrating quantum communication, quantum metrology, and distributed quantum computing, could provide secure and efficient information transfer, high-resolution sensing, and an exponential speed-up in information processing. Deterministic entanglement distribution over long distances is a prerequisite for scalable quantum networks, enabling the utilization of device-independent quantum key distribution (DI-QKD) and quantum teleportation to achieve secure and efficient information transfer. However, the exponential photon loss in optical fibres prohibits efficient and deterministic entanglement distribution. Quantum repeaters, incorporating entanglement swapping and entanglement purification with quantum memories, offer the most promising means to overcome this limitation in fibre-based quantum networks. Despite numerous pioneering efforts toward realizing quantum repeaters, a critical bottleneck remains, as remote memory-memory entanglement suffers from decoherence more rapidly than it can be established and purified over long distances. We overcome this by developing long-lived trapped-ion memories, an efficient telecom interface, and a high-visibility single-photon entanglement protocol. This allows us to establish and maintain memory-memory entanglement over a 10 km fibre within the average entanglement establishment time for the same distance. As a direct application, we demonstrate metropolitan-scale DI-QKD, distilling 1,917 secret keys out of 4.05*10^5 Bell pairs over 10 km. We further report a positive key rate over 101 km in the asymptotic limit, extending the achievable distance by more than two orders of magnitude. Our work provides a critical building block for quantum repeaters and marks an important step toward scalable quantum networks.

quant-ph↗

A Contrastive Learning Foundation Model Based on Perfectly Aligned Sample Pairs for Remote Sensing Images

Self-Supervised Learning (SSL) enables us to pre-train foundation models without costly labeled data. Among SSL methods, Contrastive Learning (CL) methods are better at obtaining accurate semantic representations in noise interference. However, due to the significant domain gap, while CL methods have achieved great success in many computer vision tasks, they still require specific adaptation for Remote Sensing (RS) images. To this end, we present a novel self-supervised method called PerA, which produces all-purpose RS features through semantically Perfectly Aligned sample pairs. Specifically, PerA obtains features from sampled views by applying spatially disjoint masks to augmented images rather than random cropping. Our framework provides high-quality features by ensuring consistency between teacher and student and predicting learnable mask tokens. Compared to previous contrastive methods, our method demonstrates higher memory efficiency and can be trained with larger batches due to its sparse inputs. Additionally, the proposed method demonstrates remarkable adaptability to uncurated RS data and reduce the impact of the potential semantic inconsistency. We also collect an unlabeled pre-training dataset, which contains about 5 million RS images. We conducted experiments on multiple downstream task datasets and achieved performance comparable to previous state-of-the-art methods with a limited model scale, demonstrating the effectiveness of our approach. We hope this work will contribute to practical remote sensing interpretation works.

eess.IV↗

EvasionBench: A Large-Scale Benchmark for Detecting Managerial Evasion in Earnings Call Q&A

We present EvasionBench, a comprehensive benchmark for detecting evasive responses in corporate earnings call question-and-answer sessions. Drawing from 22.7 million Q&A pairs extracted from S&P Capital IQ transcripts, we construct a rigorously filtered dataset and introduce a three-level evasion taxonomy: direct, intermediate, and fully evasive. Our annotation pipeline employs a Multi-Model Consensus (MMC) framework, combining dual frontier LLM annotation with a three-judge majority voting mechanism for ambiguous cases, achieving a Cohen's Kappa of 0.835 on human inter-annotator agreement. We release: (1) a balanced 84K training set, (2) a 1K gold-standard evaluation set with expert human labels, and (3) [Eva-4B], a 4-billion parameter classifier fine-tuned from Qwen3-4B that achieves 84.9% Macro-F1, outperforming Claude 4.5, GPT-5.2, and Gemini 3 Flash. Our ablation studies demonstrate the effectiveness of multi-model consensus labeling over single-model annotation. EvasionBench fills a critical gap in financial NLP by providing the first large-scale benchmark specifically targeting managerial communication evasion.

cs.LG↗

Photometry and Spectroscopy of SN 2024pxl: A Luminosity Link Among Type Iax Supernovae

We present extensive ultraviolet to optical photometric and optical to near-infrared (NIR) spectroscopic follow-up observations of the nearby intermediate-luminosity ($M_V = -16.81\pm0.19$~mag) Type Iax supernova (SN) 2024pxl in NGC 6384. SN~2024pxl exhibits a faster light curve than the high-luminosity members of this class, and slower than low-luminosity events. The observationally well-constrained rise time of $\sim$11 days and an estimated synthesized $^{56}$Ni mass of 0.03\, M$_\odot$, based on analytical modeling of the integrated spectral energy distribution light curve, are consistent with models of the weak deflagration of a carbon-oxygen white dwarf. Our optical spectral sequence of SN~2024pxl shows weak \ion{Si}{2} lines and spectral evolution similar to other high-luminosity Type Iax SNe, but also a prominent early-time \ion{C}{2} line, like lower-luminosity Type Iax SNe. The late-time optical spectrum of SN~2024pxl closely matches that of SN~2014dt, and its NIR spectral evolution aligns with that of other well-studied, high-luminosity Type Iax SNe. The spectral-line expansion velocities of SN~2024pxl are at the lower end of the Type Iax SN velocity distribution, and the velocity distribution of iron-group elements compared to intermediate-mass elements suggests that the ejecta are mixed on large scales, as expected in pure deflagration models. SN~2024pxl exhibits characteristics intermediate between those of high-luminosity and low-luminosity Type~Iax SNe, further establishing a link across this diverse class.

astro-ph.HE↗

Object Fidelity Diffusion for Remote Sensing Image Generation

High-precision controllable remote sensing image generation is both meaningful and challenging. Existing diffusion models often produce low-fidelity images due to their inability to adequately capture morphological details, which may affect the robustness and reliability of object detection models. To enhance the accuracy and fidelity of generated objects in remote sensing, this paper proposes Object Fidelity Diffusion (OF-Diff), which effectively improves the fidelity of generated objects. Specifically, we are the first to extract the prior shapes of objects based on the layout for diffusion models in remote sensing. Then, we introduce a dual-branch diffusion model with diffusion consistency loss, which can generate high-fidelity remote sensing images without providing real images during the sampling phase. Furthermore, we introduce DDPO to fine-tune the diffusion process, making the generated remote sensing images more diverse and semantically consistent. Comprehensive experiments demonstrate that OF-Diff outperforms state-of-the-art methods in the remote sensing across key quality metrics. Notably, the performance of several polymorphic and small object classes shows significant improvement. For instance, the mAP increases by 8.3%, 7.7%, and 4.0% for airplanes, ships, and vehicles, respectively.

cs.CV↗

TransNormal: Dense Visual Semantics for Diffusion-based Transparent Object Normal Estimation

Monocular normal estimation for transparent objects is critical for laboratory automation, yet it remains challenging due to complex light refraction and reflection. These optical properties often lead to catastrophic failures in conventional depth and normal sensors, hindering the deployment of embodied AI in scientific environments. We propose TransNormal, a novel framework that adapts pre-trained diffusion priors for single-step normal regression. To handle the lack of texture in transparent surfaces, TransNormal integrates dense visual semantics from DINOv3 via a cross-attention mechanism, providing strong geometric cues. Furthermore, we employ a multi-task learning objective and wavelet-based regularization to ensure the preservation of fine-grained structural details. To support this task, we introduce TransNormal-Synthetic, a physics-based dataset with high-fidelity normal maps for transparent labware. Extensive experiments demonstrate that TransNormal significantly outperforms state-of-the-art methods: on the ClearGrasp benchmark, it reduces mean error by 24.4% and improves 11.25° accuracy by 22.8%; on ClearPose, it achieves a 15.2% reduction in mean error. The code and dataset will be made publicly available at https://longxiang-ai.github.io/TransNormal.

cs.CV↗