Searcharxiv⌕ Search

arXiv subjects

Yue Shen

Publications and source records attributed to Yue Shen.

At least 55 records · Page 3Linked to original sources

MedLA: A Logic-Driven Multi-Agent Framework for Complex Medical Reasoning with Large Language Models

Answering complex medical questions requires not only domain expertise and patient-specific information, but also structured and multi-perspective reasoning. Existing multi-agent approaches often rely on fixed roles or shallow interaction prompts, limiting their ability to detect and resolve fine-grained logical inconsistencies. To address this, we propose \textsc{MedLA}, a logic-driven multi-agent framework built on large language models. Each agent organizes its reasoning process into an explicit logical tree based on syllogistic triads (major premise, minor premise, and conclusion), enabling transparent inference and premise-level alignment. Agents engage in a multi-round, graph-guided discussion to compare and iteratively refine their logic trees, achieving consensus through error correction and contradiction resolution. We demonstrate that \textsc{MedLA} consistently outperforms both static role-based systems and single-agent baselines on challenging benchmarks such as MedDDx and standard medical QA tasks. Furthermore, \textsc{MedLA} scales effectively across both open-source and commercial LLM backbones, achieving state-of-the-art performance and offering a generalizable paradigm for trustworthy medical reasoning.

cs.AI↗

World Simulation with Video Foundation Models for Physical AI

We introduce [Cosmos-Predict2.5], the latest generation of the Cosmos World Foundation Models for Physical AI. Built on a flow-based architecture, [Cosmos-Predict2.5] unifies Text2World, Image2World, and Video2World generation in a single model and leverages [Cosmos-Reason1], a Physical AI vision-language model, to provide richer text grounding and finer control of world simulation. Trained on 200M curated video clips and refined with reinforcement learning-based post-training, [Cosmos-Predict2.5] achieves substantial improvements over [Cosmos-Predict1] in video quality and instruction alignment, with models released at 2B and 14B scales. These capabilities enable more reliable synthetic data generation, policy evaluation, and closed-loop simulation for robotics and autonomous systems. We further extend the family with [Cosmos-Transfer2.5], a control-net style framework for Sim2Real and Real2Real world translation. Despite being 3.5$\times$ smaller than [Cosmos-Transfer1], it delivers higher fidelity and robust long-horizon video generation. Together, these advances establish [Cosmos-Predict2.5] and [Cosmos-Transfer2.5] as versatile tools for scaling embodied intelligence. To accelerate research and deployment in Physical AI, we release source code, pretrained checkpoints, and curated benchmarks under the NVIDIA Open Model License at https://github.com/nvidia-cosmos/cosmos-predict2.5 and https://github.com/nvidia-cosmos/cosmos-transfer2.5. We hope these open resources lower the barrier to adoption and foster innovation in building the next generation of embodied intelligence.

cs.CV↗

LiveClin: A Live Clinical Benchmark without Leakage

The reliability of medical LLM evaluation is critically undermined by data contamination and knowledge obsolescence, leading to inflated scores on static benchmarks. To address these challenges, we introduce LiveClin, a live benchmark designed for approximating real-world clinical practice. Built from contemporary, peer-reviewed case reports and updated biannually, LiveClin ensures clinical currency and resists data contamination. Using a verified AI-human workflow involving 239 physicians, we transform authentic patient cases into complex, multimodal evaluation scenarios that span the entire clinical pathway. The benchmark currently comprises 1,407 case reports and 6,605 questions. Our evaluation of 26 models on LiveClin reveals the profound difficulty of these real-world scenarios, with the top-performing model achieving a Case Accuracy of just 35.7%. In benchmarking against human experts, Chief Physicians achieved the highest accuracy, followed closely by Attending Physicians, with both surpassing most models. LiveClin thus provides a continuously evolving, clinically grounded framework to guide the development of medical LLMs towards closing this gap and achieving greater reliability and real-world utility. Our data and code are publicly available at https://github.com/AQ-MedAI/LiveClin.

cs.LG↗

ClinAlign: Scaling Healthcare Alignment from Clinician Preference

Although large language models (LLMs) demonstrate expert-level medical knowledge, aligning their open-ended outputs with fine-grained clinician preferences remains challenging. Existing methods often rely on coarse objectives or unreliable automated judges that are weakly grounded in professional guidelines. We propose a two-stage framework to address this gap. First, we introduce HealthRubrics, a dataset of 7,034 physician-verified preference examples in which clinicians refine LLM-drafted rubrics to meet rigorous medical standards. Second, we distill these rubrics into HealthPrinciples: 119 broadly reusable, clinically grounded principles organized by clinical dimensions, enabling scalable supervision beyond manual annotation. We use HealthPrinciples for (1) offline alignment by synthesizing rubrics for unlabeled queries and (2) an inference-time tool for guided self-revision. A 30B-A3B model trained with our framework achieves 33.4% on HealthBench-Hard, outperforming much larger models including Deepseek-R1 and o3, establishing a resource-efficient baseline for clinical alignment.

cs.AI↗

Transient Relativistic Iron Emission Line from an X-ray Flaring Supermassive Black Hole

We report the discovery of the first transient relativistic iron Kα line in an Active Galactic Nucleus (AGN) J1047+5907. The line was detected 21.5 days (rest-frame) after an X-ray coronal flare observed in 2008 and it exhibits significant broadening consistent with relativistic reflection from the accretion disk in the vicinity of the central supermassive black hole (SMBH). The line has a width of ~300 eV, corresponding to a Keplerian velocity of 14,000 km s-1, at a distance of 5-41 light-days from the SMBH, strongly implying that the observed coronal flare triggered the emergence of the line. This event provides rare direct evidence of the response of the accretion disk to impulsive coronal illumination and offers a new method to probe the SMBH and disk physics. The relativistic modeling favors a broadened line produced by distant reflection from an accretion disk around a rapidly spinning black hole viewed at an intermediate inclination, consistent with other observations. Systematic monitoring of type 1 AGN following strong X-ray flares may open a new observational window into the innermost regions of AGN, enabling constraints on the physics of SMBH and its accretion disk at different radii that are otherwise challenging to access.

astro-ph.HE↗

CTRL-RAG: Contrastive Likelihood Reward Based Reinforcement Learning for Context-Faithful RAG Models

With the growing use of Retrieval-Augmented Generation (RAG), training large language models (LLMs) for context-sensitive reasoning and faithfulness is increasingly important. Existing RAG-oriented reinforcement learning (RL) methods rely on external rewards that often fail to evaluate document faithfulness, and may misjudge similar answers in open-domain settings. In addition, there is no RAG-based selfreward mechanism. Moreover, although such a mechanism could in principle estimate answer confidence given documents, the absence of objective feedback in a self-judgment can cause hallucination accumulation and eventual model collapse. To tackle these issues, we propose a novel "internal-external" hybrid reward framework centered on a Contrastive Likelihood Reward (CLR). CLR directly optimizes the log-likelihood gap between responses conditioned on prompts with and without supporting evidence. This encourages the model to extract relevant evidence and increases its confidence when grounded in a specific context. Experiments show that our method (used alone or combined with external correctness rewards) achieves strong performance on singlehop, multi-hop, vertical-domain, and faithfulness benchmarks. Our training code and models are coming soon.

cs.CL↗

Photometric Redshifts in JWST Deep Fields: A Pixel-Based Alternative with DeepDISC

Photo-z algorithms that utilize SED template fitting have matured, and are widely adopted for use on high-redshift near-infrared data that provides a unique window into the early universe. Alternative photo-z methods have been developed, largely within the context of low-redshift optical surveys. Machine learning based approaches have gained footing in this regime, including those that utilize raw pixel information instead of aperture photometry. However, the efficacy of image-based algorithms on high-redshift, near-infrared data remains underexplored. Here, we test the performance of Detection, Instance Segmentation and Classification with Deep Learning (DeepDISC) on photometric redshift estimation with NIRCam images from the JWST Advanced Deep Extragalactic Survey (JADES) program. DeepDISC is designed to produce probabilistic photometric redshift estimates directly from images, after detecting and deblending sources in a scene. Using NIRCam-only images and a compiled catalog of spectroscopic redshifts, we show that DeepDISC produces reliable photo-zs and uncertainties comparable to those estimated from template fitting using HST+JWST filters; DeepDISC even outperforms template fitting (lower scatter/fewer outliers) when the input photometric filters are matched. Compared with template fitting, DeepDISC does not require measured photometry from images, and can produce a catalog of 94000 photo-zs in ~4 minutes on a single NVIDIA A40 GPU. While current spectroscopic training samples are small and incomplete in color-magnitude space, this work demonstrates the potential of DeepDISC for increasingly larger image volumes and spectroscopic samples from ongoing and future programs. We discuss the impact of the training data on applications to broader samples and produce a catalog of photo-zs for all JADES DR2 photometric sources in the GOOD-S field, with quality flags indicating caveats.

astro-ph.IM↗

TL-GRPO: Turn-Level RL for Reasoning-Guided Iterative Optimization

Large language models have demonstrated strong reasoning capabilities in complex tasks through tool integration, which is typically framed as a Markov Decision Process and optimized with trajectory-level RL algorithms such as GRPO. However, a common class of reasoning tasks, iterative optimization, presents distinct challenges: the agent interacts with the same underlying environment state across turns, and the value of a trajectory is determined by the best turn-level reward rather than cumulative returns. Existing GRPO-based methods cannot perform fine-grained, turn-level optimization in such settings, while black-box optimization methods discard prior knowledge and reasoning capabilities. To address this gap, we propose Turn-Level GRPO (TL-GRPO), a lightweight RL algorithm that performs turn-level group sampling for fine-grained optimization. We evaluate TL-GRPO on analog circuit sizing (ACS), a challenging scientific optimization task requiring multiple simulations and domain expertise. Results show that TL-GRPO outperforms standard GRPO and Bayesian optimization methods across various specifications. Furthermore, our 30B model trained with TL-GRPO achieves state-of-the-art performance on ACS tasks under same simulation budget, demonstrating both strong generalization and practical utility.

cs.CL↗

Perplexity-Aware Data Scaling Law: Perplexity Landscapes Predict Performance for Continual Pre-training

Continual Pre-training (CPT) serves as a fundamental approach for adapting foundation models to domain-specific applications. Scaling laws for pre-training define a power-law relationship between dataset size and the test loss of an LLM. However, the marginal gains from simply increasing data for CPT diminish rapidly, yielding suboptimal data utilization and inefficient training. To address this challenge, we propose a novel perplexity-aware data scaling law to establish a predictive relationship between the perplexity landscape of domain-specific data and the test loss. Our approach leverages the perplexity derived from the pre-trained model on domain data as a proxy for estimating the knowledge gap, effectively quantifying the informational perplexity landscape of candidate training samples. By fitting this scaling law across diverse perplexity regimes, we enable adaptive selection of high-utility data subsets, prioritizing content that maximizes knowledge absorption while minimizing redundancy and noise. Extensive experiments demonstrate that our method consistently identifies near-optimal training subsets and achieves superior performance on both medical and general-domain benchmarks.

cs.LG↗

A Medical Multimodal Diagnostic Framework Integrating Vision-Language Models and Logic Tree Reasoning

With the rapid growth of large language models (LLMs) and vision-language models (VLMs) in medicine, simply integrating clinical text and medical imaging does not guarantee reliable reasoning. Existing multimodal models often produce hallucinations or inconsistent chains of thought, limiting clinical trust. We propose a diagnostic framework built upon LLaVA that combines vision-language alignment with logic-regularized reasoning. The system includes an input encoder for text and images, a projection module for cross-modal alignment, a reasoning controller that decomposes diagnostic tasks into steps, and a logic tree generator that assembles stepwise premises into verifiable conclusions. Evaluations on MedXpertQA and other benchmarks show that our method improves diagnostic accuracy and yields more interpretable reasoning traces on multimodal tasks, while remaining competitive on text-only settings. These results suggest a promising step toward trustworthy multimodal medical AI.

cs.AI↗

Connecting current and future dual AGN searches to LISA and PTA gravitational wave detections

Dual active galactic nuclei (DAGN) mark an observable stage of massive black hole (MBH) pairing in galaxy mergers and are precursors to the MBH binaries that generate low-frequency gravitational waves. Using the large-volume ASTRID cosmological simulation, we construct DAGN catalogs matched to current (COSMOS-Web, DESI) and forthcoming (AXIS, Roman) searches. With realistic selection functions applied, ASTRID reproduces observed dual fractions, separations, and host-galaxy properties across redshifts. We predict a substantial population of small-separation (<5 kpc) duals that current surveys fail to capture, indicating that the apparent paucity of sub-kpc systems in COSMOS-Web is driven primarily by selection effects rather than a physical deficit. By following each simulated dual forward in time, we show that dual AGN are robust tracers of MBH mergers: ~30-70% coalesce within $\lesssim 1$ Gyr, and 20-60% of these mergers produce gravitational-wave signals detectable by LISA. Duals accessible to AXIS and Roman are the progenitors of ~10% of low-redshift LISA events and ~30% of the PTA-band stochastic background. Massive green-valley galaxies with moderate-luminosity AGN, together with massive star-forming hosts containing bright quasars at $z>1$, emerge as the most likely environments for imminent MBH binaries. These results provide a unified cosmological framework linking dual AGN demographics, MBH binary formation, and gravitational-wave emission, and they identify concrete, high-priority targets for coordinated electromagnetic and GW searches in upcoming multi-messenger surveys.

astro-ph.GA↗

Cold Gas Infall onto A Brightest Group Galaxy via A Gas-Rich Minor Merger

Dust and cold gas are not uncommon in nearby early-type galaxies (ETGs), and represent an important aspect of their evolution. However, their origin has been debated for decades. Potential sources include internal processes (e.g., mass loss from evolved stars), external mechanisms (e.g., minor mergers or cooling flows), or a combination of both. Gas-rich minor mergers have long been proposed as an important channel for cold gas fueling in both observations and simulations, but direct evidence of cold gas transportation via gas-rich minor mergers remains elusive, particularly in galaxy groups and clusters where environmental effects are prevalent. In this letter, we present the first unambiguous case of direct cold gas transportation onto a brightest group galaxy (BGG) at $z=0.25$, driven by an ongoing close-separation gas-rich minor merger with a mass ratio of $\sim1:56$. High-resolution JWST imaging reveals a heavily obscured, low-mass satellite that is barely visible at restframe optical wavelengths. Tidal stripping from this satellite deposits gas and dust onto the BGG, forming prominent $\sim$10 kpc dust lanes in situ. Cosmological simulations indicate that such interactions preferentially occur in gas-rich satellites undergoing their first infall in highly eccentric orbits. Our results highlight the pivotal role of gas-rich minor mergers in replenishing cold gas reservoirs and shaping the evolution of central ETGs in galaxy groups.

astro-ph.GA↗

Fast X-ray Variability from the Coronae of Supermassive Black Holes

We present the first systematic study of short-timescale X-ray variability in radio-quiet active galactic nuclei (AGN), utilizing archival Chandra observations of approximately 3,000 broad-line AGN selected from the SDSS and DESI spectroscopic surveys. We identify 14 AGN exhibiting rapid (on timescales of tens of kiloseconds) X-ray flux variations by factors of two or more that are statistically significant ($p\le6\times10^{-4}$), indicative of fast coronal variability. By converting minimum variability timescales to light-crossing times, we place upper limits on the sizes of the variable coronal regions, finding typical scales of $\lesssim10^{-4}$~pc. The coronal variable region size upper limits of an AGN in our sample are found to be much smaller than the typical coronal sizes inferred from microlensing, suggesting that its corona is composed of localized, transient structures rather than smooth, homogeneous plasmas. Such efficient magnetic energy dissipation in compact volumes is consistent with expectations for magnetically dominated coronae and is supported by recent general relativistic magnetohydrodynamic simulations. Future high-throughput X-ray observatories will enable the detection of even faster coronal variability, providing direct constraints on the physical mechanisms driving plasma energization and flux fluctuation near supermassive black holes. Our results suggest that luminous AGN hosting massive black holes are prime targets for probing the small-scale structure and dynamics of AGN coronae.

astro-ph.HE↗

Little red dot variability over a century reveals black hole envelope via a giant Einstein cross

"Little red dots" (LRDs) represent a new population of astronomical objects uncovered by JWST whose nature remains debated. Although many LRDs are suspected as active galactic nuclei (AGN), they show little variability on days-years timescales. We report the discovery of two gravitationally lensed LRDs at redshift $\sim$4.3 behind the cluster RXCJ2211-0350, one of which (RX1) is quadruply imaged with time delays spanning $\sim$130 years. RX1 exhibits intrinsic color and brightness variations of up to 0.7 magnitude among its images. These changes are consistent with blackbody-temperature variations of a photosphere, indicating long-term variability analogous to Cepheid-like pulsations but in a far more extended ($R \sim 2000$ AU) and massive ($M \gtrsim 10^6 \, M_{\odot}$) systems. These results suggest LRDs as a distinct class of AGN with stellar-like envelopes.

astro-ph.GA↗

Estimating the masses of Narrow line Seyfert 1 galaxies using damped random walk method

Narrow-line Seyfert 1 galaxies (NLSy1s) are a subclass of active galactic nuclei (AGNs), commonly associated with rapidly accreting, relatively low-mass black holes ($10^6$ - $10^8 M_\odot$) hosted in spiral galaxies. Although typically considered to have high Eddington ratios, recent observations, particularly of $γ$-ray-emitting NLSy1s, have raised questions about their true black hole masses, with some estimates approaching those of Broad-line Seyfert 1 (BLSy1) systems. In this work, we present the recalibrated mass estimations for a large sample of NLSy1s galaxies with z $<0.8$. We apply the damped random walk (DRW) formalism to a comparison set of 1,141 NLSy1 and 1,143 BLSy1 galaxies, matched in redshift and bolometric luminosity using SDSS DR17 spectroscopy. Our analysis employs a multivariate calibration that incorporates both the Eddington ratio and the rest-frame wavelength to refine the mass estimates. We obtain median DRW-based black hole masses of $\text{log}(M_{\text{BH}}^{\text{DRW}}/M_\odot) = 6.25 \pm 0.65$ for NLSy1s and $7.07 \pm 0.67$ for BLSy1s, in agreement with their respective virial mass distributions. Furthermore, we identify strong inverse trends between the variability amplitude and both optical luminosity and FeII emission strength, consistent with a scenario where higher accretion rates suppress long-term optical variability. These findings reinforce the view that NLSy1s harbor smaller black holes and highlight the value of variability-based approaches in tracing AGN accretion properties.

astro-ph.GA↗

Too Quiet for Comfort: Local Little Red Dots Lack Variability over Decades

Several local ($z\lesssim 0.2$) metal-poor dwarf AGNs have remarkably similar properties to those of high-redshift Little Red Dots (LRDs), and are recently proposed to be local analogs of LRDs. We use long-term photometric and spectroscopic observations of three local LRDs spanning $\sim 20$ years to measure variability in their rest-frame optical continuum and broad H$α$ emission lines. Using ZTF light curves over a rest-frame $\sim 5$ yr baseline, the $r$-band intrinsic rms variability is $(9\times 10^{-5})_{\rm -9E-5}^{+0.014}$ mag (J1022), $0.025\pm0.004$ mag (J1025) and $0.020\pm0.005$ mag (J1047), indicating low intrinsic variability ($<3-4\%$ at 3$σ$). These rms variability amplitudes are much lower than those for dwarf AGNs and more massive quasars. There is little structure in the optical variability structure functions for the three local LRDs, in contrast to normal AGN variability. Using available multi-epoch spectra, we constrain the broad H$α$ line flux variability to be less than a few percent, without significant profile changes, over a rest-frame baseline of $\sim 15$ yrs in J1025 and J1047, respectively. The three LRDs stand out in the Balmer line properties compared with normal broad-line AGNs, with exceptionally large H$α$ equivalent widths and H$α$/H$β$ ratios far exceeding the Case B recombination value. In the context of recent theoretical models of LRDs as dense gas-enshrouded massive black holes with super-Eddington accretion, our results suggest that the photosphere emission is long-term stable and the broad Balmer lines are primarily collisonally excited. This scenario is consistent with the lack of variability, large H$α$/H$β$ ratios and little dust extinction, as well as the expected high gas density. Virial black hole mass estimates using broad H$α$ assuming photoionization are therefore highly questionable for LRDs.

astro-ph.GA↗

The SDSS-V Black Hole Mapper Reverberation Mapping Project: Light Echoes of the Coronal Line Region in a Luminous Quasar

We present a reverberation mapping analysis of the coronal line [Ne V]$λ$3427 emitting region of the quasar COS168 (SDSS J095910.30+020732.2). [Ne V]$λ$3427 is known as one of the "coronal lines," which are a species of emission lines present in AGN spectra with high ionization potentials ($\geq$ 100 eV) that can serve as tracers for AGN activity. The spatial extent of the coronal line region has been studied with only spatial resolving techniques that are not sensitive to the innermost regions of AGN. Through our reverberation mapping analysis of [Ne V]$λ$3427, we measure a nominal `optimal emission radius' for [Ne V]$λ$3427 of $381.1^{+16}_{-22}$ light days (observed-frame). We place the coronal line region in context with other AGN regions by comparing it with the characteristic radius of H$α$, the dust-sublimation radius, and the dusty torus. The coronal line region is located at a larger radius from the black hole than the characteristic radius of the dusty torus, measured using a torus-radius luminosity relationship. The virial product ($v^2 R/G$) of both H$α$ and [Ne V]$λ$3427 is consistent within the uncertainties, implying that the coronal line region, as probed by the [Ne V]$λ$3427 line, may be in a virialized orbit that is dominated by the gravitational potential of the black hole. This plausibly suggests that coronal lines could be an effective method for estimating black hole masses.

astro-ph.GA↗

HIRAG: Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation

Retrieval-augmented generation (RAG) has become a fundamental paradigm for addressing the challenges faced by large language models in handling real-time information and domain-specific problems. Traditional RAG systems primarily rely on the in-context learning (ICL) capabilities of the large language model itself. Still, in-depth research on the specific capabilities needed by the RAG generation model is lacking, leading to challenges with inconsistent document quality and retrieval system imperfections. Even the limited studies that fine-tune RAG generative models often \textit{lack a granular focus on RAG task} or \textit{a deeper utilization of chain-of-thought processes}. To address this, we propose that RAG models should possess three progressively hierarchical abilities (1) Filtering: the ability to select relevant information; (2) Combination: the ability to combine semantic information across paragraphs; and (3) RAG-specific reasoning: the ability to further process external knowledge using internal knowledge. Thus, we introduce our new RAG instruction fine-tuning method, Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation (HIRAG) incorporates a "think before answering" strategy. This method enhances the model's open-book examination capability by utilizing multi-level progressive chain-of-thought. Experiments show that the HIRAG training strategy significantly improves the model's performance on datasets such as RGB, PopQA, MuSiQue, HotpotQA, and PubmedQA.

cs.CL↗