arXiv subjects

Hanwen Sun

Publications and source records attributed to Hanwen Sun.

16 recordsLinked to original sources

arXiv2026

Speed by Simplicity: A Single-Stream Architecture for Fast Audio-Video Generative Foundation Model

We present daVinci-MagiHuman, an open-source audio-video generative foundation model for human-centric generation. daVinci-MagiHuman jointly generates synchronized video and audio using a single-stream Transformer that processes text, video, and audio within a unified token sequence via self-attention only. This single-stream design avoids the complexity of multi-stream or cross-attention architectures while remaining easy to optimize with standard training and inference infrastructure. The model is particularly strong in human-centric scenarios, producing expressive facial performance, natural speech-expression coordination, realistic body motion, and precise audio-video synchronization. It supports multilingual spoken generation across Chinese (Mandarin and Cantonese), English, Japanese, Korean, German, and French. For efficient inference, we combine the single-stream backbone with model distillation, latent-space super-resolution, and a Turbo VAE decoder, enabling generation of a 5-second 256p video in 2 seconds on a single H100 GPU. In automatic evaluation, daVinci-MagiHuman achieves the highest visual quality and text alignment among leading open models, along with the lowest word error rate (14.60%) for speech intelligibility. In pairwise human evaluation, it achieves win rates of 80.0% against Ovi 1.1 and 60.9% against LTX 2.3 over 2000 comparisons. We open-source the complete model stack, including the base model, the distilled model, the super-resolution model, and the inference codebase.

cs.CV↗

arXiv2026

A Bending in the Size-mass Relation of Star-forming Galaxies across $0.5 < z < 6.0$ at a Critical Stellar Mass of $10^{10}M_\odot$ Revealed by JWST

We investigate the rest-frame optical size-stellar mass relation of galaxies at $0.5 M_{\rm p}$, an increasing fraction of SFGs decouple from halo growth and become compact, likely associated with rapid bulge (and black hole) growth in $M_{\rm h} \gtrsim 10^{12} M_{\odot}$ halos. These compact SFGs are promising progenitors of massive QGs, as evidenced by their similar masses, surface brightness profiles, and morphologies. Their high number densities can account for the observed buildup of massive QGs at $z > 2$, suggesting that the compaction pathway, rather than major mergers of extended SFGs, dominates the formation of high-z massive QGs.

astro-ph.GA↗

arXiv2026

ULTIMATE-deblending I. A 50-band Ultraviolet to Mid-infrared Photometric Catalog Combining Space- and Ground-based Data in the JWST/PRIMER survey

Our understanding of the early Universe has long been limited by biased galaxy samples selected through various color criteria. With deep JWST infrared imaging, mass-complete galaxy samples can now be studied up to $z \sim 8$ for the first time. However, recent work has revealed systematic uncertainties in measuring physical properties of galaxies based solely on JWST/NIRCam and HST photometry, due to their limited wavelength coverage. This highlights the need for supplementary data, particularly in the rest-frame UV and near-infrared. Here we present the ULTIMATE-deblending project, which will eventually deliver self-consistent UV to radio photometry for galaxies detected in deep JWST surveys, including both NIRCam and MIRI data. In this first paper, we release a 50-band photometric catalog spanning CFHT/U to JWST/MIRI F1800W, covering a total of 627.1 arcmin$^2$ across two JWST/PRIMER fields. We detail the reduction of the JWST imaging data, the photometric procedures, and the spectral-energy-distribution-fitting methodology used to derive the galaxy properties. Compared with photometry including only HST and JWST bands, the inclusion of deblended low-resolution photometry from ground-based telescopes improves the accuracy of photometric redshifts by $\sim$40%, while reducing the outlier fraction by $\sim$60%. This galaxy sample can serve as a key reference for statistical studies of galaxy formation and evolution in the early Universe. The UV-to-MIR catalogs and JWST mosaics from the ULTIMATE-deblending project have been made publicly available.

astro-ph.GA↗

arXiv2025

Cosmic Vine: High abundance of massive galaxies and dark matter halos in a forming cluster at z=3.44

The Cosmic Vine is a massive protocluster at z=3.44 in the JWST CEERS field, offering an ideal laboratory for studying the early phases of cluster formation. Using the data from the DAWN JWST Archive, we conduct a comprehensive study on the large-scale structure, stellar mass function (SMF), quiescent members, and dark matter halos in the Cosmic Vine. First, we spectroscopically confirm 136 galaxies in the Vine at z=3.44, and an additional 47 galaxies belonging to a diffuse foreground structure at z=3.34 which we dub the Leaf. We identify four subgroups comprising the Cosmic Vine and two subgroups within the Leaf. Second, we identified 11 quiescent members with log(M*/Msun)=9.5-11.0, the largest sample of quiescent galaxies in overdense environments at z>3, which gives an enhanced quiescent galaxy number density 2x10^(-4)cMpc^(-3) that is three times above the field level at log(M*/Msun) > 10. Notably, these quiescent members form a tight red sequence on the color-magnitude diagram, making it one of the earliest red sequences known to date. Third, by constructing the SMFs for both star-forming and quiescent members, we find that both SMFs are top-heavy, with a significantly enhanced quiescent fraction at log(M*/Msun)>10.5 compared to field counterparts. The stellar mass-size analysis reveals that star-forming members are more compact at higher masses than their field counterparts. Finally, we estimate a halo mass of log(Mh/Msun)=13.2+-0.3 for the protocluster core, and log(Mh/Msun)=11.9-12.4 for satellite subgroups. The phase-space analysis indicates that three subgroups are likely infalling to the core. This work reveals a high abundance of massive galaxies and dark matter halos in a forming cluster, demonstrating the accelerated assembly of massive galaxies in massive halos when the Universe was less than 2 billion years old.

astro-ph.GA↗

arXiv2025

Long-Context Attention Benchmark: From Kernel Efficiency to Distributed Context Parallelism

Transformer-based large language models (LLMs) have achieved remarkable success, yet their standard attention mechanism incurs quadratic computation and memory costs with respect to sequence length, posing a major bottleneck for long-context training. Prior work tackles this challenge along two directions: (1) kernel-level optimizations, which accelerate dense and sparse attention operators; and (2) module-level strategies, often referred to as distributed attention or context parallel training, which scale attention across multiple devices. However, systematic evaluation still remains limited: operator-level comparisons are often incomplete, while context parallel strategies are typically framework-specific, with unclear performance analysis across contexts. To address these gaps, we propose a unified benchmark that integrates representative attention kernels and context parallel mechanisms with a modular and extensible interface for evaluation. The benchmark evaluates methods along two critical dimensions: (1) attention mask patterns, which strongly affect efficiency, scalability, and usability, and (2) sequence length and distributed scale, which determine performance under extreme long-context training. Through comprehensive experiments on the cluster of up to 96 GPUs, our benchmark enables reproducible comparisons, highlights method-specific trade-offs, and provides practical guidance for designing and deploying attention mechanisms in long-context LLM training.

cs.LG↗

arXiv2025

A census of quiescent galaxies across $0.5 < z < 8$ with JWST/MIRI: Mass-dependent number density evolution of quiescent galaxies in the early Universe

Recent JWST observations have revealed a large population of quiescent galaxies (QGs) at high redshift ($z \sim 4-8$), challenging current models of early galaxy formation and quenching. Accurate number density estimates are crucial but remain uncertain. We present a systematic study of QGs at $0.5 < z < 8$ using a mass-complete sample from the JWST/PRIMER survey with deep NIRCam and MIRI imaging. We demonstrate that MIRI photometry is essential for refining the QG sample: it helps to mitigate contamination from dusty star-forming galaxies in the high-mass regime at $z \sim 3-5$ and aids in recovering lower-mass QG candidates at $z > 5$ that are often missed without including MIRI data. We find that the evolution of the QG number density is strongly mass-dependent. The density of massive QGs ($\log (M_{\star}/M_{\odot}) > 10.6$) declines rapidly, falling from $n \approx 1.32\times10^{-5}~~\mathrm{Mpc^{-3}}$ at $z \sim 3-4$ to $n < 1 \times10^{-6}~~\mathrm{Mpc^{-3}}$ at $z \sim 6$, and becomes negligible at $z > 6$. In contrast, low-mass QGs ($9.5 < \log (M_{\star}/M_{\odot}) < 10.6$) exhibit a remarkably constant number density of $n \sim 3\times10^{-6}~\mathrm{Mpc^{-3}}$ across the redshift range $z = 4-8$. This plateau suggests that these high-redshift, low-mass QGs may be galaxies undergoing temporary quenching episodes, likely subject to rejuvenation upon future gas accretion. Comparisons with leading galaxy formation models reveal significant tensions: most models underestimate the abundance of massive QGs at $z > 4$ and fail to reproduce the flat density evolution observed for the low-mass population.

astro-ph.GA↗

arXiv2025

SHAPE. I. A SOM-SED hybrid approach for efficient galaxy parameter estimation leveraging JWST

With the launch and application of next-generation ground- and space-based telescopes, astronomy has entered the era of big data, necessitating more efficient and robust data analysis methods. Most traditional parameter estimation methods are unable to reconcile differences between photometric systems. Ideally, we would like to optimally rely on high-quality observation data provided by, e.g., JWST, for calibrating and improving upcoming wide-field surveys such as the China Space Station Telescope (CSST) and Euclid. To this end, we introduce a new approach (SHAPE, SOM-SED Hybrid Approach for efficient Parameter Estimation) that can bridge different photometric systems and efficiently estimate key galaxy parameters, such as stellar mass ($M_\star$) and star formation rate (SFR), leveraging data from a large and deep JWST/NIRCam and MIRI survey (PRIMER). As a test of the methodology, we focus on galaxies at $z\sim 1.5-2.5$. To mitigate discrepancies between input colors and the training set, we replace the default SOM weights with stacked SEDs from each cell, extending the applicability of our model to other photometric catalogs (e.g., COSMOS2020). By incorporating a SED library (SED Lib), we apply this JWST-calibrated model to the COSMOS2020 catalog. Despite the limited sample size and potential template-related uncertainties, SOM-derived parameters exhibit a good agreement with results from SED-fitting using extended photometry. Under identical photometric constraints from CSST and Euclid bands, our method outperforms traditional SED-fitting techniques in SFR estimation, exhibiting both a reduced bias (-0.01 vs. 0.18) and a smaller $\sigma_{\rm NMAD}$ (0.25 vs. 0.35). With its computational efficiency capable of processing $10^6$ sources per CPU per hour during the estimation phase, this JWST-calibrated estimator holds significant promise for next-generation wide-field surveys.

astro-ph.GA↗

arXiv2025

The Bigfoot: A footprint of a Coma cluster progenitor at z=3.98

Protoclusters, galaxy clusters' high redshift progenitors, hold the keys to understanding the formation and evolution of clusters and their member galaxies. However, their cosmological distances and spatial extensions (tens of Mpc) have inhibited complete mapping of their structure and constituent galaxies, which is key to robustly linking protoclusters to their descendants. Here we report the discovery of the Bigfoot, a tridimensional structure at $z = 3.98$ including 11 subgroups traced by 55 (700) spectroscopic (photometric) redshifts with JWST, extending over $15\times 37$ $\times 49{\rm{cMpc^3}}$ in the PRIMER-UDS field. Bigfoot's large-scale and mass function of member galaxies closely match constrained simulations' predictions for the progenitors of today's most massive clusters (${M_0} > 10^{15} {M_{_ \odot }}$). All subgroups with ${M_{\rm{h}}} > {10^{12.5}}{M_{_ \odot }}$ exhibit enhanced fractions of massive galaxies ($>{10^{10.0} {M_{_ \odot }}}$) compared to lower-mass halos and the field, demonstrating the accelerated formation of massive galaxies in massive halos. The presence of this massive protocluster with a large central halo (${10^{13.0} {M_{_ \odot }}}$) in a JWST deep field bears important cosmological implication that favors high ${\sigma _8}$ of PLANCK cosmology over low-redshift probes.

astro-ph.GA↗

arXiv2025

Noema formIng Cluster survEy (NICE): A Census of Star Formation and Cold Gas Properties in Massive protoclusters at 1.5<z<4

Massive protoclusters at z~1.5-4, the peak of the cosmic star formation history, are key to understanding the formation mechanisms of massive galaxies in today's clusters. However, studies of protoclusters at these high redshifts remain limited, primarily due to small sample sizes and heterogeneous selection criteria. In this work, we conduct a systematic investigation of the star formation and cold gas properties of member galaxies of eight massive protoclusters in the COSMOS field, using the statistical and homogeneously selected sample from the Noema formIng Cluster survEy (NICE). Our analysis reveals a steep increase in the star formation rates per halo mass ($\Sigma_{\rm SFR} /M_{\rm halo}$) with redshifts in these intensively star-forming protoclusters, reaching values one to two orders of magnitude higher than those observed in the field at z>2. We further show that, instead of an enhancement of starbursts, this increase is largely driven by the concentration of massive and gas-rich star-forming galaxies in the protocluster cores. The member galaxies still generally follow the same star formation main sequence as in the field, with a moderate enhancement at the low mass end. Notably, the most massive protocluster galaxies ($M_\star$>8$\times$10$^{10}$M$_\odot$) exhibit higher $f_{\rm gas}$ and $\tau_{\rm gas}$ than their field counterparts, while remaining on the star forming main sequence. These gas-rich, massive, and star-forming galaxies are predominantly concentrated in the protocluster cores and are likely progenitors of massive ellipticals in the center of today's clusters. These results suggest that the formation of massive galaxies in such environments is sustained by substantial gas reservoirs, which support persistent star formation and drive early mass assembly in forming cluster cores.

astro-ph.GA↗

arXiv2025

MAGI-1: Autoregressive Video Generation at Scale

We present MAGI-1, a world model that generates videos by autoregressively predicting a sequence of video chunks, defined as fixed-length segments of consecutive frames. Trained to denoise per-chunk noise that increases monotonically over time, MAGI-1 enables causal temporal modeling and naturally supports streaming generation. It achieves strong performance on image-to-video (I2V) tasks conditioned on text instructions, providing high temporal consistency and scalability, which are made possible by several algorithmic innovations and a dedicated infrastructure stack. MAGI-1 facilitates controllable generation via chunk-wise prompting and supports real-time, memory-efficient deployment by maintaining constant peak inference cost, regardless of video length. The largest variant of MAGI-1 comprises 24 billion parameters and supports context lengths of up to 4 million tokens, demonstrating the scalability and robustness of our approach. The code and models are available at https://github.com/SandAI-org/MAGI-1 and https://github.com/SandAI-org/MagiAttention. The product can be accessed at https://sand.ai.

cs.CV↗

arXiv2025

Ram-pressure stripping caught in action in a young cluster at $z = 2.51$

Galaxy clusters in the local Universe are dominated by massive quiescent galaxies with old ages, formed at high redshifts. Whether their quenching is driven by internal processes or environmental effects is a matter of debate that has been challenging to resolve due to the lack of observations during their peak formation epoch. Here we report clear evidence from the Atacama Large Millimeter/submillimeter Array of extended and elongated gas tails in five galaxies in a forming cluster at z = 2.51. The single-tailed gas distributions, which extend notably beyond the stellar emission probed by JWST in galaxies that are relatively isolated and lack signatures of mergers or interactions (features that are very uncommon in the field), provide evidence of ram-pressure stripping. These very distant confirmed cases of ram-pressure stripping highlight the critical role of environmental effects in gas removal at high redshifts, an often-overlooked quenching pathway.

astro-ph.GA↗

arXiv2024

NOEMA formIng Cluster survEy (NICE): Characterizing eight massive galaxy groups at $1.5 < z < 4$ in the COSMOS field

The NOEMA formIng Cluster survEy (NICE) is a large program targeting 69 massive galaxy group candidates at $z>2$ in six deep fields. We report spectroscopic confirmation of eight groups at $1.65\leq z\leq3.61$ in COSMOS. Homogeneously selected as significant overdensities of red IRAC sources with red Herschel colors, four groups are confirmed by CO and [CI] with NOEMA 3mm observations, three are confirmed with ALMA, and one is confirmed by H$\alpha$ from Subaru/FMOS. We constructed the integrated FIR SEDs for the eight groups, obtaining total IR SFR $=260-1300~{\rm M_\odot}$~yr$^{-1}$. We adopted six methods to estimate the dark matter masses, including stellar mass to halo mass relations, overdensity with galaxy bias, and NFW profile fitting to radial stellar mass density. We found the radial stellar mass density are consistent with a NFW profile, supporting that they are collapsed structures hosted by a single dark matter halo. The best halo mass estimates are $\log(M_{\rm h}/{\rm M_\odot})=12.8-13.7$ with uncertainty of 0.3 dex. From halo mass estimates, we derive baryonic accretion rate ${\rm BAR}=(1-8)\times10^{3}\,{\rm M_{\odot}/yr}$ for this sample. We find a quasi-linear correlation between the integrated SFR/BAR and the theoretical halo mass limit for cold streams, $M_{\rm stream}/M_{\rm h}$, with ${\rm SFR/BAR}=10^{-0.46\pm0.22}\left({M_{\rm stream}/M_{\rm h}}\right)^{0.71\pm0.16}$ with a scatter of $0.40\,{\rm dex}$. Further, we compare halo masses and stellar masses with simulations, and find all structures are consistent with being progenitors of $M_{\rm h}(z=0)>10^{14}\,{\rm M_{\odot}}$ galaxy clusters, and the most massive central galaxies have stellar masses consistent with brightest cluster galaxies (BCGs) progenitors in the TNG300 simulation. The results strongly suggest these structures are forming massive galaxy clusters via baryonic and dark matter accretion.

astro-ph.GA↗

arXiv2024

JWST's first glimpse of a z > 2 forming cluster reveals a top-heavy stellar mass function

Clusters and their progenitors (protoclusters) at z = 2-4, the peak epoch of star formation, are ideal laboratories to study the formation process of both the clusters themselves and their member galaxies. However, a complete census of their member galaxies has been challenging due to observational difficulties. Here we present new JWST/NIRCam observations targeting the distant cluster CLJ1001 at z = 2.51 from the COSMOS-Web program, which, in combination with previous narrowband imaging targeting H-alpha emitters and deep millimeter surveys of CO emitters, provide a complete view of massive galaxy assembly in CLJ1001. In particular, JWST reveals a population of massive, extremely red cluster members in the long-wavelength bands that were invisible in previous Hubble Space Telescope (HST)/F160W imaging (HST-dark members). Based on this highly complete spectroscopic sample of member galaxies, we show that the spatial distribution of galaxies in CLJ1001 exhibits a strong central concentration, with the central galaxy density already resembling that of low-z clusters. Moreover, we reveal a "top-heavy" stellar mass function for the star-forming galaxies (SFGs), with an overabundance of massive SFGs piled up in the cluster core. These features strongly suggest that CLJ1001 is caught in a rapid transition, with many of its massive SFGs likely soon becoming quiescent. In the context of cluster formation, these findings suggest that the earliest clusters form from the inside out and top to bottom, with the massive galaxies in the core assembling first, followed by the less massive ones in the outskirts.

astro-ph.GA↗

arXiv2024

JWST/MIRI reveals the true number density of massive galaxies in the early Universe

Early JWST studies reporting an unexpected abundance of massive galaxies at $z \sim 5$--$8$ challenge galaxy formation models in the $\Lambda$CDM framework. Previous stellar mass ($M_\star$) estimates suffered from large uncertainties due to the lack of rest-frame near-infrared data. Using deep JWST/NIRCam and MIRI photometry from PRIMER, we systematically analyze massive galaxies at $z \sim 3$--$8$, leveraging rest-frame $\gtrsim 1\,\mu$m constraints. We find MIRI is critical for robust $M_\star$ measurements for massive galaxies at $z > 5$: excluding MIRI overestimates $M_\star$ by $\sim 0.4$ dex on average for $M_\star > 10^{10}\,M_\odot$ galaxies, with no significant effects at lower masses. This reduces number densities of $M_\star > 10^{10}\,M_\odot$ ($10^{10.3}\,M_\odot$) galaxies by $\sim 36\%$ ($55\%$). MIRI inclusion also reduces ``Little Red Dot'' (LRD) contamination in massive galaxy samples, lowering the LRD fraction from $\sim 32\%$ to $\sim 13\%$ at $M_\star > 10^{10.3}\,M_\odot$. Assuming pure stellar origins, LRDs exhibit $M_\star \sim 10^{9\text{--}10.5}\,M_\odot$ with MIRI constraints, rarely exceeding $10^{10.5}\,M_\odot$. Within standard $\Lambda$CDM, our results indicate a moderate increase in the baryon-to-star conversion efficiency ($\epsilon$) toward higher redshifts and masses at $z > 3$. For the most massive $z \sim 8$ galaxies, $\epsilon \sim 0.3$, compared to $\epsilon \lesssim 0.2$ for typical galaxies at $z < 3$. This result is consistent with models where high gas densities and short free-fall times suppress stellar feedback in massive high-$z$ halos.

astro-ph.GA↗

arXiv2023

Noema formIng Cluster survEy (NICE): Discovery of a starbursting galaxy group with a radio-luminous core at z=3.95

The study of distant galaxy groups and clusters at the peak epoch of star formation is limited by the lack of a statistically and homogeneously selected and spectroscopically confirmed sample. Recent discoveries of concentrated starburst activities in cluster cores have opened a new window to hunt for these structures based on their integrated IR luminosities. Hereby we carry out the large NOEMA (NOrthern Extended Millimeter Array) program targeting a statistical sample of infrared-luminous sources associated with overdensities of massive galaxies at z>2, the Noema formIng Cluster survEy (NICE). We present the first result from the ongoing NICE survey, a compact group at z=3.95 in the Lockman Hole field (LH-SBC3), confirmed via four massive (M_star>10^10.5M_sun) galaxies detected in CO(4-3) and [CI](1-0) lines. The four CO-detected members of LH-SBC3 are distributed over a 180 kpc physical scale, and the entire structure has an estimated halo mass of ~10^13Msun and total star formation rate (SFR) of ~4000Msun/yr. In addition, the most massive galaxy hosts a radio-loud AGN with L_1.4GHz, rest = 3.0*10^25W/Hz. The discovery of LH-SBC3 demonstrates the feasibility of our method to efficiently identify high-z compact groups or forming cluster cores. The existence of these starbursting cluster cores up to z~4 provides critical insights into the mass assembly history of the central massive galaxies in clusters.

astro-ph.GA↗

arXiv2023

Accelerated structural evolution of galaxies in a starbursting cluster at z=2.51

Structural properties of cluster galaxies during their peak formation epoch, $z \sim 2-4$ provide key information on whether and how environment affects galaxy formation and evolution. Based on deep HST/WFC3 imaging towards the z=2.51 cluster, J1001, we explore environmental effects on the structure, color gradients, and stellar populations of a statistical sample of cluster SFGs. We find that the cluster SFGs are on average smaller than their field counterparts. This difference is most pronounced at the high-mass end ($M_{\star} > 10^{10.5} M_{\odot}$) with nearly all of them lying below the mass-size relation of field galaxies. The high-mass cluster SFGs are also generally old with a steep negative color gradient, indicating an early formation time likely associated with strong dissipative collapse. For low-mass cluster SFGs, we unveil a population of compact galaxies with steep positive color gradients that are not seen in the field. This suggests that the low-mass compact cluster SFGs may have already experienced strong environmental effects, e.g., tidal/ram pressure stripping, in this young cluster. These results provide evidence on the environmental effects at work in the earliest formed clusters with different roles in the formation of low and high-mass galaxies.

astro-ph.GA↗