SearcharxivSearch

arXiv subjects

Yi Mao

Publications and source records attributed to Yi Mao.

At least 19 recordsLinked to original sources

Foreground Subtraction with a Tensor-Based Oriented Singular Value Decomposition Method for HI Experiments

We introduce a native tensor-based framework for foreground mitigation in 21\,cm intensity mapping (IM), utilizing the Oriented Singular Value Decomposition (O-SVD) algorithm. While 21\,cm IM is a powerful probe of the large-scale structure of the Universe, its efficacy is severely limited by astrophysical foregrounds that are orders of magnitude brighter than the cosmological signal. Traditional mitigation strategies often necessitate flattening multidimensional data cubes into two-dimensional matrices, a process that potentially compromises the intrinsic spatial-spectral correlations by treating distinct spatial pixels as independent samples. By treating multi-frequency sky maps and angular power spectra as third-order tensors, the O-SVD method performs decomposition directly on the multilinear manifold, preserving the underlying physical topology and leveraging the distinct coherence properties of astrophysical foregrounds across different dimensions. We demonstrate the performance and versatility of the O-SVD framework through its application to high-fidelity simulations from the SKA Science Data Challenge 3a (SDC3a) and real-world observational data from the Tianlai Cylinder Pathfinder Array. Our results indicate that O-SVD provides a robust and universal approach for foreground subtraction, achieving high-fidelity signal recovery while offering superior performance compared to conventional matrix-based Singular Value Decomposition (SVD) methods.

astro-ph.IM

Training Small LLMs as Spatial Multi-Agent Policies

Training LLM-based multi-agent systems with multi-agent reinforcement learning is rapidly gaining traction, and a parallel line of work argues that such systems should be judged by their behavior, not only their reward. We take up both threads in spatial cooperative games, where small frozen LLMs prompted with low-level actions fail outright, earning zero reward. Guided by the options/semi-MDP framework---and, because option execution is asynchronous across agents, its multi-agent extension in macro-action Dec-POMDPs---we equip each game with a library of symbolic \emph{options}: typed, state-feasible, short-horizon behaviors executed by a symbolic planner. Each library is drafted by a frontier coding model from the game's source code; the feasibility guards that filter each menu are then synthesized mechanically from cheap random-policy burn-in rollouts---a guard is adopted only if it explains repeated execution failures while hiding no logged success---so no guard is authored, selected, or reward-tuned by hand. Each agent's LLM acts as its policy over options, with a private per-agent LoRA adapter trained by a per-agent variant of multi-agent GRPO (PA-MAGRPO); this lifts frozen bases from zero reward to competent play across three games and four small backbones. Behavioral audits then reveal that reward and cooperation decouple: a rising reward curve may simply mean that one agent has learned to run the entire task alone while its partner idles---cooperation emerges only when the task makes it necessary. Reward alone is thus an unreliable readout of cooperation; behavioral evaluation must sit alongside it.

cs.MA

No way ou$\tau$: Epoch of Reionization Observations Do not Support Large Values of the Optical Depth to Reionization

Recent cosmological analyses combining high-redshift cosmic microwave background (CMB) measurements with low-redshift baryon acoustic oscillation (BAO) data have reported a preference for dynamical dark energy, with the cosmological constant scenario ($\Lambda$CDM) disfavored at the $\sim 3\sigma$ level. These analyses, however, typically rely on large-scale CMB polarization measurements to constrain the optical depth to reionization $\tau_{\rm reio}\sim 0.06$, raising the question of whether potential systematics in this dataset could influence the inferred cosmological preference. Excluding large-scale polarization data substantially weakens the tension with $\Lambda$CDM to the $\lesssim 2\sigma$ level, nevertheless at a price of increasing $\tau_{\rm reio}$ significantly to $\sim 0.09$. Here, we use a physically motivated Gompertzian reionization framework to perform a self-consistent Bayesian analysis combining CMB (excluding large-scale polarization data), BAO, and independent measurements of the neutral hydrogen fraction evolution from quasar damping wing observations and dark pixel constraints. We derive $\tau_{\rm reio} = 0.067 \pm 0.011$ (dynamical dark energy scenario) in good agreement with cosmological analyses that would include large-scale CMB polarization data, while the inferred reionization history is consistent with multiple observational constraints. Our analysis recovers a preference for dynamical dark energy at the $\gtrapprox2\sigma$ level. These results demonstrate that astrophysical probes of reionization independently recover the optical depth required by CMB polarization measurements, suggesting that potential systematics in large-scale polarization alone are unlikely to fully explain the emerging preference for dynamical dark energy.

astro-ph.CO

Foreground Characterization and Mitigation in the Observations of the CD/EoR with the SKA

The Square Kilometre Array (SKA), with its unprecedented sensitivity, frequency coverage, and large collecting area, is poised to revolutionize our understanding of the Cosmic Dawn (CD) and Epoch of Reionization (EoR) epochs marking the formation of the first luminous sources and the subsequent reionization of the intergalactic medium (IGM). However, detecting the faint redshifted 21-cm signal from neutral hydrogen remains one of the foremost challenges in observational cosmology, as it is buried beneath bright foregrounds from Galactic synchrotron radiation, free-free emission, and extragalactic point sources that are 4-5 orders of magnitude stronger than the cosmological signal. In this chapter, we highlight the key components and characteristics of these foregrounds and review ongoing efforts to model, characterize, and mitigate them. We emphasize how the SKA-Low AA* configuration, through its optimized array design, wide field of view, and improved calibration accuracy, enhances our capacity to suppress foreground contamination and recover the cosmological signal. The SKA Observatory Foreground Challenge plays a pivotal role in this effort by bringing together the global EoR/CD community to develop, compare, and validate foreground removal pipelines using realistic simulated datasets. Building on the experience of existing pathfinders such as LOFAR, MWA, and HERA, these collaborative initiatives are helping refine statistical and machine learning-based approaches for signal recovery. Together, these advancements are laying the groundwork for the SKA to probe the thermal and ionization history of the early Universe with unprecedented precision.

astro-ph.CO

Overview of 21cm Experiments at high redshift with SKAO

We provide an overview of the eight SKAO Science Book chapters that motivate the Epoch of Reionisation and Cosmic Dawn experiments with SKA-Low. We describe the individual SKA-Low experiments and expected sensitivity - power spectrum, tomography, 21-cm forest, cross-correlations, building on the broad observational plan laid out in the 2015 SKA Science Book. Finally, we outline features of the telescope that will be critical for the success of EoR/CD science, e.g., beam apodization, substations, and multi-beaming.

astro-ph.CO

Data-Driven Evolution of Library and Information Science Research Methods (1990-2022): A Perspective Based on Fine-grained Method Entities

Since the 1990s, advancements in big data and information technology have increasingly driven data-centric research in the field of Library and Information Science (LIS). To assess the influence of this data-driven research paradigm on the LIS discipline, this study conducts a fine-grained analysis to uncover the evolutionary trends of research methods within the domain. Using academic papers from LIS published between 1990 and 2022, four key categories of data-driven method entities are automatically extracted: algorithms and models, data resources, software and tools, and metrics. Based on these entities, the study examines the evolution of LIS research methods from three dimensions: the characteristics of research method entities over time, their evolution within different research topics, and the evolutionary features of research method entities across various research methods. The findings highlight data resources as a pivotal driver of methodological evolution in LIS, revealing a cyclical pattern of "emergence-stability/practical application" in the development of research methods within the field.

cs.DL

Research Method Usage across Academic Ages in Library and Information Science: An Empirical Study (1990-2023)

Academic age critically shapes career development, influencing research behavior, output volume, and methodological choices. Analyzing method variation across academic ages offers a new theoretical lens on scholarly evolution and provides early-career researchers with practical guidance for method selection. A corpus of 26,677 articles published 1990-2023 in 14 authoritative Library and Information Science journals was compiled. The CogFT model automatically classified the research methods embedded in these articles, and Top2Vec generated the topic model. This process resulted in a comprehensive dataset linking research methods with topics. Author-name disambiguation enabled calculation of each scholar's academic age. Popularity and Shannon diversity indices for methods, together with topic diversity, were compared across academic age groups. Results reveal dynamic methodological trends: the share of theoretical approaches declined gradually, whereas experimental and bibliometric methods gained ground. Method popularity differs significantly among cohorts. Mid-career scholars exhibit the highest method diversity; late-career scholars the lowest.

cs.DL

Unveiling the dark matter nature with reionization relics

Dark matter constitutes roughly one-fourth of the Universe, yet its physical nature remains unknown. Warm dark matter (WDM), a class of dark matter candidates, has non-negligible velocity dispersion that suppresses the formation of small-scale cosmic structures. Current constraints therefore rely mainly on small-scale probes such as the Lyman-alpha (Ly${\alpha}$) forest and Milky Way observations of satellite galaxies and stellar streams. We propose a novel large-scale probe based on long-lived "reionization relics": because the thermal and dynamical evolution of the intergalactic medium depends on the local reionization redshift, patchy reionization imprints additional large-scale fluctuations in Ly${\alpha}$ forest opacity and post-reionization HI traced by 21 cm intensity mapping. The strength of these imprints depends on WDM through both small-scale gas evolution and WDM-driven changes in the reionization history. For example, the Ly${\alpha}$ (21 cm) power spectrum in 3 keV WDM differs from cold dark matter by ~19% (~19%) at $k=0.05\,{\rm Mpc^{-1}}$ at z=4 (z=5.5) when reionization relics are included. Using Ly${\alpha}$ forest with a covariance model designed to mimic the capabilities of the Dark Energy Spectroscopic Instrument (DESI), we forecast a constraint of $m_{\rm WDM}>5.0\,{\rm keV}$ (95%), which improves to $m_{\rm WDM}>7.1\,{\rm keV}$ when combined with 21 cm intensity-mapping observations from the Square Kilometre Array (SKA). The next-generation surveys can further strengthen the current best lower bounds from 9.7 to 39 keV.

astro-ph.CO

JD-BP: A Joint-Decision Generative Framework for Auto-Bidding and Pricing

Auto-bidding services optimize real-time bidding strategies for advertisers under key performance indicator (KPI) constraints such as target return on investment and budget. However, uncertainties such as model prediction errors and feedback latency can cause bidding strategies to deviate from ex-post optimality, leading to inefficient allocation. To address this issue, we propose JD-BP, a Joint generative Decision framework for Bidding and Pricing. Unlike prior methods, JD-BP jointly outputs a bid value and a pricing correction term that acts additively with the payment rule such as GSP. To mitigate adverse effects of historical constraint violations, we design a memory-less Return-to-Go that encourages future value maximizing of bidding actions while the cumulated bias is handled by the pricing correction. Moreover, a trajectory augmentation algorithm is proposed to generate joint bidding-pricing trajectories from a (possibly arbitrary) base bidding policy, enabling efficient plug-and-play deployment of our algorithm from existing RL/generative bidding models. Finally, we employ an Energy-Based Direct Preference Optimization method in conjunction with a cross-attention module to enhance the joint learning performance of bidding and pricing correction. Offline experiments on the AuctionNet dataset demonstrate that JD-BP achieves state-of-the-art performance. Online A/B tests at JD.com confirm its practical effectiveness, showing a 4.70% increase in ad revenue and a 6.48% improvement in target cost.

cs.GT

Boosting AI Reliability with an FSM-Driven Streaming Inference Pipeline: An Industrial Case

The widespread adoption of AI in industry is often hampered by its limited robustness when faced with scenarios absent from training data, leading to prediction bias and vulnerabilities. To address this, we propose a novel streaming inference pipeline that enhances data-driven models by explicitly incorporating prior knowledge. This paper presents the work on an industrial AI application that automatically counts excavator workloads from surveillance videos. Our approach integrates an object detection model with a Finite State Machine (FSM), which encodes knowledge of operational scenarios to guide and correct the AI's predictions on streaming data. In experiments on a real-world dataset of over 7,000 images from 12 site videos, encompassing more than 300 excavator workloads, our method demonstrates superior performance and greater robustness compared to the original solution based on manual heuristic rules. We will release the code at https://github.com/thulab/video-streamling-inference-pipeline.

cs.CV

How to evaluate the sufficiency and complementarity of summary statistics for cosmic fields: an information-theoretic perspective

The advent of increasingly advanced surveys and cosmic tracers has motivated the development of new inference techniques and novel approaches to extracting information from cosmic fields. A central challenge in this endeavor is to quantify the information content carried by these summary statistics in cosmic fields. In particular, how should we assess which statistics are more informative than others and assess the exact degree of complementarity of the information from each statistic? Here, we introduce mutual information (MI) that provides, from an information-theoretic perspective, a natural framework for assessing the sufficiency and complementarity of summary statistics in cosmological data. We demonstrate how MI can be applied to typical inference tasks to make information-theoretic evaluations, using two representative examples: the cosmic microwave background map, from which the power spectrum extracts almost all information as is expected for a Gaussian random field, and the 21~cm brightness temperature map, from which the scattering transform extracts the most non-Gaussian information but is complementary to power spectrum and bispectrum. Our results suggest that MI offers a robust theoretical foundation for evaluating and improving summaries, thereby enabling a deeper understanding of cosmic fields from an information-theoretic perspective.

astro-ph.CO

Constraining fuzzy dark matter with the 21-cm power spectrum from Cosmic Dawn and Reionization

The 21-cm signals from Cosmic Dawn and the Epoch of Reionization contain valuable information on cosmological structure formation dominated by dark matter. Measurements of the 21-cm power spectrum can thus probe certain dark matter candidates. Here we investigate the impacts of fuzzy dark matter (FDM) on the 21-cm signals, taking into account both the linear matter power spectrum and the halo mass function (HMF) in FDM cosmologies. The full FDM dynamics are implemented in reionization simulations, along with a new ansatz on modulation of the FDM HMF by the linear overdensity. Not only does the suppression of FDM halos on small scales give rise to delay of the signature epochs during cosmic reionization, but these epochs are also shortened relative to the cold dark matter cosmology. In addition, we find that while the FDM effects on the 21-cm power spectrum are dominated by its linear dynamics early in Cosmic Dawn, a correct FDM HMF resulting from nonlinear wave dynamics must be considered when X-ray heating begins. We forecast the constraints on the FDM model parameters from upcoming 21-cm power spectrum measurements by SKA1-Low (central area). In FDM cosmologies with $m_\mathrm{FDM}=10^{-21}$ eV, SKA1-Low will be able to constrain the boson mass to within $\sim10$% at 2$\sigma$ confidence with a mock 1080-hour observation, if the ionizing efficiency is mass independent. However, our results show that realistic astrophysical processes are degenerate with the FDM effects, which shall severely loosen the constraints on the boson mass from 21-cm power spectrum data alone.

astro-ph.CO

Tantalizing Evidence of Reionization Relics in the eBOSS DR16 Ly$\boldsymbol{\alpha}$ Forest Correlations: a Preference for Early Reionization

Cosmic reionization of HI leaves enduring relics in the post-reionization intergalactic medium, potentially influencing the Lyman-$\alpha$ (Ly$\alpha$) forest down to redshifts as low as $z \approx 2$, which is the so-called ''memory of reionization'' effect. Here, we re-analyze the baryonic acoustic oscillation (BAO) measurements from Ly$\alpha$ absorption and quasar correlations using data from the extended Baryonic Oscillation Spectroscopic Survey (eBOSS) Data Release 16 (DR16), incorporating for the first time the memory of reionization in the Ly$\alpha$ forest. Three distinct scenarios of reionization timeline are considered in our analyses. We find that the recovered BAO parameters ($\alpha_\parallel$, $\alpha_\perp$) remain consistent with the original eBOSS DR16 analysis. However, models incorporating reionization relics provide a better fit to the data, with a tantalizing preference for early reionization, consistent with recent findings from the James Webb Space Telescope. Furthermore, the inclusion of reionization relics significantly impacts the non-BAO parameters. For instance, we report deviations of up to $3\sigma$ in the Ly$\alpha$ redshift-space distortion parameter and $\sim7\sigma$ in the linear Ly$\alpha$ bias for the late reionization scenario. Our findings suggest that the eBOSS Ly$\alpha$ data is more accurately described by models that incorporate a broadband enhancement to the Ly$\alpha$ forest power spectrum, highlighting the importance of accounting for reionization relics in cosmological analyses.

astro-ph.CO

Prospects for ${\rm kSZ^2}$-${\rm 21cm^2}$ Cross-Correlations during Reionization

The 21\,cm line and the patchy kinetic Sunyaev-Zel'dovich (kSZ) effect are promising and complementary probes of the Epoch of Reionization (EoR). A challenge for cross-correlating these two signals is that foreground avoidance or removal algorithms applied to the 21\,cm data inevitably sacrifice Fourier modes with long wavelengths along the line-of-sight (i.e., low-$k_\parallel$ modes), yet \textit{only} these same modes contribute to the kSZ signal. Here we show that a suitable kSZ$^2$ $\times$ 21\,cm$^2$ cross-correlation statistic nevertheless remains non-vanishing, even after filtering out the corrupted low-$k_\parallel$ Fourier modes from the 21\,cm data. We simulate the kSZ$^2$ $\times$ 21\,cm$^2$ cross-correlation signal across reionization-era redshifts and find distinctive redshift evolution. This signal peaks early in the reionization history, when the volume-averaged fraction is around $0.1 \lesssim x_\mathrm{HII} \lesssim 0.2$, after which it changes sign and reaches a minimum near reionization's midpoint ($x_\mathrm{HII} \sim 0.5$), while the signal gradually vanishes as reionization completes. These trends appear generic across three simulated models which differ in their reionization histories. We forecast the detectability of the kSZ$^2$ $\times$ 21\,cm$^2$ cross-power spectrum for the HERA and SKA1-Low 21\,cm experiments in combination with current and next-generation CMB surveys including the Simons Observatory, CMB-S4, and CMB-HD. We find that a high-significance detection ($\mathrm{S/N} \gtrsim 5\sigma$) is possible with SKA1-Low and CMB-S4.

astro-ph.CO

Likelihood-free Model Selection in Cosmic Reionization with Three-dimensional Tomographic 21 cm Lightcone Images

We explore likelihood-free (aka simulation-based) Bayesian model selection to quantify model comparison analyses of reionisation scenarios. We iteratively train the 3D Convolutional Neural Network (CNN) on four toy EoR models based on 21cmFAST simulations with contrasting morphology to obtain summaries of the 21 cm lightcone. Within the pyDelfi framework, we replaced the Emcee sampler with MultiNest to integrate learnt posteriors and produce the Bayesian Evidence. We comfortably distinguish the model used to produce the mock data set in all cases. However, we struggle to produce accurate posterior distributions for outside-in reionisation models. After a variety of cross-checks and alternate analyses we discuss the flexibility of summarising models that differ from precisely the intended network training conditions as this should be more widely scrutinised before CNN can reliably analyse observed data.

astro-ph.IM

Multi-fidelity emulator for large-scale 21 cm lightcone images: a few-shot transfer learning approach with generative adversarial network

Emulators using machine learning techniques have emerged to efficiently generate mock data matching the large survey volume for upcoming experiments, as an alternative approach to large-scale numerical simulations. However, high-fidelity emulators have become computationally expensive as the simulation volume grows to hundreds of megaparsecs. Here, we present a {\it multi-fidelity} emulation of large-scale 21~cm lightcone images from the epoch of reionization, which is realized by applying the {\it few-shot transfer learning} to training generative adversarial networks (GAN) from small-scale to large-scale simulations. Specifically, a GAN emulator is first trained with a huge number of small-scale simulations, and then transfer-learned with only a limited number of large-scale simulations, to emulate large-scale 21~cm lightcone images. We test the precision of our transfer-learned GAN emulator in terms of representative statistics including global 21~cm brightness temperature history, 2D power spectrum, and scattering transform coefficients. We demonstrate that the lightcone images generated by the transfer-learned GAN emulator can reach the percentage level precision in most cases on small scales, and the error on large scales only increases mildly to the level of a few tens of per cent. Nevertheless, our multi-fidelity emulation technique saves a significant portion of computational resources that are mostly consumed for generating training samples for GAN. On estimate, the computational resource by training GAN completely with large-scale simulations would be one to two orders of magnitude larger than using our multi-fidelity technique. This implies that our technique allows for emulating high-fidelity, traditionally computationally prohibitive, images in an economic manner.

astro-ph.IM

Optimizing Urban Service Allocation with Time-Constrained Restless Bandits

Municipal inspections are an important part of maintaining the quality of goods and services. In this paper, we approach the problem of intelligently scheduling service inspections to maximize their impact, using the case of food establishment inspections in Chicago as a case study. The Chicago Department of Public Health (CDPH) inspects thousands of establishments each year, with a substantial fail rate (over 3,000 failed inspection reports in 2023). To balance the objectives of ensuring adherence to guidelines, minimizing disruption to establishments, and minimizing inspection costs, CDPH assigns each establishment an inspection window every year and guarantees that they will be inspected exactly once during that window. Meanwhile, CDPH also promises surprise public health inspections for unexpected food safety emergencies or complaints. These constraints create a challenge for a restless multi-armed bandit (RMAB) approach, for which there are no existing methods. We develop an extension to Whittle index-based systems for RMABs that can guarantee action window constraints and frequencies, and furthermore can be leveraged to optimize action window assignments themselves. Briefly, we combine MDP reformulation and integer programming-based lookahead to maximize the impact of inspections subject to constraints. A neural network-based supervised learning model is developed to model state transitions of real Chicago establishments using public CDPH inspection records, which demonstrates 10% AUC improvements compared with directly predicting establishments' failures. Our experiments not only show up to 24% (in simulation) or 33% (on real data) objective improvements resulting from our approach and robustness to surprise inspections, but also give insight into the impact of scheduling constraints.

cs.LG

$\texttt{synax}$: A Differentiable and GPU-accelerated Synchrotron Simulation Package

We introduce synax, a novel library for automatically differentiable simulation of Galactic synchrotron emission. Built on the JAX framework, synax leverages JAX's capabilities, including batch acceleration, just-in-time compilation, and hardware-specific optimizations (CPU, GPU, TPU). Crucially, synax uses JAX's automatic differentiation (AD) mechanism, enabling precise computation of derivatives with respect to any model parameters. This feature facilitates powerful inference algorithms, such as Hamiltonian Monte Carlo (HMC) and gradient-based optimization, which enables inference over models that would otherwise be computationally prohibitive. In its initial release, synax supports synchrotron intensity and polarization calculations down to GHz frequencies, alongside several models of the Galactic magnetic field (GMF), cosmic ray (CR) spectra, and thermal electron density fields. We demonstrate the transformative potential of AD for tasks involving full posterior inference using gradient-based techniques or Maximum Likelihood Estimation (MLE) optimization. Notably, we show that GPU acceleration brings a twenty-fold enhancement in efficiency, while HMC achieves a two-fold improvement over standard random walk Metropolis-Hastings (RWMH) when performing inference over a four-parameter test model. HMC still works on a more complex, 16-parameter model while RWMH fails to converge. Additionally, we showcase the application of synax in optimizing the GMF based on the Haslam 408 MHz map, achieving residuals with a standard deviation below 1 K.

astro-ph.IM