SearcharxivSearch

arXiv subjects

Shifan Zuo

Publications and source records attributed to Shifan Zuo.

At least 19 recordsLinked to original sources

Foreground Subtraction with a Tensor-Based Oriented Singular Value Decomposition Method for HI Experiments

We introduce a native tensor-based framework for foreground mitigation in 21\,cm intensity mapping (IM), utilizing the Oriented Singular Value Decomposition (O-SVD) algorithm. While 21\,cm IM is a powerful probe of the large-scale structure of the Universe, its efficacy is severely limited by astrophysical foregrounds that are orders of magnitude brighter than the cosmological signal. Traditional mitigation strategies often necessitate flattening multidimensional data cubes into two-dimensional matrices, a process that potentially compromises the intrinsic spatial-spectral correlations by treating distinct spatial pixels as independent samples. By treating multi-frequency sky maps and angular power spectra as third-order tensors, the O-SVD method performs decomposition directly on the multilinear manifold, preserving the underlying physical topology and leveraging the distinct coherence properties of astrophysical foregrounds across different dimensions. We demonstrate the performance and versatility of the O-SVD framework through its application to high-fidelity simulations from the SKA Science Data Challenge 3a (SDC3a) and real-world observational data from the Tianlai Cylinder Pathfinder Array. Our results indicate that O-SVD provides a robust and universal approach for foreground subtraction, achieving high-fidelity signal recovery while offering superior performance compared to conventional matrix-based Singular Value Decomposition (SVD) methods.

astro-ph.IM

Observational Frontiers in the post-EoR 21-cm Intensity Mapping: Lessons from the SKA Pathfinders

The 21-cm line from neutral hydrogen has long been recognised as a promising tracer of the large-scale structure of the Universe. The line is weak however, making individual galaxy detections quite inefficient, especially at higher redshifts. The technique of 21-cm intensity mapping has been pioneered over the last two decades to address this limitation. Instead of detecting individual galaxies, the brightness temperature field from the combined 21-cm emission of many unresolved galaxies is mapped as a function of angle and frequency, resulting in 3D tracer maps of the large-scale structure. In this chapter, we review the major pioneering efforts to develop this observable into a competitive cosmological tool, paying particular attention to the status of pathfinder observations that have paved the way for a large and highly sensitive 21-cm intensity mapping survey with the SKA-Mid telescope.

astro-ph.CO

Foreground Mitigation and Power Spectrum Analysis for Tianlai Full-Sky 21 cm Survey Observation

We present a comprehensive analysis of the 21 cm intensity mapping (IM) data from the Tianlai Cylinder Pathfinder Array (TCPA), focusing on multi-scale foreground mitigation and three-dimensional power spectrum estimation. Utilizing 20 days of drift-scan observations (714.4-781.7 MHz, corresponding to HI emission at redshift $z \approx 0.82-0.99$), we reconstruct high-fidelity sky maps by incorporating a high-precision, drone-measured primary beam model. This in-situ calibration significantly enhances reconstruction accuracy over previous analytical approximations. To address astrophysical foregrounds, which exceed the cosmological signal by approximately five orders of magnitude, we implement a robust multi-scale subtraction strategy--mPCA-UWTS--which combines an isotropic Undecimated Wavelet Transform on the Sphere (UWTS) with independent Principal Component Analysis (PCA) within each wavelet domain. We subsequently estimate the 3D power spectrum via Spherical Fourier-Bessel (SFB) decomposition, providing a mathematically rigorous treatment of wide-angle and line-of-sight curvature effects inherent in wide-field surveys. Our analysis demonstrates that the SFB framework effectively isolates systematic contaminants and recovers the clustering signal without the biases introduced by conventional flat-sky approximations. This work represents the first application of the SFB formalism to observational 21 cm IM data, establishing it as a computationally efficient and scalable diagnostic tool for the next generation of wide-field 21 cm surveys, including the Square Kilometre Array (SKA) and the full Tianlai array.

astro-ph.CO

Measuring Tianlai's primary beam using sky model

We present the beam pattern measurement of the Tianlai Cylinder Pathfinder Array. As it is a pure drift-scan instrument, we exploit the North-South motion of the Sun to demonstrate that the primary beam is factorizable. Leveraging this property, we decompose the primary beam into independent East-West (E-W) and North-South (N-S) components. Using the Sun as a calibration source, we obtain the E-W beam profiles at various elevations, applying normalization to eliminate the effects of solar activity. Subsequently, we simulate the observed signals using a sky map model to derive the best-fit N-S beam. The results of this work are consistent with previous expectations.

astro-ph.IM

21 cm Power Spectrum Analysis of North Celestial Pole Observations with the Tianlai Dish Pathfinder Array

The Tianlai Dish Pathfinder Array (TDPA) is a radio interferometer designed to test techniques for 21 cm intensity mapping in the post-reionization universe as a means of measuring large-scale cosmic structure. Using 9 nights of observations targeting the North Celestial Pole (NCP) field, totaling approximately 107 hours of integration time, we analyze data in the frequency range 700-800 MHz (corresponding to redshift $z \sim 0.9$). We do the data format conversion, radio frequency interference (RFI) flagging, calibration, imaging and point source subtraction, and foreground removal via Singular Value Decomposition (SVD). The spherically averaged power spectrum $\Delta^2(k)$ is obtained. This work successfully establishes and validates a comprehensive data analysis framework for the TDPA. We identify key improvements including sky model refinement, increased integration time, and pipeline optimization that will enable future detection of the 21 cm signal through auto-correlation and cross-correlation with optical galaxy surveys.

astro-ph.IM

FATHOMER survey: III. Preliminary HI galaxy identification results

We present the HI galaxy observation results of the FATHOMER (FAst neuTral HydrOgen intensity Mapping ExpeRiment), a pilot drift scan survey by the Five-hundred-meter Aperture Spherical radio Telescope (FAST). The survey comprises 28 hours of observations over 7 nights in 2021, covering a $60\, \deg^2$ sky area in the frequency range 1.05-1.45 GHz. The HI galaxies are identified using both a matched-filtering algorithm and the SoFiA source-finding pipeline, which yield consistent detections. We derive the velocity width ($W_{50}$), flux density, and HI mass for detected galaxies. A total of 702 galaxies are identified with HI mass above $10^{6.2}\,{M_\odot}$, signal-to-noise ratio greater than 5, and redshift $z < 0.09$. Among these, 331 are previously known from the ALFALFA survey. Of the newly detected sources, 9 have spectroscopic confirmation from SDSS, 285 are matched to SDSS or DESI photometric data, and 77 lack optical counterparts--possible candidates for dark or faint galaxies. Comparison with ALFALFA shows that FAST enables detection of galaxies at higher redshifts and with lower HI fluxes, despite the radio frequency interference (RFI) and partial data masking. A preliminary HI mass function analysis reveals a higher characteristic mass and steeper low-mass slope than ALFALFA, indicating FAST's enhanced sensitivity to massive and distant HI systems. These results demonstrate FAST's strong potential for future deep HI surveys and highlight the importance of improved RFI mitigation and completeness correction.

astro-ph.GA

Beamforming in Interferometer Arrays with Cross-couplings

For an interferometric array, an image of the sky can be synthesized from interferometric visibilities, which are the cross-correlations of the received electric voltages of pairs of array elements. However, to search for transient targets such as the fast radio burst (FRB), it is more convenient to use the beam-forming technique, where the real-time voltage outputs of the array elements are used to generate data streams (beams) which are sensitive to a specific direction. This is usually achieved by a weighted sum of the array element voltages, with the complex weight adjusted so that all outputs have the same phase for that direction. Alternatively, beams can also be formed from the weighted sum of the short time averaged correlation (visibility) data. We shall call these two approaches the electric voltage beam forming (EBF) and cross-correlation beam forming (XBF), respectively. All beams formed with the EBF can also be formed by the XBF method, but the latter can also generate beams which can not be generated by the former. We discuss the properties of these two kinds of beams, and the amount of computation required in each case. For an array with large number of elements, the XBF would require much more computation resource, although this is partly compensated by the fact that it allows integration over time. We study the impact of cross-coupling between array elements on the beamforming, first using a toy model, then for the case of the Tianlai Cylinder Pathfinder Array. In both cases, we find that the impact of the cross-coupling on the beam profile is relatively small. The understanding gained in this study is helpful in designing and understanding the beam-forming FRB digital backend for compact arrays such as the Tianlai array.

astro-ph.IM

Measurement of the Primary Beam of the Tianlai Cylindrical Antenna Using an Unmanned Aerial Vehicle

The Tianlai Cylinder Pathfinder Array consists of three adjacent cylindrical reflectors fixed on the ground, each 40 meters long and 15 meters wide, with the cylinder axis oriented along the North-South (N-S)direction. Dual linear polarisation feeds are distributed along the focus line, parallel to the cylinder axis. Measurement of the primary beam profile of these cylindrical reflectors is difficult, as they are too large to be placed in an anechoic chamber. While the beam profile along the East-West (E-W) direction can be measured with the transit observations of bright astronomical radio sources, the beam profile along the N-S direction remains very uncertain. We present a preliminary measurement of the beam profile of the Tianlai cylindrical antenna along both the N-S direction and E-W direction in the frequency range of 700-800 MHz, using a calibrator source carried by an unmanned aerial vehicle (UAV) flying in the far field. The beam profile of the Tianlai cylindrical antenna is determined from the analysis of the auto-correlation signals from the the cylinder array correlator, taking into account the emitter antenna beam profile, itself measured with a dipole antenna on the ground. The accuracy of the UAV-based determination of the cylinder beam profiles is validated by comparing the results with the one derived from bright astronomical source transits, and with simulated beams.

astro-ph.IM

CRAFTS for HI cosmology: I. data processing pipeline and validation tests

We present the calibration procedures and validation of source measurement with the data of the Commensal Radio Astronomy FAST Survey (CRAFTS) for \HI intensity mapping by the Five-hundred-meter Aperture Spherical Radio Telescope (FAST). Using 70-hour drift-scan observation with the L-band (1.05-1.45GHz) 19-beam receiver, we obtain the data covering $270\,\rm deg^2$ sky area. We employ both the pulsar backend and the spectrum backend to calibrate the spectral time-ordered-data (TOD) before projecting them onto HEALPix maps. We produce calibrated TOD with frequency resolution of 30kHz and time resolution of 1s and the map data-cube with frequency resolution of 30kHz and spatial resolution of $2.95\,\rm arcmin^2$. We examine the pointing errors, noise overflow, RFI contamination and their effect on the data quality. The resulting noise level is $\sim$ 5.7mJy for the calibrated TOD and 1.6mJy for the map, consistent with the theoretical predictions within 5\% at RFI-free channels. We also validate the data by Principal Components Analysis (PCA) and find the residual map looks thermal noise dominated after removing 30 modes. We identify 447 isolated bright continuum sources in our data matching the NRAO-VLA Sky Survey (NVSS) catalog, with relative flux error of 8.3\% for TOD and 6.6\% for the map-level. We also measure the \HI emission of 90 galaxies with redshift $z<0.07$ and compare with \HI-MaNGA spectra, yielding an overall relative \HI integral flux error of 16.7\%. These results provide an important first step in assessing the feasibility of conducting cosmological \HI detection with CRAFTS.

astro-ph.CO

The FRB-searching pipeline of the Tianlai Cylinder Pathfinder Array

This paper presents the design, calibration, and survey strategy of the Fast Radio Burst (FRB) digital backend and its real-time data processing pipeline employed in the Tianlai Cylinder Pathfinder array. The array, consisting of three parallel cylindrical reflectors and equipped with 96 dual-polarization feeds, is a radio interferometer array designed for conducting drift scans of the northern celestial semi-sphere. The FRB digital backend enables the formation of 96 digital beams, effectively covering an area of approximately 40 square degrees with 3 dB beam. Our pipeline demonstrates the capability to make automatic search of FRBs, detecting at quasi-real-time and classify FRB candidates automatically. The current FRB searching pipeline has an overall recall rate of 88\%. During the commissioning phase, we successfully detected signals emitted by four well-known pulsars: PSR B0329+54, B2021+51, B0823+26, and B2020+28. We report the first discovery of an FRB by our array, designated as FRB 20220414A. We also investigate the optimal arrangement for the digitally formed beams to achieve maximum detection rate by numerical simulation.

astro-ph.IM

Application of Regularization Methods in the Sky Map Reconstruction of the Tianlai Cylinder Pathfinder Array

The Tianlai cylinder pathfinder is a radio interferometer array to test 21 cm intensity mapping techniques in the post-reionization era. It works in passive drift scan mode to survey the sky visible in the northern hemisphere. To deal with the large instantaneous field of view and the spherical sky, we decompose the drift scan data into m-modes, which are linearly related to the sky intensity. The sky map is reconstructed by solving the linear interferometer equations. Due to incomplete uv coverage of the interferometer baselines, this inverse problem is usually ill-posed, and regularization method is needed for its solution. In this paper, we use simulation to investigate two frequently used regularization methods, the Truncated Singular Value Decomposition (TSVD), and the Tikhonov regularization techniques. Choosing the regularization parameter is very important for its application. We employ the generalized cross validation (GCV) method and the L-curve method to determine the optimal value. We compare the resulting maps obtained with the different regularization methods, and for the different parameters derived using the different criteria. While both methods can yield good maps for a range of regularization parameters, in the Tikhonov method the suppression of noisy modes are more gradually applied, produce more smooth maps which avoids some visual artefacts in the maps generated with the TSVD method.

astro-ph.IM

Simulation-based Inference of Reionization Parameters from 3D Tomographic 21 cm Light-cone Images -- II: Application of Solid Harmonic Wavelet Scattering Transform

The information regarding how the intergalactic medium is reionized by astrophysical sources is contained in the tomographic three-dimensional 21 cm images from the epoch of reionization. In Zhao et al. (2022a) ("Paper I"), we demonstrated for the first time that density estimation likelihood-free inference (DELFI) can be applied efficiently to perform a Bayesian inference of the reionization parameters from the 21 cm images. Nevertheless, the 3D image data needs to be compressed into informative summaries as the input of DELFI by, e.g., a trained 3D convolutional neural network (CNN) as in Paper I (DELFI-3D CNN). Here in this paper, we introduce an alternative data compressor, the solid harmonic wavelet scattering transform (WST), which has a similar, yet fixed (i.e. no training), architecture to CNN, but we show that this approach (i.e. solid harmonic WST with DELFI) outperforms earlier analyses based on 3D 21 cm images using DELFI-3D CNN in terms of credible regions of parameters. Realistic effects, including thermal noise and residual foreground after removal, are also applied to the mock observations from the Square Kilometre Array (SKA). We show that under the same inference strategy using DELFI, the 21 cm image analysis with solid harmonic WST outperforms the 21 cm power spectrum analysis. This research serves as a proof of concept, demonstrating the potential to harness the strengths of WST and simulation-based inference to derive insights from future 21 cm light-cone image data.

astro-ph.IM

A simulation of calibration and map-making errors of the Tianlai cylinder pathfinder array

The Tianlai cylinder array is a pathfinder for developing and testing 21cm intensity mapping techniques. In this paper, we use numerical simulation to assess how its measurement is affected by thermal noise and the errors in calibration and map-making process, and the error in the sky map reconstructed from a drift scan survey. Here we consider only the single frequency, unpolarized case. The beam is modelled by fitting to the electromagnetic simulation of the antenna, and the variations of the complex gains of the array elements are modelled by Gaussian processes. Mock visibility data is generated and run through our data processing pipeline. We find that the accuracy of the current calibration is limited primarily by the absolute calibration, where the error comes mainly from the approximation of a single dominating point source. We then studied the $m$-mode map-making with the help of Moore-Penrose inverse. We find that discarding modes with singular values smaller than a threshold could generate visible artifacts in the map. The impacts of the residue variation of the complex gain and thermal noise are also investigated. The thermal noise in the map varies with latitude, being minimum at the latitude passing through the zenith of the telescope. The angular power spectrum of the reconstructed map show that the current Tianlai cylinder pathfinder, which has a shorter maximum baseline length in the North-South direction, can measure modes up to $l \lesssim 2\pi b_{\rm NS}/\lambda \sim 200$ very well, but would lose a significant fraction of higher angular modes when noise is present. These results help us to identify the main limiting factors in our current array configuration and data analysis procedure, and suggest that the performance can be improved by reconfiguration of the array feed positions.

astro-ph.IM

3D ScatterNet: Inference from 21 cm Light-cones

The Square Kilometre Array (SKA) will have the sensitivity to take the 3D light-cones of the 21 cm signal from the epoch of reionization. This signal, however, is highly non-Gaussian and can not be fully interpreted by the traditional statistic using power spectrum. In this work, we introduce the 3D ScatterNet that combines the normalizing flows with solid harmonic wavelet scattering transform, a 3D CNN featurizer with inductive bias, to perform implicit likelihood inference (ILI) from 21 cm light-cones. We show that 3D ScatterNet outperforms the ILI with a fine-tuned 3D CNN in the literature. It also reaches better performance than ILI with the power spectrum for varied light-cone effects and varied signal contaminations.

astro-ph.IM

Map Reconstruction of radio observations with Conditional Invertible Neural Networks

In radio astronomy, the challenge of reconstructing a sky map from time ordered data (TOD) is known as an inverse problem. Standard map-making techniques and gridding algorithms are commonly employed to address this problem, each offering its own benefits such as producing minimum-variance maps. However, these approaches also carry limitations such as computational inefficiency and numerical instability in map-making and the inability to remove beam effects in grid-based methods. To overcome these challenges, this study proposes a novel solution through the use of the conditional invertible neural network (cINN) for efficient sky map reconstruction. With the aid of forward modeling, where the simulated TODs are generated from a given sky model with a specific observation, the trained neural network can produce accurate reconstructed sky maps. Using the five-hundred-meter aperture spherical radio telescope (FAST) as an example, cINN demonstrates remarkable performance in map reconstruction from simulated TODs, achieving a mean squared error of $2.29\pm 2.14 \times 10^{-4}~\rm K^2$, a structural similarity index of $0.968\pm0.002$, and a peak signal-to-noise ratio of $26.13\pm5.22$ at the $1σ$ level. Furthermore, by sampling in the latent space of cINN, the reconstruction errors for each pixel can be accurately quantified.

astro-ph.IM

FAST drift scan survey for HI intensity mapping: I. preliminary data analysis

This work presents the initial results of the drift-scan observation for the neutral hydrogen (HI) intensity mapping survey with the Five-hundred-meter Aperture Spherical radio Telescope (FAST). The data analyzed in this work were collected in night observations from 2019 through 2021. The primary findings are based on 28 hours of drift-scan observation carried out over seven nights in 2021, which covers $60\,{\rm deg}^2$ sky area. Our main findings are: (i) Our calibration strategy can successfully correct both the temporal and bandpass gain variation over the $4$-hour drift-scan observation. (ii) The continuum maps of the surveyed region are made with frequency resolution of $28$ kHz and pixel area of $2.95\,{\rm arcmin}^2$. The pixel noise levels of the continuum maps are slightly higher than the forecast assuming $T_{\rm sys}=20\,{\rm K}$, which are $36.0$ mK (for 10.0 s integration time) at the $1050$--$1150$ MHz band, and $25.9$ mK (for 16.7 s integration time) at the $1323$--$1450$ MHz band, respectively. (iii) The flux-weighted differential number count is consistent with the NRAO-VLA Sky Survey (NVSS) catalog down to the confusion limit $\sim7\,{\rm mJy}/{\rm beam}^{-1}$. (iv) The continuum flux measurements of the sources are consistent with that found in the literature. The difference in the flux measurement of $81$ isolated NVSS sources is about $6.3\%$. Our research offers a systematic analysis for the FAST HI intensity mapping drift-scan survey and serves as a helpful resource for further cosmology and associated galaxies sciences with the FAST drift-scan survey.

astro-ph.CO

Detecting HI Galaxies with Deep Neural Networks in the Presence of Radio Frequency Interference

In neutral hydrogen (HI) galaxy survey, a significant challenge is to identify and extract the HI galaxy signal from observational data contaminated by radio frequency interference (RFI). For a drift-scan survey, or more generally a survey of a spatially continuous region, in the time-ordered spectral data, the HI galaxies and RFI all appear as regions which extend an area in the time-frequency waterfall plot, so the extraction of the HI galaxies and RFI from such data can be regarded as an image segmentation problem, and machine learning methods can be applied to solve such problems. In this study, we develop a method to effectively detect and extract signals of HI galaxies based on a Mask R-CNN network combined with the PointRend method. By simulating FAST-observed galaxy signals and potential RFI impacts, we created a realistic data set for the training and testing of our neural network. We compared five different architectures and selected the best-performing one. This architecture successfully performs instance segmentation of HI galaxy signals in the RFI-contaminated time-ordered data (TOD), achieving a precision of 98.64% and a recall of 93.59%.

astro-ph.IM

A Semi-blind PCA-based Foreground Subtraction Method for 21 cm Intensity Mapping

The Principal Component Analysis (PCA) method and the Singular Value Decomposition (SVD) method are widely used for foreground subtraction in 21 cm intensity mapping experiments. We show their equivalence, and point out that the condition for completely clean separation of foregrounds and cosmic 21 cm signal using the PCA/SVD is unrealistic. We propose a PCA-based foreground subtraction method, dubbed "Singular Vector Projection (SVP)" method, which exploits a priori information of the left and/or right singular vectors of the foregrounds. We demonstrate with simulation tests that this new, semi-blind method can reduce the error of the recovered 21 cm signal by orders of magnitude, even if only the left and/or right singular vectors in the largest few modes are exploited. The SVP estimators provide a new, effective approach for 21 cm observations to remove foregrounds and uncover the physics in the cosmic 21 cm signal.

astro-ph.CO