arXiv subjects

Yi Mao

Publications and source records attributed to Yi Mao.

At least 73 records · Page 4Linked to original sources

arXiv2020

The Breakdown Scale of HI Bias Linearity

The 21 cm intensity mapping experiments promise to obtain the large-scale distribution of HI gas at the post-reionization epoch. In order to reveal the underlying matter density fluctuations from the HI mapping, it is important to understand how HI gas traces the matter density distribution. Both nonlinear halo clustering and nonlinear effects modulating HI gas in halos may determine the scale below which the HI bias deviates from linearity. We employ three approaches to generate the mock HI density from a large-scale N-body simulation at low redshifts, and demonstrate that the assumption of HI linearity is valid at the scale corresponding to the first peak of baryon acoustic oscillations, but breaks down at $k \gtrsim 0.1\,h\, {\rm Mpc}^{-1}$. The nonlinear effects of halo clustering and HI content modulation counteract each other at small scales, and their competition results in a model-dependent "sweet-spot" redshift near $z$=1 where the HI bias is scale-independent down to small scales. We also find that the linear HI bias scales approximately linearly with redshift for $z\le 3$.

astro-ph.CO↗

arXiv2020

Ly$α$ forest power spectrum as an emerging window into the epoch of reionization and cosmic dawn

Conventional wisdom was that thermal relics from the epoch of reionization (EOR) would vanish swiftly. Recently, however, it was shown that these relics can survive to lower redshifts ($z \sim 2$) than previously thought, due to gas at mean density being heated to $T \sim 3 \times 10^4$ K by reionization, which is inhomogeneous, and shocks. Given the high sensitivities of upcoming Ly$α$ forest surveys, this effect will be a novel broadband systematic for cosmological application. From the astrophysical point of view, however, the imprint of inhomogeneous reionization can shed light on the EOR and cosmic dawn. We utilize a hybrid method -- which includes two different simulation codes capable of handling the huge dynamical range -- to show the impact of patchy reionization on the Ly$α$ forest and its dependence on different astrophysical scenarios. We found statistically significant deviations in the 1D Ly$α$ power spectrum at $k = 0.14$ cMpc$^{-1}$ that range from $\sim 1\%$ at $z = 2$ up to almost $\sim 20\%$ at $z = 4$. The deviations in the 3D Ly$α$ power spectrum, at the same wavenumber, are large and range from a few per cent at $z = 2$ up to $\sim 50\%$ at $z = 4$, although these deviations ignore the effect of He II reionization and AGN feedback at $z<4$. By exploiting different $k$-dependence of power spectrum among various astrophysical scenarios, the effect of patchy reionization on the Ly$α$ forest power spectrum can open a new window into cosmic reionization and possibly cosmic dawn.

astro-ph.CO↗

arXiv2020

Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning

In this work, we aim at equipping pre-trained language models with structured knowledge. We present two self-supervised tasks learning over raw text with the guidance from knowledge graphs. Building upon entity-level masked language models, our first contribution is an entity masking scheme that exploits relational knowledge underlying the text. This is fulfilled by using a linked knowledge graph to select informative entities and then masking their mentions. In addition we use knowledge graphs to obtain distractors for the masked entities, and propose a novel distractor-suppressed ranking objective which is optimized jointly with masked language model. In contrast to existing paradigms, our approach uses knowledge graphs implicitly, only during pre-training, to inject language models with structured knowledge via learning from raw text. It is more efficient than retrieval-based methods that perform entity linking and integration during finetuning and inference, and generalizes more effectively than the methods that directly learn from concatenated graph triples. Experiments show that our proposed model achieves improved performance on five benchmark datasets, including question answering and knowledge base completion tasks.

cs.CL↗

arXiv2020

Conditional Self-Attention for Query-based Summarization

Self-attention mechanisms have achieved great success on a variety of NLP tasks due to its flexibility of capturing dependency between arbitrary positions in a sequence. For problems such as query-based summarization (Qsumm) and knowledge graph reasoning where each input sequence is associated with an extra query, explicitly modeling such conditional contextual dependencies can lead to a more accurate solution, which however cannot be captured by existing self-attention mechanisms. In this paper, we propose \textit{conditional self-attention} (CSA), a neural network module designed for conditional dependency modeling. CSA works by adjusting the pairwise attention between input tokens in a self-attention module with the matching score of the inputs to the given query. Thereby, the contextual dependencies modeled by CSA will be highly relevant to the query. We further studied variants of CSA defined by different types of attention. Experiments on Debatepedia and HotpotQA benchmark datasets show CSA consistently outperforms vanilla Transformer and previous models for the Qsumm problem.

cs.CL↗

arXiv2019

The impact of inhomogeneous subgrid clumping on cosmic reionization

Cosmic reionization was driven by the imbalance between early sources and sinks of ionizing radiation, both of which were dominated by small-scale structure and are thus usually treated in cosmological reionization simulations by subgrid modelling. The recombination rate of intergalactic hydrogen is customarily boosted by a subgrid clumping factor, ${\left /\left ^2}$, which corrects for unresolved fluctuations in gas density ${n}$ on scales below the grid-spacing of coarse-grained simulations. We investigate in detail the impact of this inhomogeneous subgrid clumping on reionization and its observables, as follows: (1) Previous attempts generally underestimated the clumping factor because of insufficient mass resolution. We perform a high-resolution $N$-body simulation that resolves haloes down to the pre-reionization Jeans mass to derive the time-dependent, spatially-varying local clumping factor and a fitting formula for its correlation with local overdensity. (2) We then perform a large-scale $N$-body and radiative transfer simulation that accounts for this inhomogeneous subgrid clumping by applying this clumping factor-overdensity correlation. Boosting recombination significantly slows the expansion of ionized regions, which delays completion of reionization and suppresses 21 cm power spectra on large scales in the later stages of reionization. (3) We also consider a simplified prescription in which the globally-averaged, time-evolving clumping factor from the same high-resolution $N$-body simulation is applied uniformly to all cells in the reionization simulation, instead. Observables computed with this model agree fairly well with those from the inhomogeneous clumping model, e.g. predicting 21 cm power spectra to within 20% error, suggesting it may be a useful approximation.

astro-ph.CO↗

arXiv2019

X-SQL: reinforce schema representation with context

In this work, we present X-SQL, a new network architecture for the problem of parsing natural language to SQL query. X-SQL proposes to enhance the structural schema representation with the contextual output from BERT-style pre-training model, and together with type information to learn a new schema representation for down-stream tasks. We evaluated X-SQL on the WikiSQL dataset and show its new state-of-the-art performance.

cs.CL↗

arXiv2019

Discovering the Sky at the Longest Wavelengths with Small Satellite Constellations

Due to ionosphere absorption and the interference by natural and artificial radio emissions, ground observation of the sky at the decameter or longer is very difficult. This unexplored part of electromagnetic spectrum has the potential of great discoveries, notably in the study of cosmic dark ages and dawn, but also in heliophysics and space weather, planets, cosmic ray and neutrinos, pulsar and interstellar medium, extragalactic radio sources, and even SETI. At a forum organized by the International Space Science Institute-Beijing (ISSI-BJ), we discussed the prospect of opening up this window for astronomical observations by using a constellation of small or micro-satellites. We discussed the past experiments and the current ones such as the low frequency payload on Chang'e-4 mission lander, relay satellite and the Longjiang satellite, and also the future DSL mission, which is a linear array on lunar orbit which can make synthesized map of the whole sky as well as measure the global spectrum. We also discuss the synergy with other experiments, including ground global experiments such as EDGES, SARAS, SCI-HI and High-z, PRIZM/Albatros, ground imaging facillities such as LOFAR and MWA, and space experiments such as SUNRISE, DARE/DAPPER and PRATUSH. We also discussed some technical aspects of the DSL concept.

astro-ph.IM↗

arXiv2019

Testing the scale-dependent hemispherical asymmetry with the 21-cm power spectrum from the epoch of reionization

Hemispherical power asymmetry has emerged as a new challenge to cosmology in early universe. While the cosmic microwave background (CMB) measurements indicated the asymmetry amplitude $A \simeq 0.07$ at the CMB scale $k_{\rm CMB}\simeq 0.0045\,{\rm Mpc}^{-1}$, the high-redshift quasar observations found no significant deviation from statistical isotropy. This conflict can be reconciled in some scale-dependent asymmetry models. We put forward a new parameterization of scale-dependent asymmetric power spectrum, inspired by a multi-speed inflation model. The 21-cm power spectrum from the epoch of reionization can be used to constrain the scale-dependent hemispherical asymmetry. We demonstrate that an optimum, multi-frequency observation by the Square Kilometre Array (SKA) Phase 2 can impose a constraint on the amplitude of the power asymmetry anomaly at the level of $ΔA \simeq 0.2$ at $0.056 \lesssim k_{\rm 21cm} \lesssim 0.15 \,{\rm Mpc}^{-1}$. This limit may be further improved by an order of magnitude as $ΔA \simeq 0.01$ with a cosmic variance limited experiment such as the Omniscope.

astro-ph.CO↗

arXiv2019

Signatures of Cosmic Reionization on the 21cm 2- and 3-point Correlation Function I: Quadratic Bias Modeling

The three-point correlation function (3PCF) of the 21cm brightness temperature from the Epoch of Reionization (EoR) probes complementary information to the commonly studied two-point correlation function (2PCF) about the morphology of ionized regions. We investigate the 21cm 2PCF and 3PCF in configuration space using semi-numerical simulations and test whether they can be described by the local quadratic bias model. We find that fits of bias model predictions for the 2PCF and 3PCF deviate from our measurements by $\sim 20\%$ at scales above the typical size of ionized regions ($\simeq 30$ Mpc) and at early times with global neutral fractions of $\langle x_{\rm HI} \rangle \gtrsim 0.7$. At later times and smaller scales these deviations increase strongly, indicating a break down of the bias model. The 2PCF and 3PCF fits of the linear bias parameter agree at the $10\%$ level for different EoR model configurations. This agreement holds, when adding redshift space distortions to the simulations. The relation between spatial fluctuations in the matter density and the 21cm signal, as predicted by the bias model, is consistent with direct measurements of this relation in simulations for large smoothing scales ($\gtrsim 30$ Mpc). From this latter test we conclude that negative amplitudes of the 21cm 3PCF result from negative bias parameters, which describe the anti-correlation between the matter over-densities and the 21cm signal during the EoR. However, a more detailed interpretation of the bias parameters may require a description of non-local contributions to the bias model.

astro-ph.CO↗

arXiv2019

Astro2020 Science White Paper: Synergies Between Galaxy Surveys and Reionization Measurements

The early phases of galaxy formation constitute one of the most exciting frontiers in astrophysics. It is during this era that the first luminous sources reionize the intergalactic medium - the moment when structure formation affects every baryon in the Universe. Here we argue that we will obtain a complete picture of this era by combining observations of galaxies with direct measurements of the reionization process: the former will provide a detailed understanding of bright sources, while the latter will constrain the (substantial) faint source population. We further describe how optimizing the comparison of these two measurements requires near-infrared galaxy surveys covering large volumes and retaining redshift information and also improvements in 21-cm analysis, moving those experiments into the imaging regime.

astro-ph.GA↗

arXiv2019

Astro2020 Science White Paper: Insights Into the Epoch of Reionization with the Highly-Redshifted 21-cm Line

The epoch of reionization, when photons from early galaxies ionized the intergalactic medium about a billion years after the Big Bang, is the last major phase transition in the Universe's history. Measuring the characteristics of the transition is important for understanding early galaxies and the cosmic web and for modeling dwarf galaxies in the later Universe. But such measurements require probes of the intergalactic medium itself. Here we describe how the 21-cm line of neutral hydrogen provides a powerful probe of the reionization process and therefore important constraints on both the galaxies and intergalactic absorbers at that time. While existing experiments will make precise statistical measurements over the next decade, we argue that improved 21-cm analysis techniques - allowing imaging of the neutral gas itself - as well as improved theoretical models, are crucial for testing our understanding of this important era.

astro-ph.CO↗

arXiv2019

Astro 2020 Science White Paper: Fundamental Cosmology in the Dark Ages with 21-cm Line Fluctuations

The Dark Ages are the period between the last scattering of the cosmic microwave background and the appearance of the first luminous sources, spanning approximately 1100 < z < 30. The only known way to measure fluctuations in this era is through the 21-cm line of neutral hydrogen. Such observations have enormous potential for cosmology, because they span a large volume while the fluctuations remain linear even on small scales. Observations of 21-cm fluctuations during this era can therefore constrain fundamental aspects of our Universe, including inflation and any exotic physics of dark matter. While the observational challenges to these low-frequency 21-cm observations are enormous, especially from the terrestrial environment, they represent an important goal for cosmology.

astro-ph.CO↗

arXiv2019

Astro2020 Science White Paper: First Stars and Black Holes at Cosmic Dawn with Redshifted 21-cm Observations

The "cosmic dawn" refers to the period of the Universe's history when stars and black holes first formed and began heating and ionizing hydrogen in the intergalactic medium (IGM). Though exceedingly difficult to detect directly, the first stars and black holes can be constrained indirectly through measurements of the cosmic 21-cm background, which traces the ionization state and temperature of intergalactic hydrogen gas. In this white paper, we focus on the science case for such observations, in particular those targeting redshifts z $\gtrsim$ 10 when the IGM is expected to be mostly neutral. 21-cm observations provide a unique window into this epoch and are thus critical to advancing first star and black hole science in the next decade.

astro-ph.CO↗

arXiv2019

Cosmology with the Highly Redshifted 21cm Line

In addition to being a probe of Cosmic Dawn and Epoch of Reionization astrophysics, the 21cm line at $z>6$ is also a powerful way to constrain cosmology. Its power derives from several unique capabilities. First, the 21cm line is sensitive to energy injections into the intergalactic medium at high redshifts. It also increases the number of measurable modes compared to existing cosmological probes by orders of magnitude. Many of these modes are on smaller scales than are accessible via the CMB, and moreover have the advantage of being firmly in the linear regime (making them easy to model theoretically). Finally, the 21cm line provides access to redshifts prior to the formation of luminous objects. Together, these features of 21cm cosmology at $z>6$ provide multiple pathways toward precise cosmological constraints. These include the "marginalizing out" of astrophysical effects, the utilization of redshift space distortions, the breaking of CMB degeneracies, the identification of signatures of relative velocities between baryons and dark matter, and the discovery of unexpected signs of physics beyond the $Λ$CDM paradigm at high redshifts.

astro-ph.CO↗

arXiv2019

Mapping Cosmic Dawn and Reionization: Challenges and Synergies

Cosmic dawn and the Epoch of Reionization (EoR) are among the least explored observational eras in cosmology: a time at which the first galaxies and supermassive black holes formed and reionized the cold, neutral Universe of the post-recombination era. With current instruments, only a handful of the brightest galaxies and quasars from that time are detectable as individual objects, due to their extreme distances. Fortunately, a multitude of multi-wavelength intensity mapping measurements, ranging from the redshifted 21 cm background in the radio to the unresolved X-ray background, contain a plethora of synergistic information about this elusive era. The coming decade will likely see direct detections of inhomogenous reionization with CMB and 21 cm observations, and a slew of other probes covering overlapping areas and complementary physical processes will provide crucial additional information and cross-validation. To maximize scientific discovery and return on investment, coordinated survey planning and joint data analysis should be a high priority, closely coupled to computational models and theoretical predictions.

astro-ph.CO↗

arXiv2019

Cosmic Dawn and Reionization: Astrophysics in the Final Frontier

The cosmic dawn and epoch of reionization mark the time period in the universe when stars, galaxies, and blackhole seeds first formed and the intergalactic medium changed from neutral to an ionized one. Despite substantial progress with multi-wavelength observations, astrophysical process during this time period remain some of the least understood with large uncertainties on our existing models of galaxy, blackhole, and structure formation. This white paper outlines the current state of knowledge and anticipated scientific outcomes with ground and space-based astronomical facilities in the 2020s. We then propose a number of scientific goals and objectives for new facilities in late 2020s to mid 2030s that will lead to definitive measurements of key astrophysical processes in the epoch of reionization and cosmic dawn.

astro-ph.GA↗

arXiv2018

IncSQL: Training Incremental Text-to-SQL Parsers with Non-Deterministic Oracles

We present a sequence-to-action parsing approach for the natural language to SQL task that incrementally fills the slots of a SQL query with feasible actions from a pre-defined inventory. To account for the fact that typically there are multiple correct SQL queries with the same or very similar semantics, we draw inspiration from syntactic parsing techniques and propose to train our sequence-to-action models with non-deterministic oracles. We evaluate our models on the WikiSQL dataset and achieve an execution accuracy of 83.7% on the test set, a 2.1% absolute improvement over the models trained with traditional static oracles assuming a single correct target SQL query. When further combined with the execution-guided decoding strategy, our model sets a new state-of-the-art performance at an execution accuracy of 87.1%.

cs.CL↗

arXiv2018

Robust Text-to-SQL Generation with Execution-Guided Decoding

We consider the problem of neural semantic parsing, which translates natural language questions into executable SQL queries. We introduce a new mechanism, execution guidance, to leverage the semantics of SQL. It detects and excludes faulty programs during the decoding procedure by conditioning on the execution of partially generated program. The mechanism can be used with any autoregressive generative model, which we demonstrate on four state-of-the-art recurrent or template-based semantic parsing models. We demonstrate that execution guidance universally improves model performance on various text-to-SQL datasets with different scales and query complexity: WikiSQL, ATIS, and GeoQuery. As a result, we achieve new state-of-the-art execution accuracy of 83.8% on WikiSQL.

cs.CL↗