arXiv subjects

Ying Qin

Publications and source records attributed to Ying Qin.

At least 55 records · Page 3Linked to original sources

arXiv2022

Explicitly Increasing Input Information Density for Vision Transformers on Small Datasets

Vision Transformers have attracted a lot of attention recently since the successful implementation of Vision Transformer (ViT) on vision tasks. With vision Transformers, specifically the multi-head self-attention modules, networks can capture long-term dependencies inherently. However, these attention modules normally need to be trained on large datasets, and vision Transformers show inferior performance on small datasets when training from scratch compared with widely dominant backbones like ResNets. Note that the Transformer model was first proposed for natural language processing, which carries denser information than natural images. To boost the performance of vision Transformers on small datasets, this paper proposes to explicitly increase the input information density in the frequency domain. Specifically, we introduce selecting channels by calculating the channel-wise heatmaps in the frequency domain using Discrete Cosine Transform (DCT), reducing the size of input while keeping most information and hence increasing the information density. As a result, 25% fewer channels are kept while better performance is achieved compared with previous work. Extensive experiments demonstrate the effectiveness of the proposed approach on five small-scale datasets, including CIFAR-10/100, SVHN, Flowers-102, and Tiny ImageNet. The accuracy has been boosted up to 17.05% with Swin and Focal Transformers. Codes are available at https://github.com/xiangyu8/DenseVT.

cs.CV↗

arXiv2022

Identification of exciton complexes in a charge-tuneable Janus WSeS monolayer

Janus transition-metal dichalcogenide monolayers are fully artificial materials, where one plane of chalcogen atoms is replaced by chalcogen atoms of a different type. Theory predicts an in-built out-of-plane electric field, giving rise to long-lived, dipolar excitons, while preserving direct-bandgap optical transitions in a uniform potential landscape. Previous Janus studies had broad photoluminescence (>15 meV) spectra obfuscating their excitonic origin. Here, we identify the neutral, and negatively charged inter- and intravalley exciton transitions in Janus WSeS monolayer with $\sim 6$ meV optical linewidth. We combine a recently developed synthesis technique, with the integration of Janus monolayers into vertical heterostructures, allowing doping control. Further, magneto-optic measurements indicate that monolayer WSeS has a direct bandgap at the K points. This work provides the foundation for applications such as nanoscale sensing, which relies on resolving excitonic energy shifts, and photo-voltaic energy harvesting, which requires efficient creation of long-lived excitons and integration into vertical heterostructures.

cond-mat.mes-hall↗

arXiv2022

A possible 250-second X-ray quasi-periodicity in the fast blue optical transient AT2018cow

The fast blue optical transients (FBOTs) are a new population of extragalactic transients of unclear physical origin. A variety of mechanisms have been proposed including failed supernova explosion, shock interaction with a dense medium, young magnetar, accretion onto a compact object, and stellar tidal disruption event, but none is conclusive. Here we report the discovery of a possible X-ray quasi-periodicity signal with a period of $\sim$250 second (at a significance level of 99.76%) in the brightest FBOT AT2018cow through the analysis of XMM-Newton/PN data. The signal is independently detected at the same frequency in the average power density spectrum from data taken from the Swift telescope, with observations covering from 6 to 37 days after the optical discovery, though the significance level is lower (94.26%). This suggests that the QPO frequency may be stable over at least 1.1$\times$ 10$^{4}$ cycles. Assuming the $\sim$250 second QPO to be a scaled-down analogue of that typically seen in stellar mass black holes, a black hole mass of $\sim10^{3}-10^{5}$ solar masses could be inferred. The overall X-ray luminosity evolution could be modeled with the stellar tidal disruption by a black hole of $\sim10^4$ solar masses, providing a viable mechanism to produce AT2018cow. Our findings suggest that other bright FBOTs may also harbor intermediate-mass black holes.

astro-ph.HE↗

arXiv2022

The formation of the stripped envelope type II b Supernova progenitors: Rotation, Metallicity and Overshooting

Type IIb supernovae are believed to originate from core-collapse progenitors having kept only a very thin hydrogen envelope. We aim to explore how some physical factors, such as rotation, metallicity, overshooting, and the initial orbital period in binaries, significantly affect the Roche lobe overflow and the formation of type IIb supernovae. It is found that binaries are the main channel that capable of producing type typeIIb supernovae progenitors in the mass range for initial masses below 20 $M_{\odot}$. The formation of type IIb supernova progenitors is extremely sensitive to the initial orbital period. A less massive hydrogen indicates smaller radius and a higher effective temperatures, and vice versa. Binary systems with initial periods between 300 and 720 days produce type IIb progenitors that are a red supergiant. Those with an initial period between 50 and 300 days produce yellow supergiant progenitors and those with initial periods shorter than 50 days, blue supergiant progenitors. Both rapid rotation and larger overshooting can enlarge the carbon-oxygen core mass and lead to higher core temperature and lower central density at the pre-collapse phase. They are also beneficial to surface nitrogen enrichment but restrict the efficiency of the first dredge-up. SN IIb progenitors with low metallicity have smaller hydrogen envelope masses and radii than the high metallicity counterparts. Ultra-stripped binary models have systematically higher core mass fraction $\rm ^{12}C$ left, which has important influence on the compactness of type IIb progenitors.

astro-ph.SR↗

arXiv2022

POSYDON: A General-Purpose Population Synthesis Code with Detailed Binary-Evolution Simulations

Most massive stars are members of a binary or a higher-order stellar systems, where the presence of a binary companion can decisively alter their evolution via binary interactions. Interacting binaries are also important astrophysical laboratories for the study of compact objects. Binary population synthesis studies have been used extensively over the last two decades to interpret observations of compact-object binaries and to decipher the physical processes that lead to their formation. Here, we present POSYDON, a novel, binary population synthesis code that incorporates full stellar-structure and binary-evolution modeling, using the MESA code, throughout the whole evolution of the binaries. The use of POSYDON enables the self-consistent treatment of physical processes in stellar and binary evolution, including: realistic mass-transfer calculations and assessment of stability, internal angular-momentum transport and tides, stellar core sizes, mass-transfer rates and orbital periods. This paper describes the detailed methodology and implementation of POSYDON, including the assumed physics of stellar- and binary-evolution, the extensive grids of detailed single- and binary-star models, the post-processing, classification and interpolation methods we developed for use with the grids, and the treatment of evolutionary phases that are not based on pre-calculated grids. The first version of POSYDON targets binaries with massive primary stars (potential progenitors of neutron stars or black holes) at solar metallicity.

astro-ph.SR↗

arXiv2022

Long-duration Gamma-ray Burst and Associated Kilonova Emission from Fast-spinning Black Hole--Neutron Star Mergers

Here we collect three unique bursts, GRBs\,060614, 211211A and 211227A, all characterized by a long-duration main emission (ME) phase and a rebrightening extended emission (EE) phase, to study their observed properties and the potential origin as neutron star-black hole (NSBH) mergers. NS-first-born (BH-first-born) NSBH mergers tend to contain fast-spinning (non-spinning) BHs that more easily (hardly) allow tidal disruption to happen with (without) forming electromagnetic signals. We find that NS-first-born NSBH mergers can well interpret the origins of these three GRBs, supported by that: (1) Their X-ray MEs and EEs show unambiguous fall-back accretion signatures, decreasing as $\propto{t}^{-5/3}$, which might account for their long duration. The EEs can result from the fall-back accretion of $r$-process heating materials, predicted to occur after NSBH mergers. (2) The beaming-corrected local event rate density for this type of merger-origin long-duration GRBs is $\mathcal{R}_0\sim2.4^{+2.3}_{-1.3}\,{\rm{Gpc}}^{-3}\,{\rm{yr}}^{-1}$, consistent with that of NS-first-born NSBH mergers. (3) Our detailed analysis on the EE, afterglow and kilonova of the recently high-impact event GRB\,211211A reveals it could be a merger between a $\sim1.23^{+0.06}_{-0.07}\,M_\odot$ NS and a $\sim8.21^{+0.77}_{-0.75}\,M_\odot$ BH with an aligned-spin of $χ_{\rm{BH}}\sim0.62^{+0.06}_{-0.07}$, supporting an NS-first-born NSBH formation channel. Long-duration burst with rebrightening fall-back accretion signature after ME, and bright kilonova might be commonly observed features for on-axis NSBHs. We estimate the multimessenger detection rate between gravitational waves, GRBs and kilonovae from NSBH mergers in O4 (O5) is $\sim0.1\,{\rm{yr}}^{-1}$ ($\sim1\,{\rm{yr}}^{-1}$).

astro-ph.HE↗

arXiv2022

Neighbors Are Not Strangers: Improving Non-Autoregressive Translation under Low-Frequency Lexical Constraints

However, current autoregressive approaches suffer from high latency. In this paper, we focus on non-autoregressive translation (NAT) for this problem for its efficiency advantage. We identify that current constrained NAT models, which are based on iterative editing, do not handle low-frequency constraints well. To this end, we propose a plug-in algorithm for this line of work, i.e., Aligned Constrained Training (ACT), which alleviates this problem by familiarizing the model with the source-side context of the constraints. Experiments on the general and domain datasets show that our model improves over the backbone constrained NAT model in constraint preservation and translation quality, especially for rare constraints.

cs.CL↗

arXiv2022

A Channel to Form Fast-spinning Black Hole--Neutron Star Binary Mergers as Multi-messenger Sources

After the successful detection of a gravitational-wave (GW) signal and its associated electromagnetic (EM) counterparts from GW170817, neutron star--black hole (NSBH) mergers have been highly expected to be the next type of multi-messenger source. However, despite the detection of several of NSBH merger candidates during the GW third observation run, no confirmed EM counterparts from these sources have been identified. The most plausible explanation is that these NSBH merger candidates were plunging events mainly because the primary BHs had near-zero projected aligned-spins based on GW observations. In view that NSs can be easily tidally disrupted by BHs with high projected aligned-spins, we study an evolution channel to form NSBH binaries with fast-spinning BHs, the properties of BH mass and spin, and their associated tidal disruption probability. We find that if the NSs are born firstly, the companion helium stars would be tidally spun up efficiently, and would thus finally form fast-spinning BHs. If BHs do not receive significant natal kicks at birth, these NSBH binaries that can merge within the Hubble time would have BHs with the projected aligned-spins $χ_{z}\gtrsim0.8$ and, hence, can certainly allow tidal disruption to happen. Even if significant BH kicks are considered for a small fraction of NSBH binaries, the projected aligned-spins of BHs are $χ_z\gtrsim0.2$. These systems can still be disrupted events unless the NSs are very massive. Thus, NS-first-born NSBH mergers would be promising multi-messenger sources. We discuss various potential EM counterparts associated with these systems and their detectability in the upcoming fourth observation run.

astro-ph.HE↗

arXiv2022

Population Properties of Gravitational-Wave Neutron Star--Black Hole Mergers

Over the course of the third observing run of LIGO-Virgo-KAGRA Collaboration, several gravitational-wave (GW) neutron star--black hole (NSBH) candidates have been announced. By assuming these candidates are real signals and of astrophysical origins, we analyze the population properties of the mass and spin distributions for GW NSBH mergers. We find that the primary BH mass distribution of NSBH systems, whose shape is consistent with that inferred from the GW binary BH (BBH) primaries, can be well described as a power-law with an index of $α= 4.8^{+4.5}_{-2.8}$ plus a high-mass Gaussian component peaking at $\sim33^{+14}_{-9}\,M_\odot$. The NS mass spectrum could be shaped as a near flat distribution between $\sim1.0-2.1\,M_\odot$. The constrained NS maximum mass agrees with that inferred from NSs in our Galaxy. If GW190814 and GW200210 are NSBH mergers, the posterior results of the NS maximum mass would be always larger than $\sim2.5\,M_\odot$ and significantly deviate from that inferred in the Galactic NSs. The effective inspiral spin and effective precession spin of GW NSBH mergers are measured to potentially have near-zero distributions. The negligible spins for GW NSBH mergers imply that most events in the universe should be plunging events, which supports the standard isolated formation channel of NSBH binaries. More NSBH mergers to be discovered in the fourth observing run would help to more precisely model the population properties of cosmological NSBH mergers.

astro-ph.HE↗

arXiv2022

Hypercritical Accretion for Black Hole High Spin in Cygnus X-1

Recent observations of AdLIGO and Virgo have shown that the spin measurements in binary black hole (BH) systems are typically small, which is consistent with the predictions by the classical isolated binary evolution channel. In this standard formation channel, the progenitor of the first-born BH is assumed to have efficient angular momentum transport. The BH spins in high-mass X-ray binaries (HMXBs), however, have been found consistently to be extremely high. In order to explain the high BH spins, the inefficient angular momentum transport inside the BH progenitor is required. This requirement, however, is incompatible with the current understanding of conventional efficient angular momentum transport mechanism. We find that this tension can be highly alleviated as long as the hypercritical accretion is allowed. We show that, for a case study of Cygnus X-1, the hypercritical accretion cannot only be a good solution for the inconsistent assumption upon the angular momentum transport within massive stars, but match its other properties reported recently.

astro-ph.HE↗

arXiv2021

Probing the progenitors of spinning binary black-hole mergers with long gamma-ray bursts

Long-duration gamma-ray bursts are thought to be associated with the core-collapse of massive, rapidly spinning stars and the formation of black holes. However, efficient angular momentum transport in stellar interiors, currently supported by asteroseismic and gravitational-wave constraints, leads to predominantly slowly-spinning stellar cores. Here, we report on binary stellar evolution and population synthesis calculations, showing that tidal interactions in close binaries not only can explain the observed sub-population of spinning, merging binary black holes but also lead to long gamma-ray bursts at the time of black-hole formation. Given our model calibration against the distribution of isotropic-equivalent energies of luminous long gamma-ray bursts, we find that ~10% of the GWTC-2 reported binary black holes had a luminous long gamma-ray burst associated with their formation, with GW190517 and GW190719 having a probability of ~85% and ~60%, respectively, being among them. Moreover, given an assumption about their average beaming fraction, our model predicts the rate density of long gamma-ray bursts, as a function of redshift, originating from this channel. For a constant beaming fraction $f_\mathrm{B}\sim 0.05$ our model predicts a rate density comparable to the observed one, throughout the redshift range, while, at redshift $z \in [0,2.5]$, a tentative comparison with the metallicity distribution of observed LGRB host galaxies implies that between 20% to 85% of the observed long gamma-ray bursts may originate from progenitors of merging binary black holes. The proposed link between a potentially significant fraction of observed, luminous long gamma-ray bursts and the progenitors of spinning binary black-hole mergers allows us to probe the latter well outside the horizon of current-generation gravitational wave observatories, and out to cosmological distances.

astro-ph.HE↗

arXiv2021

On the Angular Momentum Transport Efficiency within the Star Constrained from Gravitational-wave Observations

The LIGO Scientific Collaboration and Virgo Collaboration (LVC) have recently reported in GWTC-2.1 eight additional candidate events with a probability of astrophysical origin greater than 0.5 in the LVC deeper search on O3a running. In GWTC-2.1, the majority of the effective inspiral spins ($χ_{\rm eff}$) show magnitudes consistent with zero, while two (GW190403$_{-}$051519 and GW190805$_{-}$211137) of the eight new events have $χ_{\rm eff}$ $> 0$ (at 90% credibility). We note that GW190403$_{-}$051519 was reported with $χ_{\rm eff}$ = $0.70^{+0.15}_{-0.27}$ and mass ratio $q$ = $0.25^{+0.54}_{-0.11}$, respectively. Assuming a uniform prior probability between 0 and 1 for each black hole's dimensionless spin magnitude, GW190403$_{-}$051519 was reported with the dimensionless spin of the more massive black hole, $χ_1$ = $0.92^{+0.07}_{-0.22}$. This is the fastest first-born black hole ever measured in all current gravitational-wave events. If GW190403$_{-}$051519 is formed through isolated binary evolution channel, this extremely high spin challenges, at least in that case, the existence of efficient angular momentum transport mechanism between the stellar core and the radiative envelope of massive stars, as for instance predicted by the Tayler-Spruit dynamo (Spruit 2002) or its revised version by Fuller et al. 2019.

astro-ph.HE↗

arXiv2021

Constraining the circumburst medium of gamma-ray bursts with X-ray afterglows

Long gamma-ray bursts (GRBs) are considered to be originated from core collapse of massive stars. It is believed that the afterglow property is determined by the density of the material in the surrounding interstellar medium. Therefore, the circumburst density can be used to distinguish between an interstellar wind $n(R) \propto R^{\rm -k}$, and a constant density medium (ISM), $n(R) = const$. Previous studies with different afterglow samples, show that the circumburst medium of GRBs is neither simply supported by an interstellar wind, nor completely favored by an ISM. In this work, our new sample is consisted of 39 GRBs with smoothly onset bump-like features in early X-ray afterglows, in which 20 GRBs have the redshift measurements. By using a smooth broken power law function to fit the bumps of X-ray light curves, we derive the full width at half-maximum (FWHM) as the feature width ($ω$), as well as the rise and decay time scales of the bumps ($T_{\rm r}$ and $T_{\rm d}$). The correlations between the timescales of X-ray bumps are similar to those found previously in the optical afterglows. Based on the fireball forward shock (FS) model of the thin shell case, we obtain the distribution of the electron spectral index $p$, and further constrain the medium density distribution index $k$. The new inferred $k$ is found to be concentrated at 1.0, with a range from 0.2 to 1.8. This finding is consistent with previous studies. The conclusion of our detailed investigation for X-ray afterglows suggests that the ambient medium of the selected GRBs is not homogeneous, i.e., neither ISM nor the typical interstellar wind.

astro-ph.HE↗

arXiv2021

Close binary evolution based on Gaia DR2: the origin of late WC-type Wolf-Rayet stars with low luminosity

The observed late-type WC Wolf-Rayet stars (WC7-9) with low luminosity below $\rm \log L/L_{\odot} < 5.4$ in the HR diagram cannot be reproduced satisfactorily by the evolutionary track of single stars. The mass transfer due to Roche lobe overflow drastically modifies the internal structure and surface compositions of two components. Therefore, binaries provide a very promising evolutionary channel to produce these WC stars.

astro-ph.SR↗

arXiv2021

Mass and effective spin distributions of binary black hole events: Evidence for a population of hierarchical black hole mergers in active galactic nuclei disks

The origins of the coalescing binary black holes (BBHs) detected by the advanced LIGO/Virgo are still in debate and clues may present in the mass and effective spin ($χ_{\rm eff}$) distributions of these merger events. Here we analyze the GWTC-1 and GWTC-2.1 BBH events, and find evidence for a primary mass dependent $χ_{\rm eff}$ distribution. Below (above) the mass of $\sim 50M_\odot$, a nearly zero (relatively high) effective spin is typical. In the joint analysis of the primary mass and $χ_{\rm eff}$ distributions, we identify a sub-population of BBHs characterized by both a bump-like primary mass distribution extending to $\sim 100M_\odot$ and a relatively high $χ_{\rm eff}\sim 0.3$, consistent with the expectation for the $\geq 2$g merger events in the disks of active galactic nuclei (AGNs). Our results suggest that the merger rate in AGN disks is around $1.7~{\rm Gpc}^{-3}{\rm yr}^{-1}$.

astro-ph.HE↗

arXiv2021

A study on the efficacy of model pre-training in developing neural text-to-speech system

In the development of neural text-to-speech systems, model pre-training with a large amount of non-target speakers' data is a common approach. However, in terms of ultimately achieved system performance for target speaker(s), the actual benefits of model pre-training are uncertain and unstable, depending very much on the quantity and text content of training data. This study aims to understand better why and how model pre-training can positively contribute to TTS system performance. It is postulated that the pre-training process plays a critical role in learning text-related variation in speech, while further training with the target speaker's data aims to capture the speaker-related variation. Different test sets are created with varying degrees of similarity to target speaker data in terms of text content. Experiments show that leveraging a speaker-independent TTS trained on speech data with diverse text content can improve the target speaker TTS on domain-mismatched text. We also attempt to reduce the amount of pre-training data for a new text domain and improve the data and computational efficiency. It is found that the TTS system could achieve comparable performance when the pre-training data is reduced to 1/8 of its original size.

eess.AS↗

arXiv2021

Exploiting Pre-Trained ASR Models for Alzheimer's Disease Recognition Through Spontaneous Speech

Alzheimer's disease (AD) is a progressive neurodegenerative disease and recently attracts extensive attention worldwide. Speech technology is considered a promising solution for the early diagnosis of AD and has been enthusiastically studied. Most recent works concentrate on the use of advanced BERT-like classifiers for AD detection. Input to these classifiers are speech transcripts produced by automatic speech recognition (ASR) models. The major challenge is that the quality of transcription could degrade significantly under complex acoustic conditions in the real world. The detection performance, in consequence, is largely limited. This paper tackles the problem via tailoring and adapting pre-trained neural-network based ASR model for the downstream AD recognition task. Only bottom layers of the ASR model are retained. A simple fully-connected neural network is added on top of the tailored ASR model for classification. The heavy BERT classifier is discarded. The resulting model is light-weight and can be fine-tuned in an end-to-end manner for AD recognition. Our proposed approach takes only raw speech as input, and no extra transcription process is required. The linguistic information of speech is implicitly encoded in the tailored ASR model and contributes to boosting the performance. Experiments show that our proposed approach outperforms the best manual transcript-based RoBERTa by an absolute margin of 4.6% in terms of accuracy. Our best-performing models achieve the accuracy of 83.2% and 78.0% in the long-audio and short-audio competition tracks of the 2021 NCMMSC Alzheimer's Disease Recognition Challenge, respectively.

eess.AS↗

arXiv2021

The HW-TSC's Offline Speech Translation Systems for IWSLT 2021 Evaluation

This paper describes our work in participation of the IWSLT-2021 offline speech translation task. Our system was built in a cascade form, including a speaker diarization module, an Automatic Speech Recognition (ASR) module and a Machine Translation (MT) module. We directly use the LIUM SpkDiarization tool as the diarization module. The ASR module is trained with three ASR datasets from different sources, by multi-source training, using a modified Transformer encoder. The MT module is pretrained on the large-scale WMT news translation dataset and fine-tuned on the TED corpus. Our method achieves 24.6 BLEU score on the 2021 test set.

cs.CL↗