SearcharxivSearch

arXiv subjects

Andrey Kostin

Publications and source records attributed to Andrey Kostin.

9 recordsLinked to original sources

Little Brains, Big Feats: Exploring Compact Language Models

While large language models have been dominating the research landscape recently, small language models remain highly relevant across various domains; yet, they receive far less attention. In this study, we investigate how smaller language models perform during the generation stage within a Retrieval-Augmented Generation (RAG) system. To benchmark these models effectively, we utilised both open-source and proprietary datasets covering diverse subject areas and question types. Our findings demonstrate that a RAG system with small language models can be executed directly on-device without requiring any GPU hardware within a reasonable time. The experimental code and links to the supplementary materials can be accessed through the GitHub repository: https://github.com/SibNN/SLM-RAG-EVAL.

cs.CL

asr_eval: Algorithms and tools for multi-reference and streaming speech recognition evaluation

We propose several improvements to the speech recognition evaluation. First, we propose a string alignment algorithm that supports both multi-reference labeling, arbitrary-length insertions and better word alignment. This is especially useful for non-Latin languages, those with rich word formation, to label cluttered or longform speech. Secondly, we collect a novel test set DiverseSpeech-Ru of longform in-the-wild Russian speech with careful multi-reference labeling. We also perform multi-reference relabeling of popular Russian tests set and study fine-tuning dynamics on its corresponding train set. We demonstrate that the model often adopts to dataset-specific labeling, causing an illusion of metric improvement. Based on the improved word alignment, we develop tools to evaluate streaming speech recognition and to align multiple transcriptions to compare them visually. Additionally, we provide uniform wrappers for many offline and streaming speech recognition models. Our code will be made publicly available.

cs.CL

Multi-Atom Quasiparticle Scattering Interference for Superconductor Energy-Gap Symmetry Determination

Complete theoretical understanding of the most complex superconductors requires a detailed knowledge of the symmetry of the superconducting energy-gap $Δ_\mathbf{k}^α$, for all momenta $\mathbf{k}$ on the Fermi surface of every band $α$. While there are a variety of techniques for determining $|Δ_\mathbf{k}^α|$, no general method existed to measure the signed values of $Δ_\mathbf{k}^α$. Recently, however, a new technique based on phase-resolved visualization of superconducting quasiparticle interference (QPI) patterns centered on a single non-magnetic impurity atom, was introduced. In principle, energy-resolved and phase-resolved Fourier analysis of these images identifies wavevectors connecting all k-space regions where $Δ_\mathbf{k}^α$ has the same or opposite sign. But use of a single isolated impurity atom, from whose precise location the spatial phase of the scattering interference pattern must be measured is technically difficult. Here we introduce a generalization of this approach for use with multiple impurity atoms, and demonstrate its validity by comparing the $Δ_\mathbf{k}^α$ it generates to the $Δ_\mathbf{k}^α$ determined from single-atom scattering in FeSe where $s_{\pm}$ energy-gap symmetry is established. Finally, to exemplify utility, we use the multi-atom technique on LiFeAs and find scattering interference between the hole-like and electron-like pockets as predicted for $Δ_\mathbf{k}^α$ of opposite sign.

cond-mat.supr-con

Severe Dirac Mass Gap Suppression in Sb_2Te_3-based Quantum Anomalous Hall Materials

Quantum anomalous Hall (QAH) effect appears in ferromagnetic topological insulators (FMTI) when a Dirac mass gap opens in the spectrum of the topological surface states (SS). Unaccountably, although the mean mass gap can exceed 28 meV (or ~320 K), the QAH effect is frequently only detectable at temperatures below 1 K. Using atomic-resolution Landau level spectroscopic imaging, we compare the electronic structure of the archetypal FMTI Cr_0.08(Bi_0.1Sb_0.9)_1.92Te_3 to that of its non-magnetic parent (Bi_0.1Sb_0.9)_2Te_3, to explore the cause. In (Bi_0.1Sb_0.9)_2Te_3, we find spatially random variations of the Dirac energy. Statistically equivalent Dirac energy variations are detected in Cr_0.08(Bi_0.1Sb_0.9)_1.92Te_3 with concurrent but uncorrelated Dirac mass gap disorder. These two classes of SS electronic disorder conspire to drastically suppress the minimum mass gap to below 100 μeV for nanoscale regions separated by <1 μm. This fundamentally limits the fully quantized anomalous Hall effect in Sb_2Te_3-based FMTI materials to very low temperatures.

cond-mat.mes-hall

Momentum Resolved Superconducting Energy Gaps of Sr$_2$RuO$_4$ from Quasiparticle Interference Imaging

Sr$_2$RuO$_4$ has long been the focus of intense research interest because of conjectures that it is a correlated topological superconductor. It is the momentum space (k-space) structure of the superconducting energy gap $Δ_i(\mathbf{k})$ on each band $i$ that encodes its unknown superconducting order-parameter. But, because the energy scales are so low, it has never been possible to directly measure the $Δ_i(\mathbf{k})$ of Sr$_2$RuO$_4$. Here we implement Bogoliubov quasiparticle interference (BQPI) imaging, a technique capable of high-precision measurement of multiband $Δ_i(\mathbf{k})$. At T=90 mK we visualize a set of Bogoliubov scattering interference wavevectors $q_j:j=1-5$ consistent with eight gap nodes/minima, that are all closely aligned to the $(\pm1,\pm1)$ crystal-lattice directions on both the $α$-and $β$-bands. Taking these observations in combination with other very recent advances in directional thermal conductivity (E. Hassinger et al. Phys. Rev. X 7, 011032 (2017)), temperature dependent Knight shift (A. Pustogow et al. Nature 574, 72 (2019)), time-reversal symmetry conservation (S. Kashiwaya et al. arXiv:1907.030939) and theory (A.T. Romer et al. Phys. Rev. Lett. 123, 247001 (2019); H. S. Roising et al. Phys. Rev. Research 1, 033108 (2019),O. Gingras et al. Phys. Rev. Lett. 123, 217005 (2019)), the BQPI signature of Sr$_2$RuO$_4$ appears most consistent with $Δ_i(\mathbf{k})$ having $d_{x^2-y^2}$ $(B_{1g})$ symmetry.

cond-mat.supr-con

Imaging Orbital-selective Quasiparticles in the Hund's Metal State of FeSe

Strong electronic correlations, emerging from the parent Mott insulator phase, are key to copper-based high temperature superconductivity (HTS). By contrast, the parent phase of iron-based HTS is never a correlated insulator. But this distinction may be deceptive because Fe has five active d-orbitals while Cu has only one. In theory, such orbital multiplicity can generate a Hund's Metal state, in which alignment of the Fe spins suppresses inter-orbital fluctuations producing orbitally selective strong correlations. The spectral weights $Z_m$ of quasiparticles associated with different Fe orbitals m should then be radically different. Here we use quasiparticle scattering interference resolved by orbital content to explore these predictions in FeSe. Signatures of strong, orbitally selective differences of quasiparticle $Z_m$ appear on all detectable bands over a wide energy range. Further, the quasiparticle interference amplitudes reveal that $Z_{xy}<Z_{xz}<<Z_{yz}$, consistent with earlier orbital-selective Cooper pairing studies. Thus, orbital-selective strong correlations dominate the parent state of iron-based HTS in FeSe.

cond-mat.str-el

Magnetic-field Induced Pair Density Wave State in the Cuprate Vortex Halo

When very high magnetic fields suppress the superconductivity in underdoped cuprates, an exceptional new electronic phase appears. It supports remarkable and unexplained quantum oscillations and exhibits an unidentified density wave (DW) state. Although generally referred to as a "charge" density wave (CDW) because of the observed charge density modulations, theory indicates that this could actually be the far more elusive electron-pair density wave state (PDW). To search for evidence of a field-induced PDW in cuprates, we visualize the modulations in the density of electronic states $N(\bf{r})$ within the halo surrounding Bi$_2$Sr$_2$CaCu$_2$O$_8$ vortex cores. This reveals multiple signatures of a field-induced PDW, including two sets of $N(\bf{r})$ modulations occurring at wavevectors $\bf{Q}_P$ and $2\bf{Q}_P$, both having predominantly $s$-symmetry form factors, the amplitude of the latter decaying twice as rapidly as the former, along with induced energy-gap modulations at $\bf{Q}_P$ . Such a microscopic phenomenology is in detailed agreement with theory for a field-induced primary PDW that generates secondary CDWs within the vortex halo. These data indicate that the fundamental state generated by increasing magnetic fields from the underdoped cuprate superconducting phase is actually a PDW with approximately eight CuO$_2$ unit-cell periodicity ($λ= 8a_0$) and predominantly $d$-symmetry form factor.

cond-mat.supr-con

Discovery of Orbital-Selective Cooper Pairing in FeSe

The superconductor FeSe is of intense interest thanks to its unusual non-magnetic nematic state and potential for high temperature superconductivity. But its Cooper pairing mechanism has not been determined. Here we use Bogoliubov quasiparticle interference imaging to determine the Fermi surface geometry of the bands surrounding the $Γ= (0,0)$ and $X=(π/ a_{Fe}, 0)$ points of FeSe, and to measure the corresponding superconducting energy gaps. We show that both gaps are extremely anisotropic but nodeless, and exhibit gap maxima oriented orthogonally in momentum space. Moreover, by implementing a novel technique we demonstrate that these gaps have opposite sign with respect to each other. This complex gap configuration reveals the existence of orbital-selective Cooper pairing which, in FeSe, is based preferentially on electrons from the $d_{yz}$ orbitals of the iron atoms.

cond-mat.supr-con

Orbital selective pairing and gap structures of iron-based superconductors

We discuss the influence on spin-fluctuation pairing theory of orbital selective strong correlation effects in Fe-based superconductors, particularly Fe chalcogenide systems. We propose that a key ingredient for an improved itinerant pairing theory is orbital selectivity, i.e., incorporating the reduced coherence of quasiparticles occupying specific orbital states. This modifies the usual spin-fluctuation via suppression of pair scattering processes involving those less coherent states and results in orbital selective Cooper pairing of electrons in the remaining states. We show that this paradigm yields remarkably good agreement with the experimentally observed anisotropic gap structures in both bulk and monolayer FeSe, as well as LiFeAs, indicating that orbital selective Cooper pairing plays a key role in the more strongly correlated iron-based superconductors.

cond-mat.supr-con