SearcharxivSearch

arXiv subjects

Jintao Jiang

Publications and source records attributed to Jintao Jiang.

6 recordsLinked to original sources

Colossal Type-II Multiferroic Polarization Driven by Collinear Spin Orders

Achieving strong magnetoelectric coupling (MEC) together with large ferroelectric polarization remains a central challenge in type-II multiferroics. In conventional spin-driven multiferroics, the induced polarization is usually mediated by spin-orbit coupling (SOC) or spin-lattice coupling (SLC). Since many representative systems are based on 3d transition-metal ions, where SOC is relatively weak and SLC-induced lattice distortions are often limited, their polarizations are typically much smaller than those of proper ferroelectrics. Moreover, electric polarizations in type-II multiferroics are generally induced by spiral spin orders stabilized by competing magnetic interactions, which often leads to relatively low magnetic transition temperatures. In this Letter, using spin-group symmetry, we propose an SOC- and SLC-independent route to MEC in collinear 3d magnetic systems. We show that, even for a noncentrosymmetric lattice structure, different collinear magnetic configurations can either forbid or allow electric polarization, indicating direct magnetic control of polarization and hence strong MEC. The first-principles calculations excluding SOC on monolayer 2H-VS2 support this picture: a collinear stripy antiferromagnetic order induces an in-plane ferroelectric polarization up to 25.00 μC/cm2, about two orders of magnitude larger than that of typical type-II multiferroics. Furthermore, our microscopic model suggests that the induced polarization originates from SOC-independent p-d hybridization governed by electronic hopping. Our results suggest a possible route toward type-II multiferroics combining strong MEC with large electronic polarization in collinear 3d magnetic systems.

cond-mat.mtrl-sci

Electric-field Switching of Interlayer Magnetic Order in a van der Waals Heterobilayer via Spin-potential Coupling

Electric-field switching of magnetic order is of significant physical interest and holds great potential for spintronic applications. However, it has rarely been reported in two-dimensional (2D) van der Waals (vdW) magnets due to the inherently weak interaction between spin order and electric fields. Here we propose a general spin-potential mechanism that significantly enhances the magnetoelectric coupling. As a result, the relative stability of different interlayer magnetic orders in an asymmetric van der Waals heterobilayer can be reversed by external electric fields via spin-potential coupling. Based on this mechanism, we designed a series of 2D vdW all-magnetic heterobilayers, such as CrI3/MnSe2, in which a transition from interlayer ferromagnetic (iFM) to antiferromagnetic (iAFM) order is realized by a feasible electric field around 0.1 V/Å. Our findings not only reveal a novel magnetoelectric coupling mechanism, but also present a practical strategy for achieving pure electric-field-driven magnetic order switching

cond-mat.mtrl-sci

Alternating Weak Triphone/BPE Alignment Supervision from Hybrid Model Improves End-to-End ASR

In this paper, alternating weak triphone/BPE alignment supervision is proposed to improve end-to-end model training. Towards this end, triphone and BPE alignments are extracted using a pre-existing hybrid ASR system. Then, regularization effect is obtained by cross-entropy based intermediate auxiliary losses computed on such alignments at a mid-layer representation of the encoder for triphone alignments and at the encoder for BPE alignments. Weak supervision is achieved through strong label smoothing with parameter of 0.5. Experimental results on TED-LIUM 2 indicate that either triphone or BPE alignment based weak supervision improves ASR performance over standard CTC auxiliary loss. Moreover, their combination lowers the word error rate further. We also investigate the alternation of the two auxiliary tasks during model training, and additional performance gain is observed. Overall, the proposed techniques result in over 10% relative error rate reduction over a CTC-regularized baseline system.

cs.CL

Weak Alignment Supervision from Hybrid Model Improves End-to-end ASR

In this paper, we aim to create weak alignment supervision from an existing hybrid system to aid the end-to-end modeling of automatic speech recognition. Towards this end, we use the existing hybrid ASR system to produce triphone alignments of the training audios. We then create a cross-entropy loss at a certain layer of the encoder using the derived alignments. In contrast to the general one-hot cross-entropy losses, here we use a cross-entropy loss with a label smoothing parameter to regularize the supervision. As a comparison, we also conduct the experiments with one-hot cross-entropy losses and CTC losses with loss weighting. The results show that placing the weak alignment supervision with the label smoothing parameter of 0.5 at the third encoder layer outperforms the other two approaches and leads to about 5\% relative WER reduction on the TED-LIUM 2 dataset over the baseline. We see similar improvements when applying the method out-of-the-box on a Tagalog end-to-end ASR system.

cs.SD

Baechi: Fast Device Placement of Machine Learning Graphs

Machine Learning graphs (or models) can be challenging or impossible to train when either devices have limited memory, or models are large. To split the model across devices, learning-based approaches are still popular. While these result in model placements that train fast on data (i.e., low step times), learning-based model-parallelism is time-consuming, taking many hours or days to create a placement plan of operators on devices. We present the Baechi system, the first to adopt an algorithmic approach to the placement problem for running machine learning training graphs on small clusters of memory-constrained devices. We integrate our implementation of Baechi into two popular open-source learning frameworks: TensorFlow and PyTorch. Our experimental results using GPUs show that: (i) Baechi generates placement plans 654 X - 206K X faster than state-of-the-art learning-based approaches, and (ii) Baechi-placed model's step (training) time is comparable to expert placements in PyTorch, and only up to 6.2% worse than expert placements in TensorFlow. We prove mathematically that our two algorithms are within a constant factor of the optimal. Our work shows that compared to learning-based approaches, algorithmic approaches can face different challenges for adaptation to Machine learning systems, but also they offer proven bounds, and significant performance benefits.

cs.DC

Self-Normalized Importance Sampling for Neural Language Modeling

To mitigate the problem of having to traverse over the full vocabulary in the softmax normalization of a neural language model, sampling-based training criteria are proposed and investigated in the context of large vocabulary word-based neural language models. These training criteria typically enjoy the benefit of faster training and testing, at a cost of slightly degraded performance in terms of perplexity and almost no visible drop in word error rate. While noise contrastive estimation is one of the most popular choices, recently we show that other sampling-based criteria can also perform well, as long as an extra correction step is done, where the intended class posterior probability is recovered from the raw model outputs. In this work, we propose self-normalized importance sampling. Compared to our previous work, the criteria considered in this work are self-normalized and there is no need to further conduct a correction step. Through self-normalized language model training as well as lattice rescoring experiments, we show that our proposed self-normalized importance sampling is competitive in both research-oriented and production-oriented automatic speech recognition tasks.

cs.CL