arXiv subjects

Rui Liu

Publications and source records attributed to Rui Liu.

At least 325 records · Page 18Linked to original sources

arXiv2022

Controllable Accented Text-to-Speech Synthesis

Accented text-to-speech (TTS) synthesis seeks to generate speech with an accent (L2) as a variant of the standard version (L1). Accented TTS synthesis is challenging as L2 is different from L1 in both in terms of phonetic rendering and prosody pattern. Furthermore, there is no easy solution to the control of the accent intensity in an utterance. In this work, we propose a neural TTS architecture, that allows us to control the accent and its intensity during inference. This is achieved through three novel mechanisms, 1) an accent variance adaptor to model the complex accent variance with three prosody controlling factors, namely pitch, energy and duration; 2) an accent intensity modeling strategy to quantify the accent intensity; 3) a consistency constraint module to encourage the TTS system to render the expected accent intensity at a fine level. Experiments show that the proposed system attains superior performance to the baseline models in terms of accent rendering and intensity control. To our best knowledge, this is the first study of accented TTS synthesis with explicit intensity control.

cs.SD↗

arXiv2022

MnTTS: An Open-Source Mongolian Text-to-Speech Synthesis Dataset and Accompanied Baseline

This paper introduces a high-quality open-source text-to-speech (TTS) synthesis dataset for Mongolian, a low-resource language spoken by over 10 million people worldwide. The dataset, named MnTTS, consists of about 8 hours of transcribed audio recordings spoken by a 22-year-old professional female Mongolian announcer. It is the first publicly available dataset developed to promote Mongolian TTS applications in both academia and industry. In this paper, we share our experience by describing the dataset development procedures and faced challenges. To demonstrate the reliability of our dataset, we built a powerful non-autoregressive baseline system based on FastSpeech2 model and HiFi-GAN vocoder, and evaluated it using the subjective mean opinion score (MOS) and real time factor (RTF) metrics. Evaluation results show that the powerful baseline system trained on our dataset achieves MOS above 4 and RTF about $3.30\times10^{-1}$, which makes it applicable for practical use. The dataset, training recipe, and pretrained TTS models are freely available \footnote{\label{github}\url{https://github.com/walker-hyf/MnTTS}}.

cs.SD↗

arXiv2022

FastQSL: A Fast Computation Method for Quasi-separatrix Layers

Magnetic reconnection preferentially takes place at the intersection of two separatrices or two quasi-separatrix layers, which can be quantified by the squashing factor Q, whose calculation is computationally expensive due to the need to trace as many field lines as possible. We developed a method (FastQSL) optimized for obtaining Q and the twist number in a 3D data cube. FastQSL utilizes the hardware acceleration of the graphic process unit (GPU) and adopts a step-size adaptive scheme for the most computationally intensive part: tracing magnetic field lines. As a result, it achieves a computational efficiency of 4.53 million Q values per second. FastQSL is open source, and user-friendly for data import, export, and visualization.

astro-ph.SR↗

arXiv2022

Correlation-corrected band topology and topological surface states in iron-based superconductors

Iron-based superconductors offer an ideal platform for studying topological superconductivity and Majorana fermions. In this paper, we carry out a comprehensive study of the band topology and topological surface states of a number of iron-based superconductors using a combination of density functional theory (DFT) and dynamical mean field theory. We find that the strong electronic correlation of Fe 3d electrons plays a crucial role in determining the band topology and topological surface states of iron-based superconductors. Electronic correlation not only strongly renormalizes the bandwidth of Fe 3d electrons, but also shifts the band positions of both Fe 3d and As/Se p electrons. As a result, electronic correlation moves the DFT-calculated topological surface states of many iron-based superconductors much closer to the Fermi level, which is crucial for realizing topological superconducting surface states and observing Majorana zero modes as well as achieving practical applications, such as quantum computation. More importantly, electronic correlation can change the band topology and make some iron-based superconductors topologically nontrivial with topological surface states whereas they have trivial band topology and no topological surface states in DFT calculations. Our paper demonstrates that it is important to take into account electronic correlation effects in order to accurately determine the band topology and topological surface states of iron-based superconductors and other strongly correlated materials.

cond-mat.supr-con↗

arXiv2022

Sigmoid Formation Through Slippage of A Single J-shaped Coronal Loop

A well-known precursor of an imminent solar eruption is the appearance of a hot S-shaped loop, also known as sigmoid, in an active region (AR). Classically, the formation of such an S-shaped loop is envisaged to be implemented by magnetic reconnection of two oppositely oriented J-shaped loops. However, the details of reconnection are elusive due to weak emission and subtle evolution during the pre-eruptive phase. In this paper, we investigate how a single J-shaped loop transforms into an S-shaped one through the slippage of one of its footpoints in NOAA AR 11719 on 2013 April 11. During an interval of about 16 min, the J-shaped loop slips through a low-corona region of strong electric current density in a bursty fashion, reaching a peak apparent speed as fast as over 1000 km s$^{-1}$, at the slipping footpoint. The enhancement of electric current density, as suggested by non-linear force-free field modeling, indicates that the "non-idealness" of coronal plasma becomes locally important, which may facilitate magnetic reconnection. The loop segment undergoing slipping motions is heated; meanwhile, above the fixed footpoint coronal emission dims due to a combination effect of the lengthening and heating of the loop, the latter of which is manifested in the temporal variation of dimming slope and of emission measure. These features together support an asymmetric scenario of sigmoid formation through slipping reconnection of a single J-shaped loop, which differs from the standard tether-cutting scenario involving a double J-shaped loop system.

astro-ph.SR↗

arXiv2022

Deeply Supervised Skin Lesions Diagnosis with Stage and Branch Attention

Accurate and unbiased examinations of skin lesions are critical for the early diagnosis and treatment of skin diseases. Visual features of skin lesions vary significantly because the images are collected from patients with different lesion colours and morphologies by using dissimilar imaging equipment. Recent studies have reported that ensembled convolutional neural networks (CNNs) are practical to classify the images for early diagnosis of skin disorders. However, the practical use of these ensembled CNNs is limited as these networks are heavyweight and inadequate for processing contextual information. Although lightweight networks (e.g., MobileNetV3 and EfficientNet) were developed to achieve parameters reduction for implementing deep neural networks on mobile devices, insufficient depth of feature representation restricts the performance. To address the existing limitations, we develop a new lite and effective neural network, namely HierAttn. The HierAttn applies a novel deep supervision strategy to learn the local and global features by using multi-stage and multi-branch attention mechanisms with only one training loss. The efficacy of HierAttn was evaluated by using the dermoscopy images dataset ISIC2019 and smartphone photos dataset PAD-UFES-20 (PAD2020). The experimental results show that HierAttn achieves the best accuracy and area under the curve (AUC) among the state-of-the-art lightweight networks. The code is available at https://github.com/anthonyweidai/HierAttn.

eess.IV↗

arXiv2022

Collective Conditioned Reflex: A Bio-Inspired Fast Emergency Reaction Mechanism for Designing Safe Multi-Robot Systems

A multi-robot system (MRS) is a group of coordinated robots designed to cooperate with each other and accomplish given tasks. Due to the uncertainties in operating environments, the system may encounter emergencies, such as unobserved obstacles, moving vehicles, and extreme weather. Animal groups such as bee colonies initiate collective emergency reaction behaviors such as bypassing obstacles and avoiding predators, similar to muscle-conditioned reflex which organizes local muscles to avoid hazards in the first response without delaying passage through the brain. Inspired by this, we develop a similar collective conditioned reflex mechanism for multi-robot systems to respond to emergencies. In this study, Collective Conditioned Reflex (CCR), a bio-inspired emergency reaction mechanism, is developed based on animal collective behavior analysis and multi-agent reinforcement learning (MARL). The algorithm uses a physical model to determine if the robots are experiencing an emergency; then, rewards for robots involved in the emergency are augmented with corresponding heuristic rewards, which evaluate emergency magnitudes and consequences and decide local robots' participation. CCR is validated on three typical emergency scenarios: \textit{turbulence, strong wind, and hidden obstacle}. Simulation results demonstrate that CCR improves robot teams' emergency reaction capability with faster reaction speed and safer trajectory adjustment compared with baseline methods.

cs.RO↗

arXiv2022

Aiming in Harsh Environments: A New Framework for Flexible and Adaptive Resource Management

The harsh environment imposes a unique set of challenges on networking strategies. In such circumstances, the environmental impact on network resources and long-time unattended maintenance has not been well investigated yet. To address these challenges, we propose a flexible and adaptive resource management framework that incorporates the environment awareness functionality. In particular, we propose a new network architecture and introduce the new functionalities against the traditional network components. The novelties of the proposed architecture include a deep-learning-based environment resource prediction module and a self-organized service management module. Specifically, the available network resource under various environmental conditions is predicted by using the prediction module. Then based on the prediction, an environment-oriented resource allocation method is developed to optimize the system utility. To demonstrate the effectiveness and efficiency of the proposed new functionalities, we examine the method via an experiment in a case study. Finally, we introduce several promising directions of resource management in harsh environments that can be extended from this paper.

cs.NI↗

arXiv2022

Gating Dropout: Communication-efficient Regularization for Sparsely Activated Transformers

Sparsely activated transformers, such as Mixture of Experts (MoE), have received great interest due to their outrageous scaling capability which enables dramatical increases in model size without significant increases in computational cost. To achieve this, MoE models replace the feedforward sub-layer with Mixture-of-Experts sub-layer in transformers and use a gating network to route each token to its assigned experts. Since the common practice for efficient training of such models requires distributing experts and tokens across different machines, this routing strategy often incurs huge cross-machine communication cost because tokens and their assigned experts likely reside in different machines. In this paper, we propose \emph{Gating Dropout}, which allows tokens to ignore the gating network and stay at their local machines, thus reducing the cross-machine communication. Similar to traditional dropout, we also show that Gating Dropout has a regularization effect during training, resulting in improved generalization performance. We validate the effectiveness of Gating Dropout on multilingual machine translation tasks. Our results demonstrate that Gating Dropout improves a state-of-the-art MoE model with faster wall-clock time convergence rates and better BLEU scores for a variety of model sizes and datasets.

cs.LG↗

arXiv2022

Accurate Emotion Strength Assessment for Seen and Unseen Speech Based on Data-Driven Deep Learning

Emotion classification of speech and assessment of the emotion strength are required in applications such as emotional text-to-speech and voice conversion. The emotion attribute ranking function based on Support Vector Machine (SVM) was proposed to predict emotion strength for emotional speech corpus. However, the trained ranking function doesn't generalize to new domains, which limits the scope of applications, especially for out-of-domain or unseen speech. In this paper, we propose a data-driven deep learning model, i.e. StrengthNet, to improve the generalization of emotion strength assessment for seen and unseen speech. This is achieved by the fusion of emotional data from various domains. We follow a multi-task learning network architecture that includes an acoustic encoder, a strength predictor, and an auxiliary emotion predictor. Experiments show that the predicted emotion strength of the proposed StrengthNet is highly correlated with ground truth scores for both seen and unseen speech. We release the source codes at: https://github.com/ttslr/StrengthNet.

cs.SD↗

arXiv2022

NTIRE 2022 Challenge on High Dynamic Range Imaging: Methods and Results

This paper reviews the challenge on constrained high dynamic range (HDR) imaging that was part of the New Trends in Image Restoration and Enhancement (NTIRE) workshop, held in conjunction with CVPR 2022. This manuscript focuses on the competition set-up, datasets, the proposed methods and their results. The challenge aims at estimating an HDR image from multiple respective low dynamic range (LDR) observations, which might suffer from under- or over-exposed regions and different sources of noise. The challenge is composed of two tracks with an emphasis on fidelity and complexity constraints: In Track 1, participants are asked to optimize objective fidelity scores while imposing a low-complexity constraint (i.e. solutions can not exceed a given number of operations). In Track 2, participants are asked to minimize the complexity of their solutions while imposing a constraint on fidelity scores (i.e. solutions are required to obtain a higher fidelity score than the prescribed baseline). Both tracks use the same data and metrics: Fidelity is measured by means of PSNR with respect to a ground-truth HDR image (computed both directly and with a canonical tonemapping operation), while complexity metrics include the number of Multiply-Accumulate (MAC) operations and runtime (in seconds).

cs.CV↗

arXiv2022

Transformer with Memory Replay

Transformers achieve state-of-the-art performance for natural language processing tasks by pre-training on large-scale text corpora. They are extremely compute-intensive and have very high sample complexity. Memory replay is a mechanism that remembers and reuses past examples by saving to and replaying from a memory buffer. It has been successfully used in reinforcement learning and GANs due to better sample efficiency. In this paper, we propose \emph{Transformer with Memory Replay} (TMR), which integrates memory replay with transformer, making transformer more sample-efficient. Experiments on GLUE and SQuAD benchmark datasets show that Transformer with Memory Replay achieves at least $1\%$ point increase compared to the baseline transformer model when pretrained with the same number of examples. Further, by adopting a careful design that reduces the wall-clock time overhead of memory replay, we also empirically achieve a better runtime efficiency.

cs.LG↗

arXiv2022

Neutral Utterances are Also Causes: Enhancing Conversational Causal Emotion Entailment with Social Commonsense Knowledge

Conversational Causal Emotion Entailment aims to detect causal utterances for a non-neutral targeted utterance from a conversation. In this work, we build conversations as graphs to overcome implicit contextual modelling of the original entailment style. Following the previous work, we further introduce the emotion information into graphs. Emotion information can markedly promote the detection of causal utterances whose emotion is the same as the targeted utterance. However, it is still hard to detect causal utterances with different emotions, especially neutral ones. The reason is that models are limited in reasoning causal clues and passing them between utterances. To alleviate this problem, we introduce social commonsense knowledge (CSK) and propose a Knowledge Enhanced Conversation graph (KEC). KEC propagates the CSK between two utterances. As not all CSK is emotionally suitable for utterances, we therefore propose a sentiment-realized knowledge selecting strategy to filter CSK. To process KEC, we further construct the Knowledge Enhanced Directed Acyclic Graph networks. Experimental results show that our method outperforms baselines and infers more causes with different emotions from the targeted utterance.

cs.CL↗

arXiv2022

Local Rotational Jamming and Multi-Scale Hyperuniformities in an Active Spinner System

An active system consisting of many self-spinning dimers is simulated, and a distinct local rotational jamming transition is observed as the density increases. In the low density regime, the system stays in an absorbing state, in which each dimer rotates independently subject to the applied torque. While in the high density regime, a fraction of the dimers become rotationally jammed into local clusters, and the system exhibits spinodal-decomposition like two-phase morphologies. For high enough densities, the system becomes completely jammed in both rotational and translational degrees of freedom. Such a simple system is found to exhibit rich and multiscale disordered hyperuniformities among the above phases: the absorbing state shows a critical hyperuniformity of the strongest class and subcritically preserves the vanishing density-fluctuation scaling up to some length scale; the locally-jammed state shows a two-phase hyperuniformity conversely beyond some length scale with respect to the phase cluster sizes; the totally jammed state appears to be a monomer crystal, but intrinsically loses large-scale hyperuniformity. These results are inspiring for designing novel phase-separation and disordered hyperuniform systems through dynamical organization.

cond-mat.soft↗

arXiv2022

Real-Time Anomaly Detection in Edge Streams

Given a stream of graph edges from a dynamic graph, how can we assign anomaly scores to edges in an online manner, for the purpose of detecting unusual behavior, using constant time and memory? Existing approaches aim to detect individually surprising edges. In this work, we propose MIDAS, which focuses on detecting microcluster anomalies, or suddenly arriving groups of suspiciously similar edges, such as lockstep behavior, including denial of service attacks in network traffic data. We further propose MIDAS-F, to solve the problem by which anomalies are incorporated into the algorithm's internal states, creating a `poisoning' effect that can allow future anomalies to slip through undetected. MIDAS-F introduces two modifications: 1) We modify the anomaly scoring function, aiming to reduce the `poisoning' effect of newly arriving edges; 2) We introduce a conditional merge step, which updates the algorithm's data structures after each time tick, but only if the anomaly score is below a threshold value, also to reduce the `poisoning' effect. Experiments show that MIDAS-F has significantly higher accuracy than MIDAS. MIDAS has the following properties: (a) it detects microcluster anomalies while providing theoretical guarantees about its false positive probability; (b) it is online, thus processing each edge in constant time and constant memory, and also processes the data orders-of-magnitude faster than state-of-the-art approaches; (c) it provides up to 62% higher ROC-AUC than state-of-the-art approaches.

cs.LG↗

arXiv2022

The generality of uncooperative and cooperative effects in elementary hydrogen-bonded systems

The cooperative effect plays a significant role in understanding the intermolecular donor-acceptor interactions of hydrogen bonds (H-bonds, D-H...A). Herein, using the benchmark method of high-precision ab initio, the well-known cooperative effect is reproduced in elementary H-bonded systems with different D and A atoms. That is, with the decreasing of intermolecular distance, the D-H bond length first increases and then decreases, while the H...A bond length decreases. On the contrary, when D and A are the same, as the intermolecular distance decreases, the D-H bond length decreases without increasing, which is referred to as the uncooperative effect. Further analyses conclude that compared to cooperative H-bonded systems, uncooperative systems at their respective equilibrium position have a larger core-valence bifurcation (CVB) index (>0.022) and lower binding energies (<0.25 eV), showing a clear linear inverse relationship related to H-bond strength. Therefore, the intermolecular non-H-bonding interactions are predicted to reflect the uncooperative characteristics, which is confirmed by high-precision ab initio calculations. These findings provide a direction for the comprehensive understanding of H-bonds.

physics.chem-ph↗

arXiv2022

Electronic structure and magnetism of the Hund insulator CrI3

CrI3 is a two-dimensional ferromagnetic van der Waals material with a charge gap of 1.1-1.2 eV. In this study, the electronic structure and magnetism of CrI3 are investigated by using density functional theory and dynamical mean-field theory. Our calculations successfully reproduce a charge gap of 1.1 eV in the paramagnetic state when a Hund coupling JH = 0.7 eV is included with an on-site Hubbard U = 5 eV. In contrast, with a large U value of 8 eV and negligible Hund coupling JH, CrI3 is predicted to be a moderately correlated metal in the paramagnetic state. We conclude that CrI3 is a Mott-Hund insulator due to the half-filled configuration of the Cr 3d t2g orbitals. The Cr 3d eg orbitals are occupied by approximately one electron, which leads to strong valence fluctuations so that the Cr 3d orbitals cannot be described by a single state. Moreover, at finite temperature, the calculated ordered static magnetic moment in the ferromagnetic state is significantly larger in the R3 phase than in the C2/m phase. This observation indicates that the structural phase transition from the C2/m phase to the R3 phase with decreasing temperature is driven by ferromagnetic spin fluctuations.

cond-mat.str-el↗

arXiv2022

Where and how does a decay-index profile become saddle-like?

The decay index of solar magnetic fields is known as an important parameter in regulating solar eruptions from the standpoint of the torus instability. In particular, a saddle-like profile of decay index, which hosts a local torus-stable regime at higher altitudes than where the decay index first exceeds the instability threshold, is found to be associated with some confined or two-step eruptions. To understand the occurrence of such a profile, we employed dipoles to emulate different kinds of photospheric flux distributions. Corroborated by observations of representative active regions (ARs), our major results are: 1) in bipolar configurations the critical height increases away from the AR center along the polarity inversion line (PIL) and its average is roughly half of the centroid distance between opposite polarities; 2) in quadrupolar configurations saddle-like profiles appear above the PIL when the two dipoles oriented in the same direction are significantly more separated in this direction than in the perpendicular direction, and when the two dipoles are oriented differently or have unequal fluxes; 3) saddle-like profiles in quadrupolar configurations are associated with magnetic skeletons such as a null point or a hyperbolic flux tube, and the role of such profiles in eruptions is anticipated to be double-edged if magnetic reconnection is involved.

astro-ph.SR↗