arXiv subjects

Li Fu

Publications and source records attributed to Li Fu.

At least 19 recordsLinked to original sources

arXiv2026

Dual-Form ASR: Semantics-Aware Inverse Text Normalization for Chinese Speech Recognition

Modern automatic speech recognition (ASR) scenarios require both spoken-form transcripts for faithful transcription and readable written-form transcripts with inverse text normalization (ITN). However, these forms are typically produced by cascaded modules, where a spoken-form ASR output is rewritten by a separate ITN component, making written-form ASR-ITN vulnerable to recognition errors and decoupling normalization from acoustic-contextual modeling, especially for semantically dependent numeric expressions. In this paper, we propose Dual-Form ASR (DF-ASR), a framework that extends spoken-form ASR capability to semantics-aware written-form ITN through paired spoken-form and written-form supervision while retaining prompt-level selection between transcript forms. The dual-form supervision is constructed via a large language model (LLM)-driven generate-and-judge workflow, and training is further enhanced by ITN-MWER, a sequence-level objective that assigns higher cost to errors on normalization-sensitive spans. We also introduce a decision-aware REQUIRE-ITN/\FORBID-ITN protocol to separately measure required normalization and forbidden-span preservation. On manually annotated Chinese subsets from SpeechIO, DF-ASR consistently outperforms open-source ASR-ITN systems, remains competitive with strong closed-source references, and preserves reliable prompt-level control between spoken-form and written-form outputs.

cs.CL↗

arXiv2026

Automated Discovery of Metainterfaces with Tailored Friction Laws

Providing dry solid contacts with on-demand macroscale frictional behaviour remains a formidable challenge in tribology, haptics or robotics. Metainterfaces created from surfaces with engineered asperity-based topographies can achieve such friction control. However, only few friction behaviours were demonstrated because suitable topographies were identified based on human intuition. Here, we introduce a numerical-optimisation-based inverse design framework to automatically discover new metainterfaces satisfying specified relationships between friction and normal forces (friction law). To illustrate the framework's versatility, we first expand the range of achievable friction coefficients at a constant material pair; we next unlock power-law friction laws with arbitrary exponents between 2/3 and 1.35; we then achieve bilinear laws with a smaller slope in the second segment than in the first. We validate relevant cases experimentally. By enabling systematic exploration of large parameter spaces, not limited to topography but potentially incorporating the individual asperities' bulk material or surface physicochemistry, our automated framework offers design solutions for any physically possible friction law. It also provides new insights into the elusive relationship between local interfacial properties and macroscopic friction.

physics.class-ph↗

arXiv2026

fix pimd/langevin: An Efficient Implementation of Path Integral Molecular Dynamics in LAMMPS

Path integral molecular dynamics (PIMD), which maps a quantum particle onto a fictitious classical system of ring polymers and propagates the "beads" of this extended classical system using molecular dynamics, is widely used to capture nuclear quantum effects (NQEs) in molecular simulations. Accurate PIMD calculations typically require a large number of beads and are therefore computationally demanding. While software packages such as i-PI offer comprehensive PIMD functionality, the high efficiency of simulations driven by machine learning interatomic potentials, such as Deep Potential (DP), calls for more efficient PIMD implementations that fully exploit modern massively parallel supercomputers. Here we present fix pimd/langevin, an efficient PIMD implementation in LAMMPS that supports commonly used features and leverages the Message Passing Interface architecture of LAMMPS to achieve high computational efficiency. We demonstrate the usage and validate the correctness of our code using liquid water as a representative example, and provide a comprehensive overview of the supported features. Then we discuss several important technical aspects of the implementation. Using DP simulations of water as a benchmark, we show that our implementation achieves several-fold acceleration compared to i-PI. Finally, we report strong and weak scaling results that demonstrate the favorable parallel performance of our code.

physics.chem-ph↗

arXiv2026

Efficient Screening of Organic Singlet Fission Molecules Using Graph Neural Networks

Singlet fission (SF) provides a promising strategy for surpassing the Shockley-Queisser limit in photovoltaics. However, the identification of efficient SF materials is hindered by the limited availability of suitable molecular candidates and the high computational costs associated with conventional quantum-chemical methods for excited states. In this study, we introduce a high-throughput screening framework that integrates a graph neural network (GNN) with multi-level validation to accelerate the discovery of SF-active molecules. Trained on a previously reported FORMED database, the GNN achieves state-of-the-art accuracy in predicting SF-relevant excited-state properties, demonstrating a mean absolute error of about 0.1 eV for S1, T1, and T2 excitation energies. This capability facilitates the efficient screening of over 20 million molecular structures from both OE62 and QO2Mol databases. Our framework significantly reduces the computational demand associated with Time-Dependent Density Functional Theory validation by four orders of magnitude and identifies 180 potential SF molecules along with more than 1000 conformers. Subsequent assessments regarding synthetic accessibility, GW approximation and Bethe-Salpeter equation calculations further highlight a subset of experimentally feasible candidates among these SF candidates. The approach presented herein exemplifies an effective strategy for accelerating the discovery of functional molecules with optoelectronic applications.

cond-mat.mtrl-sci↗

arXiv2025

PAC: Pronunciation-Aware Contextualized Large Language Model-based Automatic Speech Recognition

This paper presents a Pronunciation-Aware Contextualized (PAC) framework to address two key challenges in Large Language Model (LLM)-based Automatic Speech Recognition (ASR) systems: effective pronunciation modeling and robust homophone discrimination. Both are essential for raw or long-tail word recognition. The proposed approach adopts a two-stage learning paradigm. First, we introduce a pronunciation-guided context learning method. It employs an interleaved grapheme-phoneme context modeling strategy that incorporates grapheme-only distractors, encouraging the model to leverage phonemic cues for accurate recognition. Then, we propose a pronunciation-discriminative reinforcement learning method with perturbed label sampling to further enhance the model\'s ability to distinguish contextualized homophones. Experimental results on the public English Librispeech and Mandarin AISHELL-1 datasets indicate that PAC: (1) reduces relative Word Error Rate (WER) by 30.2% and 53.8% compared to pre-trained LLM-based ASR models, and (2) achieves 31.8% and 60.5% relative reductions in biased WER for long-tail words compared to strong baselines, respectively.

cs.CL↗

arXiv2025

Electrochemistry-Enhanced Dynamic Paths Sampling Unveiling Nuclear Quantum Effects in Electrocatalysis

Proton-coupled electron transfers (PCET) are elementary steps in electrocatalysis. However, accurate calculations of PCET rates remain challenging, especially considering nuclear quantum effects (NQEs) under a constant potential condition. Statistical sampling of reaction paths is an ideal approach for rate calculations, however, is always limited by the rare-event issue. Here we develop an electrochemistry-driven quantum dynamics approach enabling realistic enhanced paths sampling under constant potentials without a priori defined reaction coordinates. We apply the method in modeling the Volmer step of the hydrogen evolution reaction, and demonstrate that the NQEs exhibit more than one order of magnitude impact on the computed rate constant, indicating an essential role of NQEs in electrochemistry.

physics.chem-ph↗

arXiv2025

Efficiently charting the space of mixed vacancy-ordered perovskites by machine-learning encoded atomic-site information

Vacancy-ordered double perovskites (VODPs) are promising alternatives to three-dimensional lead halide perovskites for optoelectronic and photovoltaic applications. Mixing these materials creates a vast compositional space, allowing for highly tunable electronic and optical properties. However, the extensive chemical landscape poses significant challenges in efficiently screening candidates with target properties. In this study, we illustrate the diversity of electronic and optical characteristics as well as the nonlinear mixing effects on electronic structures within mixed VODPs. For mixed systems with limited local environment options, the information regarding atomic-site occupation in-principle determines both structural configurations and all essential properties. Building upon this concept, we have developed a model that integrates a data-augmentation scheme with a transformer-inspired graph neural network (GNN), which encodes atomic-site information from mixed systems. This approach enables us to accurately predict band gaps and formation energies for test samples, achieving Root Mean Square Errors (RMSE) of 21 meV and 3.9 meV/atom, respectively. Trained with datasets that include (up to) ternary mixed systems and supercells with less than 72 atoms, our model can be generalized to medium- and high-entropy mixed VODPs (with 4 to 6 principal mixing elements) and large supercells containing more than 200 atoms. Furthermore, our model successfully reproduces experimentally observed bandgap bowing in Sn-based mixed VODPs and reveals an unconventional mixing effect that can result in smaller band gaps compared to those found in pristine systems.

cond-mat.mtrl-sci↗

arXiv2024

UME: Upcycling Mixture-of-Experts for Scalable and Efficient Automatic Speech Recognition

Recent advancements in scaling up models have significantly improved performance in Automatic Speech Recognition (ASR) tasks. However, training large ASR models from scratch remains costly. To address this issue, we introduce UME, a novel method that efficiently Upcycles pretrained dense ASR checkpoints into larger Mixture-of-Experts (MoE) architectures. Initially, feed-forward networks are converted into MoE layers. By reusing the pretrained weights, we establish a robust foundation for the expanded model, significantly reducing optimization time. Then, layer freezing and expert balancing strategies are employed to continue training the model, further enhancing performance. Experiments on a mixture of 170k-hour Mandarin and English datasets show that UME: 1) surpasses the pretrained baseline by a margin of 11.9% relative error rate reduction while maintaining comparable latency; 2) reduces training time by up to 86.7% and achieves superior accuracy compared to training models of the same size from scratch.

eess.AS↗

arXiv2023

The first Ka-band (26.1-35 GHz) blind line survey towards Orion KL

We conducted a Ka-band (26.1--35 GHz) line survey towards Orion KL using the TianMa 65-m Radio Telescope (TMRT). It is the first blind line survey in the Ka band, and achieves a sensitivity of mK level (1--3 mK at a spectral resolution of $\sim$1 km s$^{-1}$). In total, 592 Gaussian features are extracted. Among them, 257 radio recombination lines (RRLs) are identified. The maximum $\Delta n$ of RRLs of H, He and C are 20, 15, and 5, respectively. Through stacking, we have detected the $\beta$ lines of ion RRLs (RRLs of C$^+$ with possible contribution of other ions like O$^+$) for the first time, and tentative signal of the $\gamma$ lines of ion RRLs can also be seen on the stacked spectrum. Besides, 318 other line features were assigned to 37 molecular species, and ten of these species were not detected in the Q-band survey of TMRT. The vibrationally excited states of nine species were also detected. Emission of most species can be modeled under LTE. A number of transitions of E-CH3OH ($J_2-J_1$) display maser effects, which are confirmed by our modeling, and besides the bumping peak at $J\sim 6$ there is another peak at $J\sim 13$. Methylcyanoacetylene (CH$_3$C$_3$N) is detected in Orion KL for the first time. This work emphasizes that the Ka band, which was long-ignored for spectral line surveys, is very useful for surveying RRLs and molecular lines simultaneously.

astro-ph.GA↗

arXiv2023

Neural2Speech: A Transfer Learning Framework for Neural-Driven Speech Reconstruction

Reconstructing natural speech from neural activity is vital for enabling direct communication via brain-computer interfaces. Previous efforts have explored the conversion of neural recordings into speech using complex deep neural network (DNN) models trained on extensive neural recording data, which is resource-intensive under regular clinical constraints. However, achieving satisfactory performance in reconstructing speech from limited-scale neural recordings has been challenging, mainly due to the complexity of speech representations and the neural data constraints. To overcome these challenges, we propose a novel transfer learning framework for neural-driven speech reconstruction, called Neural2Speech, which consists of two distinct training phases. First, a speech autoencoder is pre-trained on readily available speech corpora to decode speech waveforms from the encoded speech representations. Second, a lightweight adaptor is trained on the small-scale neural recordings to align the neural activity and the speech representation for decoding. Remarkably, our proposed Neural2Speech demonstrates the feasibility of neural-driven speech reconstruction even with only 20 minutes of intracranial data, which significantly outperforms existing baseline methods in terms of speech fidelity and intelligibility.

cs.SD↗

arXiv2023

Do self-supervised speech and language models extract similar representations as human brain?

Speech and language models trained through self-supervised learning (SSL) demonstrate strong alignment with brain activity during speech and language perception. However, given their distinct training modalities, it remains unclear whether they correlate with the same neural aspects. We directly address this question by evaluating the brain prediction performance of two representative SSL models, Wav2Vec2.0 and GPT-2, designed for speech and language tasks. Our findings reveal that both models accurately predict speech responses in the auditory cortex, with a significant correlation between their brain predictions. Notably, shared speech contextual information between Wav2Vec2.0 and GPT-2 accounts for the majority of explained variance in brain activity, surpassing static semantic and lower-level acoustic-phonetic information. These results underscore the convergence of speech contextual representations in SSL models and their alignment with the neural network underlying speech perception, offering valuable insights into both SSL models and the neural basis of speech and language processing.

q-bio.NC↗

arXiv2023

OTF: Optimal Transport based Fusion of Supervised and Self-Supervised Learning Models for Automatic Speech Recognition

Self-Supervised Learning (SSL) Automatic Speech Recognition (ASR) models have shown great promise over Supervised Learning (SL) ones in low-resource settings. However, the advantages of SSL are gradually weakened when the amount of labeled data increases in many industrial applications. To further improve the ASR performance when abundant labels are available, we first explore the potential of combining SL and SSL ASR models via analyzing their complementarity in recognition accuracy and optimization property. Then, we propose a novel Optimal Transport based Fusion (OTF) method for SL and SSL models without incurring extra computation cost in inference. Specifically, optimal transport is adopted to softly align the layer-wise weights to unify the two different networks into a single one. Experimental results on the public 1k-hour English LibriSpeech dataset and our in-house 2.6k-hour Chinese dataset show that OTF largely outperforms the individual models with lower error rates.

eess.AS↗

arXiv2023

Ionic blockade in a charged single-file water channel

The classical continuum theories fail to describe the ionic transport in Angstrom channels, where conduction deviates from Ohm's law, as attributed to dehydration/self-energy barrier and dissociation of Bjerrum ion-pairs in previous work. Here we found that the cations are strongly bound to the surface charge that blockade the ionic transport in a single-file water channel, causing nonlinear current-voltage responses. The presence of free ions significantly increased the probability of bound ions being released, resulting in an ionic current. We found that ionic conduction gradually becomes Ohmic as surface charge density increases, but the conduction amplitude decreased due to increased friction from bound ions. We rationalized the ionic transport by 1D Kramers' escape theory framework, which well described nonlinear ionic current, and the impact of surface charge density on turning to Ohmic system. Our results possibly provide an alternative view of ionic blockade in Angstrom channels.

cond-mat.soft↗

arXiv2023

First Detection of Radio Recombination Lines of Ions Heavier than Helium

We report the first detection of radio recombination lines (RRLs) of ions heavier than helium. In a highly sensitive multi-band (12--50 GHz) line survey toward Orion KL with the TianMa 65-m Radio Telescope (TMRT), we successfully detected more than fifteen unblended $\alpha$ lines of RRLs of singly ionized species (XII) recombined from XIII. The Ka-band (35--50 GHz) spectrum also shows tentative signals of $\beta$ lines of ions. The detected lines can be successfully crossmatched with the the rest frequencies of RRLs of CII and/or OII. This finding greatly expands the connotation of ion RRLs, since before this work only two blended lines (105$\alpha$ and 121$\alpha$) of HeII had been reported. Our detected lines can be fitted simultaneously under assumption of local thermodynamic equilibrium (LTE). An abundance of CIII and OIII of 8.8$\times$10$^{-4}$ is obtained, avoiding the complexities of optical/infrared observations and the blending of RRLs of atoms. It is consistent with but approaches the upper bound of the value (10$^{-4}$--$10^{-3}$) estimated from optical/infrared observations. The effects of dielectronic recombination may contribute to enhancing the level populations even at large $n$. We expect future observations using radio interferometers could break the degeneracy between C and O, and help to reveal the ionization structure and dynamical evolution of various ionized regions.

astro-ph.GA↗

arXiv2022

UFO2: A unified pre-training framework for online and offline speech recognition

In this paper, we propose a Unified pre-training Framework for Online and Offline (UFO2) Automatic Speech Recognition (ASR), which 1) simplifies the two separate training workflows for online and offline modes into one process, and 2) improves the Word Error Rate (WER) performance with limited utterance annotating. Specifically, we extend the conventional offline-mode Self-Supervised Learning (SSL)-based ASR approach to a unified manner, where the model training is conditioned on both the full-context and dynamic-chunked inputs. To enhance the pre-trained representation model, stop-gradient operation is applied to decouple the online-mode objectives to the quantizer. Moreover, in both the pre-training and the downstream fine-tuning stages, joint losses are proposed to train the unified model with full-weight sharing for the two modes. Experimental results on the LibriSpeech dataset show that UFO2 outperforms the SSL-based baseline method by 29.7% and 18.2% relative WER reduction in offline and online modes, respectively.

eess.AS↗

arXiv2022

A Q-band line survey towards Orion KL using the Tianma radio telescope

We have conducted a line survey towards Orion KL using the Q-band receiver of Tianma 65 m radio telescope (TMRT), covering 34.8--50 GHz with a velocity resolution between 0.79 km s$^{-1}$ and 0.55 km s$^{-1}$ respectively. The observations reach a sensitivity on the level of 1-8 mK, proving that the TMRT is sensitive for conducting deep line surveys. In total, 597 Gaussian features are extracted. Among them, 177 radio recombination lines (RRLs) are identified, including 126, 40 and 11 RRLs of hydrogen, helium and carbon, with a maximum $\Delta n$ of 16, 7, and 3, respectively. The carbon RRLs are confirmed to originate from photodissociation regions with a $V_{\rm LSR}\sim$9 km s$^{-1}$. In addition, 371 molecular transitions of 53 molecular species are identified. Twenty-one molecular species of this survey were not firmly detected in the Q band by Rizzo et al. (2017), including species such as H$_2$CS, HCOOH, C$_2$H$_5$OH, H$_2^{13}$CO, H$_2$CCO, CH$_3$CHO, CH$_2$OCH$_2$, HCN $v_2=1$, and CH$_3$OCHO $v_t=1$. In particular, the vibrationally excited states of ethyl cyanide (C$_2$H$_5$CN $v$13/$v$21) are for the first time firmly detected in the Q band. NH$_3$ (15,15) and (16,16) are identified, and they are so far the highest transitions of the NH$_3$ inversion lines detected towards Orion KL. All the identified lines can be reproduced by a radiative transfer model.

astro-ph.GA↗

arXiv2021

Self-repairing high entropy oxides

All biological organisms, from plants to living creatures, can heal minor wounds and damage. The realization of a similar self-healing capacity in inorganic materials has been a design target for many decades. This would represent a breakthrough in materials engineering, enabling many novel technological applications, since such materials would be able to resist damage caused by electromagnetic irradiation and/or mechanical impact. Here we demonstrate that a high-entropy oxide is intrinsically capable of undergoing an autonomous self-repairing process. Transmission electron microscopy revealed that the spinel structure of (AlCoCrCu0.5FeNi)3O4 can regrow and repair itself at the atomic level when damaged. Density functional theory calculations reveal that the extra enthalpy stored in the high entropy material during fabrication can be released to effectively heal macroscopic defects by regrowing into a partially ordered state. This extraordinary self-repairing phenomenon makes this new material highly desirable as a coating, enabling structures used in harsh environments to better withstand damage, such as cosmic irradiation in space, nuclear irradiation in nuclear power facilities, or tribological damage. Most importantly, our results set the general design principles for the synthesis of self-repairing materials.

cond-mat.mtrl-sci↗

arXiv2021

SCaLa: Supervised Contrastive Learning for End-to-End Speech Recognition

End-to-end Automatic Speech Recognition (ASR) models are usually trained to optimize the loss of the whole token sequence, while neglecting explicit phonemic-granularity supervision. This could result in recognition errors due to similar-phoneme confusion or phoneme reduction. To alleviate this problem, we propose a novel framework based on Supervised Contrastive Learning (SCaLa) to enhance phonemic representation learning for end-to-end ASR systems. Specifically, we extend the self-supervised Masked Contrastive Predictive Coding (MCPC) to a fully-supervised setting, where the supervision is applied in the following way. First, SCaLa masks variable-length encoder features according to phoneme boundaries given phoneme forced-alignment extracted from a pre-trained acoustic model; it then predicts the masked features via contrastive learning. The forced-alignment can provide phoneme labels to mitigate the noise introduced by positive-negative pairs in self-supervised MCPC. Experiments on reading and spontaneous speech datasets show that our proposed approach achieves 2.8 and 1.4 points Character Error Rate (CER) absolute reductions compared to the baseline, respectively.

eess.AS↗