SearcharxivSearch

arXiv subjects

Hui Yu

Publications and source records attributed to Hui Yu.

At least 91 records · Page 5Linked to original sources

Application of Data Encryption in Chinese Named Entity Recognition

Recently, with the continuous development of deep learning, the performance of named entity recognition tasks has been dramatically improved. However, the privacy and the confidentiality of data in some specific fields, such as biomedical and military, cause insufficient data to support the training of deep neural networks. In this paper, we propose an encryption learning framework to address the problems of data leakage and inconvenient disclosure of sensitive data in certain domains. We introduce multiple encryption algorithms to encrypt training data in the named entity recognition task for the first time. In other words, we train the deep neural network using the encrypted data. We conduct experiments on six Chinese datasets, three of which are constructed by ourselves. The experimental results show that the encryption method achieves satisfactory results. The performance of some models trained with encrypted data even exceeds the performance of the unencrypted method, which verifies the effectiveness of the introduced encryption method and solves the problem of data leakage to a certain extent.

cs.CR

Quantum critical points, lines and surfaces

In this paper we promote the idea of quantum critical lines ({\em inter alia} surfaces) as opposed to points. A quantum critical line obtains when criticality at zero temperature is extended over a continuum in a one-dimensional line. We base our ideas on a simple but exactly solved model introduced by one of the authors involving a one-dimensional quantum transverse field Ising model with added 3-spin interaction. While many of the ideas are quite general, there are other aspects that are not. In particular, a line of criticality with continuously varying exponents is not captured. However, the exact solvability of the model gives us considerable confidence in our results. Although the pure system is analytically exactly solved, the disorder case requires numerical analyses based on exact computation of the correlation function in the Pfaffian representation. The disorder case leads to dynamic structure factor as a function of frequency and wave vector. We expect that the model is experientally realizable and perhaps many other similar models will be found to explore quantum critical lines.

cond-mat.str-el

Nebula Graph: An open source distributed graph database

This paper introduces the recent work of Nebula Graph, an open-source, distributed, scalable, and native graph database. We present a system design trade-off and a comprehensive overview of Nebula Graph internals, including graph data models, partitioning strategies, secondary indexes, optimizer rules, storage-side transactions, graph query languages, observability, graph processing frameworks, and visualization tool-kits. In addition, three sets of large-scale graph b

cs.DB

Quantum sensing with diamond NV centers under megabar pressures

Megabar pressures are of crucial importance for cutting-edge studies of condensed matter physics and geophysics. With the development of diamond anvil cell, laboratory studies of high pressure have entered the megabar era for decades. However, it is still challenging to implement in-situ magnetic sensing under ultrahigh pressures. Here, we demonstrate optically detected magnetic resonance of diamond nitrogen-vacancy (NV) centers, a promising quantum sensor of strain and magnetic fields, up to 1.4 Mbar. We quantify the reduction and blueshifts of NV fluorescence under high pressures. We demonstrate coherent manipulation of NV electron spins and extend its working pressure to the megabar region. These results shed new light on our understanding of diamond NV centers and will benefit quantum sensing under extreme conditions.

quant-ph

High-Pressure NMR Enabled by Diamond Nitrogen-Vacancy Centers

The integration of NMR and high pressure technique brings unique opportunities to study electronic, structural and dynamical properties under extreme conditions. Despite a great degree of success has been achieved using coil-based schemes, the contradictory requirement on sample volume of these two techniques remains an outstanding challenge. In this letter, we introduce diamond nitrogen-vacancy (NV) centers, as the source and probe of in-situ nuclear spin polarization, to address the sample volume issue. We demonstrate hyperpolarization and coherent control of $^{14}$N nuclear spins under high pressures. NMR spectra of a micro-diamond are measured up to 16.6 GPa, and unexpected pressure shift of the $^{14}$N nuclear quadrupole and hyperfine coupling terms are observed. Our work contributes to quantum sensing enhanced spectrometry under extreme conditions.

quant-ph

Filter-enhanced MLP is All You Need for Sequential Recommendation

Recently, deep neural networks such as RNN, CNN and Transformer have been applied in the task of sequential recommendation, which aims to capture the dynamic preference characteristics from logged user behavior data for accurate recommendation. However, in online platforms, logged user behavior data is inevitable to contain noise, and deep recommendation models are easy to overfit on these logged data. To tackle this problem, we borrow the idea of filtering algorithms from signal processing that attenuates the noise in the frequency domain. In our empirical experiments, we find that filtering algorithms can substantially improve representative sequential recommendation models, and integrating simple filtering algorithms (eg Band-Stop Filter) with an all-MLP architecture can even outperform competitive Transformer-based models. Motivated by it, we propose \textbf{FMLP-Rec}, an all-MLP model with learnable filters for sequential recommendation task. The all-MLP architecture endows our model with lower time complexity, and the learnable filters can adaptively attenuate the noise information in the frequency domain. Extensive experiments conducted on eight real-world datasets demonstrate the superiority of our proposed method over competitive RNN, CNN, GNN and Transformer-based methods. Our code and data are publicly available at the link: \textcolor{blue}{\url{https://github.com/RUCAIBox/FMLP-Rec}}.

cs.IR

STNN-DDI: A Substructure-aware Tensor Neural Network to Predict Drug-Drug Interactions

Motivation: Computational prediction of multiple-type drug-drug interaction (DDI) helps reduce unexpected side effects in poly-drug treatments. Although existing computational approaches achieve inspiring results, they ignore that the action of a drug is mainly caused by its chemical substructures. In addition, their interpretability is still weak. Results: In this paper, by supposing that the interactions between two given drugs are caused by their local chemical structures (sub-structures) and their DDI types are determined by the linkages between different substructure sets, we design a novel Substructure-ware Tensor Neural Network model for DDI prediction (STNN-DDI). The proposed model learns a 3-D tensor of (substructure, in-teraction type, substructure) triplets, which characterizes a substructure-substructure interaction (SSI) space. According to a list of predefined substructures with specific chemical meanings, the mapping of drugs into this SSI space enables STNN-DDI to perform the multiple-type DDI prediction in both transductive and inductive scenarios in a unified form with an explicable manner. The compar-ison with deep learning-based state-of-the-art baselines demonstrates the superiority of STNN-DDI with the significant improvement of AUC, AUPR, Accuracy, and Precision. More importantly, case studies illustrate its interpretability by both revealing a crucial sub-structure pair across drugs regarding a DDI type of interest and uncovering interaction type-specific substructure pairs in a given DDI. In summary, STNN-DDI provides an effective approach to predicting DDIs as well as explaining the interaction mechanisms among drugs.

cs.LG

A Novel Grid-forming Voltage Control Strategy for Supplying Unbalanced Microgrid Loads Using Inverter-based Resources

This paper presents a novel grid-forming voltage control strategy for a battery energy storage system to maintain balanced three-phase output voltages when serving unbalanced loads. A stationary reference frame ($αβ$) based control scheme is proposed to regulate positive-sequence and negative-sequence voltages. Compared with the conventional rotating reference frame ($dq$) based control scheme, the proposed scheme shows better dynamic performance. Then, we analyze the system zero-sequence network and propose adding a grounding transformer to the Y/Yg connected output transformer to further reduce the voltage unbalance at the point of common coupling. The simulation results demonstrate the effective performance of the proposed voltage control scheme. Based on the results, the power-voltage unbalance curve is derived for different output transformer configurations to establish the relationship between the power unbalance limit and the voltage unbalance limit for microgrid power scheduling.

eess.SY

Superconductivity in compressed SnPS3

Metal phosphorous trichalcogenides, MPX3, is a group of van der Waals materials with rich electronic properties and even exotic magnetic behavior. These properties can be well manipulated by pressure/strain via effective control of interlayer interaction, lattice parameters and crystal structure. Superconducting transition has been observed in compressed FePSe3. However, it is the only one superconductor reported in the large MPX3 family. Is it possible to achieve superconducting transition in other MPX3 compounds, especially in a trisulfide compound? In this work, we tentatively compressed the SnPS3 (an insulator with large band gap at ambient condition) up to 48.9 GPa, and managed to achieve the superconducting transition above 31.7 GPa with Tc ranging from ~2.2 K to ~2.8 K. The upper critical field is estimated to be ~3.03 T at 40.5 GPa. Optical absorption measurements together with Raman spectroscopy show a series of transitions under pressure, which is well consistent with the electric transport results. This work provides direct experimental evidence that SnPS3 undergoes an insulator-metal transition near 31.7 GPa. More importantly, it demonstrates that superconductivity can exist in MPS3 compounds, which not only further enriches the electronic properties of this kind of material but also paves a new avenue to explore the abundant emergence phenomena in the whole MPX3 family, and it also benefits the study of superconductor mechanism.

cond-mat.supr-con

Half-space solutions with $7/2$ frequency in the thin obstacle problem

For the thin obstacle problem in 3d, we show that half-space solutions form an isolated family in the space of $7/2$-homogeneous solutions. For a general solution with one blow-up profile in this family, we establish the rate of convergence to this profile. As a consequence, we obtain regularity of the free boundary near such contact points.

math.AP

Dual Discriminator Adversarial Distillation for Data-free Model Compression

Knowledge distillation has been widely used to produce portable and efficient neural networks which can be well applied on edge devices for computer vision tasks. However, almost all top-performing knowledge distillation methods need to access the original training data, which usually has a huge size and is often unavailable. To tackle this problem, we propose a novel data-free approach in this paper, named Dual Discriminator Adversarial Distillation (DDAD) to distill a neural network without any training data or meta-data. To be specific, we use a generator to create samples through dual discriminator adversarial distillation, which mimics the original training data. The generator not only uses the pre-trained teacher's intrinsic statistics in existing batch normalization layers but also obtains the maximum discrepancy from the student model. Then the generated samples are used to train the compact student network under the supervision of the teacher. The proposed method obtains an efficient student network which closely approximates its teacher network, despite using no original training data. Extensive experiments are conducted to to demonstrate the effectiveness of the proposed approach on CIFAR-10, CIFAR-100 and Caltech101 datasets for classification tasks. Moreover, we extend our method to semantic segmentation tasks on several public datasets such as CamVid and NYUv2. All experiments show that our method outperforms all baselines for data-free knowledge distillation.

cs.CV

A Unified Power-Setpoint Tracking Algorithm for Utility-Scale PV Systems with Power Reserves and Fast Frequency Response Capabilities

This paper presents a fast power-setpoint tracking algorithm to enable utility-scale photovoltaic (PV) systems to provide high quality grid services such as power reserves and fast frequency response. The algorithm unites maximum power-point estimation (MPPE) with flexible power-point tracking (FPPT) control to improve the performance of both algorithms, achieving fast and accurate PV power-setpoint tracking even under rapid solar irradiance changes. The MPPE is developed using a real-time, nonlinear curve-fitting approach based on the Levenberg-Marquardt algorithm. A modified adaptive FPPT based on the Perturb and Observe technique is developed for the power-setpoint tracking. By using MPPE to decouple the impact of irradiance changes on the measured PV output power, we develop a fast convergence technique for tracking power-reference changes within three FPPT iterations. Furthermore, to limit the maximum output power ripple, a new design is introduced for the steady-state voltage step size of the adaptive FPPT. The proposed algorithm is implemented on a testbed consisting of a 500 kVA three-phase, single-stage, utility-scale PV system on the OPAL-RT eMEGASIM platform. Results show that the proposed method outperforms the state-of-the-art.

eess.SY

Free boundary regularity in the triple membrane problem

We investigate the regularity of the free boundaries in the 3 elastic membranes problem. We show that the two free boundaries corresponding to the coincidence regions between consecutive membranes are $C^{1,\log}$-hypersurfaces near a regular intersection point. We also study two types of singular intersections. The first type of singular points are locally covered by a $C^{1,α}$-hypersurface. The second type of singular points stratify and each stratum is locally covered by a $C^1$-manifold.

math.AP

Parallel Medical Imaging for Intelligent Medical Image Analysis: Concepts, Methods, and Applications

There has been much progress in data-driven artificial intelligence technology for medical image analysis in the last decades. However, it still remains challenging due to its distinctive complexity of acquiring and annotating image data, extracting medical domain knowledge, and explaining the diagnostic decision for medical image analysis. In this paper, we propose a data-knowledge-driven framework termed as Parallel Medical Imaging (PMI) for intelligent medical image analysis based on the methodology of interactive ACP-based parallel intelligence. In the PMI framework, computational experiments with predictive learning in a data-driven way are conducted to extract medical knowledge for diagnostic decision support. Artificial imaging systems are introduced to select and prescriptively generate medical image data in a knowledge-driven way to utilize medical domain knowledge. Through the closed-loop optimization based on parallel execution, our proposed PMI framework can boost the generalization ability and alleviate the limitation of medical interpretation for diagnostic decisions. Furthermore, we illustrate the preliminary implementation of PMI method through the case studies of mammogram analysis and skin lesion image analysis. Experimental results on several public medical image datasets demonstrate the effectiveness of proposed PMI.

cs.CV

Resonant Damping of Kink Modes in Solar Coronal Slabs

We examine resonantly damped kink modes in straight coronal slabs, paying special attention to the effects of the formulation for the transverse density distribution ("profile"). We work in the framework of pressure-less, gravity-free, resistive magnetohydrodynamics, and we adopt the dissipative-eigenmode perspective. The density profile is restricted to be one-dimensional, but nonetheless allowed to take a generic form characterized by a continuous transition layer connecting a uniform interior to a uniform exterior. A dispersion relation (DR) is derived in the thin-boundary limit, yielding analytical expressions for the eigenfrequencies that generalize known results in various aspects. We find that the analytical rather than the numerical solutions to the thin-boundary DR serve better the purpose for validating our self-consistent resistive solutions. More importantly, the eigenfrequencies are found to be sensitive to profile specifications, the ratio of the imaginary to the real part readily varying by a factor of two when one profile is used in place of another. Our eigenmode computations are also examined in the context of impulsively excited kink waves, suggesting the importance of resonant absorption for sufficiently oblique components when the spatial scale of the exciter is comparable to the slab half-width.

astro-ph.SR

Similarity Transfer for Knowledge Distillation

Knowledge distillation is a popular paradigm for learning portable neural networks by transferring the knowledge from a large model into a smaller one. Most existing approaches enhance the student model by utilizing the similarity information between the categories of instance level provided by the teacher model. However, these works ignore the similarity correlation between different instances that plays an important role in confidence prediction. To tackle this issue, we propose a novel method in this paper, called similarity transfer for knowledge distillation (STKD), which aims to fully utilize the similarities between categories of multiple samples. Furthermore, we propose to better capture the similarity correlation between different instances by the mixup technique, which creates virtual samples by a weighted linear interpolation. Note that, our distillation loss can fully utilize the incorrect classes similarities by the mixed labels. The proposed approach promotes the performance of student model as the virtual sample created by multiple images produces a similar probability distribution in the teacher and student networks. Experiments and ablation studies on several public classification datasets including CIFAR-10,CIFAR-100,CINIC-10 and Tiny-ImageNet verify that this light-weight method can effectively boost the performance of the compact student model. It shows that STKD substantially has outperformed the vanilla knowledge distillation and has achieved superior accuracy over the state-of-the-art knowledge distillation methods.

cs.CV