Searcharxiv⌕ Search

arXiv subjects

Fei Kong

Publications and source records attributed to Fei Kong.

At least 37 records · Page 2Linked to original sources

An Efficient Membership Inference Attack for the Diffusion Model by Proximal Initialization

Recently, diffusion models have achieved remarkable success in generating tasks, including image and audio generation. However, like other generative models, diffusion models are prone to privacy issues. In this paper, we propose an efficient query-based membership inference attack (MIA), namely Proximal Initialization Attack (PIA), which utilizes groundtruth trajectory obtained by $ε$ initialized in $t=0$ and predicted point to infer memberships. Experimental results indicate that the proposed method can achieve competitive performance with only two queries on both discrete-time and continuous-time diffusion models. Moreover, previous works on the privacy of diffusion models have focused on vision tasks without considering audio tasks. Therefore, we also explore the robustness of diffusion models to MIA in the text-to-speech (TTS) task, which is an audio generation task. To the best of our knowledge, this work is the first to study the robustness of diffusion models to MIA in the TTS task. Experimental results indicate that models with mel-spectrogram (image-like) output are vulnerable to MIA, while models with audio output are relatively robust to MIA. {Code is available at \url{https://github.com/kong13661/PIA}}.

cs.SD↗

In situ electron paramagnetic resonance spectroscopy using single nanodiamond sensors

An ultimate goal of electron paramagnetic resonance (EPR) spectroscopy is to analyze molecular dynamics in place where it occurs, such as in a living cell. The nanodiamond (ND) hosting nitrogen-vacancy (NV) centers will be a promising EPR sensor to achieve this goal. However, ND-based EPR spectroscopy remains elusive, due to the challenge of controlling NV centers without well-defined orientations inside a flexible ND. Here, we show a generalized zero-field EPR technique with spectra robust to the sensor's orientation. The key is applying an amplitude modulation on the control field, which generates a series of equidistant Floquet states with energy splitting being the orientation-independent modulation frequency. We acquire the zero-field EPR spectrum of vanadyl ions in aqueous glycerol solution with embedded single NDs, paving the way towards \emph{in vivo} EPR.

quant-ph↗

Exposing the Fake: Effective Diffusion-Generated Images Detection

Image synthesis has seen significant advancements with the advent of diffusion-based generative models like Denoising Diffusion Probabilistic Models (DDPM) and text-to-image diffusion models. Despite their efficacy, there is a dearth of research dedicated to detecting diffusion-generated images, which could pose potential security and privacy risks. This paper addresses this gap by proposing a novel detection method called Stepwise Error for Diffusion-generated Image Detection (SeDID). Comprising statistical-based $\text{SeDID}_{\text{Stat}}$ and neural network-based $\text{SeDID}_{\text{NNs}}$, SeDID exploits the unique attributes of diffusion models, namely deterministic reverse and deterministic denoising computation errors. Our evaluations demonstrate SeDID's superior performance over existing methods when applied to diffusion models. Thus, our work makes a pivotal contribution to distinguishing diffusion model-generated images, marking a significant step in the domain of artificial intelligence security.

cs.CV↗

Quantum affine vertex algebras associated to untwisted quantum affinization algebras

Let $\mathcal U_\hbar(\hat{\mathfrak g})$ be the untwisted quantum affinization of a symmetrizable quantum Kac-Moody algebra $\mathcal U_\hbar({\mathfrak g})$. For $\ell\in\mathbb C$, we construct an $\hbar$-adic quantum vertex algebra $V_{\hat{\mathfrak g},\hbar}(\ell,0)$, and establish a one-to-one correspondence between $ϕ$-coordinated $V_{\hat{\mathfrak g},\hbar}(\ell,0)$-modules and restricted $\mathcal U_\hbar(\hat{\mathfrak g})$-modules of level $\ell$. Suppose that $\ell$ is a positive integer. We construct a quotient $\hbar$-adic quantum vertex algebra $L_{\hat{\mathfrak g},\hbar}(\ell,0)$ of $V_{\hat{\mathfrak g},\hbar}(\ell,0)$, and establish a one-to-one correspondence between certain $ϕ$-coordinated $L_{\hat{\mathfrak g},\hbar}(\ell,0)$-modules and restricted integrable $\mathcal U_\hbar(\hat{\mathfrak g})$-modules of level $\ell$. Suppose further that ${\mathfrak g}$ is of finite type. We prove that $L_{\hat{\mathfrak g},\hbar}(\ell,0)/\hbar L_{\hat{\mathfrak g},\hbar}(\ell,0)$ is isomorphic to the simple affine vertex algebra $L_{\hat{\mathfrak g}}(\ell,0)$.

math.QA↗

Are Diffusion Models Vulnerable to Membership Inference Attacks?

Diffusion-based generative models have shown great potential for image synthesis, but there is a lack of research on the security and privacy risks they may pose. In this paper, we investigate the vulnerability of diffusion models to Membership Inference Attacks (MIAs), a common privacy concern. Our results indicate that existing MIAs designed for GANs or VAE are largely ineffective on diffusion models, either due to inapplicable scenarios (e.g., requiring the discriminator of GANs) or inappropriate assumptions (e.g., closer distances between synthetic samples and member samples). To address this gap, we propose Step-wise Error Comparing Membership Inference (SecMI), a query-based MIA that infers memberships by assessing the matching of forward process posterior estimation at each timestep. SecMI follows the common overfitting assumption in MIA where member samples normally have smaller estimation errors, compared with hold-out samples. We consider both the standard diffusion models, e.g., DDPM, and the text-to-image diffusion models, e.g., Latent Diffusion Models and Stable Diffusion. Experimental results demonstrate that our methods precisely infer the membership with high confidence on both of the two scenarios across multiple different datasets. Code is available at https://github.com/jinhaoduan/SecMI.

cs.CV↗

Twisted quantum affine algebras and equivariant $ϕ$-coordinated modules for quantum vertex algebras

This paper is about establishing a natural connection of quantum affine algebras with quantum vertex algebras. Among the main results, we establish $\hbar$-adic versions of the smash product construction of quantum vertex algebras and their $ϕ$-coordinated quasi modules, which were obtained before in a sequel, we construct a family of $\hbar$-adic quantum vertex algebras $V_L[[\hbar]]^η$ as deformations of the lattice vertex algebras $V_L$, and establish a natural connection between twisted quantum affine algebras of type $A, D, E$ and equivariant $ϕ$-coordinated quasi modules for the $\hbar$-adic quantum vertex algebras $V_L[[\hbar]]^η$ with certain specialized $η$.

math.QA↗

Picotesla magnetometry of microwave fields with diamond sensors

Developing robust microwave-field sensors is both fundamentally and practically important with a wide range of applications from astronomy to communication engineering. The Nitrogen-Vacancy (NV) center in diamond is an attractive candidate for such purpose because of its magnetometric sensitivity, stability and compatibility with ambient conditions. However, the existing NV center-based magnetometers have limited sensitivity in the microwave band. Here we present a continuous heterodyne detection method that can enhance the sensor's response to weak microwaves, even in the absence of spin controls. Experimentally, we achieve a sensitivity of 8.9 pT$\cdot$Hz$^{-1/2}$ for microwaves of 2.9 GHz by simultaneously using an ensemble of $n_{\text{NV}} \sim 2.8\times10^{13}$ NV centers within a sensor volume of $4\times10^{-2}$ mm$^3$. Besides, we also achieve $1/t$ scaling of frequency resolution up to measurement time $t$ of 10000 s. Our method removes the control pulses and thus will greatly benefit the practical application of diamond-based microwave sensors.

quant-ph↗

Twisted quantum affinizations and quantization of extended affine Lie algebras

In this paper, for an arbitrary Kac-Moody Lie algebra $\mathfrak g$ and a diagram automorphism $μ$ of $\mathfrak g$ satisfying certain natural linking conditions, we introduce and study a $μ$-twisted quantum affinization algebra $\mathcal U_\hbar\left(\hat{\mathfrak g}_μ\right)$ of $\mathfrak g$. When $\mathfrak g$ is of finite type, $\mathcal U_\hbar\left(\hat{\mathfrak g}_μ\right)$ is Drinfeld's current algebra realization of the twisted quantum affine algebra. When $μ=\mathrm{id}$ and $\mathfrak g$ in affine type, $\mathcal U_\hbar\left(\hat{\mathfrak g}_μ\right)$ is the quantum toroidal algebra introduced by Ginzburg, Kapranov and Vasserot. As the main results of this paper, we first prove a triangular decomposition for $\mathcal U_\hbar\left(\hat{\mathfrak g}_μ\right)$. Second, we give a simple characterization of the affine quantum Serre relations on restricted $\mathcal U_\hbar\left(\hat{\mathfrak g}_μ\right)$-modules in terms of "normal order products". Third, we prove that the category of restricted $\mathcal U_\hbar\left(\hat{\mathfrak g}_μ\right)$-modules is a monoidal category and hence obtain a topological Hopf algebra structure on the "restricted completion" of $\mathcal U_\hbar\left(\hat{\mathfrak g}_μ\right)$. Last, we study the classical limit of $\mathcal U_\hbar\left(\hat{\mathfrak g}_μ\right)$ and abridge it to the quantization theory of extended affine Lie algebras. In particular, based on a classification result of Allison-Berman-Pianzola, we obtain the $\hbar$-deformation of all nullity $2$ extended affine Lie algebras.

math.QA↗

Improving Low-resource Reading Comprehension via Cross-lingual Transposition Rethinking

Extractive Reading Comprehension (ERC) has made tremendous advances enabled by the availability of large-scale high-quality ERC training data. Despite of such rapid progress and widespread application, the datasets in languages other than high-resource languages such as English remain scarce. To address this issue, we propose a Cross-Lingual Transposition ReThinking (XLTT) model by modelling existing high-quality extractive reading comprehension datasets in a multilingual environment. To be specific, we present multilingual adaptive attention (MAA) to combine intra-attention and inter-attention to learn more general generalizable semantic and lexical knowledge from each pair of language families. Furthermore, to make full use of existing datasets, we adopt a new training framework to train our model by calculating task-level similarities between each existing dataset and target dataset. The experimental results show that our XLTT model surpasses six baselines on two multilingual ERC benchmarks, especially more effective for low-resource languages with 3.9 and 4.1 average improvement in F1 and EM, respectively.

cs.CL↗

DiaKG: an Annotated Diabetes Dataset for Medical Knowledge Graph Construction

Knowledge Graph has been proven effective in modeling structured information and conceptual knowledge, especially in the medical domain. However, the lack of high-quality annotated corpora remains a crucial problem for advancing the research and applications on this task. In order to accelerate the research for domain-specific knowledge graphs in the medical domain, we introduce DiaKG, a high-quality Chinese dataset for Diabetes knowledge graph, which contains 22,050 entities and 6,890 relations in total. We implement recent typical methods for Named Entity Recognition and Relation Extraction as a benchmark to evaluate the proposed dataset thoroughly. Empirical results show that the DiaKG is challenging for most existing methods and further analysis is conducted to discuss future research direction for improvements. We hope the release of this dataset can assist the construction of diabetes knowledge graphs and facilitate AI-based applications.

cs.CL↗

PatentMiner: Patent Vacancy Mining via Context-enhanced and Knowledge-guided Graph Attention

Although there are a small number of work to conduct patent research by building knowledge graph, but without constructing patent knowledge graph using patent documents and combining latest natural language processing methods to mine hidden rich semantic relationships in existing patents and predict new possible patents. In this paper, we propose a new patent vacancy prediction approach named PatentMiner to mine rich semantic knowledge and predict new potential patents based on knowledge graph (KG) and graph attention mechanism. Firstly, patent knowledge graph over time (e.g. year) is constructed by carrying out named entity recognition and relation extrac-tion from patent documents. Secondly, Common Neighbor Method (CNM), Graph Attention Networks (GAT) and Context-enhanced Graph Attention Networks (CGAT) are proposed to perform link prediction in the constructed knowledge graph to dig out the potential triples. Finally, patents are defined on the knowledge graph by means of co-occurrence relationship, that is, each patent is represented as a fully connected subgraph containing all its entities and co-occurrence relationships of the patent in the knowledge graph; Furthermore, we propose a new patent prediction task which predicts a fully connected subgraph with newly added prediction links as a new pa-tent. The experimental results demonstrate that our proposed patent predic-tion approach can correctly predict new patents and Context-enhanced Graph Attention Networks is much better than the baseline. Meanwhile, our proposed patent vacancy prediction task still has significant room to im-prove.

cs.CL↗

Deforming vertex algebras by vertex bialgebras

This is a continuation of a previous study initiated by one of us on nonlocal vertex bialgebras and smash product nonlocal vertex algebras. In this paper, we study a notion of right $H$-comodule nonlocal vertex algebra for a nonlocal vertex bialgebra $H$ and give a construction of deformations of vertex algebras with a right $H$-comodule nonlocal vertex algebra structure and a compatible $H$-module nonlocal vertex algebra structure. We also give a construction of $ϕ$-coordinated quasi modules for smash product nonlocal vertex algebras. As an example, we give a family of quantum vertex algebras by deforming the vertex algebras associated to non-degenerate even lattices.

math.QA↗

Robust All-Optical Single-Shot Readout of NV Centers in Diamond

High-fidelity projective readout of a qubit's state in a single experimental repetition is a prerequisite for various quantum protocols of sensing and computing. Achieving single-shot readout is challenging for solid-state qubits. For Nitrogen-Vacancy (NV) centers in diamond, it has been realized using nuclear memories or resonant excitation at cryogenic temperature. All of these existing approaches have stringent experimental demands. In particular, they require a high efficiency of photon collection, such as immersion optics or all-diamond micro-optics. For some of the most relevant applications, such as shallow implanted NV centers in a cryogenic environment, these tools are unavailable. Here we demonstrate an all-optical spin readout scheme that achieves single-shot fidelity even if photon collection is poor (delivering less than 10$^3$ clicks/second). The scheme is based on spin-dependent resonant excitation at cryogenic temperature combined with spin-to-charge conversion, mapping the fragile electron spin states to the stable charge states. We prove this technique to work on shallow implanted NV centers as they are required for sensing and scalable NV-based quantum registers.

quant-ph↗

High-fidelity single-shot readout of single electron spin in diamond with spin-to-charge conversion

High fidelity single-shot readout of qubits is a crucial component for fault-tolerant quantum computing and scalable quantum networks. In recent years, the nitrogen-vacancy (NV) center in diamond has risen as a leading platform for the above applications. The current single-shot readout of the NV electron spin relies on resonance fluorescence method at cryogenic temperature. However, the the spin-flip process interrupts the optical cycling transition, therefore, limits the readout fidelity. Here, we introduce a spin-to-charge conversion method assisted by near-infrared (NIR) light to suppress the spin-flip error. This method leverages high spin-selectivity of cryogenic resonance excitation and high flexibility of photonionization. We achieve an overall fidelity $>$ 95% for the single-shot readout of an NV center electron spin in the presence of high strain and fast spin-flip process. With further improvements, this technique has the potential to achieve spin readout fidelity exceeding the fault-tolerant threshold, and may also find applications on integrated optoelectronic devices.

quant-ph↗

$(G,χ_ϕ)$-equivariant $ϕ$-coordinated quasi modules for nonlocal vertex algebras

In this paper, we study $(G,χ_ϕ)$-equivariant $ϕ$-coordinated quasi modules for nonlocal vertex algebras. Among the main results, we establish several conceptual results, including a generalized commutator formula and a general construction of weak quantum vertex algebras and their $(G,χ_ϕ)$-equivariant $ϕ$-coordinated quasi modules. As an application, we also construct (equivariant) $ϕ$-coordinated quasi modules for lattice vertex algebras by using Lepowsky's work on twisted vertex operators.

math.QA↗

On quantum toroidal algebra of type $A_1$

In this paper we introduce a new quantum algebra which specializes to the $2$-toroidal Lie algebra of type $A_1$. We prove that this quantum toroidal algebra has a natural triangular decomposition, a (topological) Hopf algebra structure and a vertex operator realization.

math.QA↗

Kilohertz electron paramagnetic resonance spectroscopy of single nitrogen centers at zero magnetic field

Electron paramagnetic resonance spectroscopy (EPR) is among the most important analytical tools in physics, chemistry, and biology. The emergence of nitrogen-vacancy (NV) centers in diamond, serving as an atomic-sized magnetometer, has promoted this technique to single-spin level, even under ambient conditions. Despite the enormous progress in spatial resolution, the current megahertz spectral resolution is still insufficient to resolve key heterogeneous molecular information. A major challenge is the short coherence times of the sample electron spins. Here, we address this challenge by employing a magnetic noise-insensitive transition between states of different symmetry. We demonstrate a 27-fold narrower spectrum of single substitutional nitrogen (P1) centers in diamond with linewidth of several kilohertz, and then some weak couplings can be resolved. Those results show both spatial and spectral advances of NV center-based EPR, and provide a route towards analytical (EPR) spectroscopy at single-molecule level.

quant-ph↗

Nanoscale electrometry based on a magnetic-field-resistant spin sensor

The nitrogen-vacancy (NV) center is a potential atomic-scale spin sensor for electric field sensing. However, its natural susceptibility to the magnetic field hinders effective detection of the electric field. Here we propose a robust electrometric method utilizing continuous dynamic decoupling (CDD) technique. During the CDD period, the NV center evolves in a dressed-state space, where the sensor is resistant to magnetic fields but remains sensitive to electric fields. As an example, we use this method to isolate the electric noise from a complex electro-magnetical environment near diamond surface via measuring the dephasing rate between dressed states. By reducing the surface electric noise with different covered liquids, we observe an unambiguous relation between the dephasing rate and the dielectric permittivity of the liquid, which enables a quantitative investigation of electric noise model near diamond surface.

quant-ph↗