arXiv subjects

Jun Li

Publications and source records attributed to Jun Li.

At least 667 records · Page 37Linked to original sources

arXiv2021

Detection of genuine multipartite entanglement based on local sum uncertainty relations

Genuine multipartite entanglement (GME) offers more significant advantages in quantum information compared with entanglement. We propose a sufficient criterion for the detection of GME based on local sum uncertainty relations for chosen observables of subsystems. We apply the criterion to detect the GME properties of noisy $n$-partite W state when $n = 3, 4, 5$ and $6$, and find that the criterion can detect more noisy W states when $n$ ranges from 4 to 6. Moreover, the criterion is also used to detect the genuine entanglement of $3$-qutrit state. The result is stronger than that based on GME concurrence and fisher information.

quant-ph↗

arXiv2021

Effects of Number of Filters of Convolutional Layers on Speech Recognition Model Accuracy

Inspired by the progress of the End-to-End approach [1], this paper systematically studies the effects of Number of Filters of convolutional layers on the model prediction accuracy of CNN+RNN (Convolutional Neural Networks adding to Recurrent Neural Networks) for ASR Models (Automatic Speech Recognition). Experimental results show that only when the CNN Number of Filters exceeds a certain threshold value is adding CNN to RNN able to improve the performance of the CNN+RNN speech recognition model, otherwise some parameter ranges of CNN can render it useless to add the CNN to the RNN model. Our results show a strong dependency of word accuracy on the Number of Filters of convolutional layers. Based on the experimental results, the paper suggests a possible hypothesis of Sound-2-Vector Embedding (Convolutional Embedding) to explain the above observations. Based on this Embedding hypothesis and the optimization of parameters, the paper develops an End-to-End speech recognition system which has a high word accuracy but also has a light model-weight. The developed LVCSR (Large Vocabulary Continuous Speech Recognition) model has achieved quite a high word accuracy of 90.2% only by its Acoustic Model alone, without any assistance from intermediate phonetic representation and any Language Model. Its acoustic model contains only 4.4 million weight parameters, compared to the 35~68 million acoustic-model weight parameters in DeepSpeech2 [2] (one of the top state-of-the-art LVCSR models) which can achieve a word accuracy of 91.5%. The light-weighted model is good for improving the transcribing computing efficiency and also useful for mobile devices, Driverless Vehicles, etc. Our model weight is reduced to ~10% the size of DeepSpeech2, but our model accuracy remains close to that of DeepSpeech2. If combined with a Language Model, our LVCSR system is able to achieve 91.5% word accuracy.

cs.LG↗

arXiv2021

User-Level Privacy-Preserving Federated Learning: Analysis and Performance Optimization

Federated learning (FL), as a type of collaborative machine learning framework, is capable of preserving private data from mobile terminals (MTs) while training the data into useful models. Nevertheless, from a viewpoint of information theory, it is still possible for a curious server to infer private information from the shared models uploaded by MTs. To address this problem, we first make use of the concept of local differential privacy (LDP), and propose a user-level differential privacy (UDP) algorithm by adding artificial noise to the shared models before uploading them to servers. According to our analysis, the UDP framework can realize $(ε_{i}, δ_{i})$-LDP for the $i$-th MT with adjustable privacy protection levels by varying the variances of the artificial noise processes. We then derive a theoretical convergence upper-bound for the UDP algorithm. It reveals that there exists an optimal number of communication rounds to achieve the best learning performance. More importantly, we propose a communication rounds discounting (CRD) method. Compared with the heuristic search method, the proposed CRD method can achieve a much better trade-off between the computational complexity of searching and the convergence performance. Extensive experiments indicate that our UDP algorithm using the proposed CRD method can effectively improve both the training efficiency and model quality for the given privacy protection levels.

cs.LG↗

arXiv2021

Covert Model Poisoning Against Federated Learning: Algorithm Design and Optimization

Federated learning (FL), as a type of distributed machine learning frameworks, is vulnerable to external attacks on FL models during parameters transmissions. An attacker in FL may control a number of participant clients, and purposely craft the uploaded model parameters to manipulate system outputs, namely, model poisoning (MP). In this paper, we aim to propose effective MP algorithms to combat state-of-the-art defensive aggregation mechanisms (e.g., Krum and Trimmed mean) implemented at the server without being noticed, i.e., covert MP (CMP). Specifically, we first formulate the MP as an optimization problem by minimizing the Euclidean distance between the manipulated model and designated one, constrained by a defensive aggregation rule. Then, we develop CMP algorithms against different defensive mechanisms based on the solutions of their corresponding optimization problems. Furthermore, to reduce the optimization complexity, we propose low complexity CMP algorithms with a slight performance degradation. In the case that the attacker does not know the defensive aggregation mechanism, we design a blind CMP algorithm, in which the manipulated model will be adjusted properly according to the aggregated model generated by the unknown defensive aggregation. Our experimental results demonstrate that the proposed CMP algorithms are effective and substantially outperform existing attack mechanisms.

cs.LG↗

arXiv2021

Measuring the scalar induced gravitational waves from observations

We measure the scalar induced gravitational waves from the cosmic microwave background (CMB) observations and the gravitational wave observations. In the $Λ$CDM+$r$ model, we constrain the cosmological parameters within the evolution of the scalar induced gravitational waves by the additional scalar power spectrum. The two special cases called narrow power spectrum and wide power spectrum have influence on the cosmological parameters, especially the combinations of Planck18+BAO+BK15+LISA. We also compare these numerical results from four datasets within LIGO, LISA, IPTA and FAST projects, respectively. The constraints from FAST have a significant impact on tensor-to-scalar ratio.

astro-ph.CO↗

arXiv2021

HiVision: Rapid Visualization of Large-Scale Spatial Vector Data

Rapid visualization of large-scale spatial vector data is a long-standing challenge in Geographic Information Science. In existing methods, the computation overheads grow rapidly with data volumes, leading to the incapability of providing real-time visualization for large-scale spatial vector data, even with parallel acceleration technologies. To fill the gap, we present HiVision, a display-driven visualization model for large-scale spatial vector data. Different from traditional data-driven methods, the computing units in HiVision are pixels rather than spatial objects to achieve real-time performance, and efficient spatial-index-based strategies are introduced to estimate the topological relationships between pixels and spatial objects. HiVision can maintain exceedingly good performance regardless of the data volume due to the stable pixel number for display. In addition, an optimized parallel computing architecture is proposed in HiVision to ensure the ability of real-time visualization. Experiments show that our approach outperforms traditional methods in rendering speed and visual effects while dealing with large-scale spatial vector data, and can provide interactive visualization of datasets with billion-scale points/segments/edges in real-time with flexible rendering styles. The HiVision code is open-sourced at https://github.com/MemoryMmy/HiVision with an online demonstration.

cs.GR↗

arXiv2021

Solving localized wave solutions of the derivative nonlinear Schrodinger equation using an improved PINN method

The solving of the derivative nonlinear Schrodinger equation (DNLS) has attracted considerable attention in theoretical analysis and physical applications. Based on the physics-informed neural network (PINN) which has been put forward to uncover dynamical behaviors of nonlinear partial different equation from spatiotemporal data directly, an improved PINN method with neuron-wise locally adaptive activation function is presented to derive localized wave solutions of the DNLS in complex space. In order to compare the performance of above two methods, we reveal the dynamical behaviors and error analysis for localized wave solutions which include one-rational soliton solution, genuine rational soliton solutions and rogue wave solution of the DNLS by employing two methods, also exhibit vivid diagrams and detailed analysis. The numerical results demonstrate the improved method has faster convergence and better simulation effect. On the bases of the improved method, the effects for different numbers of initial points sampled, residual collocation points sampled, network layers, neurons per hidden layer on the second order genuine rational soliton solution dynamics of the DNLS are considered, and the relevant analysis when the locally adaptive activation function chooses different initial values of scalable parameters are also exhibited in the simulation of the two-order rogue wave solution.

nlin.PS↗

arXiv2021

Hybrid quantum-classical approach to enhanced quantum metrology

Quantum metrology plays a fundamental role in many scientific areas. However, the complexity of engineering entangled probes and the external noise raise technological barriers for realizing the expected precision of the to-be-estimated parameter with given resources. Here, we address this problem by introducing adjustable controls into the encoding process and then utilizing a hybrid quantum-classical approach to automatically optimize the controls online. Our scheme does not require any complex or intractable off-line design, and it can inherently correct certain unitary errors during the learning procedure. We also report the first experimental demonstration of this promising scheme for the task of finding optimal probes for frequency estimation on a nuclear magnetic resonance (NMR) processor. The proposed scheme paves the way to experimentally auto-search optimal protocol for improving the metrology precision.

quant-ph↗

arXiv2021

Reconstruction of Quantitative Susceptibility Maps from Phase of Susceptibility Weighted Imaging with Cross-Connected $Ψ$-Net

Quantitative Susceptibility Mapping (QSM) is a new phase-based technique for quantifying magnetic susceptibility. The existing QSM reconstruction methods generally require complicated pre-processing on high-quality phase data. In this work, we propose to explore a new value of the high-pass filtered phase data generated in susceptibility weighted imaging (SWI), and develop an end-to-end Cross-connected $Ψ$-Net (C$Ψ$-Net) to reconstruct QSM directly from these phase data in SWI without additional pre-processing. C$Ψ$-Net adds an intermediate branch in the classical U-Net to form a $Ψ$-like structure. The specially designed dilated interaction block is embedded in each level of this branch to enlarge the receptive fields for capturing more susceptibility information from a wider spatial range of phase images. Moreover, the crossed connections are utilized between branches to implement a multi-resolution feature fusion scheme, which helps C$Ψ$-Net capture rich contextual information for accurate reconstruction. The experimental results on a human dataset show that C$Ψ$-Net achieves superior performance in our task over other QSM reconstruction algorithms.

eess.IV↗

arXiv2021

Robust Dynamical Decoupling for the Manipulation of a Spin Network via a Single Spin

High-fidelity control of quantum systems is crucial for quantum information processing, but is often limited by perturbations from the environment and imperfections in the applied control fields. Here, we investigate the combination of dynamical decoupling (DD) and robust optimal control (ROC) to address this problem. In this combination, ROC is employed to find robust shaped pulses, wherein the directional derivatives of the controlled dynamics with respect to control errors are reduced to a desired order. Then, we incorporate ROC pulses into DD sequences, achieving a remarkable improvement of robustness against multiple error channels. We demonstrate this method in the example of manipulating nuclear spin bath via an electron spin in the NV center system. Simulation results indicate that ROC based DD sequences outperform the state-of-the-art robust DD sequences. Our work has implications for robust quantum control on near-term noisy quantum devices.

quant-ph↗

arXiv2021

Experimental Creation of Single Rydberg Excitations via Adiabatic Passage

In an atomic ensemble, quantum information is typically carried as single collective excitations. It is very advantageous if the creation of single excitations is efficient and robust. Rydberg blockade enables deterministic creation of single excitations via collective Rabi oscillation by precisely controlling the pulse area, being sensitive to many experimental parameters. In this paper, we implement the adiabatic rapid passage technique to the Rydberg excitation process in a mesoscopic atomic ensemble. We make use of a two-photon excitation scheme with an intermediate state off-resonant and sweep the laser frequency of one excitation laser. We find the chirped scheme preserves internal phases of the collective Rydberg excitation and be more robust against variance of laser intensity and frequency detuning.

quant-ph↗

arXiv2021

Cavity-Enhanced Atom-Photon Entanglement with Subsecond Lifetime

A cold atomic ensemble suits well for optical quantum memories, and its entanglement with a single photon forms the building block for quantum networks that give promise for many revolutionary applications. Efficiency and lifetime are among the most important figures of merit for a memory. In this paper, we report the realization of entanglement between an atomic ensemble and a single-photon with subsecond lifetime and high efficiency. We engineer dual control modes in a ring cavity to create entanglement and make use of 3-dimensional optical lattice to prolong memory lifetime. The memory efficiency is 38% for 0.1 second storage. We verify the atom-photon entanglement after 1 second storage by testing the Bell inequality with a result of $S=2.36\pm0.14$.

quant-ph↗

arXiv2020

Learning Quantum Hamiltonians from Single-qubit Measurements

It is natural to measure the observables from the Hamiltonian-based quantum dynamics, and its inverse process that Hamiltonians are estimated from the measured data also is a vital topic. In this work, we propose a recurrent neural network to learn the parameters of the target Hamiltonians from the temporal records of single-qubit measurements. The method does not require the assumption of ground states and only measures single-qubit observables. It is applicable on both time-independent and time-dependent Hamiltonians and can simultaneously capture the magnitude and sign of Hamiltonian parameters. Taking quantum Ising Hamiltonians with the nearest-neighbor interactions as examples, we trained our recurrent neural networks to learn the Hamiltonian parameters with high accuracy, including the magnetic fields and coupling values. The numerical study also shows that our method has good robustness against the measurement noise and decoherence effect. Therefore, it has widespread applications in estimating the parameters of quantum devices and characterizing the Hamiltonian-based quantum dynamics.

quant-ph↗

arXiv2020

Blockchain Assisted Decentralized Federated Learning (BLADE-FL) with Lazy Clients

Federated learning (FL), as a distributed machine learning approach, has drawn a great amount of attention in recent years. FL shows an inherent advantage in privacy preservation, since users' raw data are processed locally. However, it relies on a centralized server to perform model aggregation. Therefore, FL is vulnerable to server malfunctions and external attacks. In this paper, we propose a novel framework by integrating blockchain into FL, namely, blockchain assisted decentralized federated learning (BLADE-FL), to enhance the security of FL. The proposed BLADE-FL has a good performance in terms of privacy preservation, tamper resistance, and effective cooperation of learning. However, it gives rise to a new problem of training deficiency, caused by lazy clients who plagiarize others' trained models and add artificial noises to conceal their cheating behaviors. To be specific, we first develop a convergence bound of the loss function with the presence of lazy clients and prove that it is convex with respect to the total number of generated blocks $K$. Then, we solve the convex problem by optimizing $K$ to minimize the loss function. Furthermore, we discover the relationship between the optimal $K$, the number of lazy clients, and the power of artificial noises used by lazy clients. We conduct extensive experiments to evaluate the performance of the proposed framework using the MNIST and Fashion-MNIST datasets. Our analytical results are shown to be consistent with the experimental results. In addition, the derived optimal $K$ achieves the minimum value of loss function, and in turn the optimal accuracy performance.

cs.LG↗

arXiv2020

Generalized Focal Loss V2: Learning Reliable Localization Quality Estimation for Dense Object Detection

Localization Quality Estimation (LQE) is crucial and popular in the recent advancement of dense object detectors since it can provide accurate ranking scores that benefit the Non-Maximum Suppression processing and improve detection performance. As a common practice, most existing methods predict LQE scores through vanilla convolutional features shared with object classification or bounding box regression. In this paper, we explore a completely novel and different perspective to perform LQE -- based on the learned distributions of the four parameters of the bounding box. The bounding box distributions are inspired and introduced as "General Distribution" in GFLV1, which describes the uncertainty of the predicted bounding boxes well. Such a property makes the distribution statistics of a bounding box highly correlated to its real localization quality. Specifically, a bounding box distribution with a sharp peak usually corresponds to high localization quality, and vice versa. By leveraging the close correlation between distribution statistics and the real localization quality, we develop a considerably lightweight Distribution-Guided Quality Predictor (DGQP) for reliable LQE based on GFLV1, thus producing GFLV2. To our best knowledge, it is the first attempt in object detection to use a highly relevant, statistical representation to facilitate LQE. Extensive experiments demonstrate the effectiveness of our method. Notably, GFLV2 (ResNet-101) achieves 46.2 AP at 14.6 FPS, surpassing the previous state-of-the-art ATSS baseline (43.6 AP at 14.6 FPS) by absolute 2.6 AP on COCO {\tt test-dev}, without sacrificing the efficiency both in training and inference. Code will be available at https://github.com/implus/GFocalV2.

cs.CV↗

arXiv2020

Soliton, Breather and Rogue Wave Solutions for Solving the Nonlinear Schrödinger Equation Using a Deep Learning Method with Physical Constraints

The nonlinear Schrodinger equation is a classical integrable equation which contains plenty of significant properties and occurs in many physical areas. However, due to the difficulty of solving this equation, in particular in high dimensions, lots of methods are proposed to effectively obtain different kinds of solutions, such as neural networks, among others. Recently, a method where some underlying physical laws are embeded into a conventional neural network is proposed to uncover the equation's dynamical behaviors from spatiotemporal data directly. Compared with traditional neural networks, this method can obtain remarkably accurate solution with extraordinarily less data. Meanwhile, this method also provides a better physical explanation and generalization. In this paper, based on the above method, we present an improved deep learning method to recover the soliton solutions, breather solution and rogue wave solutions to the nonlinear Schrodinger equation. In particular, the dynamical behaviors and error analysis about the one-order and two-order rogue waves of the Schrodinger equation are revealed by the deep neural network for the first time. Moreover, the effects of different numbers of initial points sampled, residual collocation points sampled, network layers, neurons per hidden layer on the one-order rogue wave dynamics of this equation have been considered with the help of the control variable way under the same initial and boundary conditions. Numerical experiments show that the dynamical behaviors of soliton solutions, breather solution and rogue wave solutions of the integrable nonlinear Schrodinger equation can be well reconstructed by utilizing this physically-constrained deep learning method.

nlin.SI↗

arXiv2020

Probing the pathway of an ultrafast structural phase transition to illuminate the transition mechanism in Cu2S

Disentangling the primary order parameter from secondary order parameters in phase transitions is critical to the interpretation of the transition mechanisms in strongly correlated systems and quantum materials. Here we present a study of structural phase transition pathways in superionic Cu2S nanocrystals that exhibit intriguing properties. Utilizing ultrafast electron diffraction techniques sensitive in both momentum-space and the time-domain, we distinguish the dynamics of crystal symmetry breaking and lattice expansion in this system. We are able to follow the transient states along the transition pathway and so observe the dynamics of both the primary and secondary order parameters. Based on these observations we argue that the mechanism of the structural phase transition in Cu2S is dominated by the electron-phonon coupling. This mechanism advances the understanding from previous results where the focus was solely on dynamic observations of the lattice expansion.

cond-mat.str-el↗

arXiv2020

Sensor-based localization of epidemic sources on human mobility networks

We investigate the source detection problem in epidemiology, which is one of the most important issues for control of epidemics. Mathematically, we reformulate the problem as one of identifying the relevant component in a multivariate Gaussian mixture model. Focusing on the study of cholera and diseases with similar modes of transmission, we calibrate the parameters of our mixture model using human mobility networks within a stochastic, spatially explicit epidemiological model for waterborne disease. Furthermore, we adopt a Bayesian perspective, so that prior information on source location can be incorporated (e.g., reflecting the impact of local conditions). Posterior-based inference is performed, which permits estimates in the form of either individual locations or regions. Importantly, our estimator only requires first-arrival times of the epidemic by putative observers, typically located only at a small proportion of nodes. The proposed method is demonstrated within the context of the 2000-2002 cholera outbreak in the KwaZulu-Natal province of South Africa.

stat.ME↗