arXiv subjects

Wei Li

Publications and source records attributed to Wei Li.

At least 883 records · Page 49Linked to original sources

arXiv2022

Network-Initialized Monte Carlo Based on Generative Neural Networks

We design generative neural networks that generate Monte Carlo configurations with complete absence of autocorrelation from which only short Markov chains are needed before making measurements for physical observables, irrespective of the system locating at the classical critical point, fermionic Mott insulator, Dirac semimetal, or quantum critical point. We further propose a network-initialized Monte Carlo scheme based on such neural networks, which provides independent samplings and can accelerate the Monte Carlo simulations by significantly reducing the thermalization process. We demonstrate the performance of our approach on the two-dimensional Ising and fermion Hubbard models, and expect it can systematically speed up the Monte Carlo simulations especially for the very challenging many-electron problems.

cond-mat.str-el↗

arXiv2022

Dimensionality-controlled evolution of charge-transfer energy in digital nickelates superlattices

Fundamental understanding and control of the electronic structure evolution in rare-earth nickelates is a fascinating and meaningful issue, as well as being helpful to understand the mechanism of recently discovered superconductivity. Here we systematically study the dimensionality effect on the ground electronic state in high-quality (NdNiO3)m/(SrTiO3)1 superlattices through transport and soft x-ray absorption spectroscopy. The metal-to-insulator transition temperature decreases with the thickness of the NdNiO3 slab decreasing from bulk to 7 unit cells, then increases gradually as m further reduces to 1 unit cell. Spectral evidence demonstrates that the stabilization of insulating phase can be attributed to the increase of the charge-transfer energy between O 2p and Ni 3d bands. The prominent multiplet feature on the Ni L3 edge develops with the decrease of NdNiO3 slab thickness, suggesting the strengthening of the charge disproportionate state under the dimensional confinement. Our work provides convincing evidence that dimensionality is an effective knob to modulate the charge-transfer energy and thus the collective ground state in nickelates.

cond-mat.mtrl-sci↗

arXiv2022

Few-Shot Speaker Identification Using Depthwise Separable Convolutional Network with Channel Attention

Although few-shot learning has attracted much attention from the fields of image and audio classification, few efforts have been made on few-shot speaker identification. In the task of few-shot learning, overfitting is a tough problem mainly due to the mismatch between training and testing conditions. In this paper, we propose a few-shot speaker identification method which can alleviate the overfitting problem. In the proposed method, the model of a depthwise separable convolutional network with channel attention is trained with a prototypical loss function. Experimental datasets are extracted from three public speech corpora: Aishell-2, VoxCeleb1 and TORGO. Experimental results show that the proposed method exceeds state-of-the-art methods for few-shot speaker identification in terms of accuracy and F-score.

eess.AS↗

arXiv2022

A multi-task learning for cavitation detection and cavitation intensity recognition of valve acoustic signals

With the rapid development of smart manufacturing, data-driven machinery health management has received a growing attention. As one of the most popular methods in machinery health management, deep learning (DL) has achieved remarkable successes. However, due to the issues of limited samples and poor separability of different cavitation states of acoustic signals, which greatly hinder the eventual performance of DL modes for cavitation intensity recognition and cavitation detection. In this work, a novel multi-task learning framework for simultaneous cavitation detection and cavitation intensity recognition framework using 1-D double hierarchical residual networks (1-D DHRN) is proposed for analyzing valves acoustic signals. Firstly, a data augmentation method based on sliding window with fast Fourier transform (Swin-FFT) is developed to alleviate the small-sample issue confronted in this study. Secondly, a 1-D double hierarchical residual block (1-D DHRB) is constructed to capture sensitive features from the frequency domain acoustic signals of valve. Then, a new structure of 1-D DHRN is proposed. Finally, the devised 1-D DHRN is evaluated on two datasets of valve acoustic signals without noise (Dataset 1 and Dataset 2) and one dataset of valve acoustic signals with realistic surrounding noise (Dataset 3) provided by SAMSON AG (Frankfurt). Our method has achieved state-of-the-art results. The prediction accurcies of 1-D DHRN for cavitation intensitys recognition are as high as 93.75%, 94.31% and 100%, which indicates that 1-D DHRN outperforms other DL models and conventional methods. At the same time, the testing accuracies of 1-D DHRN for cavitation detection are as high as 97.02%, 97.64% and 100%. In addition, 1-D DHRN has also been tested for different frequencies of samples and shows excellent results for frequency of samples that mobile phones can accommodate.

cs.SD↗

arXiv2022

Into the EFThedron and UV constraints from IR consistency

Recently it was proposed that the theory space of effective field theories with consistent UV completions can be described as a positive geometry, termed the EFThedron. In this paper we demonstrate that at the core, the geometry is given by the convex hull of the product of two moment curves. This makes contact with the well studied bi-variate moment problem, which in various instances has known solutions, generalizing the Hankel matrices of couplings into moment matrices. We are thus able to obtain analytic expressions for bounds, which perfectly match numerical results from semi-definite programing methods. Furthermore, we demonstrate that crossing symmetry in the IR imposes non-trivial constraints on the UV spectrum. In particular, permutation invariance for identical scalar scattering requires that any UV completion beyond the scalar sector must contain arbitrarily high spins, including at least all even spins $\ell\le28$, with the ratio of spinning spectral functions bounded from above, exhibiting large spin suppression. The spinning spectrum must also include at least one state satisfying a bound $m^2_{J}<M^2 \frac{( J^2-12) ( J^4 - 32 J^2 +204)}{8 (150 - 43 J^2 + 2 J^4)}$, where $J^2=\ell(\ell+1)$, and $M^2$ is the mass of the heaviest spin 2 state in the spectrum.

hep-th↗

arXiv2022

Spatial-Spectral Feature Extraction via Deep ConvLSTM Neural Networks for Hyperspectral Image Classification

In recent years, deep learning has presented a great advance in hyperspectral image (HSI) classification. Particularly, long short-term memory (LSTM), as a special deep learning structure, has shown great ability in modeling long-term dependencies in the time dimension of video or the spectral dimension of HSIs. However, the loss of spatial information makes it quite difficult to obtain the better performance. In order to address this problem, two novel deep models are proposed to extract more discriminative spatial-spectral features by exploiting the Convolutional LSTM (ConvLSTM). By taking the data patch in a local sliding window as the input of each memory cell band by band, the 2-D extended architecture of LSTM is considered for building the spatial-spectral ConvLSTM 2-D Neural Network (SSCL2DNN) to model long-range dependencies in the spectral domain. To better preserve the intrinsic structure information of the hyperspectral data, the spatial-spectral ConvLSTM 3-D Neural Network (SSCL3DNN) is proposed by extending LSTM to 3-D version for further improving the classification performance. The experiments, conducted on three commonly used HSI data sets, demonstrate that the proposed deep models have certain competitive advantages and can provide better classification performance than other state-of-the-art approaches.

cs.CV↗

arXiv2022

A3CLNN: Spatial, Spectral and Multiscale Attention ConvLSTM Neural Network for Multisource Remote Sensing Data Classification

The problem of effectively exploiting the information multiple data sources has become a relevant but challenging research topic in remote sensing. In this paper, we propose a new approach to exploit the complementarity of two data sources: hyperspectral images (HSIs) and light detection and ranging (LiDAR) data. Specifically, we develop a new dual-channel spatial, spectral and multiscale attention convolutional long short-term memory neural network (called dual-channel A3CLNN) for feature extraction and classification of multisource remote sensing data. Spatial, spectral and multiscale attention mechanisms are first designed for HSI and LiDAR data in order to learn spectral- and spatial-enhanced feature representations, and to represent multiscale information for different classes. In the designed fusion network, a novel composite attention learning mechanism (combined with a three-level fusion strategy) is used to fully integrate the features in these two data sources. Finally, inspired by the idea of transfer learning, a novel stepwise training strategy is designed to yield a final classification result. Our experimental results, conducted on several multisource remote sensing data sets, demonstrate that the newly proposed dual-channel A3CLNN exhibits better feature representation ability (leading to more competitive classification performance) than other state-of-the-art methods.

cs.CV↗

arXiv2022

Geometric Filterless Photodetectors for Mid-infrared Spin Light

Free-space circularly polarized light (CPL) detection, requiring polarizers and waveplates, has been well established, while such spatial degree of freedom is unfortunately absent in integrated on-chip optoelectronics. So far, those reported filterless CPL photodetectors suffer from the intrinsic small discrimination ratio, vulnerability to the non-CPL field components, and low responsivity. Here, we report a distinct paradigm of geometric photodetectors in mid-infrared exhibiting colossal discrimination ratio, close-to-perfect CPL-specific response, a zero-bias responsivity of 392 V/W at room temperature, and a detectivity of ellipticity down to 0.03$^o$ Hz$^{-1/2}$. Our approach employs plasmonic nanostructures array with judiciously designed symmetry, assisted by graphene ribbons to electrically read their near-field optical information. This geometry-empowered recipe for infrared photodetectors provides a robust, direct, strict, and high-quality solution to on-chip filterless CPL detection and unlocks new opportunities for integrated functional optoelectronic devices.

physics.optics↗

arXiv2022

Quasi-periodic oscillations of the X-ray burst from the magnetar SGR J1935+2154 and associated with the fast radio burst FRB 200428

The origin(s) and mechanism(s) of fast radio bursts (FRBs), which are short radio pulses from cosmological distances, have remained a major puzzle since their discovery. We report a strong Quasi-Periodic Oscillation(QPO) of 40 Hz in the X-ray burst from the magnetar SGR J1935+2154 and associated with FRB 200428, significantly detected with the Hard X-ray Modulation Telescope (Insight-HXMT) and also hinted by the Konus-Wind data. QPOs from magnetar bursts have only been rarely detected; our 3.4 sigma (p-value is 2.9e-4) detection of the QPO reported here reveals the strongest QPO signal observed from magnetars (except in some very rare giant flares), making this X-ray burst unique among magnetar bursts. The two X-ray spikes coinciding with the two FRB pulses are also among the peaks of the QPO. Our results suggest that at least some FRBs are related to strong oscillation processes of neutron stars. We also show that we may overestimate the significance of the QPO signal and underestimate the errors of QPO parameters if QPO exists only in a fraction of the time series of a X-ray burst which we use to calculate the Leahy-normalized periodogram.

astro-ph.HE↗

arXiv2022

Nonparametric inference about mean functionals of nonignorable nonresponse data without identifying the joint distribution

We consider identification and inference about mean functionals of observed covariates and an outcome variable subject to nonignorable missingness. By leveraging a shadow variable, we establish a necessary and sufficient condition for identification of the mean functional even if the full data distribution is not identified. We further characterize a necessary condition for $\sqrt{n}$-estimability of the mean functional. This condition naturally strengthens the identifying condition, and it requires the existence of a function as a solution to a representer equation that connects the shadow variable to the mean functional. Solutions to the representer equation may not be unique, which presents substantial challenges for nonparametric estimation and standard theories for nonparametric sieve estimators are not applicable here. We construct a consistent estimator for the solution set and then adapt the theory of extremum estimators to find from the estimated set a consistent estimator for an appropriately chosen solution. The estimator is asymptotically normal, locally efficient and attains the semiparametric efficiency bound under certain regularity conditions. We illustrate the proposed approach via simulations and a real data application on home pricing.

math.ST↗

arXiv2022

Calibrated regression estimation using empirical likelihood under data fusion

Data analysis based on information from several sources is common in economic and biomedical studies. This setting is often referred to as the data fusion problem, which differs from traditional missing data problems since no complete data is observed for any subject. We consider a regression analysis when the outcome variable and some covariates are collected from two different sources. By leveraging the common variables observed in both data sets, doubly robust estimation procedures are proposed in the literature to protect against possible model misspecifications. However, they employ only a single propensity score model for the data fusion process and a single imputation model for the covariates available in one data set. It may be questionable to assume that either model is correctly specified in practice. We therefore propose an approach that calibrates multiple propensity score and imputation models to gain more protection based on empirical likelihood methods. The resulting estimator is consistent when any one of those models is correctly specified and is robust against extreme values of the fitted propensity scores. We also establish its asymptotic normality property and discuss the semiparametric estimation efficiency. Simulation studies show that the proposed estimator has substantial advantages over existing doubly robust estimators, and an assembled U.S. household expenditure data example is used for illustration.

stat.ME↗

arXiv2022

Faster-TAD: Towards Temporal Action Detection with Proposal Generation and Classification in a Unified Network

Temporal action detection (TAD) aims to detect the semantic labels and boundaries of action instances in untrimmed videos. Current mainstream approaches are multi-step solutions, which fall short in efficiency and flexibility. In this paper, we propose a unified network for TAD, termed Faster-TAD, by re-purposing a Faster-RCNN like architecture. To tackle the unique difficulty in TAD, we make important improvements over the original framework. We propose a new Context-Adaptive Proposal Module and an innovative Fake-Proposal Generation Block. What's more, we use atomic action features to improve the performance. Faster-TAD simplifies the pipeline of TAD and gets remarkable performance on lots of benchmarks, i.e., ActivityNet-1.3 (40.01% mAP), HACS Segments (38.39% mAP), SoccerNet-Action Spotting (54.09% mAP). It outperforms existing single-network detector by a large margin.

cs.CV↗

arXiv2022

Deep Learning-based Small Magnitude Earthquake Detection and Seismic Phase Classification

Reliable earthquake detection and seismic phase classification is often challenging especially in the circumstances of low magnitude events or poor signal-to-noise ratio. With improved seismometers and better global coverage, a sharp increase in the volume of recorded seismic data is witnessed. This makes the handling of the seismic data rather daunting based on traditional approaches and therefore fuels the need for a more robust and reliable method. In this study, we investigate two deep learningbased models, termed 1D ResidualNeuralNetwork (ResNet) and multi-branch ResNet, for tackling the problem of seismic signal detection and phase identification, especially the later can be used in the case where multiple classes is organized in the hierarchical format. These methods are trained and tested on the dataset of the Southern California Seismic Network. Results demonstrate that the proposed methods can achieve robust performance for the detection of seismic signals, and the identification of seismic phases, even when the seismic events are of small magnitude and are masked by noise. Compared with previously proposed deep learning methods, the introduced frameworks achieve 4% improvement in earthquake monitoring, and a slight enhancement in seismic phase classification.

physics.geo-ph↗

arXiv2022

CREIME: A Convolutional Recurrent model for Earthquake Identification and Magnitude Estimation

The detection and rapid characterisation of earthquake parameters such as magnitude are of prime importance in seismology, particularly in applications such as Earthquake Early Warning (EEW). Traditionally, algorithms such as STA/LTA are used for event detection, while frequency or amplitude domain parameters calculated from 1-3 seconds of first P-arrival data are sometimes used to provide a first estimate of (body wave) magnitude. Owing to extensive involvement of human experts in parameter determination, these approaches are often found to be insufficient. Moreover, these methods are sensitive to the signal to noise ratio and may often lead to false or missed alarms depending on the choice of parameters. We, therefore, propose a multitasking deep learning model the Convolutional Recurrent model for Earthquake Identification and Magnitude Estimation (CREIME) that: (i) detects the first earthquake signal, from background seismic noise, (ii) determines first P arrival time as well as (iii) estimates the magnitude using the raw 3-component waveform data from a single station as model input. Considering, speed is of essence in EEW, we use up to two seconds of P-wave information which, to the best of our knowledge, is a significantly smaller data window (5 second window with up to of P wave data) compared to the previous studies. To examine the robustness of CREIME we test it on two independent datasets and find that it achieves an average accuracy of 98 percent for event vs noise discrimination and is able to estimate first P arrival time and local magnitude with average root mean squared errors of 0.13 seconds and 0.65 units, respectively. We also compare CREIME architecture with architectures of other baseline models, by training them on the same data, and also with traditional algorithms such as STA/LTA, and show that our architecture outperforms these methods.

physics.geo-ph↗

arXiv2022

MC-LCR: Multi-modal contrastive classification by locally correlated representations for effective face forgery detection

As the remarkable development of facial manipulation technologies is accompanied by severe security concerns, face forgery detection has become a recent research hotspot. Most existing detection methods train a binary classifier under global supervision to judge real or fake. However, advanced manipulations only perform small-scale tampering, posing challenges to comprehensively capture subtle and local forgery artifacts, especially in high compression settings and cross-dataset scenarios. To address such limitations, we propose a novel framework named Multi-modal Contrastive Classification by Locally Correlated Representations(MC-LCR), for effective face forgery detection. Instead of specific appearance features, our MC-LCR aims to amplify implicit local discrepancies between authentic and forged faces from both spatial and frequency domains. Specifically, we design the shallow style representation block that measures the pairwise correlation of shallow feature maps, which encodes local style information to extract more discriminative features in the spatial domain. Moreover, we make a key observation that subtle forgery artifacts can be further exposed in the patch-wise phase and amplitude spectrum and exhibit different clues. According to the complementarity of amplitude and phase information, we develop a patch-wise amplitude and phase dual attention module to capture locally correlated inconsistencies with each other in the frequency domain. Besides the above two modules, we further introduce the collaboration of supervised contrastive loss with cross-entropy loss. It helps the network learn more discriminative and generalized representations. Through extensive experiments and comprehensive studies, we achieve state-of-the-art performance and demonstrate the robustness and generalization of our method.

cs.CV↗

arXiv2022

MS-HLMO: Multi-scale Histogram of Local Main Orientation for Remote Sensing Image Registration

Multi-source image registration is challenging due to intensity, rotation, and scale differences among the images. Considering the characteristics and differences of multi-source remote sensing images, a feature-based registration algorithm named Multi-scale Histogram of Local Main Orientation (MS-HLMO) is proposed. Harris corner detection is first adopted to generate feature points. The HLMO feature of each Harris feature point is extracted on a Partial Main Orientation Map (PMOM) with a Generalized Gradient Location and Orientation Histogram-like (GGLOH) feature descriptor, which provides high intensity, rotation, and scale invariance. The feature points are matched through a multi-scale matching strategy. Comprehensive experiments on 17 multi-source remote sensing scenes demonstrate that the proposed MS-HLMO and its simplified version MS-HLMO$^+$ outperform other competitive registration algorithms in terms of effectiveness and generalization.

eess.IV↗

arXiv2022

Stochastic Backpropagation: A Memory Efficient Strategy for Training Video Models

We propose a memory efficient method, named Stochastic Backpropagation (SBP), for training deep neural networks on videos. It is based on the finding that gradients from incomplete execution for backpropagation can still effectively train the models with minimal accuracy loss, which attributes to the high redundancy of video. SBP keeps all forward paths but randomly and independently removes the backward paths for each network layer in each training step. It reduces the GPU memory cost by eliminating the need to cache activation values corresponding to the dropped backward paths, whose amount can be controlled by an adjustable keep-ratio. Experiments show that SBP can be applied to a wide range of models for video tasks, leading to up to 80.0% GPU memory saving and 10% training speedup with less than 1% accuracy drop on action recognition and temporal action detection.

cs.CV↗

arXiv2022

MeMOT: Multi-Object Tracking with Memory

We propose an online tracking algorithm that performs the object detection and data association under a common framework, capable of linking objects after a long time span. This is realized by preserving a large spatio-temporal memory to store the identity embeddings of the tracked objects, and by adaptively referencing and aggregating useful information from the memory as needed. Our model, called MeMOT, consists of three main modules that are all Transformer-based: 1) Hypothesis Generation that produce object proposals in the current video frame; 2) Memory Encoding that extracts the core information from the memory for each tracked object; and 3) Memory Decoding that solves the object detection and data association tasks simultaneously for multi-object tracking. When evaluated on widely adopted MOT benchmark datasets, MeMOT observes very competitive performance.

cs.CV↗