Searcharxiv⌕ Search

arXiv subjects

Lei Chen

Publications and source records attributed to Lei Chen.

At least 379 records · Page 21Linked to original sources
arXiv2023

Correlated two-photon scattering in a one-dimensional waveguide coupled to two- or three-level giant atoms

We study the two-photon scattering processes in a one-dimensional waveguide coupled to a two- or three-level giant atom, respectively. The accumulated phase shift between the two coupling points can be utilized to alter the scattering processes. We obtain the exact interacting two-photon scattering wavefunction of these two systems following the Lippmann-Schwinger formalism, from which the analytical expressions of incoherent power spectra and second-order correlations are also derived. The incoherent spectrum, defined by the correlation of the bound state, serves as a useful indication of photon-photon correlation. The second-order correlation function gives a direct measure of photon-photon correlation. For photons scattered by the two-level giant atom, the accumulated phase shift can be used to improve photon-photon correlation,and adjust the evolution of the second-order correlation. In the system of the three-level giant atom, the photon-photon correlation can be substantially increased. Moreover, the photon-photon interactions and correlation distance of scattered photons can be further enhanced by tuning the accumulated phase shift.

quant-ph↗
arXiv2023

Topological Diagnosis of Strongly Correlated Electron Systems

The intersection of electronic topology and strong correlations offers a rich platform to discover exotic quantum phases of matter and unusual materials. An overarching challenge that impedes the discovery is how to diagnose topology in strongly correlated settings, as exemplified by Mott insulators. Here, we develop a general framework to address this outstanding question and illustrate its power in the case of Mott insulators. The concept of Green's function Berry curvature -- which is frequency dependent -- is introduced. We apply this notion in a system that contains symmetry-protected nodes in its noninteracting bandstructure; strong correlations drive the system into a Mott insulating state, creating contours in frequency-momentum space where the Green's function vanishes. The Green's function Berry flux of such zeros is found to be quantized, and is as such direct probe of the system's topology. Our framework allows for a comprehensive search of strongly correlated topological materials with Green's function topology.

cond-mat.str-el↗
arXiv2023

Surface mapping class group actions on 3-manifolds

For each circle bundle $S^1\to X\toΣ_g$ over a surface with genus $g\ge2$, there is a natural surjection $π:Homeo^+(X)\to Mod(Σ_g)$. When $X$ is the unit tangent bundle $UΣ_g$, it is well-known that $π$ splits. On the other hand $π$ does not split when the Euler number $e(X)$ is not divisible by the Euler characteristic $χ(Σ_g)$ by work of the second two authors. In this paper we show that this homomorphism does not split in many cases where $χ(Σ_g)$ divides $e(X)$.

math.GT↗
arXiv2023

SSIN: Self-Supervised Learning for Rainfall Spatial Interpolation

The acquisition of accurate rainfall distribution in space is an important task in hydrological analysis and natural disaster pre-warning. However, it is impossible to install rain gauges on every corner. Spatial interpolation is a common way to infer rainfall distribution based on available raingauge data. However, the existing works rely on some unrealistic pre-settings to capture spatial correlations, which limits their performance in real scenarios. To tackle this issue, we propose the SSIN, which is a novel data-driven self-supervised learning framework for rainfall spatial interpolation by mining latent spatial patterns from historical observation data. Inspired by the Cloze task and BERT, we fully consider the characteristics of spatial interpolation and design the SpaFormer model based on the Transformer architecture as the core of SSIN. Our main idea is: by constructing rich self-supervision signals via random masking, SpaFormer can learn informative embeddings for raw data and then adaptively model spatial correlations based on rainfall spatial context. Extensive experiments on two real-world raingauge datasets show that our method outperforms the state-of-the-art solutions. In addition, we take traffic spatial interpolation as another use case to further explore the performance of our method, and SpaFormer achieves the best performance on one large real-world traffic dataset, which further confirms the effectiveness and generality of our method.

cs.LG↗
arXiv2023

MulMarker: a comprehensive framework for identifying multi-gene prognostic signatures

Prognostic signatures play an important role in clinical research, offering insights into the potential health outcomes of patients and guiding therapeutic decisions. Although single-gene prognostic biomarkers are valuable, multi-gene prognostic signatures offer deeper insights into disease progression. In this paper, we propose MulMarker, a comprehensive framework for identifying multi-gene prognostic signatures across various diseases. MulMarker comprises three core modules: a chatbot for addressing user queries, a module for identifying multi-gene prognostic signatures, and a module for generating tailored reports. Employing MulMarker, we identified a cell cycle-related prognostic signature that consists of CCNA1/2, CCNB1/2/3, CCNC, CCND1/2/3, CCNE1/2, CCNF, CCNG1/2, and CCNH. Based on the prognostic signature, we successfully stratified patients into high-risk and low-risk groups. Notably, our analysis revealed that patients in the low-risk group demonstrated a significantly higher survival rate compared to those in the high-risk group. Overall, MulMarker represents an efficient approach for the identification of multi-gene prognostic signatures. We release the code of MulMarker at https://github.com/Tina9/MulMarker.

q-bio.QM↗
arXiv2023

Joint Feature and Differentiable $ k $-NN Graph Learning using Dirichlet Energy

Feature selection (FS) plays an important role in machine learning, which extracts important features and accelerates the learning process. In this paper, we propose a deep FS method that simultaneously conducts feature selection and differentiable $ k $-NN graph learning based on the Dirichlet Energy. The Dirichlet Energy identifies important features by measuring their smoothness on the graph structure, and facilitates the learning of a new graph that reflects the inherent structure in new feature subspace. We employ Optimal Transport theory to address the non-differentiability issue of learning $ k $-NN graphs in neural networks, which theoretically makes our method applicable to other graph neural networks for dynamic graph learning. Furthermore, the proposed framework is interpretable, since all modules are designed algorithmically. We validate the effectiveness of our model with extensive experiments on both synthetic and real-world datasets.

cs.LG↗
arXiv2023

Non-Fermi liquid behavior in a correlated flatband pyrochlore lattice

Electronic correlation effects are manifested in quantum materials when either the onsite Coulomb repulsion is large or the electron kinetic energy is small. The former is the dominant effect in the cuprate superconductors or heavy fermion systems while the latter in twisted bilayer graphene or geometrically frustrated metals. However, the simultaneous cooperation of both effects in the same quantum material--the design principle to produce a correlated topological flat bands pinned at the Fermi level--remains rare. Here, using angle-resolved photoemission spectroscopy, we report the observation of a flat band at the Fermi level in a 3$d$ pyrochlore metal CuV$_2$S$_4$. From a combination of first-principles calculations and slave-spin calculations, we understand the origin of this band to be a destructive quantum-interference effect associated with the V pyrochlore sublattice and further renormalization to the Fermi level by electron interactions in the partially filled V $t_{2g}$ orbitals. As a result, we find transport behavior that indicates a deviation from Fermi-liquid behavior as well as a large Sommerfeld coefficient. Our work demonstrates the pathway into correlated topology by constructing and pinning correlated flat bands near the Fermi level out of a pure $d$-electron system by the combined cooperation of local Coulomb interactions and geometric frustration in a pyrochlore lattice system.

cond-mat.str-el↗
arXiv2023

Towards a Unified Conversational Recommendation System: Multi-task Learning via Contextualized Knowledge Distillation

In Conversational Recommendation System (CRS), an agent is asked to recommend a set of items to users within natural language conversations. To address the need for both conversational capability and personalized recommendations, prior works have utilized separate recommendation and dialogue modules. However, such approach inevitably results in a discrepancy between recommendation results and generated responses. To bridge the gap, we propose a multi-task learning for a unified CRS, where a single model jointly learns both tasks via Contextualized Knowledge Distillation (ConKD). We introduce two versions of ConKD: hard gate and soft gate. The former selectively gates between two task-specific teachers, while the latter integrates knowledge from both teachers. Our gates are computed on-the-fly in a context-specific manner, facilitating flexible integration of relevant knowledge. Extensive experiments demonstrate that our single model significantly improves recommendation performance while enhancing fluency, and achieves comparable results in terms of diversity.

cs.CL↗
arXiv2023

FuXi-Extreme: Improving extreme rainfall and wind forecasts with diffusion model

Significant advancements in the development of machine learning (ML) models for weather forecasting have produced remarkable results. State-of-the-art ML-based weather forecast models, such as FuXi, have demonstrated superior statistical forecast performance in comparison to the high-resolution forecasts (HRES) of the European Centre for Medium-Range Weather Forecasts (ECMWF). However, ML models face a common challenge: as forecast lead times increase, they tend to generate increasingly smooth predictions, leading to an underestimation of the intensity of extreme weather events. To address this challenge, we developed the FuXi-Extreme model, which employs a denoising diffusion probabilistic model (DDPM) to restore finer-scale details in the surface forecast data generated by the FuXi model in 5-day forecasts. An evaluation of extreme total precipitation ($\textrm{TP}$), 10-meter wind speed ($\textrm{WS10}$), and 2-meter temperature ($\textrm{T2M}$) illustrates the superior performance of FuXi-Extreme over both FuXi and HRES. Moreover, when evaluating tropical cyclone (TC) forecasts based on International Best Track Archive for Climate Stewardship (IBTrACS) dataset, both FuXi and FuXi-Extreme shows superior performance in TC track forecasts compared to HRES, but they show inferior performance in TC intensity forecasts in comparison to HRES.

cs.LG↗
arXiv2023

FuXi: A cascade machine learning forecasting system for 15-day global weather forecast

Over the past few years, due to the rapid development of machine learning (ML) models for weather forecasting, state-of-the-art ML models have shown superior performance compared to the European Centre for Medium-Range Weather Forecasts (ECMWF)'s high-resolution forecast (HRES) in 10-day forecasts at a spatial resolution of 0.25 degree. However, the challenge remains to perform comparably to the ECMWF ensemble mean (EM) in 15-day forecasts. Previous studies have demonstrated the importance of mitigating the accumulation of forecast errors for effective long-term forecasts. Despite numerous efforts to reduce accumulation errors, including autoregressive multi-time step loss, using a single model is found to be insufficient to achieve optimal performance in both short and long lead times. Therefore, we present FuXi, a cascaded ML weather forecasting system that provides 15-day global forecasts with a temporal resolution of 6 hours and a spatial resolution of 0.25 degree. FuXi is developed using 39 years of the ECMWF ERA5 reanalysis dataset. The performance evaluation, based on latitude-weighted root mean square error (RMSE) and anomaly correlation coefficient (ACC), demonstrates that FuXi has comparable forecast performance to ECMWF EM in 15-day forecasts, making FuXi the first ML-based weather forecasting system to accomplish this achievement.

physics.ao-ph↗
arXiv2023

AE-smnsMLC: Multi-Label Classification with Semantic Matching and Negative Label Sampling for Product Attribute Value Extraction

Product attribute value extraction plays an important role for many real-world applications in e-Commerce such as product search and recommendation. Previous methods treat it as a sequence labeling task that needs more annotation for position of values in the product text. This limits their application to real-world scenario in which only attribute values are weakly-annotated for each product without their position. Moreover, these methods only use product text (i.e., product title and description) and do not consider the semantic connection between the multiple attribute values of a given product and its text, which can help attribute value extraction. In this paper, we reformulate this task as a multi-label classification task that can be applied for real-world scenario in which only annotation of attribute values is available to train models (i.e., annotation of positional information of attribute values is not available). We propose a classification model with semantic matching and negative label sampling for attribute value extraction. Semantic matching aims to capture semantic interactions between attribute values of a given product and its text. Negative label sampling aims to enhance the model's ability of distinguishing similar values belonging to the same attribute. Experimental results on three subsets of a large real-world e-Commerce dataset demonstrate the effectiveness and superiority of our proposed model.

cs.IR↗
arXiv2023

Topic-DPR: Topic-based Prompts for Dense Passage Retrieval

Prompt-based learning's efficacy across numerous natural language processing tasks has led to its integration into dense passage retrieval. Prior research has mainly focused on enhancing the semantic understanding of pre-trained language models by optimizing a single vector as a continuous prompt. This approach, however, leads to a semantic space collapse; identical semantic information seeps into all representations, causing their distributions to converge in a restricted region. This hinders differentiation between relevant and irrelevant passages during dense retrieval. To tackle this issue, we present Topic-DPR, a dense passage retrieval model that uses topic-based prompts. Unlike the single prompt method, multiple topic-based prompts are established over a probabilistic simplex and optimized simultaneously through contrastive learning. This encourages representations to align with their topic distributions, improving space uniformity. Furthermore, we introduce a novel positive and negative sampling strategy, leveraging semi-structured data to boost dense retrieval efficiency. Experimental results from two datasets affirm that our method surpasses previous state-of-the-art retrieval techniques.

cs.CL↗
arXiv2023

Skip-Plan: Procedure Planning in Instructional Videos via Condensed Action Space Learning

In this paper, we propose Skip-Plan, a condensed action space learning method for procedure planning in instructional videos. Current procedure planning methods all stick to the state-action pair prediction at every timestep and generate actions adjacently. Although it coincides with human intuition, such a methodology consistently struggles with high-dimensional state supervision and error accumulation on action sequences. In this work, we abstract the procedure planning problem as a mathematical chain model. By skipping uncertain nodes and edges in action chains, we transfer long and complex sequence functions into short but reliable ones in two ways. First, we skip all the intermediate state supervision and only focus on action predictions. Second, we decompose relatively long chains into multiple short sub-chains by skipping unreliable intermediate actions. By this means, our model explores all sorts of reliable sub-relations within an action sequence in the condensed action space. Extensive experiments show Skip-Plan achieves state-of-the-art performance on the CrossTask and COIN benchmarks for procedure planning.

cs.CV↗
arXiv2023

Time-resolved laser speckle contrast imaging (TR-LSCI) of cerebral blood flow

To address many of the deficiencies in optical neuroimaging technologies such as poor spatial resolution, time-consuming reconstruction, low penetration depth, and contact-based measurement, a novel, noncontact, time-resolved laser speckle contrast imaging (TR-LSCI) technique has been developed for continuous, fast, and high-resolution 2D mapping of cerebral blood flow (CBF) at different depths of the head. TR-LSCI illuminates the head with picosecond-pulsed, coherent, widefield near-infrared light and synchronizes a newly developed, high-resolution, gated single-photon avalanche diode camera (SwissSPAD2) to capture CBF maps at different depths. By selectively collecting diffuse photons with longer pathlengths through the head, TR-LSCI reduces partial volume artifacts from the overlying tissues, thus improving the accuracy of CBF measurement in the deep brain. CBF map reconstruction was dramatically expedited by incorporating highly parallelized computation. The performance of TR-LSCI was evaluated using head-simulating phantoms with known properties and in-vivo rodents with varied hemodynamic challenges to the brain. Results from these pilot studies demonstrated that TR-LSCI enabled mapping CBF variations at different depths with a sampling rate of up to 1 Hz and spatial resolutions ranging from tens of micrometers on the head surface to 1-2 millimeters in the deep brain. With additional improvements and validation in larger populations against established methods, we anticipate offering a noncontact, fast, high-resolution, portable, and affordable brain imager for fundamental neuroscience research in animals and for translational studies in humans.

physics.med-ph↗
arXiv2023

CATR: Combinatorial-Dependence Audio-Queried Transformer for Audio-Visual Video Segmentation

Audio-visual video segmentation~(AVVS) aims to generate pixel-level maps of sound-producing objects within image frames and ensure the maps faithfully adhere to the given audio, such as identifying and segmenting a singing person in a video. However, existing methods exhibit two limitations: 1) they address video temporal features and audio-visual interactive features separately, disregarding the inherent spatial-temporal dependence of combined audio and video, and 2) they inadequately introduce audio constraints and object-level information during the decoding stage, resulting in segmentation outcomes that fail to comply with audio directives. To tackle these issues, we propose a decoupled audio-video transformer that combines audio and video features from their respective temporal and spatial dimensions, capturing their combined dependence. To optimize memory consumption, we design a block, which, when stacked, enables capturing audio-visual fine-grained combinatorial-dependence in a memory-efficient manner. Additionally, we introduce audio-constrained queries during the decoding phase. These queries contain rich object-level information, ensuring the decoded mask adheres to the sounds. Experimental results confirm our approach's effectiveness, with our framework achieving a new SOTA performance on all three datasets using two backbones. The code is available at \url{https://github.com/aspirinone/CATR.github.io}

cs.CV↗
arXiv2023

Identical and Fraternal Twins: Fine-Grained Semantic Contrastive Learning of Sentence Representations

The enhancement of unsupervised learning of sentence representations has been significantly achieved by the utility of contrastive learning. This approach clusters the augmented positive instance with the anchor instance to create a desired embedding space. However, relying solely on the contrastive objective can result in sub-optimal outcomes due to its inability to differentiate subtle semantic variations between positive pairs. Specifically, common data augmentation techniques frequently introduce semantic distortion, leading to a semantic margin between the positive pair. While the InfoNCE loss function overlooks the semantic margin and prioritizes similarity maximization between positive pairs during training, leading to the insensitive semantic comprehension ability of the trained model. In this paper, we introduce a novel Identical and Fraternal Twins of Contrastive Learning (named IFTCL) framework, capable of simultaneously adapting to various positive pairs generated by different augmentation techniques. We propose a \textit{Twins Loss} to preserve the innate margin during training and promote the potential of data enhancement in order to overcome the sub-optimal issue. We also present proof-of-concept experiments combined with the contrastive objective to prove the validity of the proposed Twins Loss. Furthermore, we propose a hippocampus queue mechanism to restore and reuse the negative instances without additional calculation, which further enhances the efficiency and performance of the IFCL. We verify the IFCL framework on nine semantic textual similarity tasks with both English and Chinese datasets, and the experimental results show that IFCL outperforms state-of-the-art methods.

cs.CL↗
arXiv2023

Model Debiasing via Gradient-based Explanation on Representation

Machine learning systems produce biased results towards certain demographic groups, known as the fairness problem. Recent approaches to tackle this problem learn a latent code (i.e., representation) through disentangled representation learning and then discard the latent code dimensions correlated with sensitive attributes (e.g., gender). Nevertheless, these approaches may suffer from incomplete disentanglement and overlook proxy attributes (proxies for sensitive attributes) when processing real-world data, especially for unstructured data, causing performance degradation in fairness and loss of useful information for downstream tasks. In this paper, we propose a novel fairness framework that performs debiasing with regard to both sensitive attributes and proxy attributes, which boosts the prediction performance of downstream task models without complete disentanglement. The main idea is to, first, leverage gradient-based explanation to find two model focuses, 1) one focus for predicting sensitive attributes and 2) the other focus for predicting downstream task labels, and second, use them to perturb the latent code that guides the training of downstream task models towards fairness and utility goals. We show empirically that our framework works with both disentangled and non-disentangled representation learning methods and achieves better fairness-accuracy trade-off on unstructured and structured datasets than previous state-of-the-art approaches.

cs.LG↗
arXiv2023

Electron correlations and superconductivity in La$_3$Ni$_2$O$_7$ under pressure tuning

Motivated by the recent discovery of superconductivity in La$_3$Ni$_2$O$_7$ under pressure, we discuss the basic ingredients of a model that captures its microscopic physics under pressure tuning. We anchor our description in terms of the spectroscopic evidence of strong correlations in this system. In a bilayer Hubbard model including the Ni $3d$ $x^2-y^2$ and $z^2$ orbitals, we show the ground state of the model crosses over from a low-spin $S=1/2$ state to a high-spin $S=3/2$ state. In the high-spin state, the two $x^2-y^2$ and the bonding $z^2$ orbitals are all close to half-filling, which promotes a strong orbital selectivity in a broad crossover regime of the phase diagram pertinent to the system. Based on these results, we construct an effective multiorbital $t$-$J$ model to describe the superconductivity of the system, and find the leading pairing channel to be an intraorbital spin singlet with a competition between the extended $s$-wave and $d_{x^2-y^2}$ symmetries. Our results highlight the role of strong multiorbital correlation effects in driving the superconductivity of La$_3$Ni$_2$O$_7$.

cond-mat.supr-con↗