arXiv subjects

Jie Liu

Publications and source records attributed to Jie Liu.

At least 397 records · Page 22Linked to original sources

arXiv2023

A Perspective of Q-value Estimation on Offline-to-Online Reinforcement Learning

Offline-to-online Reinforcement Learning (O2O RL) aims to improve the performance of offline pretrained policy using only a few online samples. Built on offline RL algorithms, most O2O methods focus on the balance between RL objective and pessimism, or the utilization of offline and online samples. In this paper, from a novel perspective, we systematically study the challenges that remain in O2O RL and identify that the reason behind the slow improvement of the performance and the instability of online finetuning lies in the inaccurate Q-value estimation inherited from offline pretraining. Specifically, we demonstrate that the estimation bias and the inaccurate rank of Q-value cause a misleading signal for the policy update, making the standard offline RL algorithms, such as CQL and TD3-BC, ineffective in the online finetuning. Based on this observation, we address the problem of Q-value estimation by two techniques: (1) perturbed value update and (2) increased frequency of Q-value updates. The first technique smooths out biased Q-value estimation with sharp peaks, preventing early-stage policy exploitation of sub-optimal actions. The second one alleviates the estimation bias inherited from offline pretraining by accelerating learning. Extensive experiments on the MuJoco and Adroit environments demonstrate that the proposed method, named SO2, significantly alleviates Q-value estimation issues, and consistently improves the performance against the state-of-the-art methods by up to 83.1%.

cs.LG↗

arXiv2023

EdgeConvFormer: Dynamic Graph CNN and Transformer based Anomaly Detection in Multivariate Time Series

Transformer-based models for anomaly detection in multivariate time series can benefit from the self-attention mechanism due to its advantage in modeling long-term dependencies. However, Transformer-based anomaly detection models have problems such as a large amount of data being required for training, standard positional encoding is not suitable for multivariate time series data, and the interdependence between time series is not considered. To address these limitations, we propose a novel anomaly detection method, named EdgeConvFormer, which integrates Time2vec embedding, stacked dynamic graph CNN, and Transformer to extract global and local spatial-time information. This design of EdgeConvFormer empowers it with decomposition capacities for complex time series, progressive spatiotemporal correlation discovery between time series, and representation aggregation of multi-scale features. Experiments demonstrate that EdgeConvFormer can learn the spatial-temporal correlations from multivariate time series data and achieve better anomaly detection performance than the state-of-the-art approaches on many real-world datasets of different scales.

cs.LG↗

arXiv2023

Middle terms of AR-sequences of graded Kronecker modules

Let $(T(n),Ω)$ be the covering of the generalized Kronecker quiver $K(n)$, where $Ω$ is a bipartite orientation. Then there exists a reflection functor $σ$ on the category $\mod(T(n),Ω)$. Suppose that $0\rightarrow X\rightarrow Y\rightarrow Z\rightarrow 0$ is an AR-sequence in the regular component $\mathcal{D}$ of $\mod(T(n),Ω)$, and $b(Z)$ is the number of flow modules in the $σ$-orbit of $Z$. Then the middle term $Y$ is a sink (source or flow) module if and only if $σZ$ is a sink (source or flow) module. Moreover, their radii and centers satisfy $r(Y)=r(σZ)+1$ and $C(Y)=C(σZ)$.

math.RT↗

arXiv2023

Tuning the anomalous Nernst and Hall effects with shifting the chemical potential in Fe-doped and Ni-doped Co$_3$Sn$_2$S$_2$

Co$_3$Sn$_2$S$_2$ is believed to be a magnetic Weyl semimetal. It displays large anomalous Hall, Nernst and thermal Hall effects with a remarkably large anomalous Hall angle. Here, we present a comprehensive study of how substituting Co by Fe or Ni affects the electrical and thermoelectric transport. We find that doping alters the amplitude of the anomalous transverse coefficients. The maximum decrease in the amplitude of the low-temperature anomalous Hall conductivity $σ^A_{ij}$ is twofold. Comparing our results with theoretical calculations of the Berry spectrum assuming a rigid shift of the Fermi level, we find that given the modest shift in the position of the chemical potential induced by doping, the experimentally observed variation occurs five times faster than expected. Doping affects the amplitude and the sign of the anomalous Nernst coefficient. Despite these drastic changes, the amplitude of the $α^A_{ij}/σ^A_{ij}$ ratio at the Curie temperature remains close to $\approx 0.5 k_B/e$, in agreement with the scaling relationship observed across many topological magnets.

cond-mat.str-el↗

arXiv2023

BOURNE: Bootstrapped Self-supervised Learning Framework for Unified Graph Anomaly Detection

Graph anomaly detection (GAD) has gained increasing attention in recent years due to its critical application in a wide range of domains, such as social networks, financial risk management, and traffic analysis. Existing GAD methods can be categorized into node and edge anomaly detection models based on the type of graph objects being detected. However, these methods typically treat node and edge anomalies as separate tasks, overlooking their associations and frequent co-occurrences in real-world graphs. As a result, they fail to leverage the complementary information provided by node and edge anomalies for mutual detection. Additionally, state-of-the-art GAD methods, such as CoLA and SL-GAD, heavily rely on negative pair sampling in contrastive learning, which incurs high computational costs, hindering their scalability to large graphs. To address these limitations, we propose a novel unified graph anomaly detection framework based on bootstrapped self-supervised learning (named BOURNE). We extract a subgraph (graph view) centered on each target node as node context and transform it into a dual hypergraph (hypergraph view) as edge context. These views are encoded using graph and hypergraph neural networks to capture the representations of nodes, edges, and their associated contexts. By swapping the context embeddings between nodes and edges and measuring the agreement in the embedding space, we enable the mutual detection of node and edge anomalies. Furthermore, BOURNE can eliminate the need for negative sampling, thereby enhancing its efficiency in handling large graphs. Extensive experiments conducted on six benchmark datasets demonstrate the superior effectiveness and efficiency of BOURNE in detecting both node and edge anomalies.

cs.SI↗

arXiv2023

Dissipation Enhanced Unidirectional Transport in Topological Systems

Dissipation is a common occurrence in real-world systems and is generally considered to be detrimental to transport. In this study, we examine the transport properties of a narrow quantum anomalous Hall system with dissipation applied on one edge. When the Fermi level resides within the hybridization gap, we find that while transport is suppressed on one edge, it is significantly enhanced on the other. We reveal that this enhancement arises from dissipation-induced gap closure, which is deeply rooted in the point gap topology of the system, resulting in a reduction of the decaying coefficient. When the dissipation is very large, we find that the low-energy physics is nearly indistinguishable from a narrower system, whose dissipation amplitude is inversely proportional to that of the original one. To get more physical intuition, we demonstrate that the low-energy physics can be well captured by a pair of coupled counter-propagating chiral edge states, one of which has a modified group velocity and an effective dissipation. We also briefly discuss the possible experimental realizations of this enhanced unidirectional transport.

cond-mat.mes-hall↗

arXiv2023

Quantum scattering treatment on the time-domain diffraction of a matter-wave soliton

We study the dynamics of the matter-wave soliton interacting with a vibrating mirror created by an evanescent light and provide a quantum scattering picture for the time-domain diffraction of the matter-wave soliton. Under Kramers-Henneberger (KH) transformation, i.e., in a vibrating coordinate, the vibration of the mirror can be cast to an effective gauge field. We then can exploit Dyson series and the quantum scattering theory to investigate the dynamics of the soliton that moves in the effective gauge field and is reflected by a static mirror. Our analytical theory can quantitatively deduce the locations and the relative weights of the scattered wave packets, which is consistent with our numerical simulations of directly solving a nonlinear Schrödinger equation. In particular, for a two-frequency vibrating case, our theory predicts some interesting multi-peak sideband structures in the diffracted matter-wave distributions, which can be resorted to the resonance of two frequencies. Underlying mechanisms and possible applications are discussed.

nlin.PS↗

arXiv2023

On the spectral variety for rank two Higgs bundles

In this article, we study the Hitchin morphism over a smooth projective variety $X$. The Hitchin morphism is a map from the moduli space of Higgs bundles to the Hitchin base, which in general not surjective when the dimension of X is greater than one. Chen-Ngô introduced the spectral base, which is a closed subvariety of the Hitchin base. They conjectured that the Hitchin morphism is surjective to the spectral base and also proved that the surjectivity is equivalent to the existence of finite Cohen-Macaulayfications of the spectral varieties. For rank two Higgs bundles over a projective manifold $X$, we explicitly construct a finite Cohen-Macaulayfication of the spectral variety as a double branched covering of $X$, thereby confirming Chen-Ngô's conjecture in this case. Moreover, using this Cohen-Macaulayfication, we can construct the Hitchin section for rank two Higgs bundles, which allows us to study the rigidity problem of the character variety and also to explore a generalization of the Milnor-Wood type inequality.

math.AG↗

arXiv2023

Unveiling nontrivial fusion rule of Majorana zero mode using a fermionic mode

Fusing Majorana zero modes leads to multiple outcomes, a property being unique to non-Abelian anyons. Successful demonstration of this nontrivial fusion rule would be a hallmark for the development of topological quantum computation.Here we show that this can be done by simply attaching a fermionic mode to a single Majorana zero mode. Through modulation of the energy level of this fermionic mode as well as its coupling with the Majorana mode in different sequences, we show that a zero or integer charge pumping can be realized when different fusion loops are chosen. Such fusion loops are intimately related with the nontrivial fusion rule of Majorana modes and are solely determined by the crossings at zero energy in the parameter space. Finally we demonstrate our proposal in a nanowire-based topological superconductor coupled to a quantum dot. We show that the charge pumping is robust for MZMs in the real system irrespective of the initial condition of FM state, contrary to the case for trivial Andreev bound states. This provides a feasible way to distinguish Majorana modes from trivial Andreev bound states.

cond-mat.mes-hall↗

arXiv2023

Distance-rank Aware Sequential Reward Learning for Inverse Reinforcement Learning with Sub-optimal Demonstrations

Inverse reinforcement learning (IRL) aims to explicitly infer an underlying reward function based on collected expert demonstrations. Considering that obtaining expert demonstrations can be costly, the focus of current IRL techniques is on learning a better-than-demonstrator policy using a reward function derived from sub-optimal demonstrations. However, existing IRL algorithms primarily tackle the challenge of trajectory ranking ambiguity when learning the reward function. They overlook the crucial role of considering the degree of difference between trajectories in terms of their returns, which is essential for further removing reward ambiguity. Additionally, it is important to note that the reward of a single transition is heavily influenced by the context information within the trajectory. To address these issues, we introduce the Distance-rank Aware Sequential Reward Learning (DRASRL) framework. Unlike existing approaches, DRASRL takes into account both the ranking of trajectories and the degrees of dissimilarity between them to collaboratively eliminate reward ambiguity when learning a sequence of contextually informed reward signals. Specifically, we leverage the distance between policies, from which the trajectories are generated, as a measure to quantify the degree of differences between traces. This distance-aware information is then used to infer embeddings in the representation space for reward learning, employing the contrastive learning technique. Meanwhile, we integrate the pairwise ranking loss function to incorporate ranking information into the latent features. Moreover, we resort to the Transformer architecture to capture the contextual dependencies within the trajectories in the latent space, leading to more accurate reward estimation. Through extensive experimentation, our DRASRL framework demonstrates significant performance improvements over previous SOTA methods.

cs.LG↗

arXiv2023

Magneto-optical trap reaction microscope for photoionization of cold strontium atoms

We developed a magneto-optical trap reaction microscope (MOTREMI) for strontium atoms by combining the multi-particle coincident detection with laser cooling technique. Present compact injection system can provide cold Sr atoms in three modes of 2D MOT, molasses and 3D MOT, delivering targets with adjustable densities and ratios of the ground state $5s^2$ ($^1S_{0}$) and the excited states $5s5p$ ($^{1}P_{1}$ and $^{3}P_{J}$ etc). The target profiles for the temperature, the density and the size of 3D MOT as well as cold atomic flux in 2D MOT model were characterized in details. With present state-of-the-art setup, we demonstrated the single photoionization of Sr atoms with molasses by absorption of few 800-nm photons, where Sr$^+$ and $e$ were detected in coincidence and most of ionization channels were identified taking into account photoelectron energy, laser-intensity dependence, and target dependence. The best momentum resolution of coincident Sr$^+$ and $e$ along time-of-flight are achieved up to 0.12 a.u. and 0.02 a.u., respectively. Present photoelectron momentum distributions ionized from the ground state and a few excited states illuminate unprecedentedly rich landscapes manifesting prominent features for multi-photon absorption. The full vector momenta of electrons and recoil ion in coincidence paves the way to further studying two-electron correlation dynamics and multi-electron effects in the multiple ionization of alkaline-earth atoms in the ultraviolet region.

physics.atom-ph↗

arXiv2023

TranUSR: Phoneme-to-word Transcoder Based Unified Speech Representation Learning for Cross-lingual Speech Recognition

UniSpeech has achieved superior performance in cross-lingual automatic speech recognition (ASR) by explicitly aligning latent representations to phoneme units using multi-task self-supervised learning. While the learned representations transfer well from high-resource to low-resource languages, predicting words directly from these phonetic representations in downstream ASR is challenging. In this paper, we propose TranUSR, a two-stage model comprising a pre-trained UniData2vec and a phoneme-to-word Transcoder. Different from UniSpeech, UniData2vec replaces the quantized discrete representations with continuous and contextual representations from a teacher model for phonetically-aware pre-training. Then, Transcoder learns to translate phonemes to words with the aid of extra texts, enabling direct word generation. Experiments on Common Voice show that UniData2vec reduces PER by 5.3% compared to UniSpeech, while Transcoder yields a 14.4% WER reduction compared to grapheme fine-tuning.

eess.AS↗

arXiv2023

How Nested Bars Enhance, Modulate, and are Destroyed by Gas Inflows

Gas flows in the presence of two independently-rotating nested bars remain not fully understood, which is likely to play an important role in fueling the central black hole. We use high-resolution hydrodynamical simulations with detailed models of subgrid physics to study this problem. Our results show that the inner bar in double-barred galaxies can help drive gas flow from the nuclear ring to the center. In contrast, gas inflow usually stalls at the nuclear ring in single-barred galaxies. The inner bar causes a quasi-periodic inflow with a frequency determined by the difference between the two bar pattern speeds. We find that the star formation rate is higher in the model with two bars than in that with one bar. The inner bar in our model gradually weakens and dissolves due to gas inflow over a few billion years. Star formation produces metal-rich/$α$-poor stars which slows the weakening of the inner bar, but does not halt its eventual decay. We also present a qualitative comparison of the gas morphology and kinematics in our simulations with those of observed double-barred galaxies.

astro-ph.GA↗

arXiv2023

OriWheelBot: An origami-wheeled robot

Origami-inspired robots with multiple advantages, such as being lightweight, requiring less assembly, and exhibiting exceptional deformability, have received substantial and sustained attention. However, the existing origami-inspired robots are usually of limited functionalities and developing feature-rich robots is very challenging. Here, we report an origami-wheeled robot (OriWheelBot) with variable width and outstanding sand walking versatility. The OriWheelBot's ability to adjust wheel width over obstacles is achieved by origami wheels made of Miura origami. An improved version, called iOriWheelBot, is also developed to automatically judge the width of the obstacles. Three actions, namely direct pass, variable width pass, and direct return, will be carried out depending on the width of the channel between the obstacles. We have identified two motion mechanisms, i.e., sand-digging and sand-pushing, with the latter being more conducive to walking on the sand. We have systematically examined numerous sand walking characteristics, including carrying loads, climbing a slope, walking on a slope, and navigating sand pits, small rocks, and sand traps. The OriWheelBot can change its width by 40%, has a loading-carrying ratio of 66.7% on flat sand and can climb a 17-degree sand incline. The OriWheelBot can be useful for planetary subsurface exploration and disaster area rescue.

cs.RO↗

arXiv2023

Optimal Power Flow Pursuit in the Alternating Current Model

Transmission-constrained problems in power systems can be cast as polynomial optimization problems whose coefficients vary over time. We consider the complications therein and suggest several approaches. On the example of the alternating-current optimal power flows (ACOPFs), we illustrate one of the approaches in detail. For the time-varying ACOPF, we provide an upper bound for the difference between the optimal cost for a relaxation using the most recent data and the current approximate optimal cost generated by our algorithm. This bound is a function of the properties of the instance and the rate of change of the coefficients over time. Moreover, we also bound the number of floating-point operations to perform between two subsequent updates to ensure a bounded error.

math.OC↗

arXiv2023

Ultraviolet Resonant Nanogap Antennas with Rhodium Nanocube Dimers for Enhancing Protein Intrinsic Autofluorescence

Plasmonic optical nanoantennas offer compelling solutions for enhancing light-matter interactions at the nanoscale. However, until now, their focus has been mainly limited to the visible and near-infrared regions, overlooking the immense potential of the ultraviolet (UV) range, where molecules exhibit their strongest absorption. Here, we present the realization of UV resonant nanogap antennas constructed from paired rhodium nanocubes. Rhodium emerges as a robust alternative to aluminum, offering enhanced stability in wet environments and ensuring reliable performance in the UV range. Our results showcase the nanoantenna ability to enhance the UV autofluorescence of label-free streptavidin and hemoglobin proteins. We achieve significant enhancements of the autofluorescence brightness per protein by up to 120-fold, and reach zeptoliter detection volumes enabling UV autofluorescence correlation spectroscopy (UV-FCS) at high concentrations of several tens of micromolar. We investigate the modulation of fluorescence photokinetic rates and report excellent agreement between experimental results and numerical simulations. This work expands the applicability of plasmonic nanoantennas into the deep UV range, unlocking the investigation of label-free proteins at physiological concentrations.

physics.optics↗

arXiv2023

Quantum engineering for compactly localized states in disordered Lieb lattices

Blending ordering within an uncorrelated disorder potential in families of 3D Lieb lattices preserves the macroscopic degeneracy of compact localized states and yields unconventional combinations of localized and delocalized phases -- as shown in Phys.Rev.B 106, 214204 (2022). We proceed to reintroduce translation invariance in the system by further ordering the disorder, and discuss the spectral structure and eigenstates features of the resulting perturbed lattices. We restore order in steps by first (i) rendering the disorder binary -- i.e. yielding a randomized checkerboard potential, then (ii) reordering the randomized checkerboard into an ordered one, and at last (iii) realigning all the checkerboard values yielding a constant potential shift, but only on a sub-lattice. Along this path, we test the influence of additional random impurities on the order restoration. We find that in each of these steps, sub-families of states are projected upon the location of the degenerate compact states, while the complementary ones are localized in the perturbed sites with energy determined by the strength of checkerboard. This strategy, herewith implemented in the 3D Lieb, highlights order restoration as experimental pathway to engineer spectral and states features in disordered lattice structures in the pursuit of quantum storage and memory applications.

cond-mat.dis-nn↗

arXiv2023

Fano foliations with small algebraic ranks

In this paper we study the algebraic ranks of foliations on $\mathbb{Q}$-factorial normal projective varieties. We start by establishing a Kobayashi-Ochiai's theorem for Fano foliations in terms of algebraic rank. We then investigate the local positivity of the anti-canonical divisors of foliations, obtaining a lower bound for the algebraic rank of a foliation in terms of Seshadri constant. We describe those foliations whose algebraic rank slightly exceeds this bound and classify Fano foliations on smooth projective varieties attaining this bound. Finally we construct several examples to illustrate the general situation, which in particular allow us to answer a question asked by Araujo and Druel on the generalised indices of foliations.

math.AG↗