Partial Answer of How Transformers Learn Automata
We introduce a novel framework for simulating finite automata using representation-theoretic semidirect products and Fourier modules, achieving more efficient Transformer-based implementations.
arXiv subjects
Publications and source records attributed to Tiantian Zhang.
We introduce a novel framework for simulating finite automata using representation-theoretic semidirect products and Fourier modules, achieving more efficient Transformer-based implementations.
Topology and chirality of fermionic quasiparticles have enabled exciting discoveries, including quantum anomalous Hall liquids and topological superconductivity. Recently, topological and chiral phonons emerge as new and fast-evolving research directions. While these concepts are separately developed, they are intimately connected in the context of Weyl phonons. The couplings between chiral and topological phonons with various electronic and magnetic quasiparticles are predicted to give rise to new quantum states and giant magnetism with fundamental and applicational interests, ranging from quantum information science to dark matter detectors.
Chiral phonons are vibrational modes in a crystal that possess a well-defined handedness or chirality, typically found in materials that lack inversion symmetry. Here we report the discovery of chiral phonon modes in the kagome ferromagnetic Weyl semimetal Co3Sn2S2, a material that preserves inversion symmetry but breaks time-reversal symmetry. Using helicity-resolved magneto-Raman spectroscopy, we observe the spontaneous splitting of the doubly degenerate in-plane Eg modes into two distinct chiral phonon modes of opposite helicity when the sample is zero-field cooled below the Curie temperature, in the absence of an external magnetic field. As we sweep the out-of-plane magnetic field, this Eg phonon splitting exhibits a well-defined hysteresis loop directly correlated with the material's magnetization. The observed spontaneous splitting reaches up to 1.27 cm-1 at low temperatures, progressively diminishes with increasing temperature, and completely vanishes near the Curie temperature. Our findings highlight the role of the magnetic order in inducing chiral phonons, paving the way for novel methods to manipulate chiral phonons through magnetization and vice versa. Additionally, our work introduces new possibilities for controlling chiral Weyl fermions using chiral phonons.
The energy spectrum of topological semimetals contains protected degeneracies in reciprocal space that correspond to Weyl, Dirac, or multifold fermionic states. To exploit the unconventional properties of these states, one has to access the electronic structure of the three-dimensional bulk. In this work, we present the first joint theory-experiment study of the electronic structure of a candidate topological semimetal with resonant inelastic X-ray scattering (RIXS). We resolve the bulk electronic states of FeSi using momentum-dependent RIXS at the Fe $L_3$ edge. We observe a broad excitation continuum devoid of sharp features, consistent with particle-hole scattering in an underlying electronic band structure. Using density functional theory (DFT), we calculate the electronic structure of FeSi and derive a band theory formulation of RIXS in the fast collision approximation to model the scattering process with zero adjustable parameters. While band theory predicts an excitation continuum with broad spectral features similar to the observed ones, discrepancies between theory and experiment suggest the presence of low-energy processes that DFT alone does not account for. This first study of RIXS in a topological semimetal shows that RIXS is a useful tool for revealing unanticipated behavior of bulk electronic states in this class of materials.
Charge density wave (CDW) is discovered within a wide interval in solids, however, its microscopic nature is still not transparent in most realistic materials, and the recently studied chiral ones with chiral structural distortion remain unclear. In this paper, we try to understand the driving forces of chiral CDW transition by chiral phonons from the electron-phonon coupling scenario. We use the prototypal monolayer 1T-TiSe$_2$ as a case study to unveil the absence of chirality in the CDW transition and propose a general approach, i.e., symmetry-breaking stimuli, to engineer the chirality of CDW in experiments. Inelastic scattering patterns are also studied as a benchmark of chiral CDW (CCDW, which breaks the mirror/inversion symmetry in 2D/3D systems). We notice that the anisotropy changing of Bragg peak profiles, which is contributed by the soft chiral phonons, can show a remarkable signature for CCDW. Our findings pave a path to understanding the CCDW from the chiral phonon perspective, especially in van der Waals materials, and provide a powerful way to manipulate the chirality of CDW.
Segment Anything Model (SAM) has demonstrated powerful zero-shot segmentation performance in natural scenes. The recently released Segment Anything Model 2 (SAM2) has further heightened researchers' expectations towards image segmentation capabilities. To evaluate the performance of SAM2 on class-agnostic instance-level segmentation tasks, we adopt different prompt strategies for SAM2 to cope with instance-level tasks for three relevant scenarios: Salient Instance Segmentation (SIS), Camouflaged Instance Segmentation (CIS), and Shadow Instance Detection (SID). In addition, to further explore the effectiveness of SAM2 in segmenting granular object structures, we also conduct detailed tests on the high-resolution Dichotomous Image Segmentation (DIS) benchmark to assess the fine-grained segmentation capability. Qualitative and quantitative experimental results indicate that the performance of SAM2 varies significantly across different scenarios. Besides, SAM2 is not particularly sensitive to segmenting high-resolution fine details. We hope this technique report can drive the emergence of SAM2-based adapters, aiming to enhance the performance ceiling of large vision models on class-agnostic instance segmentation tasks.
The efficient readout of the relevant information is pivotal for quantum simulation experiments. Often only single observables are accessed by performing standard projective measurements. In this work, we implement a generalized measurement scheme based on controlled outcoupling of atoms. This gives us simultaneous access to number imbalance and relative phase in a system of two tunnel-coupled 1D Bose gases, which realize a quantum simulator of the sine-Gordon field theory. We demonstrate that our measurement is quantum limited by accessing number squeezing and show that we can track Josephson oscillation dynamics with the generalized measurements. Finally, we show that the scheme allows the extraction of atoms while maintaining the system's coherent dynamics, which opens up the door to accessing multi-time correlation functions. Our scheme constitutes a step towards accessing quantum properties of the sine-Gordon field theory and, in the future, studying spatially extended systems under continuous monitoring.
The Prostate Imaging Reporting and Data System (PI-RADS) is pivotal in the diagnosis of clinically significant prostate cancer through MRI imaging. Current deep learning-based PI-RADS scoring methods often lack the incorporation of common PI-RADS clinical guideline~(PICG) utilized by radiologists, potentially compromising scoring accuracy. This paper introduces a novel approach that adapts a multi-modal large language model (MLLM) to incorporate PICG into PI-RADS scoring model without additional annotations and network parameters. We present a designed two-stage fine-tuning process aiming at adapting a MLLM originally trained on natural images to the MRI images while effectively integrating the PICG. Specifically, in the first stage, we develop a domain adapter layer tailored for processing 3D MRI inputs and instruct the MLLM to differentiate MRI sequences. In the second stage, we translate PICG for guiding instructions from the model to generate PICG-guided image features. Through such a feature distillation step, we align the scoring network's features with the PICG-guided image features, which enables the model to effectively incorporate the PICG information. We develop our model on a public dataset and evaluate it on an in-house dataset. Experimental results demonstrate that our approach effectively improves the performance of current scoring networks. Code is available at: https://github.com/med-air/PICG2scoring
Nonreciprocal optical devices are essential for laser protection, modern optical communication and quantum information processing by enforcing one-way light propagation. The conventional Faraday magneto-optical nonreciprocal devices rely on a strong magnetic field, which is provided by a permanent magnet. As a result, the isolation direction of such devices is fixed and severely restricts their applications in quantum networks.In this work, we experimentally demonstrate the simultaneous one-way transmission and unidirectional reflection by using a magneto-optical Fabry-Pérot cavity and a magnetic field strength of $50~\milli\tesla$. An optical isolator and a three-port quasi-circulator are realized based on this nonreciprocal cavity system. The isolator achieves an isolation ratio of up to $22~\deci\bel$ and an averaged insertion loss down to $0.97~\deci\bel$. The quasi-circulator is realized with a fidelity exceeding $99\%$ and an overall survival probability of $89.9\%$, corresponding to an insertion loss of $\sim 0.46~\deci\bel$. The magnetic field is provided by an electromagnetic coil, thereby allowing for reversing the light circulating path. The reversible quasi-circulator paves the way for building reconfigurable quantum networks.
The memory dictionary-based contrastive learning method has achieved remarkable results in the field of unsupervised person Re-ID. However, The method of updating memory based on all samples does not fully utilize the hardest sample to improve the generalization ability of the model, and the method based on hardest sample mining will inevitably introduce false-positive samples that are incorrectly clustered in the early stages of the model. Clustering-based methods usually discard a significant number of outliers, leading to the loss of valuable information. In order to address the issues mentioned before, we propose an adaptive intra-class variation contrastive learning algorithm for unsupervised Re-ID, called AdaInCV. And the algorithm quantitatively evaluates the learning ability of the model for each class by considering the intra-class variations after clustering, which helps in selecting appropriate samples during the training process of the model. To be more specific, two new strategies are proposed: Adaptive Sample Mining (AdaSaM) and Adaptive Outlier Filter (AdaOF). The first one gradually creates more reliable clusters to dynamically refine the memory, while the second can identify and filter out valuable outliers as negative samples.
We study the chemical rules for predicting and understanding topological states in stacked kagome and honeycomb lattices in both analytical and numerical ways. Starting with a minimal five-band tight-binding model, we sort out all the topological states into five groups, which are determined by the interlayer and intralayer hopping parameters. Combined with the model, we design an algorithm to obtain a series of experimentally synthesized topological semimetals with kagome and honeycomb layers, i.e., IAMX family (IA = Alkali metal element, M = Rare earth metal element, X = Carbon group element), in the inorganic crystal structure database. A follow-up high-throughput calculation shows that IAMX family materials are all nodal-line semimetals and they will be Weyl semimetals after taking spin-orbit coupling into consideration. To have further insights into the topology of the IAMX family, a detailed chemical rule analysis is carried out on the high-throughput calculations, including the lattice constants of the structure, intralayer and interlayer couplings, bond strengths, electronegativity, and so on, which are consistent with our tight-binding model. Our study provides a way to discover and modulate topological properties in stacked kagome and honeycomb crystals and offers candidates for studying topology-related properties like topological superconductors and axion insulators.
Quantum simulators built from ultracold atoms promise to study quantum phenomena in interacting many-body systems. However, it remains a challenge to experimentally prepare strongly correlated continuous systems such that the properties are dominated by quantum fluctuations. Here, we show how to enhance the quantum correlations in a one-dimensional multimode bosonic Josephson junction, which is a quantum simulator of the sine-Gordon field theory. Our approach is based on the ability to track the non-equilibrium dynamics of quantum properties. After creating a bosonic Josephson junction at the stable fixed point of the classical phase space, we observe squeezing oscillations in the two conjugate variables. We show that the squeezing oscillation frequency can be tuned by more than one order of magnitude, and we are able to achieve a spin squeezing close to 10 dB by utilising these oscillatory dynamics. The impact of improved spin squeezing is directly revealed by detecting enhanced spatial phase correlations between decoupled condensates. Our work provides new ways for engineering correlations and entanglement in the external degree of freedom of interacting many-body systems.
Replaying past experiences has proven to be a highly effective approach for averting catastrophic forgetting in supervised continual learning. However, some crucial factors are still largely ignored, making it vulnerable to serious failure, when used as a solution to forgetting in continual reinforcement learning, even in the context of perfect memory where all data of previous tasks are accessible in the current task. On the one hand, since most reinforcement learning algorithms are not invariant to the reward scale, the previously well-learned tasks (with high rewards) may appear to be more salient to the current learning process than the current task (with small initial rewards). This causes the agent to concentrate on those salient tasks at the expense of generality on the current task. On the other hand, offline learning on replayed tasks while learning a new task may induce a distributional shift between the dataset and the learned policy on old tasks, resulting in forgetting. In this paper, we introduce RECALL, a replay-enhanced method that greatly improves the plasticity of existing replay-based methods on new tasks while effectively avoiding the recurrence of catastrophic forgetting in continual reinforcement learning. RECALL leverages adaptive normalization on approximate targets and policy distillation on old tasks to enhance generality and stability, respectively. Extensive experiments on the Continual World benchmark show that RECALL performs significantly better than purely perfect memory replay, and achieves comparable or better overall performance against state-of-the-art continual learning methods.
Physical layer key generation technology which leverages channel randomness to generate secret keys has attracted extensive attentions in long range (LoRa)-based networks recently. We in this paper develop a software-defined radio (SDR) based LoRa communications platform using GNU Radio on universal software radio peripheral (USRP) to implement and evaluate typical physical layer key generation schemes. Thanks to the flexibility and configurability of GNU Radio to extract LoRa packets, we are able to obtain the fine-grained channel frequency response (CFR) through LoRa preamble based channel estimation for key generation. Besides, we propose a lowcomplexity preprocessing method to enhance the randomness of quantization while reducing the secret key disagreement ratio. The results indicate that we can achieve 367 key bits with a high level of randomness through just a single effective channel probing in an indoor environment at a distance of 2 meters under the circumstance of a spreading factor (SF) of 7, a preamble length of 8, a signal bandwidth of 250 kHz, and a sampling rate of 1 MHz.
In topological phase transitions involving a change in topological invariants such as the Chern number and the $\mathbb{Z}_2$ topological invariant, the gap closes, and the electric polarization becomes undefined at the transition. In this paper, we show that the jump of polarization across such topological phase transitions in two dimensions is described in terms of positions and monopole charges of Weyl points in the intermediate Weyl semimetal phase. We find that the jump of polarization is described by the Weyl dipole at $\mathbb{Z}_2$ topological phase transitions and at phase transitions without any change in the value of the Chern number. Meanwhile, when the Chern number changes at the phase transition, the jump is expressed in terms of the relative positions of Weyl points measured from a reference point in the reciprocal space.
Chirality is an indispensable concept that pervades fundamental science and nature, manifesting itself in diverse forms such as chiral quasiparticles and chiral structures. Of particular interest are Weyl phonons carrying specific Chern numbers and chiral phonons doing circular motions in crystals. Up to now, Weyl and chiral phonons have been studied independently and the interpretations of chirality seem to be different in these two concepts, impeding our understanding. Here, we demonstrate that Weyl and chiral phonons are entangled in chiral crystals. Employing a typical chiral crystal of elementary tellurium (Te) as a case study, we expound on the intrinsic relationship between Chern number of Weyl phonons and pseudo-angular momentum (PAM) of chiral phonons. In light of the mutual coupling, we propose Raman scattering as a new technique to demonstrate the existence of Weyl phonons in Te, by detecting the chirality-induced energy splitting between the two constituent chiral phonon branches for Weyl phonons. By using the same experimental approach, we also observe the obstructed phonon surface states for the first time.
A key challenge of continual reinforcement learning (CRL) in dynamic environments is to promptly adapt the RL agent's behavior as the environment changes over its lifetime, while minimizing the catastrophic forgetting of the learned information. To address this challenge, in this article, we propose DaCoRL, i.e., dynamics-adaptive continual RL. DaCoRL learns a context-conditioned policy using progressive contextualization, which incrementally clusters a stream of stationary tasks in the dynamic environment into a series of contexts and opts for an expandable multihead neural network to approximate the policy. Specifically, we define a set of tasks with similar dynamics as an environmental context and formalize context inference as a procedure of online Bayesian infinite Gaussian mixture clustering on environment features, resorting to online Bayesian inference to infer the posterior distribution over contexts. Under the assumption of a Chinese restaurant process prior, this technique can accurately classify the current task as a previously seen context or instantiate a new context as needed without relying on any external indicator to signal environmental changes in advance. Furthermore, we employ an expandable multihead neural network whose output layer is synchronously expanded with the newly instantiated context, and a knowledge distillation regularization term for retaining the performance on learned tasks. As a general framework that can be coupled with various deep RL algorithms, DaCoRL features consistent superiority over existing methods in terms of the stability, overall performance and generalization ability, as verified by extensive experiments on several robot navigation and MuJoCo locomotion tasks.
We compare the Hilbert series approach with explicit constructions of higher-order Lagrangians for the $O(N)$ nonlinear sigma model. We use the Hilbert series to find the number and type of operators up to mass dimension 16, for spacetime dimension $D$ up to 12 and $N$ up to 12, and further classify the operators into spacetime parity and parity of the internal symmetry group $O(N)$. The explicit construction of operators is done up to mass dimension 12 for both parities even and dimension 10 for the other three cases. The results of the two methods are in full agreement. This provides evidence for the Hilbert series conjecture regarding co-closed but not co-exact $k$-forms, which takes into account the integration-by-parts relations.