arXiv subjects

Xue-Feng Zhu

Publications and source records attributed to Xue-Feng Zhu.

At least 19 recordsLinked to original sources

arXiv2026

Collaborating Vision, Depth, and Thermal Signals for Multi-Modal Tracking: Dataset and Algorithm

Existing multi-modal object tracking approaches primarily focus on dual-modal paradigms, such as RGB-Depth or RGB-Thermal, yet remain challenged in complex scenarios due to limited input modalities. To address this gap, this work introduces a novel multi-modal tracking task that leverages three complementary modalities, including visible RGB, Depth (D), and Thermal Infrared (TIR), aiming to enhance robustness in complex scenarios. To support this task, we construct a new multi-modal tracking dataset, coined RGBDT500, which consists of 500 videos with synchronised frames across the three modalities. Each frame provides spatially aligned RGB, depth, and thermal infrared images with precise object bounding box annotations. Furthermore, we propose a novel multi-modal tracker, dubbed RDTTrack. RDTTrack integrates tri-modal information for robust tracking by leveraging a pretrained RGB-only tracking model and prompt learning techniques. In specific, RDTTrack fuses thermal infrared and depth modalities under a proposed orthogonal projection constraint, then integrates them with RGB signals as prompts for the pre-trained foundation tracking model, effectively harmonising tri-modal complementary cues. The experimental results demonstrate the effectiveness and advantages of the proposed method, showing significant improvements over existing dual-modal approaches in terms of tracking accuracy and robustness in complex scenarios. The dataset and source code are publicly available at https://xuefeng-zhu5.github.io/RGBDT500.

cs.CV↗

arXiv2025

Moire-driven skyrmion family

Skyrmion family members, such as skyrmions, bimerons, and skyrmioniums, have been recently observed in quantum, solid-state, water, and magnetic systems. However, it remains challenging and crucial to identify a single platform for observing their coexistence and evolution. Here, we describe a bilayer twisted moire elastic system as a controllable platform for the generation of skyrmion family members with distinct topological charges across different wave systems. Our experimental results further reveal that the twist angle induces a synergistic evolution between lattice symmetry and topological characteristics, enabling the mutual transformation and stable coexistence of different skyrmion family members within a single system. More importantly, we demonstrate that such a platform supports the discontinuous transport of Lamb-wave-induced topological textures, revealing phason-like dynamics within the quasiperiodic structure. This work opens a new avenue for designing all-in-one topological wave devices.

physics.app-ph↗

arXiv2024

Direct measurement of topological invariants through temporal adiabatic evolution of bulk states in the synthetic Brillouin zone

Mathematically, topological invariants arise from the parallel transport of eigenstates on the energy bands, which, in physics, correspond to the adiabatic dynamical evolution of transient states. It determines the presence of boundary states, while lacking direct measurements. Here, we develop time-varying programmable coupling circuits between acoustic cavities to mimic the Hamiltonians in the Brillouin zone, with which excitation and adiabatic evolution of bulk states are realized in a unit cell. By extracting the Berry phases of the bulk band, topological invariants, including the Zak phase for the SSH model and the Chern number for the AAH model, are obtained convincingly. The bulk state evolution also provides insight into the topological charges of our newly developed non-Abelian models, which are also verified by observing the adiabatic eigenframe rotation. Our work not only provides a general recipe for telling various topological invariants but also sheds light on transient acoustic wave manipulations.

cond-mat.mes-hall↗

arXiv2024

Geometric heat pumping under continuous modulation in thermal diffusion

Berry (geometric) phase has attracted a lot of interest and permeated into all aspects of physics including photonics, crystal dynamics, electromagnetism and heat transfer since it was discovered, leading to various unprecedented effects both in classical and quantum systems, such as Hannay angle, quantum Hall effect, orbital magnetism and Thouless pumping. Heat pumping is one of the most prominent and fantastic application of geometric phase in heat transport. Here we derive a general heat pumping theory based on classical diffusion equation and continuous modulation of system parameters in macroscopic thermal diffusion system and obtain a formula which is reminiscent of contact between Berry phase and the Berry curvature. Furthermore, we discuss two cases of non-trivial zero heat flux after one cycle which is fundamentally different from the trivial zero heat flux generated by static zero heat bias in physical nature. Then we analyze the dependence of the effect on the system thermal parameters, including some counterintuitive phenomenon. Finally, under the guidance of this theory, we conduct an experiment to demonstrate the accuracy and effectiveness of our theory and observe the heat pumping effect regardless of the presence and the absence of the thermal bias between two ports of system. In general, our work clearly derives the universal form of heat pumping theory under arbitrary form of the modulation in the macroscopic thermal diffusion system, this is of great significance for better heat energy transport, heat manipulation and so on. It also establishes the foundation of achieving other non-reciprocity devices or topological devices with the aid of spatiotemporal modulation.

physics.class-ph↗

arXiv2024

Visual Object Tracking on Multi-modal RGB-D Videos: A Review

The development of visual object tracking has continued for decades. Recent years, as the wide accessibility of the low-cost RGBD sensors, the task of visual object tracking on RGB-D videos has drawn much attention. Compared to conventional RGB-only tracking, the RGB-D videos can provide more information that facilitates objecting tracking in some complicated scenarios. The goal of this review is to summarize the relative knowledge of the research filed of RGB-D tracking. To be specific, we will generalize the related RGB-D tracking benchmarking datasets as well as the corresponding performance measurements. Besides, the existing RGB-D tracking methods are summarized in the paper. Moreover, we discuss the possible future direction in the field of RGB-D tracking.

cs.CV↗

arXiv2024

Chiral and non-chiral swift mode conversion near an exception point with dynamic adiabaticity engineering

The eigenvalue of a non-Hermitian Hamiltonian often forms a self-intersecting Riemann surface, leading to a unique mode conversion phenomenon when the Hamiltonian evolves along certain loop paths around an exceptional point (EP). However, two fundamental problems exist with the conventional scheme of EP encircling: the speed of mode conversion is restricted by the adiabatic requirement, and the chirality cannot be freely controlled. Here, we introduce a method which dynamically engineers the adiabaticity in the evolution of non-Hermitian Hamiltonians that allows for both chiral and non-chiral mode conversion on the same path. Our method is based on quantifying and controlling the instantaneous adiabaticity, allowing for non-uniform evolution throughout the entire path. We apply our method into the microwave waveguide system and by optimizing the distributed adiabaticity along the evolution loop, we achieve the same quality of mode conversion as conventional quasi-adiabatic evolution in only one-fourth of the time. Our approach provides a comprehensive and universal solution to address the speed and chirality challenges associated with EP encircling. It also facilitates the dynamic manipulation and regulation of non-adiabatic processes, thereby accelerating the operation and allowing for a selection among various mode conversion patterns.

quant-ph↗

arXiv2023

Observing parity-time symmetry in diffusive systems

Phase modulation has scarcely been mentioned in diffusive systems since the diffusion process does not carry momentum like waves. Recently, the non-Hermitian physics provides a new perspective for understanding diffusion and shows prospects in the phase regulation of heat flow, for example, the discovery of anti-parity-time (APT) symmetry in diffusive systems. The precise control of thermal phase however remains elusive hitherto and can hardly be realized in APT-symmetric thermal systems due to the existence of phase oscillation. Here we construct the counterpart of APT-symmetric diffusive systems, i.e., PT-symmetric diffusive systems, which can achieve complete suppression of thermal phase oscillation. We find the real coupling of diffusive fields can be readily established through a strong convective background, where the decay-rate detuning is enabled by thermal metamaterial design. Moreover, we observe phase transition of PT symmetry breaking in diffusive systems with the symmetry-determined amplitude distribution and phase regulation of coupled temperature fields. Our work uncovers the existence of PT-symmetry in dissipative energy exchanges and provides a unique approach for harnessing the mass transfer of particles, the wave propagation in strongly scattering systems as well as thermal conduction.

physics.app-ph↗

arXiv2023

Observation of Non-Hermitian Skin Effect in Thermal Diffusion

The paradigm shift of the Hermitian systems into the non-Hermitian regime profoundly modifies the inherent topological property, leading to various unprecedented effects such as the non-Hermitian skin effect (NHSE). In the past decade, the NHSE effect has been demonstrated in quantum, optical and acoustic systems. Besides in those non-Hermitian wave systems, the NHSE in diffusive systems has not yet been explicitly demonstrated, despite recent abundant advances in the study of topological thermal diffusion. Here we first design a thermal diffusion lattice based on a modified Su-Schrieffer-Heeger model which enables the observation of diffusive NHSE. In the proposed model, the periodic heat exchange rate among adjacent unit cells and the asymmetric temperature field coupling inside unit cells can be judiciously realized by appropriate configurations of structural parameters of unit cells. The transient concentration feature of temperature field on the boundary regardless of initial excitation conditions can be clearly observed, indicating the occurrence of transient thermal skin effect. Nonetheless, we experimentally demonstrated the NHSE and verified the remarkable robustness against various defects. Our work provides a platform for exploration of non-Hermitian physics in the diffusive systems, which has important applications in efficient heat collection, highly sensitive thermal sensing and others.

physics.class-ph↗

arXiv2023

Evidential Detection and Tracking Collaboration: New Problem, Benchmark and Algorithm for Robust Anti-UAV System

Unmanned Aerial Vehicles (UAVs) have been widely used in many areas, including transportation, surveillance, and military. However, their potential for safety and privacy violations is an increasing issue and highly limits their broader applications, underscoring the critical importance of UAV perception and defense (anti-UAV). Still, previous works have simplified such an anti-UAV task as a tracking problem, where the prior information of UAVs is always provided; such a scheme fails in real-world anti-UAV tasks (i.e. complex scenes, indeterminate-appear and -reappear UAVs, and real-time UAV surveillance). In this paper, we first formulate a new and practical anti-UAV problem featuring the UAVs perception in complex scenes without prior UAVs information. To benchmark such a challenging task, we propose the largest UAV dataset dubbed AntiUAV600 and a new evaluation metric. The AntiUAV600 comprises 600 video sequences of challenging scenes with random, fast, and small-scale UAVs, with over 723K thermal infrared frames densely annotated with bounding boxes. Finally, we develop a novel anti-UAV approach via an evidential collaboration of global UAVs detection and local UAVs tracking, which effectively tackles the proposed problem and can serve as a strong baseline for future research. Extensive experiments show our method outperforms SOTA approaches and validate the ability of AntiUAV600 to enhance UAV perception performance due to its large scale and complexity. Our dataset, pretrained models, and source codes will be released publically.

cs.CV↗

arXiv2023

Demonstration of acoustic high-order Stiefel-Whitney semimetal in bilayer graphene sonic crystals

Recently, higher-order topological phases have endowed materials many exotic topological phases. For three-dimensional (3D) higher-order topologies, it hosts topologically protected 1D hinge states or 0D corner states, which extend the bulk-boundary correspondence of 3D topological phases. Meanwhile, the enrichment of group symmetries with exploration of projective symmetry algebras redefined the fundamentals of nontrivial topological matter with artificial gauge fields, leading to the discovery of new topological phases in classical wave systems. In this Letter, we construct an acoustic topological semimetal characterized by both the first and the second Stiefel-Whitney (SW) topological charges by utilizing the projective symmetry. Different from conventional high-order topologies with multiple bulk-boundary correspondences protected by different class topological invariants, acoustic high-order Stiefel-Whitney semimetal (HOSWS) has two different bulk-edge correspondences protected by only one class (SW class) topological invariant. Two types of topological hinge and surface states are embedded in bulk bands at the same frequency, featuring similar characteristics of bound states in the continuum (BICs). In experiments, we demonstrate the existence of high-quality surface state and hinge state at the interested frequency window with polarized intensity field distributions.

cond-mat.mes-hall↗

arXiv2023

Observation of Multiple Topological Corner States in Thermal Diffusion

Higher-dimensional topological meta-materials have more flexible than one-dimensional topological materials, which are more convenient to apply and solve practical problems. However, in diffusion systems, higher-dimensional topological states have not been well studied. In this work, we experimentally realized the 2D topological structure based on a kagome lattice of thermal metamaterial. Due to the anti-Hermitian properties of the diffusion Hamiltonian, it has purely imaginary eigenvalues corresponding to the decay rate. By theoretical analysis and directly observing the decay rate of temperature through experiments, we present the various corner states in 2D topological diffusive system. Our work constitutes the first realization of multiple corner states with high decay rates in a pure diffusion system, which provides a new idea for the design of topological protected thermal metamaterial in the future.

cond-mat.mes-hall↗

arXiv2022

RGBD1K: A Large-scale Dataset and Benchmark for RGB-D Object Tracking

RGB-D object tracking has attracted considerable attention recently, achieving promising performance thanks to the symbiosis between visual and depth channels. However, given a limited amount of annotated RGB-D tracking data, most state-of-the-art RGB-D trackers are simple extensions of high-performance RGB-only trackers, without fully exploiting the underlying potential of the depth channel in the offline training stage. To address the dataset deficiency issue, a new RGB-D dataset named RGBD1K is released in this paper. The RGBD1K contains 1,050 sequences with about 2.5M frames in total. To demonstrate the benefits of training on a larger RGB-D data set in general, and RGBD1K in particular, we develop a transformer-based RGB-D tracker, named SPT, as a baseline for future visual object tracking studies using the new dataset. The results, of extensive experiments using the SPT tracker emonstrate the potential of the RGBD1K dataset to improve the performance of RGB-D tracking, inspiring future developments of effective tracker designs. The dataset and codes will be available on the project homepage: https://github.com/xuefeng-zhu5/RGBD1K.

cs.CV↗

arXiv2021

Localized heat diffusion in topological thermal materials

Various unusual behaviors of artificial materials are governed by their topological properties, among which the edge state at the boundary of a photonic or phononic lattice has been captivated as a popular notion. However, this remarkable bulk-boundary correspondence and the related phenomena are missing in thermal materials. One reason is that heat diffusion is described in a non-Hermitian framework because of its dissipative nature. The other is that the relevant temperature field is mostly composed of modes that extend over wide ranges, making it difficult to be rendered within the tight-binding theory as commonly employed in wave physics. Here, we overcome the above challenges and perform systematic studies on heat diffusion in thermal lattices. Based on a continuum model, we introduce a state vector to link the Zak phase with the existence of the edge state, and thereby analytically prove the thermal bulk-boundary correspondence. We experimentally demonstrate the predicted edge states with a topologically protected and localized heat dissipation capacity. Our finding sets up a solid foundation to explore the topology in novel heat transfer manipulations.

physics.app-ph↗

arXiv2021

Reciprocity of thermal diffusion in time-modulated systems

The reciprocity principle governs the symmetry in transmission of electromagnetic and acoustic waves, as well as the diffusion of heat between two points in space, with important consequences for thermal management and energy harvesting. There has been significant recent interest in materials with time-modulated properties, which have been shown to efficiently break reciprocity for light, sound, and even charge diffusion. Quite surprisingly, here we show that, from a practical point of view, time modulation cannot generally be used to break reciprocity for thermal diffusion. We establish a theoretical framework to accurately describe the behavior of diffusive processes under time modulation, and prove that thermal reciprocity in dynamic materials is generally preserved by the continuity equation, unless some external bias or special material is considered. We then experimentally demonstrate reciprocal heat transfer in a time-modulated device. Our findings correct previous misconceptions regarding reciprocity breaking for thermal diffusion, revealing the generality of symmetry constraints in heat transfer, and clarifying its differences from other transport processes in what concerns the principles of reciprocity and microscopic reversibility.

physics.app-ph↗

arXiv2020

Probability-Density-Based Deep Learning Paradigm for the Fuzzy Design of Functional Metastructures

In quantum mechanics, a norm squared wave function can be interpreted as the probability density that describes the likelihood of a particle to be measured in a given position or momentum. This statistical property is at the core of the fuzzy structure of microcosmos. Recently, hybrid neural structures raised intense attention, resulting in various intelligent systems with far-reaching influence. Here, we propose a probability-density-based deep learning paradigm for the fuzzy design of functional meta-structures. In contrast to other inverse design methods, our probability-density-based neural network can efficiently evaluate and accurately capture all plausible meta-structures in a high-dimensional parameter space. Local maxima in probability density distribution correspond to the most likely candidates to meet the desired performances. We verify this universally adaptive approach in but not limited to acoustics by designing multiple meta-structures for each targeted transmission spectrum, with experiments unequivocally demonstrating the effectiveness and generalization of the inverse design.

cs.LG↗

arXiv2019

Adaptive Distraction Context Aware Tracking Based on Correlation Filter

The Discriminative Correlation Filter (CF) uses a circulant convolution operation to provide several training samples for the design of a classifier that can distinguish the target from the background. The filter design may be interfered by objects close to the target during the tracking process, resulting in tracking failure. This paper proposes an adaptive distraction context aware tracking algorithm to solve this problem. In the response map obtained for the previous frame by the CF algorithm, we adaptively find the image blocks that are similar to the target and use them as negative samples. This diminishes the influence of similar image blocks on the classifier in the tracking process and its accuracy is improved. The tracking results on video sequences show that the algorithm can cope with rapid changes such as occlusion and rotation, and can adaptively use the distractive objects around the target as negative samples to improve the accuracy of target tracking.

cs.CV↗

arXiv2019

Robust Visual Tracking via Implicit Low-Rank Constraints and Structural Color Histograms

With the guaranteed discrimination and efficiency of spatial appearance model, Discriminative Correlation Filters (DCF-) based tracking methods have achieved outstanding performance recently. However, the construction of effective temporal appearance model is still challenging on account of filter degeneration becomes a significant factor that causes tracking failures in the DCF framework. To encourage temporal continuity and to explore the smooth variation of target appearance, we propose to enhance low-rank structure of the learned filters, which can be realized by constraining the successive filters within a $\ell_2$-norm ball. Moreover, we design a global descriptor, structural color histograms, to provide complementary support to the final response map, improving the stability and robustness to the DCF framework. The experimental results on standard benchmarks demonstrate that our Implicit Low-Rank Constraints and Structural Color Histograms (ILRCSCH) tracker outperforms state-of-the-art methods.

cs.CV↗

arXiv2019

Roadmap on STIRAP applications

STIRAP (Stimulated Raman Adiabatic Passage) is a powerful laser-based method, usually involving two photons, for efficient and selective transfer of population between quantum states. A particularly interesting feature is the fact that the coupling between the initial and the final quantum states is via an intermediate state even though the lifetime of the latter can be much shorter than the interaction time with the laser radiation. Nevertheless, spontaneous emission from the intermediate state is prevented by quantum interference. Maintaining the coherence between the initial and final state throughout the transfer process is crucial. STIRAP was initially developed with applications in chemical dynamics in mind. That is why the original paper of 1990 was published in The Journal of Chemical Physics. However, as of about the year 2000, the unique capabilities of STIRAP and its robustness with respect to small variations of some experimental parameters stimulated many researchers to apply the scheme in a variety of other fields of physics. The successes of these efforts are documented in this collection of articles.

quant-ph↗