arXiv subjects

Xudong Zhang

Publications and source records attributed to Xudong Zhang.

At least 37 records · Page 2Linked to original sources

arXiv2025

CSIYOLO: An Intelligent CSI-based Scatter Sensing Framework for Integrated Sensing and Communication Systems

ISAC is regarded as a promising technology for next-generation communication systems, enabling simultaneous data transmission and target sensing. Among various tasks in ISAC, scatter sensing plays a crucial role in exploiting the full potential of ISAC and supporting applications such as autonomous driving and low-altitude economy. However, most existing methods rely on either waveform and hardware modifications or traditional signal processing schemes, leading to poor compatibility with current communication systems and limited sensing accuracy. To address these challenges, we propose CSIYOLO, a framework that performs scatter localization only using estimated CSI from a single base station-user equipment pair. This framework comprises two main components: anchor-based scatter parameter detection and CSI-based scatter localization. First, by formulating scatter parameter extraction as an image detection problem, we propose an anchor-based scatter parameter detection method inspired by You Only Look Once architectures. After that, a CSI-based localization algorithm is derived to determine scatter locations with extracted parameters. Moreover, to improve localization accuracy and implementation efficiency, we design an extendable network structure with task-oriented optimizations, enabling multi-scale anchor detection and better adaptation to CSI characteristics. A noise injection training strategy is further designed to enhance robustness against channel estimation errors. Since the proposed framework operates solely on estimated CSI without modifying waveforms or signal processing pipelines, it can be seamlessly integrated into existing communication systems as a plugin. Experiments show that our proposed method can significantly outperform existing methods in scatter localization accuracy with relatively low complexities under varying numbers of scatters and estimation errors.

eess.SP↗

arXiv2025

Efficient Agent: Optimizing Planning Capability for Multimodal Retrieval Augmented Generation

Multimodal Retrieval-Augmented Generation (mRAG) has emerged as a promising solution to address the temporal limitations of Multimodal Large Language Models (MLLMs) in real-world scenarios like news analysis and trending topics. However, existing approaches often suffer from rigid retrieval strategies and under-utilization of visual information. To bridge this gap, we propose E-Agent, an agent framework featuring two key innovations: a mRAG planner trained to dynamically orchestrate multimodal tools based on contextual reasoning, and a task executor employing tool-aware execution sequencing to implement optimized mRAG workflows. E-Agent adopts a one-time mRAG planning strategy that enables efficient information retrieval while minimizing redundant tool invocations. To rigorously assess the planning capabilities of mRAG systems, we introduce the Real-World mRAG Planning (RemPlan) benchmark. This novel benchmark contains both retrieval-dependent and retrieval-independent question types, systematically annotated with essential retrieval tools required for each instance. The benchmark's explicit mRAG planning annotations and diverse question design enhance its practical relevance by simulating real-world scenarios requiring dynamic mRAG decisions. Experiments across RemPlan and three established benchmarks demonstrate E-Agent's superiority: 13% accuracy gain over state-of-the-art mRAG methods while reducing redundant searches by 37%.

cs.AI↗

arXiv2025

Topological quantum electrodynamics in synthetic non-Abelian gauge fields

Quantum electrodynamics (QED), a cornerstone framework that describes light-matter interactions rooted in Abelian symmetries, renders the harnessing of synthetic non-Abelian gauge fields as a fundamental yet uncharted frontier. Here, we develop a general theory of light-matter interaction of quantum emitters embedded in non-Abelian photonic lattices. Based on analytical solutions to the non-Abelian Landau dressed states beyond the continuum limit, we reveal chiral photon emission and vortices with emergent nonreciprocity enabled by selective coupling between emitters and spin-momentum-locked bands. When coexisting with Abelian and non-Abelian magnetic fields, emitters hybridize with Landau dressed orbits to form spin-polarized, squeezed Landau polaritons that carry quantized angular momenta, with Rabi frequencies tunable via Landau levels and pseudospin interactions. Multi-emitter dynamics further exhibit collective phenomena governed by real-space staggered phases induced by nonsymmorphic crystalline symmetry. These results bridge non-Abelian physics with quantum optics, and establish non-Abelian gauge fields as a versatile tool for synthesizing topological quantum optical states, angular momentum transfer, and controlling photon-mediated correlations in QED systems, relevant for applications in quantum simulations and chiral quantum optical networks.

physics.optics↗

arXiv2025

Observation of wave amplification and temporal topological state in a genuine photonic time crystal

Photonic time crystals (PTCs) are materials whose dielectric permittivity is periodically modulated in time, giving rise to bandgaps not in energy-as in conventional photonic crystals-but in momentum, known as k-gaps. These k-gaps enable wave amplification by extracting energy from temporal modulation, offering a mechanism for coherent light generation that bypasses traditional optical gain. PTCs also extend the concept of topological insulators to the time domain, inducing a temporal topological state at the mid-gap of the k-gap, characterized by the Zak phase-a topological invariant originally defined for spatial lattices. Here, we experimentally demonstrate the properties of a k gap in a genuine PTC, realized in a dynamically modulated transmission-line metamaterial. Wave amplification within the k-gap is observed, with an initial power spectrum narrowing and shifting toward the gap. To probe the mid-gaptopological state, we introduce a temporal interface separating two PTCs with distinct topological phases. The measured phase shift between time-reflected and time-refracted waves, together with the temporal confinement of the topological state, provides direct evidence of nontrivial temporal topology. By integrating kgap amplification with time-domain topological features, our work opens new avenues for light generation and manipulation in time-varying photonic materials.

physics.optics↗

arXiv2024

Broadband measurement of Feibelman's quantum surface response functions

The Feibelman $d$-parameter, a mesoscopic complement to the local bulk permittivity, describes quantum optical surface responses for interfaces, including nonlocality, spill-in and-out, and surface-enabled Landau damping. It has been incorporated into the macroscopic Maxwellian framework for convenient modeling and understanding of nanoscale electromagnetic phenomena, calling for the compilation of a $d$-parameter database for interfaces of interest in nano-optics. However, accurate first-principles calculations of $d$-parameters face computational challenges, whereas existing measurements of $d$-parameters are scarce and restricted to narrow spectral windows. We demonstrate a general broadband ellipsometric approach to measure $d$-parameters at a gold--air interface across the visible--ultraviolet regimes. Gold is found to spill in and spill out at different frequencies. We also observe gold's Bennett mode, a surface-dipole resonance associated with a pole of the $d$-parameter, around 2.5 eV. Our measurements give rise to and are further validated by the passivity and Kramers--Kronig causality analysis of $d$-parameters. Our work advances the understanding of quantum surface response and may enable applications like enhanced electron field emission.

physics.optics↗

arXiv2024

Synthetic gain for electron-beam spectroscopy

Electron-beam microscopy and spectroscopy featuring atomic-scale spatial resolution have become essential tools used daily in almost all branches of nanoscale science and technology. As a natural supercontinuum source of light, free electrons couple with phonons, plasmons, electron-hole pairs, inter- and intra-band transitions, and inner-shell ionization. The multiple excitations, intertwined with the intricate nature of nanostructured samples, present significant challenges in isolating specific spectral characteristics amidst complex experimental backgrounds. Here we introduce the approach of synthetic complex frequency waves to mitigate these challenges in free-electron--light interaction. The complex frequency waves, created through causality-informed coherent superposition of real-frequency waves induced by free electrons, offer virtual gain to offset material losses. This amplifies and enhances spectral features, as confirmed by our electron energy loss and cathodoluminescence measurements on multi-layer membranes, suspended nanoparticles, and film-coupled nanostructures. Strikingly, we reveal that our approach can retrieve resonance excitation completely buried underneath the zero-loss peak, substantially enhance the quality of hyperspectral imaging, and resolve entangled multiple-photon-electron events in their quantum interaction. Our findings indicate the versatile utility of complex frequency waves in various electron-beam spectroscopy and their promising diagnostic capabilities in free-electron quantum optics.

physics.optics↗

arXiv2024

Non-stationary BERT: Exploring Augmented IMU Data For Robust Human Activity Recognition

Human Activity Recognition (HAR) has gained great attention from researchers due to the popularity of mobile devices and the need to observe users' daily activity data for better human-computer interaction. In this work, we collect a human activity recognition dataset called OPPOHAR consisting of phone IMU data. To facilitate the employment of HAR system in mobile phone and to achieve user-specific activity recognition, we propose a novel light-weight network called Non-stationary BERT with a two-stage training method. We also propose a simple yet effective data augmentation method to explore the deeper relationship between the accelerator and gyroscope data from the IMU. The network achieves the state-of-the-art performance testing on various activity recognition datasets and the data augmentation method demonstrates its wide applicability.

cs.AI↗

arXiv2024

Scale-Translation Equivariant Network for Oceanic Internal Solitary Wave Localization

Internal solitary waves (ISWs) are gravity waves that are often observed in the interior ocean rather than the surface. They hold significant importance due to their capacity to carry substantial energy, thus influence pollutant transport, oil platform operations, submarine navigation, etc. Researchers have studied ISWs through optical images, synthetic aperture radar (SAR) images, and altimeter data from remote sensing instruments. However, cloud cover in optical remote sensing images variably obscures ground information, leading to blurred or missing surface observations. As such, this paper aims at altimeter-based machine learning solutions to automatically locate ISWs. The challenges, however, lie in the following two aspects: 1) the altimeter data has low resolution, which requires a strong machine learner; 2) labeling data is extremely labor-intensive, leading to very limited data for training. In recent years, the grand progress of deep learning demonstrates strong learning capacity given abundant data. Besides, more recent studies on efficient learning and self-supervised learning laid solid foundations to tackle the aforementioned challenges. In this paper, we propose to inject prior knowledge to achieve a strong and efficient learner. Specifically, intrinsic patterns in altimetry data are efficiently captured using a scale-translation equivariant convolutional neural network (ST-ECNN). By considering inherent symmetries in neural network design, ST-ECNN achieves higher efficiency and better performance than baseline models. Furthermore, we also introduce prior knowledge from massive unsupervised data to enhance our solution using the SimCLR framework for pre-training. Our final solution achieves an overall better performance than baselines on our handcrafted altimetry dataset. Data and codes are available at https://github.com/ZhangWan-byte/Internal_Solitary_Wave_Localization .

cs.LG↗

arXiv2024

Monocular Localization with Semantics Map for Autonomous Vehicles

Accurate and robust localization remains a significant challenge for autonomous vehicles. The cost of sensors and limitations in local computational efficiency make it difficult to scale to large commercial applications. Traditional vision-based approaches focus on texture features that are susceptible to changes in lighting, season, perspective, and appearance. Additionally, the large storage size of maps with descriptors and complex optimization processes hinder system performance. To balance efficiency and accuracy, we propose a novel lightweight visual semantic localization algorithm that employs stable semantic features instead of low-level texture features. First, semantic maps are constructed offline by detecting semantic objects, such as ground markers, lane lines, and poles, using cameras or LiDAR sensors. Then, online visual localization is performed through data association of semantic features and map objects. We evaluated our proposed localization framework in the publicly available KAIST Urban dataset and in scenarios recorded by ourselves. The experimental results demonstrate that our method is a reliable and practical localization solution in various autonomous driving localization tasks.

cs.CV↗

arXiv2024

Revised Optimal design of power electronic transformer based on hybrid MMC under over-modulation operation

The bridge arm of the hybrid modular multilevel converter (MMC) is composed of half-bridge and full-bridge sub-modules cascaded together. Compared with the half-bridge MMC, it can operate in the boost-AC mode, where the modulation index can be higher than 1, and the DC voltage and the AC voltage level are no longer mutually constrained; compared with the full-bridge MMC, it has lower switching device costs and losses. When the hybrid MMC boost-AC mode is used in the power electronic transformer, the degree of freedom in system design is improved, and the cost and volume of the power electronic transformer system can be further reduced. This paper analyzes how to make full use of the newly added modulation index of freedom introduced by the boost-AC hybrid MMC to optimize the power electronic transformer system, and finally gives the optimal modulation index selection scheme of the hybrid MMC for different optimization objectives.

eess.SY↗

arXiv2024

Samsung Research China-Beijing at SemEval-2024 Task 3: A multi-stage framework for Emotion-Cause Pair Extraction in Conversations

In human-computer interaction, it is crucial for agents to respond to human by understanding their emotions. Unraveling the causes of emotions is more challenging. A new task named Multimodal Emotion-Cause Pair Extraction in Conversations is responsible for recognizing emotion and identifying causal expressions. In this study, we propose a multi-stage framework to generate emotion and extract the emotion causal pairs given the target emotion. In the first stage, Llama-2-based InstructERC is utilized to extract the emotion category of each utterance in a conversation. After emotion recognition, a two-stream attention model is employed to extract the emotion causal pairs given the target emotion for subtask 2 while MuTEC is employed to extract causal span for subtask 1. Our approach achieved first place for both of the two subtasks in the competition.

cs.CL↗

arXiv2024

Mixing due to Solution-switch Limits the Performance of Electro-sorption for Desalination

Electro-sorption (ES) is a research frontier in electrochemical separation, with proven potential applications in desalination, wastewater treatment, and selective resource extraction. However, due to the limited adsorption capacity of film electrodes, ES requires short circuiting or circuit reversal, accompanied by solution-switch between the feed solution and receiving solution, to sustain desalination over many charging-discharge cycles. In the literature, solution-switch have been commonly ignored to simplify experimental procedures and its impacts on separation performance are thus not well understood. This study aims to provide a quantitative analysis of the impacts of mixing due to solution-switch on the performance of ES-based desalination. A numerical model of ES has been employed to evaluate the adverse effects of solution-switch on the desalination performance in three different operation modes. The analysis reveals that the impacts of mixing due to solution-switch are more severe with a larger concentration difference between the desalinated water and the brine and provides insights on the effectiveness of increasing electrode loading or specific capacity in mitigating the detrimental impacts of mixing. Even with state-of-the-art systems, producing freshwater from seawater or even brackish water with medium-to-high salinity is practically challenging due to the presence of solution-switch.

physics.chem-ph↗

arXiv2023

Robust Communicative Multi-Agent Reinforcement Learning with Active Defense

Communication in multi-agent reinforcement learning (MARL) has been proven to effectively promote cooperation among agents recently. Since communication in real-world scenarios is vulnerable to noises and adversarial attacks, it is crucial to develop robust communicative MARL technique. However, existing research in this domain has predominantly focused on passive defense strategies, where agents receive all messages equally, making it hard to balance performance and robustness. We propose an active defense strategy, where agents automatically reduce the impact of potentially harmful messages on the final decision. There are two challenges to implement this strategy, that are defining unreliable messages and adjusting the unreliable messages' impact on the final decision properly. To address them, we design an Active Defense Multi-Agent Communication framework (ADMAC), which estimates the reliability of received messages and adjusts their impact on the final decision accordingly with the help of a decomposable decision structure. The superiority of ADMAC over existing methods is validated by experiments in three communication-critical tasks under four types of attacks.

cs.MA↗

arXiv2023

SR-HetGNN:Session-based Recommendation with Heterogeneous Graph Neural Network

The Session-Based Recommendation System aims to predict the user's next click based on their previous session sequence. The current studies generally learn user preferences according to the transitions of items in the user's session sequence. However, other effective information in the session sequence, such as user profiles, are largely ignored which may lead to the model unable to learn the user's specific preferences. In this paper, we propose SR-HetGNN, a novel session recommendation method that uses a heterogeneous graph neural network (HetGNN) to learn session embeddings and capture the specific preferences of anonymous users. Specifically, SR-HetGNN first constructs heterogeneous graphs containing various types of nodes according to the session sequence, which can capture the dependencies among items, users, and sessions. Second, HetGNN captures the complex transitions between items and learns the item embeddings containing user information. Finally, local and global session embeddings are combined with the attentional network to obtain the final session embedding, considering the influence of users' long and short-term preferences. SR-HetGNN is shown to be superior to the existing state-of-the-art session-based recommendation methods through extensive experiments over two real large datasets Diginetica and Tmall.

cs.IR↗

arXiv2023

Data Augmentation of Bridging the Delay Gap for DL-based Massive MIMO CSI Feedback

In massive multiple-input multiple-output (MIMO) systems under the frequency division duplexing (FDD) mode, the user equipment (UE) needs to feed channel state information (CSI) back to the base station (BS). Though deep learning approaches have made a hit in the CSI feedback problem, whether they can remain excellent in actual environments needs to be further investigated. In this letter, we point out that the real-time dataset in application often has the domain gap from the training dataset caused by the time delay. To bridge the gap, we propose bubble-shift (B-S) data augmentation, which attempts to offset performance degradation by changing the delay and remaining the channel information as much as possible. Moreover, random-generation (R-G) data augmentation is especially proposed for outdoor scenarios due to the complex distribution of its channels. It generalizes the characteristics of the channel matrix and alleviates the over-fitting problem. Simulation results show that the proposed data augmentation boosts the robustness of networks in both indoor and outdoor environments. The open source codes are available at https://github.com/zhanghy23/CRNet-Aug.

eess.SP↗

arXiv2023

SGL: Structure Guidance Learning for Camera Localization

Camera localization is a classical computer vision task that serves various Artificial Intelligence and Robotics applications. With the rapid developments of Deep Neural Networks (DNNs), end-to-end visual localization methods are prosperous in recent years. In this work, we focus on the scene coordinate prediction ones and propose a network architecture named as Structure Guidance Learning (SGL) which utilizes the receptive branch and the structure branch to extract both high-level and low-level features to estimate the 3D coordinates. We design a confidence strategy to refine and filter the predicted 3D observations, which enables us to estimate the camera poses by employing the Perspective-n-Point (PnP) with RANSAC. In the training part, we design the Bundle Adjustment trainer to help the network fit the scenes better. Comparisons with some state-of-the-art (SOTA) methods and sufficient ablation experiments confirm the validity of our proposed architecture.

cs.CV↗

arXiv2023

Promoting Cooperation in Multi-Agent Reinforcement Learning via Mutual Help

Multi-agent reinforcement learning (MARL) has achieved great progress in cooperative tasks in recent years. However, in the local reward scheme, where only local rewards for each agent are given without global rewards shared by all the agents, traditional MARL algorithms lack sufficient consideration of agents' mutual influence. In cooperative tasks, agents' mutual influence is especially important since agents are supposed to coordinate to achieve better performance. In this paper, we propose a novel algorithm Mutual-Help-based MARL (MH-MARL) to instruct agents to help each other in order to promote cooperation. MH-MARL utilizes an expected action module to generate expected other agents' actions for each particular agent. Then, the expected actions are delivered to other agents for selective imitation during training. Experimental results show that MH-MARL improves the performance of MARL both in success rate and cumulative reward.

cs.LG↗

arXiv2023

Deep Learning for Hybrid Beamforming with Finite Feedback in GSM Aided mmWave MIMO Systems

Hybrid beamforming is widely recognized as an important technique for millimeter wave (mmWave) multiple input multiple output (MIMO) systems. Generalized spatial modulation (GSM) is further introduced to improve the spectrum efficiency. However, most of the existing works on beamforming assume the perfect channel state information (CSI), which is unrealistic in practical systems. In this paper, joint optimization of downlink pilot training, channel estimation, CSI feedback, and hybrid beamforming is considered in GSM aided frequency division duplexing (FDD) mmWave MIMO systems. With the help of deep learning, the GSM hybrid beamformers are designed via unsupervised learning in an end-to-end way. Experiments show that the proposed multi-resolution network named GsmEFBNet can reach a better achievable rate with fewer feedback bits compared with the conventional algorithm.

cs.IT↗