SearcharxivSearch

arXiv subjects

Xiaoqing Luo

Publications and source records attributed to Xiaoqing Luo.

14 recordsLinked to original sources

Towards Robust EEG Decoding Based on Riemannian Self-Attention

Brain-Computer Interface (BCI) based on electroencephalography (EEG) enables direct interaction between the brain and external environments and has significant applications in assistive technologies, medical rehabilitation, and entertainment. Recently, EEG decoding methods based on Symmetric Positive Definite (SPD) learning have demonstrated superior performance. However, these methods typically employ basic network architectures and do not explicitly capture local relationships between EEG signals. This limitation is problematic for EEG signals due to their inherently low Signal-to-Noise Ratio (SNR). Moreover, most existing Riemannian manifold-based methods are restricted to specific metrics. The most widely used is the Affine-Invariant Metric (AIM). However, it has a quadratic dependency on the SPD matrices and cannot handle ill-conditioned SPD matrices, which hinders the effectiveness of networks. In contrast, the Bures-Wasserstein Metric (BWM) exhibits linear dependence on SPD matrices and demonstrates superior performance for ill conditioning. To overcome these challenges, we propose a Riemannian self-attention network based on the BWM. Additionally, the recently introduced power-deformed generalized Bures-Wasserstein metric reveals a nonlinear relationship between SPD matrices and matrix power deformation. This metric provides a more nuanced representation of the geometric structure of the SPD manifold. Consequently, we extend our model to a learnable version. For simplicity, we refer to it as GBWAtt. Experimental results on three EEG benchmarking datasets validate the robustness and effectiveness of our proposed method. The code is available at https://github.com/jissc/GBWAtt.

cs.LG

FusionRegister: Every Infrared and Visible Image Fusion Deserves Registration

Spatial registration across different visual modalities is a critical but formidable step in multi-modality image fusion for real-world perception. Although several methods are proposed to address this issue, the existing registration-based fusion methods typically require extensive pre-registration operations, limiting their efficiency. To overcome these limitations, a general cross-modality registration method guided by visual priors is proposed for infrared and visible image fusion task, termed FusionRegister. Firstly, FusionRegister achieves robustness by learning cross-modality misregistration representations rather than forcing alignment of all differences, ensuring stable outputs even under challenging input conditions. Moreover, FusionRegister demonstrates strong generality by operating directly on fused results, where misregistration is explicitly represented and effectively handled, enabling seamless integration with diverse fusion methods while preserving their intrinsic properties. In addition, its efficiency is further enhanced by serving the backbone fusion method as a natural visual prior provider, which guides the registration process to focus only on mismatch regions, thereby avoiding redundant operations. Extensive experiments on three datasets demonstrate that FusionRegister not only inherits the fusion quality of state-of-the-art methods, but also delivers superior detail alignment and robustness, making it highly suitable for infrared and visible image fusion method. The code will be available at https://github.com/bociic/FusionRegister.

cs.CV

Wasserstein-Aligned Hyperbolic Multi-View Clustering

Multi-view clustering (MVC) aims to uncover the latent structure of multi-view data by learning view-common and view-specific information. Although recent studies have explored hyperbolic representations for better tackling the representation gap between different views, they focus primarily on instance-level alignment and neglect global semantic consistency, rendering them vulnerable to view-specific information (\textit{e.g.}, noise and cross-view discrepancies). To this end, this paper proposes a novel Wasserstein-Aligned Hyperbolic (WAH) framework for multi-view clustering. Specifically, our method exploits a view-specific hyperbolic encoder for each view to embed features into the Lorentz manifold for hierarchical semantic modeling. Whereafter, a global semantic loss based on the hyperbolic sliced-Wasserstein distance is introduced to align manifold distributions across views. This is followed by soft cluster assignments to encourage cross-view semantic consistency. Extensive experiments on multiple benchmarking datasets show that our method can achieve SOTA clustering performance.

cs.CV

One Latent Space to Rule All Degradations: Unifying Restoration Knowledge for Image Fusion

All-in-One Degradation-Aware Fusion Models (ADFMs) as one of multi-modal image fusion models, which aims to address complex scenes by mitigating degradations from source images and generating high-quality fused images. Mainstream ADFMs rely on end-to-end learning and heavily synthesized datasets to achieve degradation awareness and fusion. This rough learning strategy and non-real world scenario dataset dependence often limit their upper-bound performance, leading to low-quality results. To address these limitations, we present LURE, a Learning-driven Unified REpresentation model for infrared and visible image fusion, which is degradation-aware. LURE learns a Unified Latent Feature Space (ULFS) to avoid the dependency on complex data formats inherent in previous end-to-end learning pipelines. It further improves image fusion quality by leveraging the intrinsic relationships between multi-modalities. A novel loss function is also proposed to drive the learning of unified latent representations more stable.More importantly, LURE seamlessly incorporates existing high-quality real-world image restoration datasets. To further enhance the model's representation capability, we design a simple yet effective structure, termed internal residual block, to facilitate the learning of latent features. Experiments show our method outperforms state-of-the-art (SOTA) methods across general fusion, degradation-aware fusion, and downstream tasks. The code is available in the supplementary materials.

cs.CV

Revisiting Generative Infrared and Visible Image Fusion Based on Human Cognitive Laws

Existing infrared and visible image fusion methods often face the dilemma of balancing modal information. Generative fusion methods reconstruct fused images by learning from data distributions, but their generative capabilities remain limited. Moreover, the lack of interpretability in modal information selection further affects the reliability and consistency of fusion results in complex scenarios. This manuscript revisits the essence of generative image fusion under the inspiration of human cognitive laws and proposes a novel infrared and visible image fusion method, termed HCLFuse. First, HCLFuse investigates the quantification theory of information mapping in unsupervised fusion networks, which leads to the design of a multi-scale mask-regulated variational bottleneck encoder. This encoder applies posterior probability modeling and information decomposition to extract accurate and concise low-level modal information, thereby supporting the generation of high-fidelity structural details. Furthermore, the probabilistic generative capability of the diffusion model is integrated with physical laws, forming a time-varying physical guidance mechanism that adaptively regulates the generation process at different stages, thereby enhancing the ability of the model to perceive the intrinsic structure of data and reducing dependence on data quality. Experimental results show that the proposed method achieves state-of-the-art fusion performance in qualitative and quantitative evaluations across multiple datasets and significantly improves semantic segmentation metrics. This fully demonstrates the advantages of this generative image fusion method, drawing inspiration from human cognition, in enhancing structural consistency and detail quality.

cs.CV

Learning to Normalize on the SPD Manifold under Bures-Wasserstein Geometry

Covariance matrices have proven highly effective across many scientific fields. Since these matrices lie within the Symmetric Positive Definite (SPD) manifold - a Riemannian space with intrinsic non-Euclidean geometry, the primary challenge in representation learning is to respect this underlying geometric structure. Drawing inspiration from the success of Euclidean deep learning, researchers have developed neural networks on the SPD manifolds for more faithful covariance embedding learning. A notable advancement in this area is the implementation of Riemannian batch normalization (RBN), which has been shown to improve the performance of SPD network models. Nonetheless, the Riemannian metric beneath the existing RBN might fail to effectively deal with the ill-conditioned SPD matrices (ICSM), undermining the effectiveness of RBN. In contrast, the Bures-Wasserstein metric (BWM) demonstrates superior performance for ill-conditioning. In addition, the recently introduced Generalized BWM (GBWM) parameterizes the vanilla BWM via an SPD matrix, allowing for a more nuanced representation of vibrant geometries of the SPD manifold. Therefore, we propose a novel RBN algorithm based on the GBW geometry, incorporating a learnable metric parameter. Moreover, the deformation of GBWM by matrix power is also introduced to further enhance the representational capacity of GBWM-based RBN. Experimental results on different datasets validate the effectiveness of our proposed method.

cs.LG

Significant loss suppression and large induced chirality via cooperative near- and far-field coupling in plasmonic dimer nanoantennas

Plasmonic nanoantennas containing nano-gaps support "hotspots" for greatly enhanced light-matter interactions, but suffer from inherent high losses, a long-standing issue that hinders practical applications. Here we report a strategy to significantly suppress the losses of plasmonic dimer nanoantennas. Specifically, by introducing the concept of cooperative near- and far-field coupling, we observed an unprecedented transition from the weak coupling of localized resonances to strong coupling of collective (nonlocal) resonances, showing robustness to the gap distance between the dimer. We develop a generalized lattice sum approximation model to describe this transition and reveal its origins: the off-diagonal element of the anisotropic polarizability tensor due to near-field coupling, and the anisotropic lattice sums due to far-field coupling. This strong coupling leads to loss-suppressed plasmonic resonances with large modulation depths and meanwhile extremely high measured quality factors up to 3120 in the near-infrared regime, exceeding the record in the near infrared regime. Additionally, high-$Q$ and large chiroptical responses can also be induced for achiral planar dimers under the critical coupling condition. This work paves an avenue toward extremely low-loss plasmonic devices, either chiral or not, for diverse important applications.

physics.optics

Capture Artifacts via Progressive Disentangling and Purifying Blended Identities for Deepfake Detection

The Deepfake technology has raised serious concerns regarding privacy breaches and trust issues. To tackle these challenges, Deepfake detection technology has emerged. Current methods over-rely on the global feature space, which contains redundant information independent of the artifacts. As a result, existing Deepfake detection techniques suffer performance degradation when encountering unknown datasets. To reduce information redundancy, the current methods use disentanglement techniques to roughly separate the fake faces into artifacts and content information. However, these methods lack a solid disentanglement foundation and cannot guarantee the reliability of their disentangling process. To address these issues, a Deepfake detection method based on progressive disentangling and purifying blended identities is innovatively proposed in this paper. Based on the artifact generation mechanism, the coarse- and fine-grained strategies are combined to ensure the reliability of the disentanglement method. Our method aims to more accurately capture and separate artifact features in fake faces. Specifically, we first perform the coarse-grained disentangling on fake faces to obtain a pair of blended identities that require no additional annotation to distinguish between source face and target face. Then, the artifact features from each identity are separated to achieve fine-grained disentanglement. To obtain pure identity information and artifacts, an Identity-Artifact Correlation Compression module (IACC) is designed based on the information bottleneck theory, effectively reducing the potential correlation between identity information and artifacts. Additionally, an Identity-Artifact Separation Contrast Loss is designed to enhance the independence of artifact features post-disentangling. Finally, the classifier only focuses on pure artifact features to achieve a generalized Deepfake detector.

cs.CV

Polarization-independent resonant lattice Kerker effect in phase-change metasurface

Resonant lattice Kerker effect in periodic resonators is one of the most interesting generalizations of the Kerker effect that relates to various fascinating functionalities such as scattering management and Huygens metasurfaces. However, so far this effect has been shown to be sensitive to the incident polarization, restricting its applications. Here, we report, for the first time, polarization-independent resonant lattice Kerker effect in metasurfaces composed of periodic Ge$_2$Se$_2$Te$_5$ (GST) disks. For such a metasurface of square lattice, the spectrally overlap of the electric dipole and magnetic dipole surface lattice resonances can be realized by choosing an appropriate GST crystalline fraction regardless of the incident polarization. The operation wavelength and the required GST crystalline fraction can be conveniently tuned over large ranges since these parameters scale linearly with the disk size and the lattice period, greatly facilitating the design. Making use of the obtained resonant lattice Kerker effect, we realize a reconfigurable and polarization-independent lattice Huygens' metasurface with a dynamic phase modulation of close to $2π$ and high transmittance. This work will advance the engineering of the resonant lattice Kerker effect and promote its applications in phase modulation and wavefront control.

physics.optics

Broadband switchable terahertz half-/quarter-wave plate based on a graphene-metal hybrid metasurface

Metasurfaces incorporating graphene hold great promise for dynamic manipulation of terahertz waves. However, it remains challenging to design a broadband graphene-based terahertz metasurface with switchable functionality of half-wave plate (HWP) and quarter-wave plate (QWP). Here, we propose a graphene-metal hybrid metasurface for achieving broadband switchable HWP/QWP in the terahertz regime. Simulation results show that, by varying the Fermi energy of graphene from 0 eV to 1 eV, the function of the reflective metasurface can be switched from an HWP with polarization conversion ratio exceeding 97% over a wide band ranging from 0.7 THz to 1.3 THz, to a QWP with ellipticity above 0.92 over 0.78-1.33 THz. The sharing bandwidth reaches up to 0.52 THz and the relative bandwidth is as high as 50%. We expect this broadband and dynamically switchable terahertz HWP/QWP will find applications in terahertz sensing, imaging, and telecommunications.

physics.optics

A Joint Convolution Auto-encoder Network for Infrared and Visible Image Fusion

Background: Leaning redundant and complementary relationships is a critical step in the human visual system. Inspired by the infrared cognition ability of crotalinae animals, we design a joint convolution auto-encoder (JCAE) network for infrared and visible image fusion. Methods: Our key insight is to feed infrared and visible pair images into the network simultaneously and separate an encoder stream into two private branches and one common branch, the private branch works for complementary features learning and the common branch does for redundant features learning. We also build two fusion rules to integrate redundant and complementary features into their fused feature which are then fed into the decoder layer to produce the final fused image. We detail the structure, fusion rule and explain its multi-task loss function. Results: Our JCAE network achieves good results in terms of both subjective effect and objective evaluation metrics.

cs.CV

Infrared and visible image fusion based on Multi-State Contextual Hidden Markov Model

The traditional two-state hidden Markov model divides the high frequency coefficients only into two states (large and small states). Such scheme is prone to produce an inaccurate statistical model for the high frequency subband and reduces the quality of fusion result. In this paper, a fine-grained multi-state contextual hidden Markov model (MCHMM) is proposed for infrared and visible image fusion in the non-subsampled Shearlet domain, which takes full consideration of the strong correlations and level of details of NSST coefficients. To this end, an accurate soft context variable is designed correspondingly from the perspective of context correlation. Then, the statistical features provided by MCHMM are utilized for the fusion of high frequency subbands. To ensure the visual quality, a fusion strategy based on the difference in regional energy is proposed as well for lowfrequency subbands. Experimental results demonstrate that the proposed method can achieve a superior performance compared with other fusion methods in both subjective and objective aspects.

cs.CV

Broadband switchable terahertz half-/quarter-wave plate based on VO2-metal hybrid metasurface with over/underdamped transition

Dynamically switchable half-/quarter-wave plates have recently been the focus in the terahertz regime. Conventional design philosophy leads to multilayer metamaterials or narrowband metasurfaces. Here we propose a novel design philosophy and a VO2-metal hybrid metasurface for achieving broadband dynamically switchable half-/quarter-wave plate (HWP/QWP) based on the transition from the overdamped to the underdamped resonance. Results show that, by varying the VO2 conductivity by three orders of magnitude, the proposed metasurface's function can be switched between an HWP with polarization conversion ratio larger than 96% and a QWP with ellipticity close to -1 over the broad working band of 0.8-1.2 THz. We expect that the proposed design philosophy will advance the engineering of metasurfaces for dynamically switchable functionalities beyond the terahertz regime.

physics.optics

Dynamically reversible and strong circular dichroism based on Babinet-invertible chiral metasurfaces

We propose a Babinet-invertible chiral metasurface for achieving dynamically reversible and strong circular dichroism (CD). The proposed metasurface is composed of VO$_2$-metal hybrid structure, and when VO$_2$ transits between the dielectric state and the metallic state, the metasurface unit cell switches between complementary structures that are designed according to the Babinet principle. This leads to a large and reversible CD tuning range between $\pm 0.5$ at 0.97~THz, which is larger than the literature. We attribute the CD effect to extrinsic chirality of the proposed metasurface. We envision that the Babinet-invertible chiral metasurface proposed here will advance the engineering of active and tunable chiro-optical devices and promote their applications.

physics.optics