Searcharxiv⌕ Search

arXiv subjects

Bingchuan Liu

Publications and source records attributed to Bingchuan Liu.

5 recordsLinked to original sources

RPA: Residual Patch-Token Adapter for Image Retrieval from EEG and MEG

Most existing MEG and EEG (M/EEG) visual decoding methods align brain signals with a single global embedding extracted from a pretrained visual encoder, leaving open whether intermediate patch representations, which preserve richer and more granular rich visual information, can improve representation learning. To address this question, we introduce the Residual Patch Adapter (RPA), a lightweight, modular adapter that leverages all patch tokens from an intermediate layer of a ViT visual encoder for alignment. Through extensive ablation analyses, we first show that pooling or masking patch tokens degrades the learned representation, demonstrating that retaining the full set of patch tokens is important for EEG alignment, while the CLS token provides little unique information. We then use a series of six quantitative feature analyses to show that both higher-level semantics and lower-level visual features, including color and texture, are essential for this EEG-to-image alignment. Under current protocols, our system achieves Top-1 accuracies of 95.4\% within-subject and 35.5\% cross-subject on THINGS-EEG2, and 65.2\% and 6.7\%, respectively, on THINGS-MEG, achieving state-of-the-art (SOTA) performance across both datasets. Evaluations with alternative brain encoders, including pretrained EEG foundation models, demonstrate that the approach extends beyond the projection-based EEG encoder. Furthermore, we provide a plug-and-play interface that allows RPA to be replaced by convolution, attention, or ConvNeXt alternatives. Together, these findings provide significant insight into M/EEG-to-image representation learning by establishing design principles for leveraging the latent space of visual encoders, and open new directions for brain--image alignment and non-invasive brain--computer interface (BCI).

cs.CV↗

Decoding Natural Images from EEG for Object Recognition

Electroencephalography (EEG) signals, known for convenient non-invasive acquisition but low signal-to-noise ratio, have recently gained substantial attention due to the potential to decode natural images. This paper presents a self-supervised framework to demonstrate the feasibility of learning image representations from EEG signals, particularly for object recognition. The framework utilizes image and EEG encoders to extract features from paired image stimuli and EEG responses. Contrastive learning aligns these two modalities by constraining their similarity. With the framework, we attain significantly above-chance results on a comprehensive EEG-image dataset, achieving a top-1 accuracy of 15.6% and a top-5 accuracy of 42.8% in challenging 200-way zero-shot tasks. Moreover, we perform extensive experiments to explore the biological plausibility by resolving the temporal, spatial, spectral, and semantic aspects of EEG signals. Besides, we introduce attention modules to capture spatial correlations, providing implicit evidence of the brain activity perceived from EEG data. These findings yield valuable insights for neural decoding and brain-computer interfaces in real-world scenarios. The code will be released on https://github.com/eeyhsong/NICE-EEG.

cs.HC↗

A Surgery-Detection Two-Dimensional Panorama of Signal Acquisition Technologies in Brain-Computer Interface

Brain-computer interface (BCI) technology is an interdisciplinary field that allows individuals to connect with the external world. The performance of BCI systems relies predominantly on the advancements of signal acquisition technology. This paper aims to present a comprehensive overview of signal acquisition technologies in BCI by examining research articles published in the past decade. Our review incorporates both clinician and engineer perspectives and presents a surgery-detection two-dimensional panorama of signal acquisition technologies in BCI. We classify the technologies into nine distinct categories, providing representative examples and emphasizing the significant challenges associated with each modality. Our review provides researchers and practitioners with a macroscopic understanding of BCI signal acquisition technologies and discuss the field's major issues today. Future development in BCI signal acquisition technology should prioritize the integration of diverse disciplines and perspectives. Striking a balance among signal quality, trauma, biocompatibility, and other relevant factors is crucial. This will promote the advancement of BCI technology, enhancing its efficiency, safety, and reliability, and ultimately contributing to a promising future for humanity.

cs.HC↗

tACS Facilitates Flickering Driving by Boosting Steady-State Visual Evoked Potentials

There has become of increasing interest in transcranial alternating current stimulation (tACS) since its inception nearly a decade ago. tACS in modulating brain state is an active area of research and has been demonstrated effective in various neuropsychological and clinical domains. In the visual domain, much effort has been dedicated to brain rhythms and rhythmic stimulation, i.e., tACS. However, little is known about the interplay between the rhythmic stimulation and visual stimulation. Here, we used steady-state visual evoked potential (SSVEP), induced by flickering driving as a widely used technique for frequency-tagging, to investigate the aftereffect of tACS in healthy human subjects. Seven blocks of 64-channel electroencephalogram were recorded before and after the administration of 20-min 10-Hz tACS, while subjects performed several blocks of SSVEP tasks. We characterized the physiological properties of tACS aftereffect by comparing and validating the temporal, spatial, spatiotemporal and signal-to-noise ratio (SNR) patterns between and within blocks in real tACS and sham tACS. Our result revealed that tACS boosted the 10-Hz SSVEP significantly. Besides, the aftereffect on SSVEP was mitigated with time and lasted up to 5 min. Our results demonstrate the feasibility of facilitating the flickering driving by external rhythmic stimulation and open a new possibility to alter the brain state in a direction by noninvasive transcranial brain stimulation.

q-bio.NC↗

BETA: A Large Benchmark Database Toward SSVEP-BCI Application

Brain-computer interface (BCI) provides an alternative means to communicate and it has sparked growing interest in the past two decades. Specifically, for Steady-State Visual Evoked Potential based BCI, marked improvement has been made in the frequency recognition method and data sharing. However, the number of pubic database is still limited in this field. Therefore, we present a \textbf{BE}nchmark database \textbf{T}owards BCI \textbf{A}pplication (BETA) in the study. The BETA database is composed of 64-channel Electroencephalogram (EEG) data from 70 subjects performing a 40-target cued-spelling task. The design and acquisition of BETA is in pursuit of meeting the demand from real-world applications and it can be used as a test-bed for these scenarios. We validate the database by a series of analysis and conduct the classification analysis of eleven frequency recognition methods on BETA. We recommend to use the metric of wide-band SNR and BCI quotient to characterize the SSVEP at the single-trial and population level, respectively. The BETA database can be downloaded from the website http://bci.med.tsinghua.edu.cn/download.html.

eess.SP↗