arXiv subjects

Lu Bai

Publications and source records attributed to Lu Bai.

At least 37 records · Page 2Linked to original sources

arXiv2025

LLM4MG: Adapting Large Language Model for Multipath Generation via Synesthesia of Machines

Based on Synesthesia of Machines (SoM), a large language model (LLM) is adapted for multipath generation (LLM4MG) for the first time. Considering a typical sixth-generation (6G) vehicle-to-infrastructure (V2I) scenario, a new multi-modal sensing-communication dataset is constructed, named SynthSoM-V2I, including channel multipath information, millimeter wave (mmWave) radar sensory data, RGB-D images, and light detection and ranging (LiDAR) point clouds. Based on the SynthSoM-V2I dataset, the proposed LLM4MG leverages Large Language Model Meta AI (LLaMA) 3.2 for multipath generation via multi-modal sensory data. The proposed LLM4MG aligns the multi-modal feature space with the LLaMA semantic space through feature extraction and fusion networks. To further achieve general knowledge transfer from the pre-trained LLaMA for multipath generation via multi-modal sensory data, the low-rank adaptation (LoRA) parameter-efficient fine-tuning and propagation-aware prompt engineering are exploited. Simulation results demonstrate that the proposed LLM4MG outperforms conventional deep learning-based methods in terms of line-of-sight (LoS)/non-LoS (NLoS) classification with accuracy of 92.76%, multipath power/delay generation precision with normalized mean square error (NMSE) of 0.099/0.032, and cross-vehicular traffic density (VTD), cross-band, and cross-scenario generalization. The utility of the proposed LLM4MG is validated by real-world generalization. The necessity of high-precision multipath generation for system design is also demonstrated by channel capacity comparison.

eess.SP↗

arXiv2025

Multi-Modal Intelligent Channel Modeling Framework for 6G-Enabled Networked Intelligent Systems

The design and technology development of 6G-enabled networked intelligent systems needs an accurate real-time channel model as the cornerstone. However, with the new requirements of 6G-enabled networked intelligent systems, the conventional channel modeling methods face many limitations. Fortunately, the multi-modal sensors equipped on the intelligent agents bring timely opportunities, i.e., the intelligent integration and mutually beneficial mechanism between communications and multi-modal sensing could be investigated based on the artificial intelligence (AI) technologies. In this case, the mapping relationship between physical environment and electromagnetic channel could be explored via Synesthesia of Machines (SoM). This article presents a novel multi-modal intelligent channel modeling (MMICM) framework for 6G-enabled networked intelligent systems, which establishes a nonlinear model between multi-modal sensing and channel characteristics, including large-scale and small-scale channel characteristics. The architecture and features of proposed intelligent modeling framework are expounded and the key technologies involved are also analyzed. Finally, the system-engaged applications and potential research directions of MMICM framework are outlined.

eess.SP↗

arXiv2025

LLM4SG: Adapting Large Language Model for Scatterer Generation via Synesthesia of Machines

In this paper, a novel large language model (LLM)-based method for scatterer generation (LLM4SG) is proposed for sixth-generation (6G) artificial intelligence (AI)-native communications. To provide a solid data foundation, we construct a new synthetic intelligent sensing-communication dataset for Synesthesia of Machines (SoM) in vehicle-to-vehicle (V2V) communications, named SynthSoM-V2V, covering multiple V2V scenarios with multiple frequency bands and multiple vehicular traffic densities (VTDs). Leveraging the powerful cross-modal representation capabilities of LLMs, LLM4SG is designed to capture the general mapping relationship from light detection and ranging (LiDAR) point clouds to electromagnetic scatterers via SoM. To address the inherent and significant differences across multi-modal data, synergistically optimized four-module architecture, i.e., preprocessor, embedding, backbone, and output modules, are designed by considering sensing characteristics and electromagnetic propagation. The embedding module achieves effective cross-domain alignment of the sensing-communication domain and the natural language domain.The backbone network is adapted in a task-guided manner with low rank adaptation (LoRA), where a carefully selected subset of layers is fine tuned to preserve general knowledge and reduce training cost. The proposed LLM4SG is evaluated for scatterer generation by benchmarking against ray-tracing (RT) and conventional deep learning models. Simulation results demonstrate that the proposed LLM4SG achieves superior performance in both full-sample and cross-condition generalization testing. It significantly outperforms conventional deep learning models across different frequency bands, scenarios, and VTDs, and demonstrates the capability to provide the massive and high-quality channel small-scale fading data required by AI-native 6G systems.

eess.SP↗

arXiv2025

Improving Question Embeddings with Cognitive Representation Optimization for Knowledge Tracing

Designed to track changes in students' knowledge status and predict their future answers based on students' historical answer records. Current research on KT modeling focuses on predicting future student performance based on existing, unupdated records of student learning interactions. However, these methods ignore distractions in the response process (such as slipping and guessing) and ignore that static cognitive representations are temporary and limited. Most of them assume that there are no distractions during the answering process, and that the recorded representation fully represents the student's understanding and proficiency in knowledge. This can lead to many dissonant and uncoordinated issues in the original record. Therefore, we propose a knowledge-tracking cognitive representation optimization (CRO-KT) model that uses dynamic programming algorithms to optimize the structure of cognitive representation. This ensures that the structure matches the student's cognitive patterns in terms of practice difficulty. In addition, we use a synergistic optimization algorithm to optimize the cognitive representation of sub-target exercises based on the overall picture of exercise responses by considering all exercises with synergistic relationships as one goal. At the same time, the CRO-KT model integrates the relationship embedding learned in the dichotomous graph with the optimized record representation in a weighted manner, which enhances students' cognitive expression ability. Finally, experiments were conducted on three public datasets to verify the effectiveness of the proposed cognitive representation optimization model.

cs.AI↗

arXiv2025

MidPO: Dual Preference Optimization for Safety and Helpfulness in Large Language Models via a Mixture of Experts Framework

As large language models (LLMs) are increasingly applied across various domains, enhancing safety while maintaining the helpfulness of LLMs has become a critical challenge. Recent studies solve this problem through safety-constrained online preference optimization or safety-constrained offline preference optimization. However, the safety-constrained online methods often suffer from excessive safety, which might reduce helpfulness, while the safety-constrained offline methods perform poorly in adaptively balancing safety and helpfulness. To address these limitations, we propose MidPO, a \textbf{\underline{Mi}}xture of Experts (MoE) framework for safety-helpfulness \textbf{\underline{d}}ual \textbf{\underline{P}}reference \textbf{\underline{O}}ptimization. Firstly, MidPO devises single-preference enhanced direct preference optimization approach to transform the base model into two independent experts, termed safety and helpfulness experts, and fine-tunes the two independent experts for optimal safety or helpfulness performance. Secondly, to achieve an effective balance between safety and helpfulness, MidPO incorporates the two experts into the MoE framework and designs a dynamic routing mechanism to allocate contributions from each expert adaptively. We conduct quantitative and qualitative experiments on three popular datasets to demonstrate the proposed MidPO significantly outperforms state-of-the-art approaches in both safety and helpfulness. The code and models will be released.

cs.CL↗

arXiv2025

WaveNet-Volterra Neural Networks for Active Noise Control: A Fully Causal Approach

Active Noise Control (ANC) systems are challenged by nonlinear distortions, which degrade the performance of traditional adaptive filters. While deep learning-based ANC algorithms have emerged to address nonlinearity, existing approaches often overlook critical limitations: (1) end-to-end Deep Neural Network (DNN) models frequently violate causality constraints inherent to real-time ANC applications; (2) many studies compare DNN-based methods against simplified or low-order adaptive filters rather than fully optimized high-order counterparts. In this letter, we propose a causality-preserving time-domain ANC framework that synergizes WaveNet with Volterra Neural Networks (VNNs), explicitly addressing system nonlinearity while ensuring strict causal operation. Unlike prior DNN-based approaches, our method is benchmarked against both state-of-the-art deep learning architectures and rigorously optimized high-order adaptive filters, including Wiener solutions. Simulations demonstrate that the proposed framework achieves superior performance over existing DNN methods and traditional algorithms, revealing that prior claims of DNN superiority stem from incomplete comparisons with suboptimal traditional baselines. Source code is available at https://github.com/Lu-Baihh/WaveNet-VNNs-for-ANC.git.

eess.AS↗

arXiv2025

SynthSoM: A synthetic intelligent multi-modal sensing-communication dataset for Synesthesia of Machines (SoM)

Given the importance of datasets for sensing-communication integration research, a novel simulation platform for constructing communication and multi-modal sensory dataset is developed. The developed platform integrates three high-precision software, i.e., AirSim, WaveFarer, and Wireless InSite, and further achieves in-depth integration and precise alignment of them. Based on the developed platform, a new synthetic intelligent multi-modal sensing-communication dataset for Synesthesia of Machines (SoM), named SynthSoM, is proposed. The SynthSoM dataset contains various air-ground multi-link cooperative scenarios with comprehensive conditions, including multiple weather conditions, times of the day, intelligent agent densities, frequency bands, and antenna types. The SynthSoM dataset encompasses multiple data modalities, including radio-frequency (RF) channel large-scale and small-scale fading data, RF millimeter wave (mmWave) radar sensory data, and non-RF sensory data, e.g., RGB images, depth maps, and light detection and ranging (LiDAR) point clouds. The quality of SynthSoM dataset is validated via statistics-based qualitative inspection and evaluation metrics through machine learning (ML) via real-world measurements. The SynthSoM dataset is open-sourced and provides consistent data for cross-comparing SoM-related algorithms.

eess.SP↗

arXiv2025

Tuning Electrode Wettability to Optimize Nanobubble Nucleation and Reaction Rates in Electrochemical Gas-Evolving Reactions

Bubble formation in electrochemical system often hinders reaction efficiency by reducing active surface area and obstructing mass transfer, yet the mechanisms governing their nanoscale nucleation dynamics and impact remains unclear. In this study, we used molecular dynamics simulations to explore nanobubble nucleation and reaction rates during water electrolysis on planar- and nano-electrodes, with systematically tuning electrode wettability through water-electrode and gas-electrode interactions. We identified distinct nucleation regimes: gas layers, surface nanobubbles, bulk nanobubbles, and no nanobubbles, and revealed a volcano-shaped relationship between wettability and reaction rate, where optimal wettability strikes a balance between suppressing bubbles and ensuring sufficient reactant availability to maximize performance. Nanoelectrodes consistently exhibit higher current densities compared to planar electrodes with the same wettability, due to pronounced edge effects. Furthermore, moderate driving forces enhance reaction rates without triggering surface bubble formation, while excessive driving forces induce surface nanobubble nucleation, leading to suppressed reaction rates and complex dynamics driven by bubble growth and detachment. These findings highlight the importance of fine-tuning wettability and reaction driving forces to optimize gas-evolving electrochemical systems at the nanoscale and underscore the need for multiscale simulation frameworks integrating atomic-scale reaction kinetics, nanoscale bubble nucleation, and microscale bubble dynamics to fully understand bubble behavior and its impact on performance.

cond-mat.soft↗

arXiv2025

A Multi-modal Intelligent Channel Model for 6G Multi-UAV-to-Multi-Vehicle Communications

In this paper, a novel multi-modal intelligent channel model for sixth-generation (6G) multiple-unmanned aerial vehicle (multi-UAV)-to-multi-vehicle communications is proposed. To thoroughly explore the mapping relationship between the physical environment and the electromagnetic space in the complex multi-UAV-to-multi-vehicle scenario, two new parameters, i.e., terrestrial traffic density (TTD) and aerial traffic density (ATD), are developed and a new sensing-communication intelligent integrated dataset is constructed in suburban scenario under different TTD and ATD conditions. With the aid of sensing data, i.e., light detection and ranging (LiDAR) point clouds, the parameters of static scatterers, terrestrial dynamic scatterers, and aerial dynamic scatterers in the electromagnetic space, e.g., number, distance, angle, and power, are quantified under different TTD and ATD conditions in the physical environment. In the proposed model, the channel non-stationarity and consistency on the time and space domains and the channel non-stationarity on the frequency domain are simultaneously mimicked. The channel statistical properties, such as time-space-frequency correlation function (TSF-CF), time stationary interval (TSI), and Doppler power spectral density (DPSD), are derived and simulated. Simulation results match ray-tracing (RT) results well, which verifies the accuracy of the proposed multi-UAV-to-multi-vehicle channel model.

eess.SP↗

arXiv2025

Synesthesia of Machines Based Multi-Modal Intelligent V2V Channel Model

This paper proposes a novel sixth-generation (6G) multi-modal intelligent vehicle-to-vehicle (V2V) channel model from light detection and ranging (LiDAR) point clouds based on Synesthesia of Machines (SoM). To explore the mapping relationship between physical environment and electromagnetic space, a new V2V high-fidelity mixed sensing-communication integration simulation dataset with different vehicular traffic densities (VTDs) is constructed. Based on the constructed dataset, a novel scatterer recognition (ScaR) algorithm utilizing neural network SegNet is developed to recognize scatterer spatial attributes from LiDAR point clouds via SoM. In the developed ScaR algorithm, the mapping relationship between LiDAR point clouds and scatterers is explored, where the distribution of scatterers is obtained in the form of grid maps. Furthermore, scatterers are distinguished into dynamic and static scatterers based on LiDAR point cloud features, where parameters, e.g., distance, angle, and number, related to scatterers are determined. Through ScaR, dynamic and static scatterers change with the variation of LiDAR point clouds over time, which precisely models channel non-stationarity and consistency under different VTDs. Some important channel statistical properties, such as time-frequency correlation function (TF-CF) and Doppler power spectral density (DPSD), are obtained. Simulation results match well with ray-tracing (RT)-based results, thus demonstrating the necessity of exploring the mapping relationship and the utility of the proposed model.

eess.SP↗

arXiv2024

Multi-Modal Intelligent Channel Modeling: A New Modeling Paradigm via Synesthesia of Machines

In the future sixth-generation (6G) era, to support accurate localization sensing and efficient communication link establishment for intelligent agents, a comprehensive understanding of the surrounding environment and proper channel modeling are indispensable. The existing method, which solely exploits radio frequency (RF) communication information, is difficult to accomplish accurate channel modeling. Fortunately, multi-modal devices are deployed on intelligent agents to obtain environmental features, which could further assist in channel modeling. Currently, some research efforts have been devoted to utilizing multi-modal information to facilitate channel modeling, while still lack a comprehensive review. To fill this gap, we embark on an initial endeavor with the goal of reviewing multi-modal intelligent channel modeling (MMICM) via Synesthesia of Machines (SoM). Compared to channel modeling approaches that solely utilize RF communication information, the utilization of multi-modal information can provide a more in-depth understanding of the propagation environment around the transceiver, thus facilitating more accurate channel modeling. First, this paper introduces existing channel modeling approaches from the perspective of the channel modeling evolution. Then, we have elaborated and investigated recent advances in the topic of capturing typical channel characteristics and features, i.e., channel non-stationarity and consistency, by characterizing the mathematical, spatial, coupling, and mapping relationships. In addition, applications that can be supported by MMICM are summarized and analyzed. To corroborate the superiority of MMICM via SoM, we give the simulation result and analysis. Finally, some open issues and potential directions for the MMICM are outlined from the perspectives of measurements, modeling, and applications.

eess.SP↗

arXiv2024

Detecting collagen by machine learning improved photoacoustic spectral analysis for breast cancer diagnostics: feasibility studies with murine models

Collagen, a key structural component of the extracellular matrix, undergoes significant remodeling during carcinogenesis. However, the important role of collagen levels in breast cancer diagnostics still lacks effective in vivo detection techniques to provide a deeper understanding. This study presents photoacoustic spectral analysis improved by machine learning as a promising non-invasive diagnostic method, focusing on exploring collagen as a salient biomarker. Murine model experiments revealed more profound associations of collagen with other cancer components than in normal tissues. Moreover, an optimal set of feature wavelengths was identified by a genetic algorithm for enhanced diagnostic performance, among which 75% were from collagen-dominated absorption wavebands. Using optimal spectra, the diagnostic algorithm achieved 72% accuracy, 66% sensitivity, and 78% specificity, surpassing full-range spectra by 6%, 4%, and 8%, respectively. The proposed photoacoustic methods examine the feasibility of offering valuable biochemical insights into existing techniques, showing great potential for early-stage cancer detection.

physics.optics↗

arXiv2024

Scatterer Recognition for Multi-Modal Intelligent Vehicular Channel Modeling via Synesthesia of Machines

In this paper, a novel multi-modal intelligent vehicular channel model is proposed by scatterer recognition from light detection and ranging (LiDAR) point clouds via Synesthesia of Machines (SoM). The proposed model can support the design of intelligent transportation systems (ITSs). To provide a robust data foundation, a new intelligent sensing-communication integration dataset in vehicular urban scenarios is constructed. Based on the constructed dataset, the complex SoM mechanism, i.e., mapping relationship between scatterers in electromagnetic space and LiDAR point clouds in physical environment, is explored via multilayer perceptron (MLP) in consideration of electromagnetic propagation mechanism. By using LiDAR point clouds to implement scatterer recognition, channel non-stationarity and consistency are captured closely coupled with the environment. Using ray-tracing (RT)-based results as the ground truth, the scatterer recognition accuracy exceeds 90%. The accuracy of the proposed model is further verified by the close fit between simulation results and RT results.

eess.SP↗

arXiv2024

Longitudinal photoacoustic monitoring of collagen evolution modulated by cancer-associated fibroblasts: simulation and experiment studies

Noninvasive in vivo detection of collagen facilitates the investigation of mechanisms by which cancer-associated fibroblast (CAF) regulates the extracellular matrix. This study explored the feasibility of photoacoustic spectrum analysis (PASA) in identifying longitudinal changes of collagen modulated by CAFs using simulations and experiment studies. Optical and acoustic simulations in tissues were performed based on the histological slides of maximum cross-sections of murine malignancies to verify the effectiveness of photoacoustic (PA) detection system and the parameter "relative area of power spectrum density (APSD)". Experiments were conducted on three groups of mouse models with incremental ratios of CAFs and breast cancer cells at 3 continuous time points. Results discovered that the system configuration and APSD were capable of reflecting the evolution of collagen during cancer growth. Furthermore, cancers receiving a high dose of CAFs exhibited a suppressed collagen level. The presented methods show great potential for clinical translation of PASA in the field of cancer therapies targeting CAFs.

physics.bio-ph↗

arXiv2024

AKBR: Learning Adaptive Kernel-based Representations for Graph Classification

In this paper, we propose a new model to learn Adaptive Kernel-based Representations (AKBR) for graph classification. Unlike state-of-the-art R-convolution graph kernels that are defined by merely counting any pair of isomorphic substructures between graphs and cannot provide an end-to-end learning mechanism for the classifier, the proposed AKBR approach aims to define an end-to-end representation learning model to construct an adaptive kernel matrix for graphs. To this end, we commence by leveraging a novel feature-channel attention mechanism to capture the interdependencies between different substructure invariants of original graphs. The proposed AKBR model can thus effectively identify the structural importance of different substructures, and compute the R-convolution kernel between pairwise graphs associated with the more significant substructures specified by their structural attentions. Since each row of the resulting kernel matrix can be theoretically seen as the embedding vector of a sample graph, the proposed AKBR model is able to directly employ the resulting kernel matrix as the graph feature matrix and input it into the classifier for classification (i.e., the SoftMax layer), naturally providing an end-to-end learning architecture between the kernel computation as well as the classifier. Experimental results show that the proposed AKBR model outperforms existing state-of-the-art graph kernels and deep learning methods on standard graph benchmarks.

cs.LG↗

arXiv2024

SSHPool: The Separated Subgraph-based Hierarchical Pooling

In this paper, we develop a novel local graph pooling method, namely the Separated Subgraph-based Hierarchical Pooling (SSHPool), for graph classification. We commence by assigning the nodes of a sample graph into different clusters, resulting in a family of separated subgraphs. We individually employ the local graph convolution units as the local structure to further compress each subgraph into a coarsened node, transforming the original graph into a coarsened graph. Since these subgraphs are separated by different clusters and the structural information cannot be propagated between them, the local convolution operation can significantly avoid the over-smoothing problem caused by message passing through edges in most existing Graph Neural Networks (GNNs). By hierarchically performing the proposed procedures on the resulting coarsened graph, the proposed SSHPool can effectively extract the hierarchical global features of the original graph structure, encapsulating rich intrinsic structural characteristics. Furthermore, we develop an end-to-end GNN framework associated with the SSHPool module for graph classification. Experimental results demonstrate the superior performance of the proposed model on real-world datasets.

cs.AI↗

arXiv2024

Knowledge Probing for Graph Representation Learning

Graph learning methods have been extensively applied in diverse application areas. However, what kind of inherent graph properties e.g. graph proximity, graph structural information has been encoded into graph representation learning for downstream tasks is still under-explored. In this paper, we propose a novel graph probing framework (GraphProbe) to investigate and interpret whether the family of graph learning methods has encoded different levels of knowledge in graph representation learning. Based on the intrinsic properties of graphs, we design three probes to systematically investigate the graph representation learning process from different perspectives, respectively the node-wise level, the path-wise level, and the structural level. We construct a thorough evaluation benchmark with nine representative graph learning methods from random walk based approaches, basic graph neural networks and self-supervised graph methods, and probe them on six benchmark datasets for node classification, link prediction and graph classification. The experimental evaluation verify that GraphProbe can estimate the capability of graph representation learning. Remaking results have been concluded: GCN and WeightedGCN methods are relatively versatile methods achieving better results with respect to different tasks.

cs.LG↗

arXiv2024

HSFusion: A high-level vision task-driven infrared and visible image fusion network via semantic and geometric domain transformation

Infrared and visible image fusion has been developed from vision perception oriented fusion methods to strategies which both consider the vision perception and high-level vision task. However, the existing task-driven methods fail to address the domain gap between semantic and geometric representation. To overcome these issues, we propose a high-level vision task-driven infrared and visible image fusion network via semantic and geometric domain transformation, terms as HSFusion. Specifically, to minimize the gap between semantic and geometric representation, we design two separate domain transformation branches by CycleGAN framework, and each includes two processes: the forward segmentation process and the reverse reconstruction process. CycleGAN is capable of learning domain transformation patterns, and the reconstruction process of CycleGAN is conducted under the constraint of these patterns. Thus, our method can significantly facilitate the integration of semantic and geometric information and further reduces the domain gap. In fusion stage, we integrate the infrared and visible features that extracted from the reconstruction process of two seperate CycleGANs to obtain the fused result. These features, containing varying proportions of semantic and geometric information, can significantly enhance the high level vision tasks. Additionally, we generate masks based on segmentation results to guide the fusion task. These masks can provide semantic priors, and we design adaptive weights for two distinct areas in the masks to facilitate image fusion. Finally, we conducted comparative experiments between our method and eleven other state-of-the-art methods, demonstrating that our approach surpasses others in both visual appeal and semantic segmentation task.

cs.CV↗