SearcharxivSearch

arXiv subjects

Haowen Zhao

Publications and source records attributed to Haowen Zhao.

11 recordsLinked to original sources

Photonic Spiking Graph Neural Network for Energy-Efficient Structured Data Processing

Photonic computing shows great potential for signal processing and artificial intelligence (AI) acceleration due to its ultra-high speed, low energy consumption, and inherent parallelism. Existing photonic computing research has mainly focused on convolutional neural networks (CNNs) and fully connected neural networks (FCNNs), which are well suited for tasks such as image classification and object detection but face limitations in handling graph-structured data. Graph neural networks (GNNs) are specifically designed to model complex relational structures. In this work, we propose a photonic spiking graph neural network (PSGNN) architecture that integrates the structural modeling capability of GNNs, the temporal dynamics of spiking neurons, and the parallel computing advantages of photonic hardware. Through hardware-software co-optimization, a bias-term simulation method tailored for photonic chips is implemented using feature-dimension expansion, enabling effective network training. Experiments on the KarateClub and PubMed datasets achieve training accuracies of 100 percent (92 +/- 2 percent) and test accuracies of 97 percent (90 +/- 1 percent). A silicon photonics 4 x 4 Mach-Zehnder interferometer (MZI) array is further constructed for hardware validation, achieving a test accuracy of 93 percent. The system demonstrates an inference latency of 97 ps, with an energy efficiency of 280 GOPS/W and a computational density of 52 GOPS/mm^2. These results highlight the potential of PSGNN for structured-data processing applications.

physics.optics

Hardware-aware Lightweight Photonic Spiking Neural Network for Pattern Classification

There exists a significant scale gap between photonic neural network integrated chips and neural networks, which hinders the deployment and application of photonic neural network. Here, we propose hardware-aware lightweight spiking neural networks (SNNs) architecture tailored to our photonic neuromorphic chips, and conducts hardware-software collaborative computing for solving patter classification tasks. Here, we employed a simplified Mach-Zehnder interferometer (MZI) mesh for performing linear computation, and 16-channel distributed feedback lasers with saturable absorber (DFB-SA) array for performing nonlinear spike activation. Both photonic neuromorphic chips based on the MZI mesh and DFB-SA array were designed, optimized and fabricated. Furthermore, we propose a lightweight spiking neural network (SNN) with discrete cosine transform to reduce input dimension and match the input/output ports number of the photonic neuromorphic chips. We demonstrated an end-to-end inference of an entire layer of the lightweight photonic SNN. The hardware-software collaborative inference accuracy is 90% and 80.5% for MNIST and Fashion-MNIST datasets, respectively. The energy efficiency is 1.39 TOPS/W for the MZI mesh, and is 987.65 GOPS/W for the DFB-SA array. The lightweight architecture and experimental demonstration address the challenge of scale mismatch between the photonic chip and SNN, paving the way for the hardware deployment of photonic SNNs.

physics.optics

Hardware-Software Collaborative Computing of Photonic Spiking Reinforcement Learning for Robotic Continuous Control

Robotic continuous control tasks impose stringent demands on the energy efficiency and latency of computing architectures due to their high-dimensional state spaces and real-time interaction requirements. Conventional electronic computing platforms face computational bottlenecks, whereas the fusion of photonic computing and spiking reinforcement learning (RL) offers a promising alternative. Here, we propose a novel computing architecture based on photonic spiking RL, which integrates the Twin Delayed Deep Deterministic policy gradient (TD3) algorithm with spiking neural network (SNN). The proposed architecture employs an optical-electronic hybrid computing paradigm wherein a silicon photonic Mach-Zehnder interferometer (MZI) chip executes linear matrix computations, while nonlinear spiking activations are performed in the electronic domain. Experimental validation on the Pendulum-v1 and HalfCheetah-v2 benchmarks demonstrates the system capability for software-hardware co-inference, achieving a control policy reward of 5831 on HalfCheetah-v2, a 23.33% reduction in convergence steps, and an action deviation below 2.2%. Notably, this work represents the first application of a programmable MZI photonic computing chip to robotic continuous control tasks, attaining an energy efficiency of 1.39 TOPS/W and an ultralow computational latency of 120 ps. Such performance underscores the promise of photonic spiking RL for real-time decision-making in autonomous and industrial robotic systems.

cs.RO

Integrated photonic neuromorphic computing: device, architecture, chip, algorithm

Artificial intelligence (AI) has experienced explosive growth in recent years. The large models have been widely applied in various fields, including natural language processing, image generation, and complex decision-making systems, revolutionizing technological paradigms across multiple industries. Nevertheless, the substantial data processing demands during model training and inference result in the computing power bottleneck. Traditional electronic chips based on the von Neumann architecture struggle to meet the growing demands for computing power and power efficiency amid the continuous development of AI. Photonic neuromorphic computing, an emerging solution in the post-Moore era, exhibits significant development potential. Leveraging the high-speed and large-bandwidth characteristics of photons in signal transmission, as well as the low-power consumption advantages of optical devices, photonic integrated computing chips have the potential to overcome the memory wall and power wall issues of electronic chips. In recent years, remarkable advancements have been made in photonic neuromorphic computing. This article presents a systematic review of the latest research achievements. It focuses on fundamental principles and novel neuromorphic photonic devices, such as photonic neurons and photonic synapses. Additionally, it comprehensively summarizes the network architectures and photonic integrated neuromorphic chips, as well as the optimization algorithms of photonic neural networks. In addition, combining with the current status and challenges of this field, this article conducts an in-depth discussion on the future development trends of photonic neuromorphic computing in the directions of device integration, algorithm collaborative optimization, and application scenario expansion, providing a reference for subsequent research in the field of photonic neuromorphic computing.

physics.optics

Nonlinear Photonic Neuromorphic Chips for Spiking Reinforcement Learning

Photonic computing chips have made significant progress in accelerating linear computations, but nonlinear computations are usually implemented in the digital domain, which introduces additional system latency and power consumption, and hinders the implementation of fully-functional photonic neural network chips. Here, we propose and fabricate a 16-channel programmable incoherent photonic neuromorphic computing chip by co-designing a simplified MZI mesh and distributed feedback lasers with saturable absorber array using different materials, enabling implementation of both linear and nonlinear spike computations in the optical domain. Furthermore, previous studies mainly focused on supervised learning and simple image classification tasks. Here, we propose a photonic spiking reinforcement learning (RL) architecture for the first time, and develop a software-hardware collaborative training-inference framework to address the challenge of training spiking RL models. We achieve large-scale, energy-efficient (photonic linear computation: 1.39 TOPS/W, photonic nonlinear computation: 987.65 GOPS/W) and low-latency (320 ps) end-to-end deployment of an entire layer of photonic spiking RL. Two RL benchmarks include the discrete CartPole task and the continuous Pendulum tasks are demonstrated experimentally based on spiking proximal policy optimization algorithm. The hardware-software collaborative computing reward value converges to 200 (-250) for the CartPole tasks, respectively, comparable to that of a traditional PPO algorithm. This experimental demonstration addresses the challenge of the absence of large-scale photonic nonlinear spike computation and spiking RL training difficulty, and presents a high-speed and low-latency photonic spiking RL solution with promising application prospects in fields such as real-time decision-making and control for robots and autonomous driving.

physics.optics

IgCraft: A versatile sequence generation framework for antibody discovery and engineering

Designing antibody sequences to better resemble those observed in natural human repertoires is a key challenge in biologics development. We introduce IgCraft: a multi-purpose model for paired human antibody sequence generation, built on Bayesian Flow Networks. IgCraft presents one of the first unified generative modeling frameworks capable of addressing multiple antibody sequence design tasks with a single model, including unconditional sampling, sequence inpainting, inverse folding, and CDR motif scaffolding. Our approach achieves competitive results across the full spectrum of these tasks while constraining generation to the space of human antibody sequences, exhibiting particular strengths in CDR motif scaffolding (grafting) where we achieve state-of-the-art performance in terms of humanness and preservation of structural properties. By integrating previously separate tasks into a single scalable generative model, IgCraft provides a versatile platform for sampling human antibody sequences under a variety of contexts relevant to antibody discovery and engineering. Model code and weights are publicly available at https://github.com/mgreenig/IgCraft.

q-bio.BM

Computational design of target-specific linear peptide binders with TransformerBeta

The computational prediction and design of peptide binders targeting specific linear epitopes is crucial in biological and biomedical research, yet it remains challenging due to their highly dynamic nature and the scarcity of experimentally solved binding data. To address this problem, we built an unprecedentedly large-scale library of peptide pairs within stable secondary structures (beta sheets), leveraging newly available AlphaFold predicted structures. We then developed a machine learning method based on the Transformer architecture for the design of specific linear binders, in analogy to a language translation task. Our method, TransformerBeta, accurately predicts specific beta strand interactions and samples sequences with beta sheet-like molecular properties, while capturing interpretable physico-chemical interaction patterns. As such, it can propose specific candidate binders targeting linear epitope for experimental validation to inform protein design.

q-bio.BM

Constrained Online Recursive Source Separation Framework for Real-time Electrophysiological Signal Processing

Background and Objective: Processing electrophysiological signals often requires blind source separation (BSS) due to the nature of mixing source signals. However, its complex computational demands make real-time BSS challenging. The objective of this work is to develop an advanced real-time BSS method suitable for processing electrophysiological signals. Methods: In this paper, a novel BSS framework termed constrained online recursive source separation (CORSS) was proposed. In the framework, a stepwise recursive unmixing matrix learning rule was adopted to enable real-time updates with minimal computational cost. Moreover, by incorporating prior information of target signals to optimize the cost function, the framework algorithm was more likely to converge to the target sources. To validate its performance, the proposed framework was applied to both downstream tasks, namely real-time surface electromyogram (sEMG) decomposition and real-time respiratory intent monitoring based on diaphragmatic electromyogram (sEMGdi) extraction. Results: The proposed method achieved a matching rate of 96.00 % for the sEMG decomposition task and 98.12 % for the sEMGdi extraction task, exhibiting superior performance over other comparison methods (p < 0.05). Our method also exhibited minimal time delay during computation, with only 12.5 ms delay when the block size was 0.1s, demonstrating its good capabilities in online processing. Conclusions: The proposed method was demonstrated to enable real-time BSS with both improved separation performance and low computational latency. It is of substantial importance for real-time electrophysiological signal processing and applications towards advanced neural-machine interaction and clinical monitoring.

cs.HC

Extraction of Weak Surface Diaphragmatic Electromyogram Using Modified Progressive FastICA Peel-Off

Diaphragmatic electromyogram (EMGdi) contains crucial information about human respiration therefore can be used to monitor respiratory condition. Although it is practical to record EMGdi noninvasively and conveniently by placing surface electrodes over chest skin, extraction of such weak surface EMGdi (sEMGdi) from great noisy environment is a challenging task, limiting its clinical use compared with esophageal EMGdi. In this paper, a novel method is presented for extracting weak sEMGdi signal from high-noise environment based on fast independent component analysis (FastICA), constrained FastICA and a peel-off strategy. It is truly a modified version of of progressive FastICA peel-off (PFP) framework, where the constrained FastICA helps to extract and refine respiration-related sEMGdi signals, while the peel-off strategy ensures the complete extraction of weaker sEMGdi components. The method was validated using both synthetic and clinical signals. It was demonstrated that our method was able to extract clean sEMGdi signals efficiently with little distortion. It outperformed state-of-the-art comparison methods in terms of sufficiently high SIR and CORR at all noise levels when tested on synthetic data, while also achieved an accuracy of 95.06% and a F2-score of 96.73% for breath identification on clinical data. The study presents a valuable solution for noninvasive extraction of sEMGdi signals, providing a convenient and valuable way of ventilator synchrony with a significant potential in aiding respiratory rehabilitation and health.

physics.med-ph

Noninvasive Extraction of Maternal and Fetal Electrocardiograms Using Progressive Periodic Source Peel-off

Abdominal electrocardiogram (AECG) gives a safe and non-invasive way to monitor fetal well-being during pregnancy using surface electrodes. However, it is challenging to extract weak fetal ECG (fECG) from the AECG recordings with larger maternal ECG (mECG) and external noises. In this study, we introduce a novel progressive periodic source peel-off (PPSP) method for extracting periodic ECG sources from multi-channel AECG recordings, including three main modules: 1) A periodic constrained FastICA (PCFICA) module with ECG physiology-informed constraints for extracting precise ECG spike trains, 2) A singular value decomposition module for estimating ECG waveforms, and 3) A peel-off strategy that facilitates to discern weak fECG source by eliminating previously separated sources or noises. The performance of the PPSP method was examined on two public databases, synthetic data and our clinical data. For extracting fECG spike trains, our PPSP method achieved an F1-scores of 99.59% on public data, 99.50% on synthetic data at the highest noise level. It further yielded the lowest RMSE of fetal heart rate of 6.20% on clinical data. It significantly outperformed other state-of-the-art methods on any set of data (p < 0.05). This study demonstrated effectiveness of the PPSP method for extracting and separating mECG and weak fECG signals, with high precision especially at high noise levels. Our study promotes noninvasive measurement and intelligent monitoring of both fetal and maternal heart activities towards advanced healthcare in perinatal medicine.

physics.med-ph

Online Decomposition of Surface Electromyogram into Individual Motor Unit Activities Using Progressive FastICA Peel-off

Surface electromyogram (SEMG) decomposition provides a promising tool for decoding and understanding neural drive information non-invasively. In contrast to previous SEMG decomposition methods mainly developed in offline conditions, there are few studies on online SEMG decomposition. A novel method for online decomposition of SEMG data is presented using the progressive FastICA peel-off (PFP) algorithm. The online method consists of an offline prework stage and an online decomposition stage. More specifically, a series of separation vectors are first initialized by the originally offline version of the PFP algorithm from SEMG data recorded in advance. Then they are applied to online SEMG data to extract motor unit spike trains precisely. The performance of the proposed online SEMG decomposition method was evaluated by both simulation and experimental approaches. It achieved an online decomposition accuracy of 98.53% when processing simulated SEMG data. For decomposing experimental SEMG data, the proposed online method was able to extract an average of 12.00 +- 3.46 MUs per trial, with a matching rate of 90.38% compared with results from the expert-guided offline decomposition. Our study provides a valuable way of online decomposition of SEMG data with advanced applications in movement control and health.

eess.SP