SearcharxivSearch

arXiv subjects

Joshua Robertson

Publications and source records attributed to Joshua Robertson.

16 recordsLinked to original sources

Neuromorphic Infrared Fibre-Optic Event-Based Sensing with Fast and Efficient Photonic-Electronic Spiking Neurons

Current photonic technologies for remote sensing require the capture of large amounts of data, suffering as a result from high energy consumption, excessive data redundancy and storage, and costly data processing requirements, limiting their ability for direct and efficient edge-processing for rapid decision making and alarm triggering. In contrast, biological sensing systems, given their event-driven nature and in-sensor processing capabilities offer energy-efficient and practical alternatives. In this work, we draw direct inspiration from the neural spiking in biological sensory systems, to propose a novel neuromorphic event-based photonic technology permitting the remote sensing of environmental events-of-interest efficiently, at high speeds and across a wide dynamic frequency range. Our approach combines widely-deployed fibre-optic telecommunication links and photo-detecting resonant tunnelling diodes (pRTD) acting as light-triggered spiking neurons. We demonstrate that this new neuromorphic photonic sensing approach allows the remote detection of different types of environmental events, including temperature variations, strain-induced motion, audio and air turbulence, with high temporal resolution (encoding them with fast nanosecond-rate neural-like spikes). These results pave the way for novel light-enabled neuromorphic remote infrared fibre-optic sensing networks that are fast, efficient, event-driven, scalable, permit direct processing at-the-edge, and offer practical alternatives to current data-intensive approaches for photonic remote sensing.

physics.optics

Parallel Spatial Photonic Programming of Optoelectronic IGZO RRAM with a compact $\mu$LED Array

Optoelectronic resistive random-access memory elements (ORRAM) are critical emerging devices that leverage photonic technologies to bring the advantages of optical programming to traditionally electronic memristive platforms for neuromorphic computing and artificial intelligence. In this work, a free-space optic micro-LED ($\mu$LED) array is combined with a 2-terminal oxide semiconductor ORRAM (based on IGZO\textsubscript{Rich}/IGZO active layers), to realise parallel spatial programming of form-free memristive arrays. We report the optical and electrical programming of resistive states with potentiation/depression analysis of various stimuli parameters (pulse frequency, pulse width, pulse amplitude). Further, we demonstrate the simultaneous photonic-electronic programming of the ORRAM with optical SET (blue 450\,nm) and electrical RESET functionality. Persistent photocurrent is also observed and exploited as a pathway to fading memory or synaptic plasticity for temporal bit encoding. Finally, parallel optical $\mu$LED to ORRAM channels are demonstrated to achieve the simultaneous photonic programming of multiple devices and the writing of spatial patterns across a chip of memristive IGZO devices. This work highlights the light-enabled scalability of the optoelectronic platform and the feasibility of ORRAM to interface with spatially-multiplexed optical sources to bring neuromorphic technologies directly into applications that process and sense in the optical domain.

physics.optics

Combined spatially and temporally multiplexed photonic reservoir computer with a diffractively coupled VCSEL-array

We report and analyse the classification performance of an experimental hybrid spatio-temporal photonic reservoir computer based upon a free-space VCSEL array. We demonstrate experimentally the enhancement of spatial-only reservoir operation, featuring the diffractive coupling of lasers in an external cavity, by exploiting up to 88 virtual nodes with time multiplexing. We analyse the dependance of performance on the spatial and virtual node number, and achieve an improvement for both spatial- and temporal-only reservoirs with a reduced test error of 0.026 in a classification task. Further, given the high bandwidth of the non-linear laser transformation, we demonstrate the expansion of a 12 spatial node network to a 968 node network, operating at an input time of 17.6ns, maintaining high processing speed and improving network scalability and performance.

physics.optics

Neuron Surface Emitting Laser (NeuronSEL): Spiking Regimes and Negative Differential Resistance in Solitary Multi-junction VCSELs

Neuromorphic photonics is emerging as a powerful platform for fast and efficient optical information processing and sensing. However, future brain-inspired photonic systems require compact and scalable light sources, capable of generating the neuro-mimetic optical signals needed for their operation. This work demonstrates a single-stack laser that delivers optical and electrical neural-like spiking emission under solitary operation. Termed the Neuron Surface-Emitting Laser (NeuronSEL), this compact, multi-junction Vertical-Cavity Surface Emitting Laser (VCSEL) exhibits non-linear Negative Differential Resistance (NDR), similar to that observed in memristive devices. Leveraging this NDR behaviour enables the novel demonstration of multiple neuronal features in the NeuronSEL including refractoriness and threshold-/integrate-and-fire dynamics. We demonstrate the NeuronSEL's behaviour as an optical spiking neuron and its ability to perform processing functions, such as coincidence detection and exclusive OR operations. Its scalability is illustrated by proposing a network based on an array of NeuronSELs, able to perform classification tasks. The NeuronSEL emerges as a strong candidate for practical and scalable neuromorphic photonic hardware, with potential impact across a range of applications in optical sensing, communications and computing technologies, whilst benefitting from the inherent advantages of VCSEL technology -low manufacturing cost, compactness, efficiency, vertical emission, and straightforward integration into large arrayed-structures and networks.

physics.optics

Resonate-and-Fire Photonic-Electronic Spiking Neurons for Fast and Efficient Light-Enabled Neuromorphic Processing Systems

Neuromorphic computing seeks to replicate the spiking dynamics of biological neurons for brain-inspired computation. While electronic implementations of artificial spiking neurons have dominated to date, photonic approaches are attracting increasing research interest as they promise ultrafast, energy-efficient operation with low-crosstalk and high bandwidth. Nevertheless, existing photonic neurons largely mimic integrate-and-fire models, but neuroscience shows that neurons also encode information through richer mechanisms, such as the frequency and temporal patterns of spikes. Here, we present a photonic-electronic resonate-and-fire (R-and-F) spiking neuron that responds to the temporal structure of high-speed optical inputs. This is based on a light-sensitive resonant tunnelling diode that produces excitable spikes in response to nanosecond, low-power (100 microwatt) optical signals at infrared telecom wavelengths. We experimentally demonstrate control of R-and-F dynamics through inter-pulse timing of the optical stimuli and applied bias voltage, achieving bandpass filtering of both analogue and digital inputs. The R-and-F neuron also supports optical fan-in via wavelength-division multiplexed inputs from four vertical-cavity surface-emitting lasers (VCSELs). This electronic-photonic neuron exhibits key functionalities - including spike-frequency filtering, temporal pattern recognition, and digital-to-spiking conversion - critical for neuromorphic optical processing. Our approach establishes a pathway toward low-power, high-speed temporal information processing for light-enabled neuromorphic computing.

physics.optics

Neuromorphic Photonic Processing and Memory with Spiking Resonant Tunnelling Diode Neurons and Neural Networks

Neuromorphic computing-modelled after the functionality and efficiency of biological neural systems-offers promising new directions for advancing artificial intelligence and computational models. Photonic techniques for neuromorphic computing hardware are attracting increasing research interest, thanks to their potentials for ultra high bandwidths, low-crosstalk and high parallelism. Among these, approaches based upon resonant tunnelling diodes (RTDs) have recently gained attention as potential building blocks for next-generation light-enabled neuromorphic hardware, due to their capacity to replicate key neuronal behaviours such as excitable spiking and refractoriness, added to their potentials for high operational speeds, energy efficiency and compact footprints. In particular, their ability to function as opto-electronic spiking neurons makes them strong candidates for integration into novel event based neuromorphic computing systems. This work demonstrates the application of optically-triggered spiking RTD neurons to a multiplicity of applications and architectures, these include systems based upon single elements for multi-modal (photonic-electronic) fast rising edge-detection in time-series data, the construction of a two-layer feedforward artificial photonic spiking neural network (pSNN) using RTD neurons as the nonlinear nodes delivering excellent performance in complex dataset classification tasks, and a pSNN comprised of multiple coupled light-sensitive RTD spiking neurons that supports performance as an adjustable neuromorphic optical spiking memory system with a tunable storage time of spiking patterns.

physics.comp-ph

Spiking Rate and Latency Encoding with Resonant Tunnelling Diode Neuron Circuits and Design Influences

Neuromorphic computing, inspired by the functionality and efficiency of biological neural systems, holds promise for advancing artificial intelligence and computational paradigms. Resonant tunneling diodes (RTDs), thanks to their ability to generate neuronal dynamical responses, such as excitable spiking and refractoriness, have recently emerged as candidates for use as opto-electronic spiking neurons in novel neuromorphic computing hardware. This work explores the ability of RTD spiking neurons to deliver information encoding mechanisms analogous to those observed in biological neurons, specifically spike firing rate and spike latency encoding. We also report detailed experimental and numerical studies on the impact that the RTD mesa radius and circuit inductance and capacitance have on its spiking properties, providing useful information for future design of RTD-based neural networks optimised for ultrafast (>GHz rate) processing capabilities. Finally, we showcase the application of spike rate encoding in RTD neurons for the ultrafast reconstruction of a eight-level amplitude signal, effectively filtering out the noise.

physics.app-ph

Ultrafast and compact photonic-electronic leaky integrate-and-fire circuits based upon resonant tunnelling diodes

This work provides a first report of ultrafast and compact photonic-electronic neuromorphic temporal leaky integrate-and-fire neuronal circuits built with Resonant Tunnelling Diodes (RTDs). We demonstrate experimentally that multiple fast (~100-200 ps) optical input pulses, arriving within a short (sub-ns long) temporal window, control the triggering of excitable responses in two different photonic-electronic RTD circuit architectures. These architectures are an electronic RTD coupled externally to a photodetector (referred to as a PD-RTD), and an integrated opto-electronic RTD device with inherent photodetection capability at infrared telecom wavelengths (referred to as an Optical RTD-PD). For both RTD systems, we reveal that the high-speed optically-triggered integrate-and-fire spiking operation can be precisely controlled by acting on the voltage bias applied to the RTD devices, or via the intensity of incoming optical pulses. Finally, we demonstrate the application of the leaky integrate-and-fire behaviour to a pattern recognition task at high-speed, with the systems triggering fast ns-long electrical spikes in response to optical inputs of weighted 4-bit digital headers.

physics.optics

Photonic-electronic spiking neuron with multi-modal and multi-wavelength excitatory and inhibitory operation for high-speed neuromorphic sensing and computing

We report a multi-modal spiking neuron that allows optical and electronic input and control, and wavelength-multiplexing operation, for use in novel high-speed neuromorphic sensing and computing functionalities. The photonic-electronic neuron is built with a micro-scale, nanostructure resonant tunnelling diode (RTD) with photodetection (PD) capability. Leveraging the advantageous intrinsic properties of this RTD-PD system, namely highly nonlinear characteristics, photo-sensitivity, light-induced I-V curve shift, and the ability to deliver excitable responses under electrical and optical inputs, we successfully achieve flexible neuromorphic spike activation and inhibition regimes through photonic-electrical control. We also demonstrate the ability of this RTD-PD spiking sensing-processing neuron to operate under the simultaneous arrival of multiple wavelength-multiplexed optical signals, due to its large photodetection spectral window (covering the 1310 and 1550 nm telecom wavelength bands). Our results highlight the potential of RTD photonic-electronic neurons to reproduce multiple key excitatory and inhibitory spiking regimes, at high speed (ns-rate spiking responses, with faster sub-ns regimes theoretically predicted) and low energy (requiring only ~10 mV and ~150 microW, electrical and optical input amplitudes, respectively), similar in nature to those commonly found in the biological neurons of the visual system and the brain. This work offers a highly promising approach for the realisation of high-speed, energy-efficient photonic-electronic spiking neurons and spiking neural networks, enabling multi-modal and multi-wavelength operation for sensing and information processing tasks. This work therefore paves the way for innovative high-speed, photonic-electronic, and spike-based neuromorphic sensing and computing systems and artificial intelligence hardware.

physics.optics

Interfacing spiking VCSEL-neurons with silicon photonics weight banks towards integrated neuromorphic photonic systems

Spiking neurons and neural networks constitute a fundamental building block for brain-inspired computing, which is posed to benefit significantly from photonic hardware implementations. In this work, we experimentally investigate an interconnected system based on an ultrafast spiking VCSEL-neuron and a silicon photonics (SiPh) integrated micro-ring resonator (MRR) weight bank, and demonstrate two different functional arrangements of these devices. First, we show that MRR weightbanks can be used in conjuction with the spiking VCSEL-neurons to perform amplitude weighting of sub-ns optical spiking signals. Second, we show that a continuous firing VCSEL-neuron can be directly modulated using a locking signal propagated through a single weighting micro-ring, and we utilize this functionality to perform optical spike firing rate-coding via thermal tuning of the micro-ring resonator. Given the significant track record of both integrated weight banks and photonic VCSEL-neurons, we believe these results demonstrate the viability of combining these two classes of devices for use in functional neuromorphic photonic systems.

physics.optics

Photonic Spiking Neural Networks with Highly Efficient Training Protocols for Ultrafast Neuromorphic Computing Systems

Photonic technologies offer great prospects for novel ultrafast, energy-efficient and hardware-friendly neuromorphic (brain-like) computing platforms. Moreover, neuromorphic photonic approaches based upon ubiquitous, technology-mature and low-cost Vertical-Cavity Surface Emitting Lasers (VCSELs) (devices found in fibre-optic transmitters, mobile phones, automotive sensors, etc.) are of particular interest. Given VCSELs have shown the ability to realise neuronal optical spiking responses (at ultrafast GHz rates), their use for spike-based information processing systems has been proposed. In this work, Spiking Neural Network (SNN) operation, based on a hardware-friendly photonic system of just one Vertical Cavity Surface Emitting Laser (VCSEL), is reported alongside a novel binary weight 'significance' training scheme that fully capitalises on the discrete nature of the optical spikes used by the SNN to process input information. The VCSEL-based photonic SNN is tested with a highly complex, multivariate, classification task (MADELON) before performance is compared using a traditional least-squares training method and the alternative novel binary weighting scheme. Excellent classification accuracies of >94% are reached by both training methods, exceeding the benchmark performance of the dataset in a fraction of processing time. The newly reported training scheme also dramatically reduces training set size requirements as well as the number of trained nodes (<1% of the total network node count). This VCSEL-based photonic SNN, in combination with the reported 'significance' weighting scheme, therefore grants ultrafast spike-based optical processing with highly reduced training requirements and hardware complexity for potential application in future neuromorphic systems and artificial intelligence applications.

cs.ET

GHz Rate Neuromorphic Photonic Spiking Neural Network with a Single Vertical-Cavity Surface-Emitting Laser (VCSEL)

Vertical-Cavity Surface-Emitting Lasers (VCSELs) are highly promising devices for the construction of neuromorphic photonic information processing systems, due to their numerous desirable properties such as low power consumption, high modulation speed, compactness, and ease of manufacturing. Of particular interest is the ability of VCSELs to exhibit neural-like spiking responses, much like biological neurons, but at ultrafast sub-nanosecond rates; thus offering great prospects for high-speed light-enabled neuromorphic (spike-based) processors. Recent works have shown the use the spiking dynamics in VCSELs for pattern recognition and image processing problems such as image data encoding and edge-feature detection. Additionally, VCSELs have also been used recently as nonlinear elements in photonic reservoir computing (RC) implementations, yielding excellent state of the art operation. This work introduces and experimentally demonstrates for the first time the new concept of a Ghz-rate photonic spiking neural network (SNN) built with a single VCSEL neuron. The reported system effectively implements a photonic VCSEL-based spiking reservoir computer, and demonstrates its successful application to a complex nonlinear classification task. Importantly, the proposed system benefits from a highly hardware-friendly, inexpensive realization (built with a single VCSEL and off-the-shelf fibre-optic components), for high-speed (GHz-rate inputs) and low-power (sub-mW optical input power) photonic operation. These results open new pathways towards future neuromorphic photonic spike-based information processing systems based upon VCSELs (or other laser types) for novel ultrafast machine learning and AI hardware.

cs.ET

Photonic neuromorphic computing using vertical cavity semiconductor lasers

Photonic realizations of neural network computing hardware are a promising approach to enable future scalability of neuromorphic computing. In this review we provide an overview on vertical-cavity surface-emitting lasers (VCSELs) and how these high-performance electro-optical components either implement or are combined with additional photonic hardware to demonstrate points (i-iii). In the neurmorphic photonics' context, VCSELs are of exceptional interest as they are compatible with CMOS fabrication, readily achieve 30\% wall-plug efficiency and >30~GHz modulation bandwidth and hence are highly energy efficient and ultra-fast. Crucially, they react highly nonlinear to optical injection as well as to electrical modulation, making them highly suitable as all-optical as well as electro-optical photonic neurons. Their optical cavities are wavelength-limited, and standard semiconductor growth and lithography enables non-classical cavity configurations and geometries. This enables excitable VCSELs (i.e. spiking VCSELs) to finely control their temporal and spatial coherence, to unlock Terahertz bandwidths through spin-flip effects, and even to leverage cavity quantum electrodynamics to further boost their efficiency. Finally, as VCSEL arrays they are compatible with standard 2D photonic integration, but their emission vertical to the substrate makes them ideally suited for scalable integrated networks leveraging 3D photonic waveguides. Here, we discuss the implementation of spatially as well as temporally multiplexed VCSEL neural networks and reservoirs, computation on the basis of excitable VCSELs as photonic spiking neurons, as well as concepts and advances in the fabrication of VCSELs and microlasers.

cs.ET

Ultrafast Neuromorphic Photonic Image Processing with a VCSEL Neuron

The ever-increasing demand for Artificial Intelligence (AI) systems is underlining a significant requirement for new, AI-optimised hardware. Neuromorphic (brain-like) processors are one highly-promising solution, with photonic-enabled realizations receiving increasing attention. Among these, approaches based upon Vertical Cavity Surface Emitting Lasers (VCSELs) are attracting interest given their favourable attributes and mature technology. Here, we demonstrate a hardware-friendly neuromorphic photonic spike processor, using a single VCSEL, for all-optical image edge-feature detection. This exploits the ability of a VCSEL-based photonic neuron to integrate temporally-encoded pixel data at high speed; and fire fast (100ps-long) optical spikes upon detecting desired image features. Furthermore, the photonic system is combined with a software-implemented spiking neural network yielding a full platform for complex image classification tasks. This work therefore highlights the potentials of VCSEL-based platforms for novel, ultrafast, all-optical neuromorphic processors interfacing with current computation and communication systems for use in future light-enabled AI and computer vision functionalities.

cs.ET

All-optical neuromorphic binary convolution with a spiking VCSEL neuron for image gradient magnitudes

All-optical binary convolution with a photonic spiking vertical-cavity surface-emitting laser (VCSEL) neuron is proposed and demonstrated experimentally for the first time. Optical inputs, extracted from digital images and temporally encoded using rectangular pulses, are injected in the VCSEL neuron which delivers the convolution result in the number of fast (<100 ps long) spikes fired. Experimental and numerical results show that binary convolution is achieved successfully with a single spiking VCSEL neuron and that all-optical binary convolution can be used to calculate image gradient magnitudes to detect edge features and separate vertical and horizontal components in source images. We also show that this all-optical spiking binary convolution system is robust to noise and can operate with high-resolution images. Additionally, the proposed system offers important advantages such as ultrafast speed, high energy efficiency and simple hardware implementation, highlighting the potentials of spiking photonic VCSEL neurons for high-speed neuromorphic image processing systems and future photonic spiking convolutional neural networks.

physics.optics

Convolutional Image Edge Detection Using Ultrafast Photonic Spiking VCSEL Neurons

We report experimentally and in theory on the detection of edge information in digital images using ultrafast spiking optical artificial neurons towards convolutional neural networks (CNNs). In tandem with traditional convolution techniques, a photonic neuron model based on a Vertical-Cavity Surface Emitting Laser (VCSEL) is implemented experimentally to threshold and activate fast spiking responses upon the detection of target edge features in digital images. Edges of different directionalities are detected using individual kernel operators and complete image edge detection is achieved using gradient magnitude. Importantly, the neuromorphic (brain-like) image edge detection system of this work uses commercially sourced VCSELs exhibiting spiking responses at sub-nanosecond rates (many orders of magnitude faster than biological neurons) and operating at the telecom wavelength of 1300 nm; hence making our approach compatible with optical communication and data-center technologies. These results therefore have exciting prospects for ultrafast photonic implementations of neural networks towards computer vision and decision making systems for future artificial intelligence applications.

eess.IV