arXiv subjects

Jeffrey M. Shainline

Publications and source records attributed to Jeffrey M. Shainline.

At least 19 recordsLinked to original sources

arXiv2024

Relating Superconducting Optoelectronic Networks to Classical Neurodynamics

The circuits comprising superconducting optoelectronic synapses, dendrites, and neurons are described by numerically cumbersome and formally opaque coupled differential equations. Reference 1 showed that a phenomenological model of superconducting loop neurons eliminates the need to solve the Josephson circuit equations that describe synapses and dendrites. The initial goal of the model was to decrease the time required for simulations, yet an additional benefit of the model was increased transparency of the underlying neural circuit operations and conceptual clarity regarding the connection of loop neurons to other physical systems. Whereas the original model simplified the treatment of the Josephson-junction dynamics, essentially by only considering low-pass versions of the dendritic outputs, the model resorted to an awkward treatment of spikes generated by semiconductor transmitter circuits that required explicitly checking for threshold crossings and distinct treatment of time steps wherein somatic threshold is reached. Here we extend that model to simplify the treatment of spikes coming from somas, again making use of the fact that in neural systems the downstream recipients of spike events almost always perform low-pass filtering. We provide comparisons between the first and second phenomenological models, quantifying the accuracy of the additional approximations. We identify regions of circuit parameter space in which the extended model works well and regions where it works poorly. For some circuit parameters it is possible to represent the downstream dendritic response to a single spike as well as coincidences or sequences of spikes, indicating the model is not simply a reduction to rate coding. The governing equations are shown to be nearly identical to those ubiquitous in the neuroscience literature for modeling leaky-integrator dendrites and neurons.

cs.NE↗

arXiv2023

Programmable Superconducting Optoelectronic Single-Photon Synapses with Integrated Multi-State Memory

The co-location of memory and processing is a core principle of neuromorphic computing. A local memory device for synaptic weight storage has long been recognized as an enabling element for large-scale, high-performance neuromorphic hardware. In this work, we demonstrate programmable superconducting synapses with integrated memories for use in superconducting optoelectronic neural systems. Superconducting nanowire single-photon detectors and Josephson junctions are combined into programmable synaptic circuits that exhibit single-photon sensitivity, memory cells with more than 400 internal states, leaky integration of input spike events, and 0.4 fJ programming energies (including cooling power). These results are attractive for implementing a variety of supervised and unsupervised learning algorithms and lay the foundation for a new hardware platform optimized for large-scale spiking network accelerators.

physics.app-ph↗

arXiv2023

Monolithic Integration of Superconducting-Nanowire Single-Photon Detectors with Josephson Junctions for Scalable Single-photon Sensing

We demonstrate superconducting single-photon detectors that integrate signals locally at each pixel. This capability is realized by the monolithic integration of superconducting-nanowire single-photon detectors with Josephson electronics. The motivation is to realize superconducting sensor elements with integrating capabilities similar to their CMOS-sensor counterparts. The pixels can operate in several modes. First, we demonstrate that photons can be counted individually, with each detection event adding an identical amount of supercurrent to an integrating element. Second, we demonstrate an active gain control option, in which the signal added per detection event can be dynamically adjusted to account for variable light conditions. Additionally, the pixels can either retain signal indefinitely to record all counts incurred over an integration period, or the pixels can record a fading signal of detection events within a decay time constant. We describe additional semiconductor readout circuitry that will be used in future work to realize scalable, large-format sensor arrays of superconducting single photon detectors compatible with CMOS array readout architectures.

physics.app-ph↗

arXiv2022

Phenomenological Model of Superconducting Optoelectronic Loop Neurons

Superconducting optoelectronic loop neurons are a class of circuits potentially conducive to networks for large-scale artificial cognition. These circuits employ superconducting components including single-photon detectors, Josephson junctions, and transformers to achieve neuromorphic functions. To date, all simulations of loop neurons have used first-principles circuit analysis to model the behavior of synapses, dendrites, and neurons. These circuit models are computationally inefficient and leave opaque the relationship between loop neurons and other complex systems. Here we introduce a modeling framework that captures the behavior of the relevant synaptic, dendritic, and neuronal circuits at a phenomenological level without resorting to full circuit equations. Within this compact model, each dendrite is discovered to obey a single nonlinear leaky-integrator ordinary differential equation, while a neuron is modeled as a dendrite with a thresholding element and an additional feedback mechanism for establishing a refractory period. A synapse is modeled as a single-photon detector coupled to a dendrite, where the response of the single-photon detector follows a closed-form expression. We quantify the accuracy of the phenomenological model relative to circuit simulations and find that the approach reduces computational time by a factor of ten thousand while maintaining accuracy of one part in ten thousand. We demonstrate the use of the model with several basic examples. The net increase in computational efficiency enables future simulation of large networks, while the formulation provides a connection to a large body of work in applied mathematics, computational neuroscience, and physical systems such as spin glasses.

cs.NE↗

arXiv2022

Demonstration of Superconducting Optoelectronic Single-Photon Synapses

Superconducting optoelectronic hardware is being explored as a path towards artificial spiking neural networks with unprecedented scales of complexity and computational ability. Such hardware combines integrated-photonic components for few-photon, light-speed communication with superconducting circuits for fast, energy-efficient computation. Monolithic integration of superconducting and photonic devices is necessary for the scaling of this technology. In the present work, superconducting-nanowire single-photon detectors are monolithically integrated with Josephson junctions for the first time, enabling the realization of superconducting optoelectronic synapses. We present circuits that perform analog weighting and temporal leaky integration of single-photon presynaptic signals. Synaptic weighting is implemented in the electronic domain so that binary, single-photon communication can be maintained. Records of recent synaptic activity are locally stored as current in superconducting loops. Dendritic and neuronal nonlinearities are implemented with a second stage of Josephson circuitry. The hardware presents great design flexibility, with demonstrated synaptic time constants spanning four orders of magnitude (hundreds of nanoseconds to milliseconds). The synapses are responsive to presynaptic spike rates exceeding 10 MHz and consume approximately 33 aJ of dynamic power per synapse event before accounting for cooling. In addition to neuromorphic hardware, these circuits introduce new avenues towards realizing large-scale single-photon-detector arrays for diverse imaging, sensing, and quantum communication applications.

physics.app-ph↗

arXiv2021

An active dendritic tree can mitigate fan-in limitations in superconducting neurons

Superconducting electronic circuits have much to offer with regard to neuromorphic hardware. Superconducting quantum interference devices (SQUIDs) can serve as an active element to perform the thresholding operation of a neuron's soma. However, a SQUID has a response function that is periodic in the applied signal. We show theoretically that if one restricts the total input to a SQUID to maintain a monotonically increasing response, a large fraction of synapses must be active to drive a neuron to threshold. We then demonstrate that an active dendritic tree (also based on SQUIDs) can significantly reduce the fraction of synapses that must be active to drive the neuron to threshold. In this context, the inclusion of a dendritic tree provides the dual benefits of enhancing the computational abilities of each neuron and allowing the neuron to spike with sparse input activity.

cs.NE↗

arXiv2021

Considerations for neuromorphic supercomputing in semiconducting and superconducting optoelectronic hardware

Any large-scale spiking neuromorphic system striving for complexity at the level of the human brain and beyond will need to be co-optimized for communication and computation. Such reasoning leads to the proposal for optoelectronic neuromorphic platforms that leverage the complementary properties of optics and electronics. Starting from the conjecture that future large-scale neuromorphic systems will utilize integrated photonics and fiber optics for communication in conjunction with analog electronics for computation, we consider two possible paths towards achieving this vision. The first is a semiconductor platform based on analog CMOS circuits and waveguide-integrated photodiodes. The second is a superconducting approach that utilizes Josephson junctions and waveguide-integrated superconducting single-photon detectors. We discuss available devices, assess scaling potential, and provide a list of key metrics and demonstrations for each platform. Both platforms hold potential, but their development will diverge in important respects. Semiconductor systems benefit from a robust fabrication ecosystem and can build on extensive progress made in purely electronic neuromorphic computing but will require III-V light source integration with electronics at an unprecedented scale, further advances in ultra-low capacitance photodiodes, and success from emerging memory technologies. Superconducting systems place near theoretically minimum burdens on light sources (a tremendous boon to one of the most speculative aspects of either platform) and provide new opportunities for integrated, high-endurance synaptic memory. However, superconducting optoelectronic systems will also contend with interfacing low-voltage electronic circuits to semiconductor light sources, the serial biasing of superconducting devices on an unprecedented scale, a less mature fabrication ecosystem, and cryogenic infrastructure.

cs.ET↗

arXiv2020

Integrated-photonic characterization of single-photon detectors for use in neuromorphic synapses

We show several techniques for using integrated-photonic waveguide structures to simultaneously characterize multiple waveguide-integrated superconducting-nanowire detectors with a single fiber input. The first set of structures allows direct comparison of detector performance of waveguide-integrated detectors with various widths and lengths. The second type of demonstrated integrated-photonic structure allows us to achieve detection with a high dynamic range. This device allows a small number of detectors to count photons across many orders of magnitude in count rate. However, we find a stray light floor of -30 dB limits the dynamic range to three orders of magnitude. To assess the utility of the detectors for use in synapses in spiking neural systems, we measured the response with average incident photon numbers ranging from less than $10^{-3}$ to greater than $10$. The detector response is identical across this entire range, indicating that synaptic responses based on these detectors will be independent of the number of incident photons in a communication pulse. Such a binary response is ideal for communication in neural systems. We further demonstrate that the response has a linear dependence of output current pulse height on bias current with up to a factor of 1.7 tunability in pulse height. Throughout the work, we compare room-temperature measurements to cryogenic measurements. The agreement indicates room-temperature measurements can be used to determine important properties of the detectors.

physics.ins-det↗

arXiv2020

Optoelectronic Intelligence

To design and construct hardware for general intelligence, we must consider principles of both neuroscience and very-large-scale integration. For large neural systems capable of general intelligence, the attributes of photonics for communication and electronics for computation are complementary and interdependent. Using light for communication enables high fan-out as well as low-latency signaling across large systems with no traffic-dependent bottlenecks. For computation, the inherent nonlinearities, high speed, and low power consumption of Josephson circuits are conducive to complex neural functions. Operation at 4\,K enables the use of single-photon detectors and silicon light sources, two features that lead to efficiency and economical scalability. Here I sketch a concept for optoelectronic hardware, beginning with synaptic circuits, continuing through wafer-scale integration, and extending to systems interconnected with fiber-optic white matter, potentially at the scale of the human brain and beyond.

cs.ET↗

arXiv2020

Optimization of photoluminescence from W centers in silicon-on-insulator

W centers are trigonal defects generated by self-ion implantation in silicon that exhibit photoluminescence at 1.218 $μ$m. We have shown previously that they can be used in waveguide-integrated all-silicon light-emitting diodes (LEDs). Here we optimize the implant energy, fluence and anneal conditions to maximize the photoluminescence intensity for W centers implanted in silicon-on-insulator, a substrate suitable for waveguide-integrated devices. After optimization, we observe near two orders of magnitude improvement in photoluminescence intensity relative to the conditions with the stopping range of the implanted ions at the center of the silicon device layer. The previously demonstrated waveguide-integrated LED used implant conditions with the stopping range at the center of this layer. We further show that such light sources can be manufactured at the 300-mm scale by demonstrating photoluminescence of similar intensity from 300 mm silicon-on-insulator wafers. The luminescence uniformity across the entire wafer is within the measurement error.

physics.app-ph↗

arXiv2020

Superconducting microwire detectors with single-photon sensitivity in the near-infrared

We report on the fabrication and characterization of single-photon-sensitive WSi superconducting detectors with wire widths from 1 μm to 3 μm. The devices achieve saturated internal detection efficiency at 1.55 μm wavelength and exhibit maximum count rates in excess of 10^5 s^-1. We also investigate the material properties of the silicon-rich WSi films used for these devices. We find that many devices with active lengths of several hundred microns exhibit critical currents in excess of 50% of the depairing current. A meandered detector with 2.0 μm wire width is demonstrated over a surface area of 362x362 μm^2, showcasing the material and device quality achieved.

physics.app-ph↗

arXiv2020

Low-loss, high-bandwidth fiber-to-chip coupling using capped adiabatic tapered fibers

We demonstrate adiabatically tapered fibers terminating in sub-micron tips that are clad with a higher-index material for coupling to an on-chip waveguide. This cladding enables coupling to a high-index waveguide without losing light to the buried oxide. A technique to clad the tip of the tapered fiber with a higher-index polymer is introduced. Conventional tapered waveguides and forked tapered waveguide structures are investigated for coupling from the clad fiber to the on-chip waveguide. We find the forked waveguide facilitates alignment and packaging, while the conventional taper leads to higher bandwidth. The insertion loss from a fiber through a forked coupler to a sub-micron silicon nitride waveguide is 1.1 dB and the 3 dB-bandwidth is 90 nm. The coupling loss in the packaged device is 1.3 dB. With a fiber coupled to a conventional tapered waveguide, the loss is 1.4 dB with a 3 dB bandwidth extending beyond the range of the measurement apparatus, estimated to exceed 250 nm.

physics.app-ph↗

arXiv2019

Does Cosmological Evolution Select for Technology?

If the parameters defining the physics of our universe departed from their present values, the observed rich structure and complexity would not be supported. This article considers whether similar fine-tuning of parameters applies to technology. The anthropic principle is one means of explaining the observed values of the parameters. This principle constrains physical theories to allow for our existence, yet the principle does not apply to the existence of technology. Cosmological natural selection has been proposed as an alternative to anthropic reasoning. Within this framework, fine-tuning results from selection of universes capable of prolific reproduction. It was originally proposed that reproduction occurs through singularities resulting from supernovae, and subsequently argued that life may facilitate the production of the singularities that become offspring universes. Here I argue technology is necessary for production of singularities by living beings, and ask whether the physics of our universe has been selected to simultaneously enable stars, intelligent life, and technology capable of creating progeny. Specific technologies appear implausibly equipped to perform tasks necessary for production of singularities, potentially indicating fine-tuning through cosmological natural selection. These technologies include silicon electronics, superconductors, and the cryogenic infrastructure enabled by the thermodynamic properties of liquid helium. Numerical studies are proposed to determine regions of physical parameter space in which the constraints of stars, life, and technology are simultaneously satisfied. If this overlapping parameter range is small, we should be surprised that physics allows technology to exist alongside us. The tests do not call for new astrophysical or cosmological observations. Only computer simulations of well-understood condensed matter systems are required.

physics.pop-ph↗

arXiv2019

Multi-functional integrated photonics in the mid-infrared with suspended AlGaAs on silicon

The microscale integration of mid- and longwave-infrared photonics could enable the development of fieldable, robust chemical sensors, as well as highly efficient infrared frequency converters. However, such technology would be defined by the choice of material platform, which immediately determines the strength and types of optical nonlinearities available, the optical transparency window, modal confinement, and physical robustness. In this work, we demonstrate a new platform, suspended AlGaAs waveguides integrated on silicon, providing excellent performance in all of these metrics. We demonstrate low propagation losses within a span of nearly two octaves (1.26 to 4.6 $μ$m) with exemplary performance of 0.45 dB/cm at $λ= 2.4$ $μ$m. We exploit the high nonlinearity of this platform to demonstrate 1560 nm-pumped second-harmonic generation and octave-spanning supercontinuum reaching out to 2.3 $μ$m with 3.4 pJ pump pulse energy. With mid-IR pumping, we generate supercontinuum spanning from 2.3 to 6.5 $μ$m. Finally, we demonstrate the versatility of the platform with mid-infrared passive devices such as low-loss 10 $μ$m-radius bends, compact power splitters with 96 $\pm$ 1% efficiency and edge couplers with 3.0 $\pm$ 0.1 dB loss. This platform has strong potential for multi-functional integrated photonic systems in the mid-IR.

physics.app-ph↗

arXiv2019

Fluxonic Processing of Photonic Synapse Events

Much of the information processing performed by a neuron occurs in the dendritic tree. For neural systems using light for communication, it is advantageous to convert signals to the electronic domain at synaptic terminals so dendritic computation can be performed with electrical circuits. Here we present circuits based on Josephson junctions and mutual inductors that act as dendrites, processing signals from synapses receiving single-photon communication events with superconducting detectors. We show simulations of circuits performing basic temporal filtering, logical operations, and nonlinear transfer functions. We further show how the synaptic signal from a single-photon can fan out locally in the electronic domain to enable the dendrites of the receiving neuron to process a photonic synapse event or pulse train in multiple different ways simultaneously. Such a technique makes efficient use of photons, energy, space, and information.

cs.NE↗

arXiv2018

The largest cognitive systems will be optoelectronic

Electrons and photons offer complementary strengths for information processing. Photons are excellent for communication, while electrons are superior for computation and memory. Cognition requires distributed computation to be communicated across the system for information integration. We present reasoning from neuroscience, network theory, and device physics supporting the conjecture that large-scale cognitive systems will benefit from electronic devices performing synaptic, dendritic, and neuronal information processing operating in conjunction with photonic communication. On the chip scale, integrated dielectric waveguides enable fan-out to thousands of connections. On the system scale, fiber and free-space optics can be employed. The largest cognitive systems will be limited by the distance light can travel during the period of a network oscillation. We calculate that optoelectronic networks the area of a large data center ($10^5$\,m$^2$) will be capable of system-wide information integration at $1$\,MHz. At frequencies of cortex-wide integration in the human brain ($4$\,Hz, theta band), optoelectronic systems could integrate information across the surface of the earth.

cs.ET↗

arXiv2018

Circuit designs for superconducting optoelectronic loop neurons

Optical communication achieves high fanout and short delay advantageous for information integration in neural systems. Superconducting detectors enable signaling with single photons for maximal energy efficiency. We present designs of superconducting optoelectronic neurons based on superconducting single-photon detectors, Josephson junctions, semiconductor light sources, and multi-planar dielectric waveguides. These circuits achieve complex synaptic and neuronal functions with high energy efficiency, leveraging the strengths of light for communication and superconducting electronics for computation. The neurons send few-photon signals to synaptic connections. These signals communicate neuronal firing events as well as update synaptic weights. Spike-timing-dependent plasticity is implemented with a single photon triggering each step of the process. Microscale light-emitting diodes and waveguide networks enable connectivity from a neuron to thousands of synaptic connections, and the use of light for communication enables synchronization of neurons across an area limited only by the distance light can travel within the period of a network oscillation. Experimentally, each of the requisite circuit elements has been demonstrated, yet a hardware platform combining them all has not been attempted. Compared to digital logic or quantum computing, device tolerances are relaxed. For this neural application, optical sources providing incoherent pulses with 10,000 photons produced with efficiency of 10$^{-3}$ operating at 20\,MHz at 4.2\,K are sufficient to enable a massively scalable neural computing platform with connectivity comparable to the brain and thirty thousand times higher speed.

cs.NE↗

arXiv2018

Superconducting Optoelectronic Neurons III: Synaptic Plasticity

As a means of dynamically reconfiguring the synaptic weight of a superconducting optoelectronic loop neuron, a superconducting flux storage loop is inductively coupled to the synaptic current bias of the neuron. A standard flux memory cell is used to achieve a binary synapse, and loops capable of storing many flux quanta are used to enact multi-stable synapses. Circuits are designed to implement supervised learning wherein current pulses add or remove flux from the loop to strengthen or weaken the synaptic weight. Designs are presented for circuits with hundreds of intermediate synaptic weights between minimum and maximum strengths. Circuits for implementing unsupervised learning are modeled using two photons to strengthen and two photons to weaken the synaptic weight via Hebbian and anti-Hebbian learning rules, and techniques are proposed to control the learning rate. Implementation of short-term plasticity, homeostatic plasticity, and metaplasticity in loop neurons is discussed.

cs.NE↗