arXiv subjects

Volker Sorger

Publications and source records attributed to Volker Sorger.

5 recordsLinked to original sources

arXiv2024

Towards Reverse-Engineering the Brain: Brain-Derived Neuromorphic Computing Approach with Photonic, Electronic, and Ionic Dynamicity in 3D integrated circuits

The human brain has immense learning capabilities at extreme energy efficiencies and scale that no artificial system has been able to match. For decades, reverse engineering the brain has been one of the top priorities of science and technology research. Despite numerous efforts, conventional electronics-based methods have failed to match the scalability, energy efficiency, and self-supervised learning capabilities of the human brain. On the other hand, very recent progress in the development of new generations of photonic and electronic memristive materials, device technologies, and 3D electronic-photonic integrated circuits (3D EPIC ) promise to realize new brain-derived neuromorphic systems with comparable connectivity, density, energy-efficiency, and scalability. When combined with bio-realistic learning algorithms and architectures, it may be possible to realize an 'artificial brain' prototype with general self-learning capabilities. This paper argues the possibility of reverse-engineering the brain through architecting a prototype of a brain-derived neuromorphic computing system consisting of artificial electronic, ionic, photonic materials, devices, and circuits with dynamicity resembling the bio-plausible molecular, neuro/synaptic, neuro-circuit, and multi-structural hierarchical macro-circuits of the brain based on well-tested computational models. We further argue the importance of bio-plausible local learning algorithms applicable to the neuromorphic computing system that capture the flexible and adaptive unsupervised and self-supervised learning mechanisms central to human intelligence. Most importantly, we emphasize that the unique capabilities in brain-derived neuromorphic computing prototype systems will enable us to understand links between specific neuronal and network-level properties with system-level functioning and behavior.

cs.ET↗

arXiv2022

Integrated ultra-high-performance graphene optical modulator

With the increasing need for large volumes of data processing, transport, and storage, optimizing the trade-off between high-speed and energy consumption in today's optoelectronic devices is getting increasingly difficult. Heterogeneous material integration into Silicon- and Nitride-based photonics has showed high-speed promise, albeit at the expense of millimeter- to centimeter-scale footprints. The hunt for an electro-optic modulator that combines high speed, energy efficiency, and compactness to support high component density on-chip continues. Using a double-layer graphene optical modulator integrated on a Silicon photonics platform, we are able to achieve 60 GHz speed (3 dB roll-off), micrometer compactness, and efficiency of 2.25 fJ/bit in this paper. The electro-optic response is boosted further by a vertical distributed-Bragg-reflector cavity, which reduces the driving voltage by about 40 times while maintaining a sufficient modulation depth (5.2 dB/V). Modulators that are small, efficient, and quick allow high photonic chip density and performance, which is critical for signal processing, sensor platforms, and analog- and neuromorphic photonic processors.

physics.optics↗

arXiv2018

Energy-Quality Scaling in Analog Mesh Computers

The recent push for post-Moore computer architectures has introduced a wide variety of application-specific accelerators. One particular accelerator, the resistance network analogue, has been well received due to its ability to efficiently solve partial differential equations by eliminating the iterative stages required by today's numerical solvers. However, in the ago of programmable integrated circuits, the static nature of the resistance network analogue, and other analog mesh computers like it, has relegated it to an academic curiosity. Recent developments in materials, such as the memristor, have made the resistance network analogue viable for inclusion in future heterogeneous computer architectures. However, selection of an appropriate sized mesh to be incorporated into a computer system requires that energy-quality trade-offs are made regarding the problem size and required resolution of the solution. This paper provides an in-depth study of the scaling of analog mesh computer hardware, from the perspective of energy per bit and required resolution, introduces a metric to aid in quantifying analog mesh computers with different parameters, and introduces a method of virtualization which enables an analog mesh computer of a fixed size to approximate the calculations of a larger-sized mesh.

cs.ET↗

arXiv2018

Adaptive Mesh Refinement in Analog Mesh Computers

The call for efficient computer architectures has introduced a variety of application-specific compute engines to the heterogeneous computing landscape. One particular engine, the analog mesh computer, has been well received due to its ability to efficiently solve partial differential equations by eliminating the iterative stages common to numerical solvers. This article introduces an implementation of refinement for analog mesh computers.

math.NA↗

arXiv2017

Towards On-Chip Optical FFTs for Convolutional Neural Networks

Convolutional neural networks have become an essential element of spatial deep learning systems. In the prevailing architecture, the convolution operation is performed with Fast Fourier Transforms (FFT) electronically in GPUs. The parallelism of GPUs provides an efficiency over CPUs, however both approaches being electronic are bound by the speed and power limits of the interconnect delay inside the circuits. Here we present a silicon photonics based architecture for convolutional neural networks that harnesses the phase property of light to perform FFTs efficiently. Our all-optical FFT is based on nested Mach-Zender Interferometers, directional couplers, and phase shifters, with backend electro-optic modulators for sampling. The FFT delay depends only on the propagation delay of the optical signal through the silicon photonics structures. Designing and analyzing the performance of a convolutional neural network deployed with our on-chip optical FFT, we find dramatic improvements by up to 10^4 when compared to state-of-the-art GPUs when exploring a compounded figure-of-merit given by power per convolution over area. At a high level, this performance is enabled by mapping the desired mathematical function, an FFT, synergistically onto hardware, in this case optical delay interferometers.

cs.ET↗