arXiv subjects

Oluwaseun Adewunmi Alo

Publications and source records attributed to Oluwaseun Adewunmi Alo.

4 recordsLinked to original sources

arXiv2024

Scaling Analog Photonic Accelerators for Byte-Size, Integer General Matrix Multiply (GEMM) Kernels

Deep Neural Networks (DNNs) predominantly rely on General Matrix Multiply (GEMM) kernels, which are often accelerated using specialized hardware architectures. Recently, analog photonic GEMM accelerators have emerged as a promising alternative, offering vastly superior speed and energy efficiency compared to traditional electronic accelerators. However, these photonic cannot support wider than 4-bit integer operands due to their inherent trade-offs between analog dynamic range and parallelism. This is often inadequate for DNN training as at least 8-bit wide operands are deemed necessary to prevent significant accuracy drops. To address these limitations, we introduce a scalable photonic GEMM accelerator named SPOGA. SPOGA utilizes enhanced features such as analog summation of homodyne optical signals and in-transduction positional weighting of operands. By employing an extended optical-analog dataflow that minimizes overheads associated with bit-sliced integer arithmetic, SPOGA supports byte-size integer GEMM kernels, achieving significant improvements in throughput, latency, and energy efficiency. Specifically, SPOGA demonstrates up to 14.4$\times$, 2$\times$, and 28.5$\times$ improvements in frames-per-second (FPS), FPS/Watt, and FPS/Watt/mm$^2$ respectively, compared to existing state-of-the-art photonic solutions.

cs.AR↗

arXiv2024

Grey Level Co-occurrence Matrix (GLCM) Based Second Order Statistics for Image Texture Analysis

Grey Level Co-occurrence Matrix and Grey Level Difference Vector are described and computed for twenty four 128 x 128 x 3 test images along horizontal, vertical and diagonal directions. Second order image statistics such as Contrast, Dissimilarity, Homogeneity (Inverse Difference Moment), Angular Second Moment, Energy, Maximum Probability, Entropy, Mean, Standard Deviation and Correlation are computed and studied. Grey Level Co-occurrence Matrix (GLCM) and Grey Level Difference Vector (GLDV) are described and computed for twenty four 128 x 128 x 3 test images along horizontal, vertical and diagonal directions. Second order image statistics such as Contrast, Dissimilarity, Homogeneity (Inverse Difference Moment), Angular Second Moment (ASM), Energy, Maximum Probability, Entropy, Mean, Standard Deviation and Correlation are computed and studied. The results show that smooth images have lower Contrast values and higher Probability of Occurrence of Difference of same range as rough images having higher Contrast values and lower Probability of Occurrence. The degree of smoothness or roughness of an image may not be exactly the same along horizontal, vertical and diagonal directions. There are significant correlation between Dissimilarity & Contrast, Homogeneity & Contrast, Entropy & Contrast, Energy & Contrast, Standard Deviation & Contrast, Correlation & Contrast, and Probability of Occurrence of Difference of 0-19 & Contrast with correlation coefficients of 0.9322, -0.5011, 0.6681, -0.4255, -0.4914, 0.5428, and -0.8346 respectively.

eess.IV↗

arXiv2024

A Comparative Analysis of Microrings Based Incoherent Photonic GEMM Accelerators

Several microring resonator (MRR) based analog photonic architectures have been proposed to accelerate general matrix-matrix multiplications (GEMMs) in deep neural networks with exceptional throughput and energy efficiency. To implement GEMM functions, these MRR-based architectures, in general, manipulate optical signals in five different ways: (i) Splitting (copying) of multiple optical signals to achieve a certain fan-out, (ii) Aggregation (multiplexing) of multiple optical signals to achieve a certain fan-in, (iii) Modulation of optical signals to imprint input values onto analog signal amplitude, (iv) Weighting of modulated optical signals to achieve analog input-weight multiplication, (v) Summation of optical signals. The MRR-based GEMM accelerators undertake the first four ways of signal manipulation in an arbitrary order ignoring the possible impact of the order of these manipulations on their performance. In this paper, we conduct a detailed analysis of accelerator organizations with three different orders of these manipulations: (1) Modulation-Aggregation-Splitting-Weighting (MASW), (2) Aggregation-Splitting-Modulation-Weighting (ASMW), and (3) Splitting-Modulation-Weighting-Aggregation (SMWA). We show that these organizations affect the crosstalk noise and optical signal losses in different magnitudes, which renders these organizations with different levels of processing parallelism at the circuit level, and different magnitudes of throughput and energy-area efficiency at the system level. Our evaluation results for four CNN models show that SMWA organization achieves up to 4.4$\times$, 5$\times$, and 5.2$\times$ better throughput, energy efficiency, and area-energy efficiency, respectively, compared to ASMW and MASW organizations on average.

cs.AR↗

arXiv2024

A Low-Dissipation and Scalable GEMM Accelerator with Silicon Nitride Photonics

Over the past few years, several microring resonator (MRR)-based analog photonic architectures have been proposed to accelerate general matrix-matrix multiplications (GEMMs), which are found in abundance in deep learning workloads.These architectures have dramatically grown in popularity because they offer exceptional throughput and energy efficiency compared to their electronic counterparts. However, such architectures, due to their traditional realization based on the silicon-on-insulator (SOI) material platform, face two shortcomings. First, the high-index contrast of the SOI platform incurs high scattering losses, which mandates the provisioning of high optical input power.Second, SOI waveguides are susceptible to two-photon absorption, which can incur substantial optical signal losses at moderate-to-high signal fan-in. These shortcomings have severely detrimental effects on the achievable parallelism, throughput, and energy efficiency of SOI MRR-based GEMM accelerators. To address these shortcomings, we present a novel Silicon Nitride (SiN)-Based Photonic GEMM Accelerator called SiNPhAR. SiNPhAR architecture employs SiN-based active and passive devices to implement analog GEMM functions. Since the SiN material exhibits lower index contrast and no TPA, the optical signal losses in our SiNPhAR architecture are very low. This advantage significantly enhances the achievable processing parallelism, throughput, and energy efficiency of SiNPhAR architecture, compared to SOI-based photonic GEMM accelerators from prior work. We quantify and compare these benefits of SiNPhAR architecture via our cross-layer evaluation for a benchmark workload comprising four modern deep neural network models. From the system-level performance analysis, SiNPhAR demonstrates at least 1.7x better throughput FPS while consuming at least 2.8x better energy efficiency (FPS/W) than prior SOI-based GEMM accelerators.

cs.AR↗