arXiv · 2209.06001
Integrated Artificial Neural Network with Trainable Activation Function Enabled by Topological Insulator-based Spin-Orbit Torque Devices
Abstract
Non-volatile memristors offer a salient platform for artificial neural network (ANN), but the integration of different function blocks into one hardware system remains challenging. Here we demonstrate the implementation of brain-like synaptic (SOT-S) and neuronal (SOT-N) functions in the Bi2Te3/CrTe2 heterostructure-based spin-orbit torque (SOT) device. The SOT-S unit exhibits highly linear (linearity error < 4.19%) and symmetrical long-term potentiation/depression process, resulting in better performance compared to other memristor synapses. Meanwhile, the Sigmoid-shape transition curve inherited in the SOT-N cell replaces the software-based activation function block, hence reducing the system complexity. On this basis, we employ a serial-connected, voltage-mode sensing ANN architecture to enhance the vector-matrix multiplication signal strength with low reading error of 0.61%. Furthermore, the trainable activation function of SOT-N enables the integrated SOT-ANN to execute the Batch Normalization algorithm and activation operation within one clock cycle, which bring about improved on/off-chip training performance close to the ideal baseline.
Explore related subjects
Keep this discovery
Puyang Huang, Xinqi Liu, Yue Xin, Yu Gu, Albert Lee, Zhuo Xu, Peng Chen, Yu Zhang, Weijie Deng, Guoqiang Yu, Zhongkai Liu, Qi Yao, Yumeng Yang, Zhifeng Zhu, Xufeng Kou. 2022-09-13. Integrated Artificial Neural Network with Trainable Activation Function Enabled by Topological Insulator-based Spin-Orbit Torque Devices. https://arxiv.org/abs/2209.06001
Cite the original work for its findings. Save a collection to share your selection of sources.