LightBulb: A Photonic-Nonvolatile-Memory-based Accelerator for Binarized Convolutional Neural Networks
Farzaneh Zokaee1,a, Qian Lou1,b, Nathan Youngblood2, Weichen Liu3, Yiyuan Xie4 and Lei Jiang1,c
1Indiana University Bloomington, USA
afzokaee@iu.edu
blouqian@iu.edu
cjiang60@iu.edu
2University of Pittsburgh, USA
nathan.youngblood@pitt.edu
3Nanyang Technological University, Singapore
liu@ntu.edu.sg
4Southwest University, China
yyxie@swu.edu.edu
ABSTRACT
Although Convolutional Neural Networks (CNNs) have demonstrated the state-of-the-art inference accuracy in various intelligent applications, each CNN inference involves millions of expensive floating point multiply-accumulate (MAC) operations. To energy-efficiently process CNN inferences, prior work proposes an electro-optical accelerator to process powerof- 2 quantized CNNs by electro-optical ripple-carry adders and optical binary shifters.The electro-optical accelerator also uses SRAM registers to store intermediate data. However, electrooptical ripple-carry adders and SRAMs seriously limit the operating frequency and inference throughput of the electrooptical accelerator, due to the long critical path of the adder and the long access latency of SRAMs. In this paper, we propose a photonic nonvolatile memory (NVM)-based accelerator, Light-Bulb, to process binarized CNNs by high frequency photonic XNOR gates and popcount units. LightBulb also adopts photonic racetrack memory to serve as input/output registers to achieve high operating frequency. Compared to prior electro-optical accelerators, on average, LightBulb improves the CNN inference throughput by 17× ∼ 173× and the inference throughput per Watt by 17.5× ∼ 660×.
Keywords: Optical Accelerator, Photonic Racetrack Memory, Photonic Phase Change Memory, Binarized Neural Network.
