Rescuing Memristor‐based Computing with Non‐linear Resistance Levels
Jilan Lin1, Lixue Xia1, Zhenhua Zhu1, Hanbo Sun1, Yi Cai1, Hui Gao1, Ming Cheng1, Xiaoming Chen2, Yu Wang1 and Huazhong Yang1
1Dept. of E.E., Tsinghua National Laboratory for Information Science and Technology (TNList), Tsinghua University, Beijing, China
2State Key Laboratory of Computer Architecture, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China
ABSTRACT
Emerging memristor devices like metal oxide resistive switching random access memory (RRAM) and memristor crossbar have shown great potential in computing matrix‐vector multiplication. However, due to the nonlinear distribution of resistance levels in memristor devices, the state‐of‐the‐art multi‐bit cell cannot accomplish the multibit computing task accurately. In this paper, we propose fault‐tolerant schemes to rescue memristor‐based computation with nonlinear resistance levels. We classify the resistance level distributions in memristor devices into three types, and the corresponding models are proposed to analyze the computation characteristics. We propose two theoretical conditions to determine if a memristor device can support multi‐bit matrix computation. For the deviated linear model, the least squares method is used to reduce the computing error. When the resistance distribution obeys the proposed power model, a logarithmic operation circuit is used to decode the multiplication results and then accomplish the computing accurately. For the exponential model, since the device cannot complete typical matrix‐vector multiplication from hardware level, we propose online and offline quantization methods to make the neural computing algorithms friendly to memristor device. Simulation results show that the root‐mean‐square error improves around 4% with the linear model and more than 99% with the power model. After quantization, the accuracy of ResNet‐18 using memristor with exponential conductance levels can be improved to the same accuracy with ideal linear devices.
