|
An Energy-efficient Deep Belief Network Processor Based on Heterogeneous Multi-core Architecture with Transposable Memory and On-chip Learning
点击次数：
论文类型：期刊论文
第一作者：Jiajun Wu
通讯作者：C. Wang*
合写作者：, X. Huang, L. Yang, L. Wang, J. Wang, B. Liu, G. Yu, K. S. Chong,
发表刊物：IEEE Journal on Emerging and Selected Topics in Circuits and Systems (JETCAS)
收录刊物：SCI
文献类型：J
DOI码：10.1109/JETCAS.2021.3114396
发表时间：2021-09-27
影响因子：5.88
摘要：With the growing interest of edge computing in the Internet of Things (IoT), Deep Neural Network (DNN) hardware processors/accelerators face challenges of low energy consumption, low latency, and data privacy issues. This paper proposes an energy-efficient processor design based on Deep Belief Network (DBN), which is one of the most suitable DNN models for on- chip learning. In this study, a thorough algorithm-architecture-circuit design optimization method is used for efficient design. The characteristics of data reuse and data sparsity in the DBN learning algorithm inspires this study to propose a heterogeneous multi-core architecture with local learning. In addition, novel circuits of transposable weight memory and sparse address generator are proposed to reduce weight memory access and exploit neuron state sparsity, respectively, for maximizing the energy efficiency. The DBN processor is implemented and thoroughly evaluated on Xilinx Zynq FPGA. Implementation results confirm that the proposed DBN processor has excellent energy efficiency of 45.0 pJ per neuron-weight update, which has been improved by 74% against the conventional design.