Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3449301.3449342acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicraiConference Proceedingsconference-collections
research-article

A Research and Design of Lightweight Convolutional Neural Networks Accelerator Based on Systolic Array Structure

Published: 09 June 2021 Publication History

Abstract

With the wide application of convolutional neural networks(CNNs) in the field of artificial intelligence, more attention has been paid to the architecture design of CNNs accelerator. But even so, there is little research on hardware acceleration of light-weight CNNs, and there is a lack of systematic and in-depth exploration of lightweight CNNs accelerator design space. In this paper, we propose a design scheme for the lightweight CNNs accelerator based on the systolic array structure. Taking the MobileNet series, the typical representative of lightweight CNNs, as the test benchmark, we carry out detailed experiments and research analysis on the accelerator performance under different data-flow modes and different core computing array scales. Based on the systematic and comprehensive experiments, we provide powerful experimental data supporting and scientific guidance for the design space of the systolic array based lightweight CNNs accelerator and the trade-off of various indicators including operational efficiency, acceleration ratio, cycle time and so on, which makes up for the blank of current research in this field, and makes great convenience for subsequent designers to develop lightweight CNNs accelerators. Through our research, MobileNet V1 is speeded up nearly 1.2 times under certain conditions.

References

[1]
LIU S,DU Z,TAO J,et al. Cambricon: an instruction set architecture for neural networks . ACM Sigarch Co-mputer Architecture News,2016,44(3),393-405. DOI= https://doi.org/10.1109/ISCA.2016.42.
[2]
H T Kung, C E Leiserson. Systolic Arrays.1978.
[3]
Y . H. Chen, T. Krishna, J. S. Emer, and V . Sze, “Eyeriss: An energy-efficient reconfigurable accelerator for deep convolutional neural net-works,” IEEE J. Solid-State Circuits, vol. 52, no. 1, pp. 127–138,Jan. 2017. DOI= https://ieeexplore.ieee.org/document/7738524.
[4]
Hossam O. Ahmeda, Maged Ghoneimaa, and Mohamed Dessouky, “Systolic-based pyramidal neuron accelerator blocks for convolutional neural network,” in Microelectronics Journal, May, 2019, pp16-22. DOI= https://doi.org/10.1016/j.mejo.2019.04.017.
[5]
Ananda Samajdar, Yuhao Zhu, Paul Whatmough, Matthew Mattina, Tushar Krishna . SCALE-Sim: Systolic CNN Accelerator Simulator, arXiv, 2019.
[6]
L. Bai, Y . Zhao, and X. Huang, “A CNN accelerator on FPGA using depthwise separable convolution,” IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 65, no. 10, pp. 1415–1419, Aug. 2018. DOI= https://doi.org/10.1109/TCSII.2018.2865896.
[7]
R. Zhao, X. Niu, and W. Luk, “Automatic optimising CNN with depth-wise separable convolution on FPGA,” in Proc. ACM/SIGDA FPGA, 2018, p. 285. DOI= https://doi.org/10.1145/3174243.3174959.
[8]
Y . LeCun, K. Kavukcuoglu, and C. Farabet, “Convolutional net-works and applications in vision,” in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), May/Jun. 2010, pp. 253–256. DOI= https://doi.org/10.1109/ISCAS.2010.5537907.
[9]
Andrew G. Howard, M. Zhu, B. Chen, MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications, Apr, 2017.
[10]
M. Sandler, A.Howard, M. Zhu, A.Zhmoginov, L. Chen, MobileNetV2: Inverted Residuals and Linear Bottlenecks, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018, pp. 4510-4520.
[11]
A. Howard, M. Sandler, G. Chu, L. Chen, B. Chen, M. Tan, W. Wang, Y. Zhu, R. Pang, V. Vasudevan, Quoc V. Le, H. Adam, Searching for MobileNetV3, May, 2019.

Index Terms

  1. A Research and Design of Lightweight Convolutional Neural Networks Accelerator Based on Systolic Array Structure
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICRAI '20: Proceedings of the 6th International Conference on Robotics and Artificial Intelligence
    November 2020
    288 pages
    ISBN:9781450388597
    DOI:10.1145/3449301
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 09 June 2021

    Check for updates

    Author Tags

    1. CNNs accelerator
    2. Hardware architecture
    3. High performance computing
    4. Lightweight CNNs

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ICRAI 2020

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 89
      Total Downloads
    • Downloads (Last 12 months)27
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 16 Nov 2024

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media