research-article

Cycle-Accurate NoC-based Convolutional Neural Network Simulator

Authors:

Kun-Chih Jimmy Chen,

Ting-Yi George Wang,

Yueh-Chi Andrew YangAuthors Info & Claims

COINS '19: Proceedings of the International Conference on Omni-Layer Intelligent Systems

Pages 199 - 204

https://doi.org/10.1145/3312614.3312655

Published: 05 May 2019 Publication History

Abstract

Due to the development of intelligent systems, convolutional neural network (CNN) have been applied and achieved outstanding performance in many aspects, such as patent recognition and object classification. Although CNN brings many advantages to several AI applications, the longer computing time and the larger computing power still restrict the system performance significantly. Therefore, the hardware-efficient CNN accelerator design receives much attention in recent years. However, because of the intensively complicated computation and communication among the CNN operation, the interconnection between each CNN computing unit becomes complicated as the CNN size is scaling up. On the other hand, the Network-on-chip (NoC) interconnection has been proposed to solve the complex communication problem, which is an attractive interconnection to construct the hardware-efficient CNN design. To evaluate the NoC-based CNN design in the system level, we present a cycle-accurate NoC-based convolutional neural network simulator, CNN-Noxim, in this paper. The proposed CNN-Noxim can simulate the CNN models and the classification precision of the simulation output is verified by Keras. Consequently, the proposed NoC-based CNN simulator is a high flexible neural network simulator, which facilitates the evaluation of the NoC-based convolutional neural network design.

References

[1]

A. Mello et al. 2011. ATLAS-an environment for NoC generation and evaluation. (2011).

[2]

B. Reagen et al. 2016. Minerva: Enabling low-power, highly-accurate deep neural network accelerators. (June 2016), 267--278.

Digital Library

[3]

H. Kwon et al. 2017. Rethinking the NoCs for Spatial Neural Network Accelerators. (Oct. 2017).

[4]

J.L. Holi et al. 1993. Finite precision error analysis of neural network hardware implementations. IEEE Trans. on Computers 42, 3 (March 1993), 281--290.

Digital Library

[5]

J. Liu et al. 2016. Scalable Networks-on-Chip Interconnected Architecture for Astrocyte-Neuron Networks. IEEE Transactions on Circuits and Systems I: Regular Papers 63, 12 (Dec. 2016), 2290--2303.

[6]

K.C. Chen et al. 2018. NN-Noxim: High-Level Cycle-Accurate NoC-based Neural Networks Simulator. (Oct. 2018).

[7]

K. Simonyan et al. 2015. Very deep convolutional networks for large-scale image recognition. (April 2015).

[8]

N. Jiang et al. 2013. A detailed and flexible cycle-accurate network-on-chip simulator. (April 2013), 86--96.

[9]

N. Wang et al. 2004. Application of Matlab/NNTool in Neural Network System. Computer Simulation 4 (2004), 125--128.

[10]

P. C. Holanda et al. 2016. DHyANA: A NoC-based Neural Network Hardware Architecture. (Feb. 2016), 177--180.

[11]

R. Nakano et al. 2017. GAN Playground - Experiment with GAN in your browser. (2017).

[12]

V. Cataniz et al. 2016. Cycle-Accurate Network on Chip Simulation with Noxim. ACM Transactions on Modeling and Computer Simulation (TOMACS) 27, 1 (Aug. 2016).

Digital Library

[13]

V. Sze et al. 2017. Efficient Processing of Deep Neural Networks: A Tutorial and Survey. Proc. IEEE 105, 12 (Dec. 2017).

[14]

X. Liu et al. 2018. Neu-NoC: A high-efficient interconnection network for accelerated neuromorphic systems. (Feb. 2018), 141--146.

Digital Library

[15]

Y. LeCun et al. 1998. Gradient-based learning applied to document recognition. Proc. IEEE 86, 11 (1998), 2278--2324.

[16]

D. Smilkov and S. Carter. 2017. A Neural Network Playground - TensorFlow. (2017).

Cited By

Ouyang YWang JSun CWang QLiang H(2023)URMP: using reconfigurable multicast path for NoC-based deep neural network acceleratorsThe Journal of Supercomputing10.1007/s11227-023-05255-779:13(14827-14847)Online publication date: 12-Apr-2023
https://doi.org/10.1007/s11227-023-05255-7
Xue YJi JLi XLi SZhou SCheng TLi LFu Y(2022)AOME: Autonomous Optimal Mapping Exploration Using Reinforcement Learning for NoC-based Accelerators Running Neural Networks2022 IEEE 40th International Conference on Computer Design (ICCD)10.1109/ICCD56317.2022.00060(364-367)Online publication date: Oct-2022
https://doi.org/10.1109/ICCD56317.2022.00060
Ouyang YTang FHu CZhou WWang Q(2021)MMNNNMicroprocessors & Microsystems10.1016/j.micpro.2021.10424285:COnline publication date: 1-Sep-2021
https://dl.acm.org/doi/10.1016/j.micpro.2021.104242
Show More Cited By

Index Terms

Cycle-Accurate NoC-based Convolutional Neural Network Simulator
1. Computer systems organization
  1. Architectures
2. Computing methodologies
  1. Artificial intelligence

Recommendations

A NoC-based simulator for design and evaluation of deep neural networks
Abstract
The astonishing development in the field of artificial neural networks (ANN) has brought significant advancement in many application domains, such as pattern recognition, image classification, and computer vision. ANN imitates neuron ...
Streamlined network-on-chip for multicore embedded architectures
ARCS'12: Proceedings of the 25th international conference on Architecture of Computing Systems

MPSoCs are becoming complex systems incorporating a large number of compute cores as well as various accelerators and application specific units. To handle the communication in MPSoCs, the Network-on-Chip (NoC) concept has been proposed as a versatile ...
Using NoC routers as processing elements
SBCCI '09: Proceedings of the 22nd Annual Symposium on Integrated Circuits and System Design: Chip on the Dunes

The integration technology has increased at the point where the development of Multi-Core processor architectures is a market reality nowadays. In this scenario, the interconnection network has a critical function when the number of cores increases, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

COINS '19: Proceedings of the International Conference on Omni-Layer Intelligent Systems

May 2019

241 pages

ISBN:9781450366403

DOI:10.1145/3312614

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Ministry of Science and Technology, Taiwan

Conference

COINS '19

COINS '19: INTERNATIONAL CONFERENCE ON OMNI-LAYER INTELLIGENT SYSTEMS

May 5 - 7, 2019

Crete, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
483
Total Downloads

Downloads (Last 12 months)78
Downloads (Last 6 weeks)7

Reflects downloads up to 24 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ouyang YWang JSun CWang QLiang H(2023)URMP: using reconfigurable multicast path for NoC-based deep neural network acceleratorsThe Journal of Supercomputing10.1007/s11227-023-05255-779:13(14827-14847)Online publication date: 12-Apr-2023
https://doi.org/10.1007/s11227-023-05255-7
Xue YJi JLi XLi SZhou SCheng TLi LFu Y(2022)AOME: Autonomous Optimal Mapping Exploration Using Reinforcement Learning for NoC-based Accelerators Running Neural Networks2022 IEEE 40th International Conference on Computer Design (ICCD)10.1109/ICCD56317.2022.00060(364-367)Online publication date: Oct-2022
https://doi.org/10.1109/ICCD56317.2022.00060
Ouyang YTang FHu CZhou WWang Q(2021)MMNNNMicroprocessors & Microsystems10.1016/j.micpro.2021.10424285:COnline publication date: 1-Sep-2021
https://dl.acm.org/doi/10.1016/j.micpro.2021.104242
Ghosh ARoy APatra RMondal H(2021)Designing Efficient NoC-Based Neural Network Architectures for Identification of Epileptic SeizureSN Computer Science10.1007/s42979-021-00756-92:5Online publication date: 30-Jun-2021
https://doi.org/10.1007/s42979-021-00756-9
Reshadi MMirmahaleh S(2021)Mapping and virtual neuron assignment algorithms for MAERI acceleratorThe Journal of Supercomputing10.1007/s11227-021-03893-3Online publication date: 25-May-2021
https://doi.org/10.1007/s11227-021-03893-3
Mirmahaleh SReshadi MBagherzadeh NKhademzadeh A(2021)Data scheduling and placement in deep learning acceleratorCluster Computing10.1007/s10586-021-03355-8Online publication date: 10-Jul-2021
https://doi.org/10.1007/s10586-021-03355-8
Ghosh ARoy APatra RMai AMondal H(2020)An Efficient NoC-based ANN Framework for Epileptic Seizure Recognition2020 IEEE International Symposium on Smart Electronic Systems (iSES) (Formerly iNiS)10.1109/iSES50453.2020.00028(75-80)Online publication date: Dec-2020
https://doi.org/10.1109/iSES50453.2020.00028
Amin WHussain FAnjum SKhan SBaloch NNain ZKim S(2020)Performance Evaluation of Application Mapping Approaches for Network-on-Chip DesignsIEEE Access10.1109/ACCESS.2020.29826758(63607-63631)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.2982675
(Jimmy) Chen KEbrahimi MWang TYang YLiao Y(2020)A NoC-based simulator for design and evaluation of deep neural networksMicroprocessors & Microsystems10.1016/j.micpro.2020.10314577:COnline publication date: 1-Sep-2020
https://dl.acm.org/doi/10.1016/j.micpro.2020.103145
Chen KEbrahimi MWang TYang YBogdan PSilvano C(2019)NoC-based DNN acceleratorProceedings of the 13th IEEE/ACM International Symposium on Networks-on-Chip10.1145/3313231.3352376(1-8)Online publication date: 17-Oct-2019
https://dl.acm.org/doi/10.1145/3313231.3352376

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents