Benchmarking Deep Neural Network Training Using Multi- and Many-Core Processors

1. Czarnul, P.: Benchmarking parallel chess search in Stockfish on Intel Xeon and Intel Xeon Phi processors. In: Shi, Y., et al. (eds.) ICCS 2018. LNCS, vol. 10862, pp. 457–464. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93713-7_40

   Chapter  Google Scholar 

2. Czarnul, P.: Benchmarking performance of a hybrid Intel Xeon/Xeon Phi system for parallel computation of similarity measures between large vectors. Int. J. Parallel Program. 45, 1091–1107 (2017). https://doi.org/10.1007/s10766-016-0455-0

   Article  Google Scholar 

3. Krzywaniak, A., Proficz, J., Czarnul, P.: Analyzing energy/performance trade-offs with power capping for parallel applications on modern multi and many core processors. In: FedCSIS, pp. 339–346 (2018)

   Google Scholar 

4. Shi, S., Wang, Q., Xu, P., Chu, X.: Benchmarking state-of-the-art deep learning software tools. In: 2016 7th International Conference on Cloud Computing and Big Data (CCBD), pp. 99–104 (2016)

   Google Scholar 

5. Serpa, M.S., Krause, A.M., Cruz, E.H.M., Navaux, P.O.A., Pasin, M., Felber, P.: Optimizing machine learning algorithms on multi-core and many-core architectures using thread and data mapping. In: 2018 26th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP), pp. 329–333 (2018)

   Google Scholar 

6. Alzantot, M., Wang, Y., Ren, Z., Srivastava, M.B.: RSTensorFlow: GPU enabled TensorFlow for deep learning on commodity Android devices. In: MobiSys, pp. 7–12 (2017). https://doi.org/10.1145/3089801.3089805

7. Awan, A.A., Subramoni, H., Panda, D.K.: An in-depth performance characterization of CPU- and GPU-based DNN training on modern architectures. In: Proceedings of the Machine Learning on HPC Environments, MLHPC 2017, pp. 8:1–8:8. ACM, New York (2017)

   Google Scholar 

8. Dong, S., Kaeli, D.: DNNMark: a deep neural network benchmark suite for GPUs. In: Proceedings of the General Purpose GPUs, GPGPU 2010, pp. 63–72. ACM, New York (2017)

   Google Scholar 

9. Karki, A., Keshava, C.P., Shivakumar, S.M., Skow, J., Hegde, G.M., Jeon, H.: Tango: a deep neural network benchmark suite for various accelerators (2019)

   Google Scholar 

10. Barney, L.: Can FPGAs beat GPUs in accelerating next-generation deep learning? (2017). The Next Platform. https://www.nextplatform.com/2017/03/21/can-fpgas-beat-gpus-accelerating-next-generation-deep-learning/

11. Sharma, H., et al.: From high-level deep neural models to FPGAs. In: 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO), pp. 1–12 (2016)

    Google Scholar 

12. Seppälä, S.: Performance of neural network image classification on mobile CPU and GPU. Master’s thesis, Aalto University (2018)

    Google Scholar 

13. Ignatov, A., et al.: AI benchmark: running deep neural networks on Android smartphones. CoRR abs/1810.01109 (2018)

    Google Scholar 

14. Vanhoucke, V., Senior, A., Mao, M.Z.: Improving the speed of neural networks on CPUs. In: Deep Learning and Unsupervised Feature Learning Workshop, NIPS 2011 (2011)

    Google Scholar 

15. Wang, Y., Wei, G., Brooks, D.: Benchmarking TPU, GPU, and CPU platforms for deep learning. CoRR abs/1907.10701 (2019)

    Google Scholar 

16. Czarnul, P., Proficz, J., Krzywaniak, A.: Energy-aware high-performance computing: survey of state-of-the-art tools, techniques, and environments. Sci. Program. 2019 (2019). Article ID. 8348791. https://doi.org/10.1155/2019/8348791

Download references