Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3287624.3287667acmconferencesArticle/Chapter ViewAbstractPublication PagesaspdacConference Proceedingsconference-collections
research-article
Public Access

FACH: FPGA-based acceleration of hyperdimensional computing by reducing computational complexity

Published: 21 January 2019 Publication History

Abstract

Brain-inspired hyperdimensional (HD) computing explores computing with hypervectors for the emulation of cognition as an alternative to computing with numbers. In HD, input symbols are mapped to a hypervector and an associative search is performed for reasoning and classification. An associative memory, which finds the closest match between a set of learned hypervectors and a query hypervector, uses simple Hamming distance metric for similarity check. However, we observe that, in order to provide acceptable classification accuracy HD needs to store non-binarized model in associative memory and uses costly similarity metrics such as cosine to perform a reasoning task. This makes the HD computationally expensive when it is used for realistic classification problems. In this paper, we propose a FPGA-based acceleration of HD (FACH) which significantly improves the computation efficiency by removing majority of multiplications during the reasoning task. FACH identifies representative values in each class hypervector using clustering algorithm. Then, it creates a new HD model with hardware-friendly operations, and accordingly propose an FPGA-based implementation to accelerate such tasks. Our evaluations on several classification problems show that FACH can provide 5.9X energy efficiency improvement and 5.1X speedup as compared to baseline FPGA-based implementation, while ensuring the same quality of classification.

References

[1]
K. Kourou et al., "Machine learning applications in cancer prognosis and prediction," Computational and structural biotechnology journal, vol. 13, pp. 8--17, 2015.
[2]
F. Imani et al., "Nested gaussian process modeling for high-dimensional data imputation in healthcare systems," in IISE 2018 Conference & Expo, Orlando, FL, May, pp. 19--22, 2018.
[3]
M. Libbrecht et al., "Machine learning applications in genetics and genomics,"
[4]
M. Imani et al., "MFBO-SSM: Multi-fidelity Bayesian optimization for fast inference in state-space models," in AAAI, 2019.
[5]
Y. Kim et al., "Orchard: Visual object recognition accelerator based on approximate in-memory processing," in ICCAD, pp. 25--32, IEEE, 2017.
[6]
M. Imani et al., "Bayesian control of large mdps with unknown dynamics in data-poor environments," in Advances in Neural Information Processing Systems, 2018.
[7]
M. Imani et al., "Rapidnn: In-memory deep neural network acceleration framework," arXiv preprint arXiv:1806.05794, 2018.
[8]
Y. Kim et al., "Image recognition accelerator design using in-memory processing," IEEE Micro, 2018.
[9]
M. S. Razlighi et al., "Looknn: Neural network with no multiplication," in DATE, pp. 1775--1780, IEEE, 2017.
[10]
P. Kanerva, "Hyperdimensional computing: An introduction to computing in distributed representation with high-dimensional random vectors," Cognitive Computation, vol. 1, no. 2, pp. 139--159, 2009.
[11]
P. Kanerva, "What we mean when we say "what's the dollar of mexico?": Prototypes and mapping in concept space," in AAAI Fall Symposium: Quantum Informatics for Cognitive, Social, and Semantic Processes, pp. 2--6, 2010.
[12]
P. Kanerva et al., "Random indexing of text samples for latent semantic analysis," in CogSci, vol. 1036, Citeseer, 2000.
[13]
A. Joshi et al., "Language geometry using random indexing," Quantum Interaction 2016 Conference Proceedings, In press.
[14]
M. Imani et al., "Low-power sparse hyperdimensional encoder for language recognition," IEEE Design & Test, vol. 34, no. 6, pp. 94--101, 2017.
[15]
O. R. and others, "Sequence prediction with sparse distributed hyperdimensional coding applied to the analysis of mobile phone use patterns," IEEE Trans. Neural Netw. Learn. Syst., vol. PP, no. 99, pp. 1--12, 2015.
[16]
M. Imani et al., "Voicehd: Hyperdimensional computing for efficient speech recognition," in ICRC, pp. 1--6, IEEE, 2017.
[17]
M. Imani et al., "Hierarchical hyperdimensional computing for energy efficient classification," in Proceedings of the 55th Annual Design Automation Conference, p. 108, ACM, 2018.
[18]
Y. Kim et al., "Efficient human activity recognition using hyperdimensional computing," in Proceedings of the 8th International Conference on the Internet of Things, p. 38, ACM, 2018.
[19]
M. Imani et al., "Hdna: Energy-efficient dna sequencing using hyperdimensional computing," in Biomedical & Health Informatics (BHI), 2018 IEEE EMBS International Conference on, pp. 271--274, IEEE, 2018.
[20]
M. Imani et al., "A memory-centric acceleration of clustering using high-dimensional vectors," in 2019 Design, Automation & Test in Europe Conference & Exhibition (DATE), IEEE, 2019.
[21]
S. Han et al., "Learning both weights and connections for efficient neural network," in Advances in neural information processing systems, pp. 1135--1143, 2015.
[22]
M. Imani et al., "A binary learning framework for hyperdimensional computing," in 2019 Design, Automation & Test in Europe Conference & Exhibition (DATE), IEEE, 2019.
[23]
A. Rahimi et al., "High-dimensional computing as a nanoscalable paradigm," TCAS I, 2017.
[24]
M. Imani et al., "Exploring hyperdimensional associative memory," in HPCA, pp. 445--456, IEEE, 2017.
[25]
F. Pedregosa et al., "Scikit-learn: Machine learning in python," JMLR, vol. 12, pp. 2825--2830, 2011.
[26]
T. Feist, "Vivado design suite," White Paper, vol. 5, 2012.
[27]
"Uci machine learning repository." http://archive.ics.uci.edu/ml/datasets/ISOLET.
[28]
G. Griffin et al., "Caltech-256 object category dataset," 2007.
[29]
M. Everingham et al., "The pascal visual object classes challenge: A retrospective," IJCV, vol. 111, no. 1, pp. 98--136, 2015.
[30]
"Uci machine learning repository." https://archive.ics.uci.edu/ml/datasets/Daily+and+Sports+Activities.
[31]
A. Reiss et al., "Creating and benchmarking a new dataset for physical activity monitoring," in PETRA, p. 40, ACM, 2012.

Cited By

View all
  • (2024)SpecHD: Hyperdimensional Computing Framework for FPGA-Based Mass Spectrometry Clustering2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE58400.2024.10546776(1-6)Online publication date: 25-Mar-2024
  • (2024)Locking Decision Tree with State Permutation Obfuscation: Software Implementation2024 22nd IEEE Interregional NEWCAS Conference (NEWCAS)10.1109/NewCAS58973.2024.10666302(353-357)Online publication date: 16-Jun-2024
  • (2024)PartialHD: Toward Efficient Hyperdimensional Computing by Partial ProcessingIEEE Internet of Things Journal10.1109/JIOT.2023.328731611:1(987-994)Online publication date: 1-Jan-2024
  • Show More Cited By

Index Terms

  1. FACH: FPGA-based acceleration of hyperdimensional computing by reducing computational complexity

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      ASPDAC '19: Proceedings of the 24th Asia and South Pacific Design Automation Conference
      January 2019
      794 pages
      ISBN:9781450360074
      DOI:10.1145/3287624
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      In-Cooperation

      • IEICE ESS: Institute of Electronics, Information and Communication Engineers, Engineering Sciences Society
      • IEEE CAS
      • IEEE CEDA
      • IPSJ SIG-SLDM: Information Processing Society of Japan, SIG System LSI Design Methodology

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 21 January 2019

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. brain-inspired computing
      2. energy efficiency
      3. hyperdimensional computing
      4. machine learning

      Qualifiers

      • Research-article

      Funding Sources

      Conference

      ASPDAC '19
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 466 of 1,454 submissions, 32%

      Upcoming Conference

      ASPDAC '25

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)135
      • Downloads (Last 6 weeks)21
      Reflects downloads up to 13 Nov 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)SpecHD: Hyperdimensional Computing Framework for FPGA-Based Mass Spectrometry Clustering2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE58400.2024.10546776(1-6)Online publication date: 25-Mar-2024
      • (2024)Locking Decision Tree with State Permutation Obfuscation: Software Implementation2024 22nd IEEE Interregional NEWCAS Conference (NEWCAS)10.1109/NewCAS58973.2024.10666302(353-357)Online publication date: 16-Jun-2024
      • (2024)PartialHD: Toward Efficient Hyperdimensional Computing by Partial ProcessingIEEE Internet of Things Journal10.1109/JIOT.2023.328731611:1(987-994)Online publication date: 1-Jan-2024
      • (2024)AeneasHDC: An Automatic Framework for Deploying Hyperdimensional Computing Models on FPGAs2024 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN60899.2024.10651081(1-8)Online publication date: 30-Jun-2024
      • (2024)Brain-Inspired Hyperdimensional Computing in the Wild: Lightweight Symbolic Learning for Sensorimotor Controls of Wheeled Robots2024 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA57147.2024.10610176(5176-5182)Online publication date: 13-May-2024
      • (2023)Hardware-Aware Static Optimization of Hyperdimensional ComputationsProceedings of the ACM on Programming Languages10.1145/36227977:OOPSLA2(1-30)Online publication date: 16-Oct-2023
      • (2023)Recent Progress and Development of Hyperdimensional Computing (HDC) for Edge IntelligenceIEEE Journal on Emerging and Selected Topics in Circuits and Systems10.1109/JETCAS.2023.324276713:1(119-136)Online publication date: Mar-2023
      • (2023)Comprehensive Integration of Hyperdimensional Computing with Deep Learning towards Neuro-Symbolic AI2023 60th ACM/IEEE Design Automation Conference (DAC)10.1109/DAC56929.2023.10248004(1-6)Online publication date: 9-Jul-2023
      • (2022)Locality-Based Encoder and Model Quantization for Efficient Hyper-Dimensional ComputingIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2021.306913941:4(897-907)Online publication date: Apr-2022
      • (2022)Real-time Hyper-Dimensional Reconfiguration at the Edge using Hardware Accelerators2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)10.1109/CVPRW56347.2022.00405(3609-3617)Online publication date: Jun-2022
      • Show More Cited By

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Get Access

      Login options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media