Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3316781.3317785acmconferencesArticle/Chapter ViewAbstractPublication PagesdacConference Proceedingsconference-collections
research-article
Public Access

BRIC: Locality-based Encoding for Energy-Efficient Brain-Inspired Hyperdimensional Computing

Published: 02 June 2019 Publication History

Abstract

Brain-inspired Hyperdimensional (HD) computing is a new computing paradigm emulating the neuron's activity in high-dimensional space. The first step in HD computing is to map each data point into high-dimensional space (e.g., 10,000), which requires the computation of thousands of operations for each element of data in the original domain. Encoding alone takes about 80% of the execution time of training. In this paper, we propose BRIC, a fully binary Brain-Inspired Classifier based on HD computing for energy-efficient and high-accuracy classification. BRIC introduces a novel encoding module based on random projection with a predictable memory access pattern which can efficiently be implemented in hardware. BRIC is the first HD-based approach which provides data projection with a 1:1 ratio to the original data and enables all training/inference computation to be performed using binary hypervectors. To further improve BRIC efficiency, we develop an online dimension reduction approach which removes insignificant hypervector dimensions during training. Additionally, we designed a fully pipelined FPGA implementation which accelerates BRIC in both training and inference phases. Our evaluation of BRIC a wide range of classification applications show that BRIC can achieve 64.1× and 9.8× (43.8× and 6.1×) energy efficiency and speed up as compared to baseline HD computing during training (inference) while providing the same classification accuracy.

References

[1]
J. Gubbi et al., "Internet of things (iot): A vision, architectural elements, and future directions," Future generation computer systems, vol. 29, no. 7, pp. 1645--1660, 2013.
[2]
M. Hassanalieragh et al., "Health monitoring and management using internet-of-things (iot) sensing with cloud-based processing: Opportunities and challenges," in IEEE SCC, pp. 285--292, IEEE, 2015.
[3]
Y. Sun et al., "Internet of things and big data analytics for smart and connected communities," IEEE Access, vol. 4, pp. 766--773, 2016.
[4]
S. Sicari et al., "Security, privacy and trust in internet of things: The road ahead," Computer networks, vol. 76, pp. 146--164, 2015.
[5]
P. Kanerva, "Hyperdimensional computing: An introduction to computing in distributed representation with high-dimensional random vectors," Cognitive Computation, vol. 1, no. 2, pp. 139--159, 2009.
[6]
O. Rasanen and J. Saarinen, "Sequence prediction with sparse distributed hyperdimensional coding applied to the analysis of mobile phone use patterns," IEEE Transactions on Neural Networks and Learning Systems, vol. PP, no. 99, pp. 1--12, 2015.
[7]
M. Imani et al., "Voicehd: Hyperdimensional computing for efficient speech recognition," in ICRC, pp. 1--6, IEEE, 2017.
[8]
A. Rahimi et al., "A robust and energy-efficient classifier using brain-inspired hyperdimensional computing," in ISLPED, pp. 64--69, ACM, 2016.
[9]
M. Imani et al., "Hierarchical hyperdimensional computing for energy efficient classification," in DAC, p. 108, ACM, 2018.
[10]
Y. Kim et al., "Efficient human activity recognition using hyperdimensional computing," in IoT, p. 38, ACM, 2018.
[11]
P. Kanerva et al., "Random indexing of text samples for latent semantic analysis," in CogSci, vol. 1036, Citeseer, 2000.
[12]
M. Imani et al., "Hdcluster: An accurate clustering using brain-inspired high-dimensional computing," in DATE, 2019.
[13]
M. Imani et al., "Hdna: Energy-efficient dna sequencing using hyperdimensional computing," in IEEE BHI, pp. 271--274, IEEE, 2018.
[14]
M. Imani et al., "A framework for collaborative learning in secure high-dimensional space," in IEEE CLOUD, pp. 1--6, IEEE, 2019.
[15]
A. Rahimi et al., "Hyperdimensional biosignal processing: A case study for emg-based hand gesture recognition," in ICRC, pp. 1--8, IEEE, 2016.
[16]
T. Wu et al., "Brain-inspired computing exploiting carbon nanotube fets and resistive ram: Hyperdimensional computing case study," in IEEE ISSCC, IEEE, 2018.
[17]
H. Li et al., "Hyperdimensional computing with 3d vrram in-memory kernels: Device-architecture co-design for energy-efficient, error-resilient language recognition," in IEDM, pp. 16--1, IEEE, 2016.
[18]
S. Gupta et al., "Felix: Fast and energy-efficient logic in memory," in IEEE/ACM ICCAD, pp. 1--7, IEEE, 2018.
[19]
M. Imani et al., "Fach: Fpga-based acceleration of hyperdimensional computing by reducing computational complexity," in ASPDAC, pp. 493--498, ACM, 2019.
[20]
S. Salamat et al., "F5-hd: Fast flexible fpga-based framework for refreshing hyperdimensional computing," in FPGA, pp. 53--62, ACM, 2019.
[21]
M. Imani et al., "Exploring hyperdimensional associative memory," in HPCA, pp. 445--456, IEEE, 2017.
[22]
M. Imani et al., "A binary learning framework for hyperdimensional computing," in DATE, 2019.
[23]
M. Imani et al., "Sparsehd: Algorithm-hardware co-optimization for efficient high-dimensional computing," in IEEE FCCM, pp. 1--6, IEEE, 2019.
[24]
M. Schmuck et al., "Hardware optimizations of dense binary hyperdimensional computing: Rematerialization of hypervectors, binarized bundling, and combinational associative memory," arXiv preprint arXiv:1807.08583, 2018.
[25]
T. I. Cannings et al., "Random-projection ensemble classification," Journal of the Royal Statistical Society, vol. 79, no. 4, pp. 959--1035, 2017.
[26]
T. Feist, "Vivado design suite," White Paper, vol. 5, 2012.
[27]
"Uci machine learning repository." http://archive.ics.uci.edu/ml/datasets/ISOLET.
[28]
"Uci learning repository." https://archive.ics.uci.edu/ml/datasets/Daily+and+Sports+Activities.
[29]
G. Griffin, A. Holub, and P. Perona, "Caltech-256 object category dataset," 2007.
[30]
"Uci machine learning repository." https://archive.ics.uci.edu/ml/datasets/cardiotocography.
[31]
"Uci machine learning repository." https://archive.ics.uci.edu/ml/datasets/detection_of_IoT_botnet_attacks_N_BaIoT.

Cited By

View all
  • (2024)Hyperdimensional computing with holographic and adaptive encoderFrontiers in Artificial Intelligence10.3389/frai.2024.13719887Online publication date: 9-Apr-2024
  • (2024)OTFGEncoder - HDC: Hardware-efficient Encoding Techniques for Hyperdimensional Computing2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE58400.2024.10546523(1-2)Online publication date: 25-Mar-2024
  • (2024)Hyperdimensional computing: A fast, robust, and interpretable paradigm for biological dataPLOS Computational Biology10.1371/journal.pcbi.101242620:9(e1012426)Online publication date: 24-Sep-2024
  • Show More Cited By

Index Terms

  1. BRIC: Locality-based Encoding for Energy-Efficient Brain-Inspired Hyperdimensional Computing

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      DAC '19: Proceedings of the 56th Annual Design Automation Conference 2019
      June 2019
      1378 pages
      ISBN:9781450367257
      DOI:10.1145/3316781
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      In-Cooperation

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 02 June 2019

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Brain-inspired computing
      2. Energy efficiency
      3. Hyperdimensional computing
      4. Machine learning

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Funding Sources

      Conference

      DAC '19
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 1,770 of 5,499 submissions, 32%

      Upcoming Conference

      DAC '25
      62nd ACM/IEEE Design Automation Conference
      June 22 - 26, 2025
      San Francisco , CA , USA

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)439
      • Downloads (Last 6 weeks)113
      Reflects downloads up to 13 Nov 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Hyperdimensional computing with holographic and adaptive encoderFrontiers in Artificial Intelligence10.3389/frai.2024.13719887Online publication date: 9-Apr-2024
      • (2024)OTFGEncoder - HDC: Hardware-efficient Encoding Techniques for Hyperdimensional Computing2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE58400.2024.10546523(1-2)Online publication date: 25-Mar-2024
      • (2024)Hyperdimensional computing: A fast, robust, and interpretable paradigm for biological dataPLOS Computational Biology10.1371/journal.pcbi.101242620:9(e1012426)Online publication date: 24-Sep-2024
      • (2024) E 3 HDC: Energy Efficient Encoding for Hyper-Dimensional Computing on Edge Devices 2024 34th International Conference on Field-Programmable Logic and Applications (FPL)10.1109/FPL64840.2024.00045(274-280)Online publication date: 2-Sep-2024
      • (2024)PAAP-HD: PIM-Assisted Approximation for Efficient Hyper-Dimensional Computing2024 29th Asia and South Pacific Design Automation Conference (ASP-DAC)10.1109/ASP-DAC58780.2024.10473823(46-51)Online publication date: 22-Jan-2024
      • (2024)CoR-FHD: Communication-Efficient and Robust Federated Hyperdimensional Computing for Activity RecognitionWireless Artificial Intelligent Computing Systems and Applications10.1007/978-3-031-71467-2_8(87-98)Online publication date: 14-Nov-2024
      • (2023)Adversarial-HD: Hyperdimensional Computing Adversarial Attack Design for Secure Industrial Internet of ThingsProceedings of Cyber-Physical Systems and Internet of Things Week 202310.1145/3576914.3587484(1-6)Online publication date: 9-May-2023
      • (2023) HyperSpikeASIC : Accelerating Event-Based Workloads With HyperDimensional Computing and Spiking Neural Networks IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2023.326416742:11(3997-4010)Online publication date: Nov-2023
      • (2023)Testing and Enhancing Adversarial Robustness of Hyperdimensional ComputingIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2023.326312042:11(4052-4064)Online publication date: Nov-2023
      • (2023)Design of Ultracompact Content Addressable Memory Exploiting 1T-1MTJ CellIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2022.320451542:5(1450-1462)Online publication date: May-2023
      • Show More Cited By

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Get Access

      Login options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media