Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3603269.3610842acmconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
poster
Public Access

Demo: First Demonstration of Real-Time Photonic-Electronic DNN Acceleration on SmartNICs

Published: 01 September 2023 Publication History

Abstract

We demonstrate Lightning, a reconfigurable photonic-electronic deep learning smartNIC that serves real-time inference requests at 4.055 GHz compute frequency. To do so, Lightning uses a novel datapath to feed traffic from the NIC into its photonic computing cores without incurring digital data movement bottlenecks. Lightning achieves this by employing a reconfigurable count-action abstraction, which decouples the compute control plane from the data plane. The count-action abstraction counts the number of operations for each computation task in the Directed Acyclic Graph (DAG). It then triggers the execution of the next task(s) as soon as the previous task is finished without interrupting the dataflow. Our prototype shows that Lightning achieves 99.25% photonic MAC accuracy. When serving real-time inference requests, Lightning accelerates the end-to-end inference latency of the LeNet DNN by 9.4× and 6.6× compared to Nvidia P4 and A100 GPUs, respectively.

References

[1]
2022. QICK: Quantum Instrumentation Control Kit . https://github.com/openquantumhardware/qick.
[2]
2022. RFSOC-PYNQ . http://www.rfsoc-pynq.io/.
[3]
2022. UltraScale+ Devices Integrated 100G Ethernet Subsystem v3.1. https://docs.xilinx.com/v/u/en-US/pg203-cmac-usplus.
[4]
2022. UltraScale™ architecture-based FPGAs Memory IP core. https://www.xilinx.com/content/dam/xilinx/support/documents/ip_documentation/ultrascale_memory_ip/v1_4/pg150-ultrascale-memory-ip.pdf.
[5]
2022. Zynq UltraScale+ RFSoC RF Data Converter v2.6 Gen 1/2/3 LogiCORE IP Product Guide. https://docs.xilinx.com/v/u/en-US/pg269-rf-data-converter.
[6]
2022. Zynq UltraScale+ RFSoC ZCU111 Evaluation Kit. https://www.xilinx.com/products/boards-and-kits/zcu111.html,.
[7]
Devin Coldewey. 2021. Lightmatter's photonic AI ambitions light up an $80M B round. https://techcrunch.com/2021/05/06/lightmatters-photonic-ai-ambitions-light-up-an-80m-b-round/.
[8]
J. Feldmann, N. Youngblood, M. Karpov, H. Gehring, X. Li, M. Stappers, M. Le Gallo, X. Fu, A. Lukashchuk, A. S. Raja, J. Liu, C. D. Wright, A. Sebastian, T. J. Kippenberg, W. H. P. Pernice, and H. Bhaskaran. 2021. Parallel convolutional processing using an integrated photonic tensor core. Nature 589, 7840 (2021), 52--58.
[9]
Heedong Goh and Andrea Alù. 2022. Nonlocal Scatterer for Compact Wave-Based Analog Computing. Phys. Rev. Lett. 128 (Feb 2022), 073201. Issue 7.
[10]
Ryan Hamerly, Liane Bernstein, Alexander Sludds, Marin Soljačić, and Dirk Englund. 2019. Large-scale optical neural networks based on photoelectric multiplication. Physical Review X 9, 2 (2019), 021032.
[11]
Philip Jacobson, Mizuki Shirao, Kerry Yu, Guan-Lin Su, and Ming C. Wu. 2022. Hybrid Convolutional Optoelectronic Reservoir Computing for Image Recognition. Journal of Lightwave Technology 40, 3 (2022), 692--699.
[12]
Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. 1998. Gradient-based learning applied to document recognition. Proc. IEEE 86, 11 (1998), 2278--2324.
[13]
Microsoft. 2023. Project AIM (Analog Iterative Machine). https://www.microsoft.com/en-us/research/project/aim/.
[14]
Alexander Sludds, Saumil Bandyopadhyay, Zaijun Chen, Zhizhen Zhong, Jared Cochrane, Liane Bernstein, Darius Bunandar, P Ben Dixon, Scott Hamilton, Matthew Streshinsky, Ari Novack, Tom Baehr-Jones, Michael Hochberg, Manya Ghobadi, Ryan Hamerly, and Dirk Englund. 2022. Delocalized Photonic Deep Learning on the Internet's Edge. Science 378, 6617 (2022), 270--276.
[15]
Alexander Sludds, Ryan Hamerly, Saumil Bandyopadhyay, Zhizhen Zhong, Zaijun Chen, Liane Bernstein, Manya Ghobadi, and Dirk Englund. 2022. Demonstration of WDM-Enabled Ultralow-Energy Photonic Edge Computing, In Optical Fiber Communication Conference (OFC) 2022. Optical Fiber Communication Conference (OFC) 2022, Th3A.3.
[16]
Xingyuan Xu, Mengxi Tan, Bill Corcoran, Jiayang Wu, Andreas Boes, Thach G Nguyen, Sai T Chu, Brent E Little, Damien G Hicks, Roberto Morandotti, et al. 2021. 11 TOPS photonic convolutional accelerator for optical neural networks. Nature 589, 7840 (2021), 44--51.
[17]
Javier Yanes. 2020. Optical Computing: Solving Problems at the Speed of Light. https://www.bbvaopenmind.com/en/technology/future/optical-computing-solving-problems-at-the-speed-of-light/.
[18]
Zhizhen Zhong, Mingran Yang, Jay Lang, Christian Williams, Liam Kronman, Alexander Sludds, Homa Esfahanizadeh, Dirk Englund, and Manya Ghobadi. 2023. Lightning: A Reconfigurable Photonic-Electronic SmartNIC for Fast and Energy-Efficient Inference. In Proceedings of the 2023 ACM SIGCOMM 2023 Conference.

Cited By

View all
  • (2024)Real-time Wideband Software-defined Radio with Python Programmability based on RFSoCProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3698855(1772-1774)Online publication date: 4-Dec-2024

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
ACM SIGCOMM '23: Proceedings of the ACM SIGCOMM 2023 Conference
September 2023
1217 pages
ISBN:9798400702365
DOI:10.1145/3603269
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s).

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 2023

Check for updates

Author Tags

  1. photonic computing
  2. network hardware design
  3. computer architecture
  4. real-time AI
  5. machine learning inference

Qualifiers

  • Poster

Funding Sources

  • DARPA
  • Air Force AI Accelerator
  • ARPA-E
  • NSF (National Science Foundation)
  • Sloan fellowship
  • the U.S. Army Research Office through the Institute for Soldier Nanotechnologies (ISN)
  • NSF Center for Quantum Networks

Conference

ACM SIGCOMM '23
Sponsor:
ACM SIGCOMM '23: ACM SIGCOMM 2023 Conference
September 10, 2023
NY, New York, USA

Acceptance Rates

Overall Acceptance Rate 462 of 3,389 submissions, 14%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)190
  • Downloads (Last 6 weeks)28
Reflects downloads up to 16 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Real-time Wideband Software-defined Radio with Python Programmability based on RFSoCProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3698855(1772-1774)Online publication date: 4-Dec-2024

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media