Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3489517.3530400acmconferencesArticle/Chapter ViewAbstractPublication PagesdacConference Proceedingsconference-collections
research-article
Open access

QuantumNAT: quantum noise-aware training with noise injection, quantization and normalization

Published: 23 August 2022 Publication History

Abstract

Parameterized Quantum Circuits (PQC) are promising towards quantum advantage on near-term quantum hardware. However, due to the large quantum noises (errors), the performance of PQC models has a severe degradation on real quantum devices. Take Quantum Neural Network (QNN) as an example, the accuracy gap between noise-free simulation and noisy results on IBMQ-Yorktown for MNIST-4 classification is over 60%. Existing noise mitigation methods are general ones without leveraging unique characteristics of PQC; on the other hand, existing PQC work does not consider noise effect. To this end, we present QuantumNAT, a PQC-specific framework to perform noise-aware optimizations in both training and inference stages to improve robustness. We experimentally observe that the effect of quantum noise to PQC measurement outcome is a linear map from noise-free outcome with a scaling and a shift factor. Motivated by that, we propose post-measurement normalization to mitigate the feature distribution differences between noise-free and noisy scenarios. Furthermore, to improve the robustness against noise, we propose noise injection to the training process by inserting quantum error gates to PQC according to realistic noise models of quantum hardware. Finally, post-measurement quantization is introduced to quantize the measurement outcomes to discrete values, achieving the denoising effect. Extensive experiments on 8 classification tasks using 6 quantum devices demonstrate that QuantumNAT improves accuracy by up to 43%, and achieves over 94% 2-class, 80% 4-class, and 34% 10-class classification accuracy measured on real quantum computers. The code for construction and noise-aware training of PQC is available in the TorchQuantum library.

References

[1]
Mohammad H Amin, Evgeny Andriyash, Jason Rolfe, Bohdan Kulchytskyy, and Roger Melko. 2018. Quantum boltzmann machine. Physical Review X 8, 2 (2018).
[2]
Gavin E Crooks. 2019. Gradients of parameterized quantum gates using the parameter-shift rule and gate decomposition. arXiv preprint 1905.13311 (2019).
[3]
Edward Farhi and Hartmut Neven. 2018. Classification with quantum neural networks on near term processors. arXiv preprint arXiv:1802.06002 (2018).
[4]
Song Han, Huizi Mao, and William J Dally. 2015. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 (2015).
[5]
Maxwell Henderson, Samriddhi Shakya, Shashindra Pradhan, and Tristan Cook. 2020. Quanvolutional neural networks: powering image recognition with quantum circuits. Quantum Machine Intelligence 2, 1 (2020), 1--9.
[6]
IBM. [n. d.]. IBM Quantum. ([n. d.]). https://quantum-computing.ibm.com/
[7]
Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In ICML. PMLR, 448--456.
[8]
Weiwen Jiang, Jinjun Xiong, and Yiyu Shi. 2021. A co-design framework of neural networks and quantum circuits towards quantum advantage. Nature communications 12, 1 (2021), 1--13.
[9]
Alex Krizhevsky, Vinod Nair, and Geoffrey Hinton. [n. d.]. CIFAR-10 (Canadian Institute for Advanced Research). ([n. d.]).
[10]
Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner. 1998. Gradient-based learning applied to document recognition. Proc. IEEE 86, 11 (1998), 2278--2324.
[11]
Zhiding Liang, Zhepeng Wang, Junhuan Yang, Lei Yang, Yiyu Shi, and Weiwen Jiang. 2021. Can Noise on Qubits Be Learned in Quantum Neural Network? A Case Study on QuantumFlow. In ICCAD. IEEE, 1--7.
[12]
Ji Lin, Chuang Gan, and Song Han. 2019. Defensive quantization: When efficiency meets robustness. arXiv preprint arXiv:1904.08444 (2019).
[13]
Seth Lloyd, Maria Schuld, Aroosa Ijaz, Josh Izaac, and Nathan Killoran. 2020. Quantum embeddings for machine learning. arXiv preprint 2001.03622 (2020).
[14]
K. Matsuoka. 1992. Noise injection into inputs in back-propagation learning. IEEE Transactions on Systems, Man, and Cybernetics 22, 3 (1992), 436--440.
[15]
Jarrod R McClean, Sergio Boixo, Vadim N Smelyanskiy, Ryan Babbush, and Hartmut Neven. 2018. Barren plateaus in quantum neural network training landscapes. Nature communications 9, 1 (2018), 1--6.
[16]
Kristan Temme, Sergey Bravyi, and Jay M Gambetta. 2017. Error mitigation for short-depth quantum circuits. Physical review letters 119, 18 (2017), 180509.
[17]
Hanrui Wang, Yongshan Ding, Jiaqi Gu, Yujun Lin, David Z Pan, Frederic T Chong, and Song Han. 2022. QuantumNAS: Noise-adaptive search for robust quantum circuits. HPCA (2022).
[18]
Hanrui Wang, Zirui Li, Jiaqi Gu, et al. 2022. QOC: Quantum On-Chip Training with Parameter Shift and Gradient Pruning. DAC (2022).
[19]
Hanrui Wang, Zhekai Zhang, and Song Han. 2021. Spatten: Efficient sparse attention architecture with cascade token and head pruning. In HPCA. IEEE, 97--110.
[20]
Zhepeng Wang, Zhiding Liang, Shanglin Zhou, et al. 2021. Exploration of Quantum Neural Architecture by Mixing Quantum Neuron Designs. In ICCAD. IEEE.
[21]
Robert Wille, Lukas Burgholzer, and Alwin Zulehner. 2019. Mapping quantum circuits to IBM QX architectures using the minimal number of SWAP and H operations. In DAC. IEEE, 1--6.
[22]
Han Xiao, Kashif Rasul, and Roland Vollgraf. 2017. Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms. arXiv 1708.07747 (2017).

Cited By

View all
  • (2024)A Hybrid Quantum-Classical Model for Stock Price Prediction Using Quantum-Enhanced Long Short-Term MemoryEntropy10.3390/e2611095426:11(954)Online publication date: 6-Nov-2024
  • (2024)SoK Paper: Security Concerns in Quantum Machine Learning as a ServiceProceedings of the International Workshop on Hardware and Architectural Support for Security and Privacy 202410.1145/3696843.3696846(28-36)Online publication date: 2-Nov-2024
  • (2024)Towards High Performance QNNs via Distribution-Based CNOT Gate ReductionACM Transactions on Architecture and Code Optimization10.1145/369587221:4(1-22)Online publication date: 20-Nov-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
DAC '22: Proceedings of the 59th ACM/IEEE Design Automation Conference
July 2022
1462 pages
ISBN:9781450391429
DOI:10.1145/3489517
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 August 2022

Check for updates

Qualifiers

  • Research-article

Funding Sources

Conference

DAC '22
Sponsor:
DAC '22: 59th ACM/IEEE Design Automation Conference
July 10 - 14, 2022
California, San Francisco

Acceptance Rates

Overall Acceptance Rate 1,770 of 5,499 submissions, 32%

Upcoming Conference

DAC '25
62nd ACM/IEEE Design Automation Conference
June 22 - 26, 2025
San Francisco , CA , USA

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1,212
  • Downloads (Last 6 weeks)124
Reflects downloads up to 21 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)A Hybrid Quantum-Classical Model for Stock Price Prediction Using Quantum-Enhanced Long Short-Term MemoryEntropy10.3390/e2611095426:11(954)Online publication date: 6-Nov-2024
  • (2024)SoK Paper: Security Concerns in Quantum Machine Learning as a ServiceProceedings of the International Workshop on Hardware and Architectural Support for Security and Privacy 202410.1145/3696843.3696846(28-36)Online publication date: 2-Nov-2024
  • (2024)Towards High Performance QNNs via Distribution-Based CNOT Gate ReductionACM Transactions on Architecture and Code Optimization10.1145/369587221:4(1-22)Online publication date: 20-Nov-2024
  • (2024)ProxiML: Building Machine Learning Classifiers for Photonic Quantum ComputingProceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 310.1145/3620666.3651367(834-849)Online publication date: 27-Apr-2024
  • (2024)Elivagar: Efficient Quantum Circuit Search for ClassificationProceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 210.1145/3620665.3640354(336-353)Online publication date: 27-Apr-2024
  • (2024)Quantum Multi-Agent Reinforcement Learning is All You Need: Coordinated Global Access in Integrated TN/NTN Cube-Satellite NetworksIEEE Communications Magazine10.1109/MCOM.010.240000162:10(86-92)Online publication date: Oct-2024
  • (2024)JustQ: Automated Deployment of Fair and Accurate Quantum Neural NetworksProceedings of the 29th Asia and South Pacific Design Automation Conference10.1109/ASP-DAC58780.2024.10473829(121-126)Online publication date: 22-Jan-2024
  • (2024)Diffusion-Based Quantum Error Mitigation Using Stochastic Differential Equation2024 IEEE VTS Asia Pacific Wireless Communications Symposium (APWCS)10.1109/APWCS61586.2024.10679306(1-5)Online publication date: 21-Aug-2024
  • (2024)AQUA: Analytics-driven quantum neural network (QNN) user assistance for software validationFuture Generation Computer Systems10.1016/j.future.2024.05.047159(545-556)Online publication date: Oct-2024
  • (2024)Quantum neural networks under depolarization noise: exploring white-box attacks and defensesQuantum Machine Intelligence10.1007/s42484-024-00208-66:2Online publication date: 19-Nov-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media