Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3219104.3229261acmotherconferencesArticle/Chapter ViewAbstractPublication PagespearcConference Proceedingsconference-collections
extended-abstract

Scalable Biomedical Image Synthesis with GAN

Published: 22 July 2018 Publication History

Abstract

Despite the fast-paced progress in imaging techniques made possible by ubiquitous applications of convolutional neural networks, biomedical imaging has yet to benefit from the full potential of deep learning. An unresolved bottleneck is the lack of training set data. Some experimentally obtained data are kept and preserved by individual research groups where they were produced, out of the reach of the public; more often, high cost and rare occurrences simply mean not enough such images have been made. We propose to develop deep learning based workflow to overcome this barrier. Leveraging the largest radiology data (chest X-Ray) recently published by the NIH, we train a generative adversarial network (GAN) and use it to produce photorealistic images that retain pathological quality. We also explore porting our models to a range of supercomputing platforms and systems that we have access to, including XSEDE, NERSC, OLCF, Blue Waters, NIH Biowulf etc., to investigate and compare their performance. In addition to the obvious benefits of biomedical research, our work will help understand how current supercomputing infrastructure embraces machine learning demands. Our code and enhanced data set are available through GitHub/Binder.

References

[1]
Brett Bode, Michelle Butler, Thom Dunning, Torsten Hoefler, William Kramer, William Gropp, and Wen-mei Hwu. 2013. The Blue Waters Super-System for Super-Science. In Contemporary High Performance Computing. Chapman and Hall/CRC, 339--366.
[2]
Pedro Costa, Adrian Galdran, Maria Inês Meyer, Michael David Abràmoff, Meindert Niemeijer, Ana Maria Mendonça, and Aurélio Campilho. 2017. Towards Adversarial Retinal Image Synthesis. arXiv (2017), 1--11. arXiv:1701.08974
[3]
Ij Goodfellow, J Pouget-Abadie, and Mehdi Mirza. 2014. Medical Image Synthesis with Context-Aware Generative Adversarial Networks Dong. arXiv preprint arXiv:... (2014), 1--9. arXiv:arXiv:1406.2661v1
[4]
Hayit Greenspan, Bram van Ginneken, and Ronald M. Summers. 2016. Guest Editorial Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique. IEEE Transactions on Medical Imaging 35, 5 (may 2016), 1153--1159.
[5]
Patricia Jacobs, Phillip List, Mobeen Ludin, Aaron Weeden, and Robert M. Panoff. 2014. The Blue Waters Student Internship Program: Promoting Competence and Confidence for Next Generation Researchers in High-Performance Computing. In 2014 Workshop on Education for High Performance Computing. IEEE, 49--55.
[6]
Tero Karras, Timo Aila, Samuli Laine, and Jaakko Lehtinen. 2017. Progressive Growing of GANs for Improved Quality, Stability, and Variation. CoRR (oct 2017). arXiv:1710.10196 https://arxiv.org/abs/1710.10196
[7]
William Kramer, Michelle Butler, Gregory Bauer, Kalyana Chadalavada, and Celso Mendes. 2015. Blue Waters Parallel I/O Storage Sub-system. In High Performance Parallel I/O, Prabhat and Quincey Koziol (Eds.). CRC Publications, Taylor and Francis Group, 17--32.
[8]
Roman Novak, Yasaman Bahri, Daniel A Abolafia, Jeffrey Pennington, Jascha Sohl-Dickstein, and Google Brain. 2018. SENSITIVITY AND GENERALIZATION IN NEURAL NETWORKS: AN EMPIRICAL STUDY. In ICLR 2018. https://arxiv.org/pdf/1802.08760.pdf
[9]
L G Quekel, R Goei, A G Kessels, and J M van Engelshoven. 2003. {The limited detection of lung cancer on chest X-rays}. Nederlands tijdschrift voor geneeskunde 147, 22 (may 2003), 1048--56. http://www.ncbi.nlm.nih.gov/ /12814015
[10]
Alec Radford, Luke Metz, and Soumith Chintala. 2015. Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. CoRR abs/1511.06434 (2015).
[11]
Andrei A. Rusu, Neil C. Rabinowitz, Guillaume Desjardins, Hubert Soyer, James Kirkpatrick, Koray Kavukcuoglu, Razvan Pascanu, and Raia Hadsell. 2016. Progressive Neural Networks. CoRR cs.LG (jun 2016). arXiv:1606.04671 http://arxiv.org/abs/1606.04671
[12]
G H Swingler, G du Toit, S Andronikou, L van der Merwe, and H J Zar. 2005. Diagnostic accuracy of chest radiography in detecting mediastinal lymphadenopathy in suspected pulmonary tuberculosis. Archives of Disease in Childhood 90, 11 (nov 2005), 1153--1156.
[13]
Ali Taghizadieh, Alireza Ala, Farzad Rahmani, and Akbar Nadi. 2015. Diagnostic Accuracy of Chest x-Ray and Ultrasonography in Detection of Community Acquired Pneumonia; a Brief Report. Emergency (Tehran, Iran) 3, 3 (2015), 114--6. http://www.ncbi.nlm.nih.gov/ /26495396http://www.central.nih.gov/articlerender.fcgi?artid=PMC4608340
[14]
Yaniv Taigman, Adam Polyak, and Lior Wolf. 2016. Unsupervised Cross-Domain Image Generation. CoRR (nov 2016). arXiv:1611.02200 http://arxiv.org/abs/1611.02200
[15]
Nima Tajbakhsh, Jae Y. Shin, Suryakanth R. Gurudu, R. Todd Hurst, Christopher B. Kendall, Michael B. Gotway, and Jianming Liang. 2016. Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? IEEE Transactions on Medical Imaging 35, 5 (may 2016), 1299--1312.
[16]
J. Towns, T. Cockerill, M. Dahan, I. Foster, K. Gaither, A. Grimshaw, V. Hazlewood, S. Lathrop, D. Lifka, G. D. Peterson, R. Roskies, J. R. Scott, and N. Wilkins-Diehr. 2014. XSEDE: Accelerating Scientific Discovery. Computing in Science & Engineering 16, 5 (Sept.-Oct. 2014), 62--74.
[17]
Xiaosong Wang, Yifan Peng, Le Lu, Zhiyong Lu, Mohammadhadi Bagheri, and Ronald M. Summers. 2017. ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases. CoRR abs/1705.0 (may 2017). arXiv:1705.02315 http://arxiv.org/abs/1705.02315
[18]
Jelmer M Wolterink, Anna M Dinkla, Mark H F Savenije, Peter R Seevinck, Cornells A T Van Den Berg, and Ivana Išgum. 2017. Deep MR to CT Synthesis using Unpaired Data. CoRR (2017). https://arxiv.org/pdf/1708.01155.pdf
[19]
John Wright, Student Member, Yi Ma, Senior J Member Wright, and Y Ma. 2008. Dense Error Correction via 1 -Minimization. CoRR (2008). arXiv:arXiv:0809.0199v1 https://arxiv.org/pdf/0809.0199.pdf

Cited By

View all
  • (2023)A scaling up approach: a research agenda for medical imaging analysis with applications in deep learningJournal of Experimental & Theoretical Artificial Intelligence10.1080/0952813X.2023.216572136:8(1681-1735)Online publication date: 25-Jan-2023
  • (2021)A Tour of Unsupervised Deep Learning for Medical Image AnalysisCurrent Medical Imaging Formerly Current Medical Imaging Reviews10.2174/157340561766621012715425717:9(1059-1077)Online publication date: Sep-2021

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
PEARC '18: Proceedings of the Practice and Experience on Advanced Research Computing: Seamless Creativity
July 2018
652 pages
ISBN:9781450364461
DOI:10.1145/3219104
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 July 2018

Check for updates

Author Tags

  1. Biomedical Imaging
  2. Convolutional Neural Network
  3. Deep Learning
  4. Generative Adversarial Network
  5. Image Synthesis

Qualifiers

  • Extended-abstract
  • Research
  • Refereed limited

Conference

PEARC '18

Acceptance Rates

PEARC '18 Paper Acceptance Rate 79 of 123 submissions, 64%;
Overall Acceptance Rate 133 of 202 submissions, 66%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)10
  • Downloads (Last 6 weeks)1
Reflects downloads up to 22 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2023)A scaling up approach: a research agenda for medical imaging analysis with applications in deep learningJournal of Experimental & Theoretical Artificial Intelligence10.1080/0952813X.2023.216572136:8(1681-1735)Online publication date: 25-Jan-2023
  • (2021)A Tour of Unsupervised Deep Learning for Medical Image AnalysisCurrent Medical Imaging Formerly Current Medical Imaging Reviews10.2174/157340561766621012715425717:9(1059-1077)Online publication date: Sep-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media