research-article

ExaScale high performance computing in the square kilometer array

Authors:

P. Chris Broekema,

Rob V. van Nieuwpoort,

Henri E. BalAuthors Info & Claims

Astro-HPC '12: Proceedings of the 2012 workshop on High-Performance Computing for Astronomy Date

Pages 9 - 16

https://doi.org/10.1145/2286976.2286982

Published: 18 June 2012 Publication History

Abstract

Next generation radio telescopes will require tremendous amounts of compute power. With the current state of the art, the Square Kilometer Array (SKA), currently entering its pre-construction phase, will require in excess of one ExaFlop/s in order to process and reduce the massive amount of data generated by the sensors. The nature of the processing involved means that conventional high performance computing (HPC) platforms are not ideally suited. Consequently, the SKA project requires active and intensive involvement from both the high performance computing research community, as well as industry, in order to make sure a suitable system is available when the telescope is built. In this paper we present a first analysis of the processing required, and a tool that will facilitate future analysis and external involvement.

References

[1]

P. Alexander et al. Analysis of requirements derived from the DRM, August 2011. SKA Software and Computing CoDR.

[2]

H.R. Butcher. LOFAR: First of a New Generation of Radio Telescopes. Proceedings of the SPIE, 5489:537--544, October 2004.

[3]

casacore. http://code.google.com/p/casacore/.

[4]

P. Dewdney et al. SKA phase 1: Preliminary system description, 2010.

[5]

FITS world coordinate systems. http://www.atnf.csiro.au/people/mcalabre/WCS/.

[6]

The Green500 list. http://www.green500.org.

[7]

SKA Science Working Group. The square kilometre array design reference mission: SKA phase 1 v. 2.0, September 2011.

[8]

Ben Humphreys and Chris Broekema. HPC technology roadmap. Technical report, SPDO, December 2011. SKA Software and Computing CoDR.

[9]

Kamil Iskra, John W. Romein, Kazutomo Yoshii, and Pete Beckman. ZOID: I/O-Forwarding Infrastructure for Petascale Architectures. In ACM Symposium on Principles and Practice of Parallel Programming (PPoPP'08), pages 153--162, Salt Lake City, UT, February 2008.

Digital Library

[10]

Peter M. Kogge. Energy at exaflops. Supercomputing, 2009. The ExaScale Panel.

[11]

The LINPACK benchmark. http://www.netlib.org/benchmark/hpl/.

[12]

Steve McConnell. Code Complete, Second Edition. Microsoft Press, Redmond, WA, USA, 2004.

Digital Library

[13]

Jan David Mol and John W. Romein. The LOFAR Beam Former: Implementation and Performance Analysis. In EuroPar'11, volume LNCS 6853, Part II, pages 328--339, Bordeaux, France, August 2011.

Digital Library

[14]

R. V. van Nieuwpoort and J. W. Romein. Correlating Radio Astronomy Signals with Many-Core Hardware. International Journal of Parallel Processing, 1(39):88--114, February 2011.

[15]

Peter M. Kogge et al. ExaScale Computing Study: Technology Challenges in Achieving ExaScale Systems, September 2008.

[16]

John W. Romein. FCNP: Fast I/O on the Blue Gene/P. In Parallel and Distributed Processing Techniques and Applications (PDPTA'09), volume 1, pages 225--231, Las Vegas, NV, July 2009.

[17]

John W. Romein, P. Chris Broekema, Jan David Mol, and Rob V. van Nieuwpoort. The LOFAR Correlator: Implementation and Performance Analysis. In ACM Symposium on Principles and Practice of Parallel Programming (PPoPP'10), pages 169--178, Bangalore, India, January 2010.

Digital Library

[18]

Winston Royce. Managing the development of large software systems. volume 26 of WESCON. IEEE, August 1970.

[19]

ASC Sequoia Benchmark Codes. http://asc.llnl.gov/sequoia/benchmarks/.

[20]

A SKA analysis tool. http://www.exaska.org.

[21]

The Top500 list. http://www.top500.org.

[22]

Kazutomo Yoshii, Kamil Iskra, Harish Naik, Pete Beckman, and P. Chris Broekema. Performance and Scalability Evaluation of 'Big Memory' on Blue Gene Linux. International Journal of High Performance Computing Applications, 25:148--160, May 2011. first published online on May 12, 2010.

Digital Library

Cited By

Cernuda JYe JKougkas ASun X(2024)HStream: A hierarchical data streaming engine for high-throughput scientific applicationsProceedings of the 53rd International Conference on Parallel Processing10.1145/3673038.3673150(231-240)Online publication date: 12-Aug-2024
https://dl.acm.org/doi/10.1145/3673038.3673150
Falls MBernardello RCastrillo MAcosta MLlort JGalí M(2022)Use of genetic algorithms for ocean model parameter optimisation: a case study using PISCES-v2_RC for North Atlantic particulate organic carbonGeoscientific Model Development10.5194/gmd-15-5713-202215:14(5713-5737)Online publication date: 22-Jul-2022
https://doi.org/10.5194/gmd-15-5713-2022
Gillani GKokkeler APalumbo FBecchi MSchulz MSato K(2019)Go green radio astronomy: Approximate Computing Perspective: Opportunities and ChallengesProceedings of the 16th ACM International Conference on Computing Frontiers10.1145/3310273.3323427(300-301)Online publication date: 30-Apr-2019
https://dl.acm.org/doi/10.1145/3310273.3323427
Show More Cited By

Index Terms

ExaScale high performance computing in the square kilometer array
1. Applied computing
  1. Physical sciences and engineering
    1. Astronomy

Recommendations

InfiniCortex: present and future invited paper
CF '16: Proceedings of the ACM International Conference on Computing Frontiers

Commencing in June 2014, A*STAR Computational Resource Centre (A*CRC) team in Singapore, together with dozens of partners world-wide, have been building the InfiniCortex. Four concepts are integrated together to realise InfiniCortex:

i) High bandwidth (~...
Novelties in Teaching High Performance Computing
IPDPSW '15: Proceedings of the 2015 IEEE International Parallel and Distributed Processing Symposium Workshop

High Performance Computing (HPC) involves solving intensive problems beyond desktop computing. Teaching HPC to undergraduate students requires special consideration of taking students comprehension to clusters of parallel machines - which can solve ...
Making a case for distributed file systems at Exascale
LSAP '11: Proceedings of the third international workshop on Large-scale system and application performance

Exascale computers will enable the unraveling of significant scientific mysteries. Predictions are that 2019 will be the year of exascale, with millions of compute nodes and billions of threads of execution. The current architecture of high-end ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

Astro-HPC '12: Proceedings of the 2012 workshop on High-Performance Computing for Astronomy Date

June 2012

56 pages

ISBN:9781450313384

DOI:10.1145/2286976

General Chairs:
Ana Lucia Varbanescu
Delft University of Technology, The Netherlands
,
Rob van Nieuwpoort
VU University Amsterdam, The Netherlands
,
Simon Portegies Zwart
Leiden Observatory, The Netherlands
,
Program Chair:
Ana Lucia Varbanescu
Delft University of Technology, The Netherlands

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

University of Arizona: University of Arizona
SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 June 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HPDC'12

Sponsor:

University of Arizona
SIGARCH

HPDC'12: The 21st International Symposium on High-Performance Parallel and Distributed Computing

June 18, 2012

Delft, The Netherlands

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
273
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)2

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cernuda JYe JKougkas ASun X(2024)HStream: A hierarchical data streaming engine for high-throughput scientific applicationsProceedings of the 53rd International Conference on Parallel Processing10.1145/3673038.3673150(231-240)Online publication date: 12-Aug-2024
https://dl.acm.org/doi/10.1145/3673038.3673150
Falls MBernardello RCastrillo MAcosta MLlort JGalí M(2022)Use of genetic algorithms for ocean model parameter optimisation: a case study using PISCES-v2_RC for North Atlantic particulate organic carbonGeoscientific Model Development10.5194/gmd-15-5713-202215:14(5713-5737)Online publication date: 22-Jul-2022
https://doi.org/10.5194/gmd-15-5713-2022
Gillani GKokkeler APalumbo FBecchi MSchulz MSato K(2019)Go green radio astronomy: Approximate Computing Perspective: Opportunities and ChallengesProceedings of the 16th ACM International Conference on Computing Frontiers10.1145/3310273.3323427(300-301)Online publication date: 30-Apr-2019
https://dl.acm.org/doi/10.1145/3310273.3323427
Devarajan HKougkas ASun X(2019)An Intelligent, Adaptive, and Flexible Data Compression Framework2019 19th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID)10.1109/CCGRID.2019.00019(82-91)Online publication date: May-2019
https://doi.org/10.1109/CCGRID.2019.00019
Scheers BBloemen SMühleisen HSchellart Pvan Elteren AKersten MGroot P(2018)Fast in-database cross-matching of high-cadence, high-density source lists with an up-to-date sky modelAstronomy and Computing10.1016/j.ascom.2018.02.00623(27-39)Online publication date: Apr-2018
https://doi.org/10.1016/j.ascom.2018.02.006
Liew CAtkinson MGalea MAng TMartin PHemert J(2016)Scientific WorkflowsACM Computing Surveys10.1145/301242949:4(1-39)Online publication date: 12-Dec-2016
https://dl.acm.org/doi/10.1145/3012429
Markidis SPeng IIakymchuk RLaure EKestor GGioiosa R(2016)A Performance Characterization of Streaming Computing on SupercomputersProcedia Computer Science10.1016/j.procs.2016.05.30180:C(98-107)Online publication date: 1-Jun-2016
https://dl.acm.org/doi/10.1016/j.procs.2016.05.301
Price DClark MBarsdell BBabich RGreenhill L(2016)Optimizing performance-per-watt on GPUs in high performance computingComputer Science - Research and Development10.1007/s00450-015-0300-531:4(185-193)Online publication date: 1-Nov-2016
https://dl.acm.org/doi/10.1007/s00450-015-0300-5
Sclocco ABal HNieuwpoort R(2015)Finding Pulsars in Real-TimeProceedings of the 2015 IEEE 11th International Conference on e-Science10.1109/eScience.2015.11(98-107)Online publication date: 31-Aug-2015
https://dl.acm.org/doi/10.1109/eScience.2015.11
Sclocco Avan Leeuwen JBal Hvan Nieuwpoort R(2015)A real-time radio transient pipeline for ARTS2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP)10.1109/GlobalSIP.2015.7418239(468-472)Online publication date: Dec-2015
https://doi.org/10.1109/GlobalSIP.2015.7418239
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents