Abstract
Interactive urgent computing is a small but growing user of supercomputing resources. However there are numerous technical challenges that must be overcome to make supercomputers fully suited to the wide range of urgent workloads which could benefit from the computational power delivered by such instruments. An important question is how to connect the different components of an urgent workload; namely the users, the simulation codes, and external data sources, together in a structured and accessible manner.
In this paper we explore the role of workflows from both the perspective of marshalling and control of urgent workloads, and at the individual HPC machine level. Ultimately requiring two workflow systems, by using a space weather prediction urgent use-cases, we explore the benefit that these two workflow systems provide especially when one exploits the flexibility enabled by them interoperating.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Amstutz, P., et al.: Common workflow language, v1.0. Online. https://w3id.org/cwl/v1.0/
Korhonen, P.K., Hall, R.S., Young, N.D., Gasser, R.B.: Common workflow language (CWL)-based software pipeline for de novo genome assembly from long-and short-read data. GigaScience 8(4), giz014 (2019)
Brown, N., et al.: Utilising urgent computing to tackle the spread of mosquito-borne diseases. In: 2021 IEEE/ACM HPC for Urgent Decision Making (UrgentHPC), pp. 36–44. IEEE Computer Society, November 2021
Ramirez, J., Monedero, S., Silva, C.A., Cardil, A.: Stochastic decision trigger modelling to assess the probability of wildland fire impact. Sci. Total Environ. 694, 133505 (2019)
Krenz, L., et al.: 3D acoustic-elastic coupling with gravity: the dynamics of the 2018 Palu, Sulawesi earthquake and tsunami. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, pp. 1–14, November 2021
Brown, N., et al.: The role of interactive super-computing in using HPC for urgent decision making. In: Weiland, M., Juckeland, G., Alam, S., Jagode, H. (eds.) ISC High Performance 2019. LNCS, vol. 11887, pp. 528–540. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-34356-9_40
Ahrens, J., Geveci, B., Law, C.: ParaView: an end-user tool for large data visualization In: The Visualization Handbook, vol. 717(8) (2005)
Nash, R.W., Crusoe, M.R., Kontak, M., Brown, N.: Supercomputing with MPI meets the Common Workflow Language standards: an experience report. In: 2020 IEEE/ACM Workflows in Support of Large-Scale Science (WORKS), pp. 17–24. IEEE, November 2020
Chien, S.W., Nylund, J., Bengtsson, G., Peng, I.B., Podobas, A., Markidis, S.: sputniPIC: an implicit particle-in-cell code for multi-GPU systems. In: 2020 IEEE 32nd International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD), pp. 149–156. IEEE, September 2020
Acknowledgements
The research leading to these results has received funding from the Horizon 2020 Programme under grant agreement No. 800904. This work used the ARCHER2 UK National Supercomputing Service (https://www.archer2.ac.uk). For the purpose of open access, the author has applied a Creative Commons Attribution (CC BY) licence to any Author Accepted Manuscript version arising from this submission.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Brown, N. et al. (2022). Workflows to Driving High-Performance Interactive Supercomputing for Urgent Decision Making. In: Anzt, H., Bienz, A., Luszczek, P., Baboulin, M. (eds) High Performance Computing. ISC High Performance 2022 International Workshops. ISC High Performance 2022. Lecture Notes in Computer Science, vol 13387. Springer, Cham. https://doi.org/10.1007/978-3-031-23220-6_16
Download citation
DOI: https://doi.org/10.1007/978-3-031-23220-6_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-23219-0
Online ISBN: 978-3-031-23220-6
eBook Packages: Computer ScienceComputer Science (R0)