Abstract
There is an unprecedented promise of enhanced capabilities for federations of leadership computing systems and experimental science facilities by leveraging software technologies for fast and efficient operations. These federations seek to unify different science instruments, both computing and experimental, to effectively support science users and operators to execute complex workflows. The FedScI project addresses the software challenges associated with the formation and operation of federated environments by leveraging recent advances in containerization of software and softwarization of hardware. We propose a software framework to streamline the federation usage by science users and it’s provisioning and operations by facility providers. A distinguishing element of our work is the support for improved interaction between experimental devices, such as beam-line instruments, and more traditional high-performance computing resources, including compute, network, storage systems. We present guiding principles for the software framework and highlight portions of a current prototype implementation. We describe our science use case involving neutron imaging beam-lines (SNAP/BL-3, Imaging/CG-1D) at the Spallation Neutron Source and High Flux Isotope Reactor facilities at Oak Ridge National Laboratory. Additionally, we detail plans for a more direct instrument interaction within a federated environment, which could enable more advanced workflows with feedback loops to shorten the time to science.
T. Naughton et al.—Contributed Equally.
This manuscript has been co-authored by UT-Battelle, LLC, under contract DE-AC05-00OR22725 with the US Department of Energy (DOE). The US government retains and the publisher, by accepting the article for publication, acknowledges that the US government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this manuscript, or allow others to do so, for US government purposes. DOE will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan (http://energy.gov/downloads/doe-public-access-plan).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Some EPICS deployments in USA include: SNS, ANL/APS, BNL, SLAC, LANL, JLAB/CEBAF, LBNL, Fermilab D0, Keck & Gemini Telescopes; and some international deployments: Australian Square-Kilometer Array Pathfinder (ASKAP) and Synchroton; Canadian Light Source; DESY, BESSY, in Germany; PSI/SLS in Switzerland; Ganil, SACLAY in France; Diamond Light Source and ISIS in England; KEK, J-Parc in Japan; IHEP in China; NSRRC in Taiwan; PLS in South Korea.
References
ADIOS: Adaptable IO System. https://www.olcf.ornl.gov/center-projects/adios
EPICS - Experimental Physics and Industrial Control System. https://epics.anl.gov/
Globus - Data Transfer with Globus. https://www.globus.org/data-transfer
Neutron Imaging Facility (Imaging | CG-1D | HFIR). https://neutrons.ornl.gov/imaging
iMars3D: Preprocessing and reconstruction for the Neutron Imaging Beam Lines. https://github.com/ornlneutronimaging/iMars3D.git
Liu, L., Özsu, M.T. (eds.): Encyclopedia of Database Systems. Springer, New York (2018). https://doi.org/10.1007/978-1-4614-8265-9
Spallation Neutrons and Pressure Diffractometer (SNAP | BL-3 | SNS). https://neutrons.ornl.gov/snap
Acknowledgements
This research used resources of the Oak Ridge Leadership Computing Facility at the Oak Ridge National Laboratory, which is supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC05-00OR22725. This research is support by the ORNL Laboratory Directed Research & Development program.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply
About this paper
Cite this paper
Naughton, T. et al. (2020). Software Framework for Federated Science Instruments. In: Nichols, J., Verastegui, B., Maccabe, A.‘., Hernandez, O., Parete-Koon, S., Ahearn, T. (eds) Driving Scientific and Engineering Discoveries Through the Convergence of HPC, Big Data and AI. SMC 2020. Communications in Computer and Information Science, vol 1315. Springer, Cham. https://doi.org/10.1007/978-3-030-63393-6_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-63393-6_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63392-9
Online ISBN: 978-3-030-63393-6
eBook Packages: Computer ScienceComputer Science (R0)