research-article

Building the SLATE Platform

Authors:

Lincoln Bryant,

Gabriele Carcassi,

Robert W. Gardner,

Martin Izdimirski,

Benedikt Riedel,

Ilija VukoticAuthors Info & Claims

PEARC '18: Proceedings of the Practice and Experience on Advanced Research Computing: Seamless Creativity

Article No.: 5, Pages 1 - 7

https://doi.org/10.1145/3219104.3219144

Published: 22 July 2018 Publication History

Abstract

We describe progress on building the SLATE (Services Layer at the Edge) platform. The high level goal of SLATE is to facilitate creation of multi-institutional science computing systems by augmenting the canonical Science DMZ pattern with a generic, "programmable", secure and trusted underlayment platform. This platform permits hosting of advanced container-centric services needed for higher-level capabilities such as data transfer nodes, software and data caches, workflow services and science gateway components. SLATE uses best-of-breed data center virtualization and containerization components, and where available, software defined networking, to enable distributed automation of deployment and service lifecycle management tasks by domain experts. As such it will simplify creation of scalable platforms that connect research teams, institutions and resources to accelerate science while reducing operational costs and development cycle times.

References

[1]

2005--2009. perfSONAR-PS Publications. (2005--2009). http://www.perfsonar.net/publications.html

[2]

2016. GENI Network Stitching Architecture. (2016). http://groups.geni.net/geni/wiki/GeniNetworkStitching

[3]

2018. AlienVault OSSIM. (2018). https://www.alienvault.com/products/ossim

[4]

2018. Center for Trusted Scientific Cyberinfrastructure. (2018). https://trustedci.org/

[5]

2018. Check_Mk. (2018). Retrieved 2018/03/26 from https://mathias-kettner.de/check_mk.html

[6]

2018. Cloud-Init: multi-distribution cloud initialization. (2018). http://cloudinit.readthedocs.io/en/latest/

[7]

2018. CoreOS Container Linux. (2018). https://coreos.com/os/docs/latest

[8]

2018. Cyverse life sciences platform. (2018). http://www.cyverse.org/about

[9]

2018. Docker Website. (2018). https://www.docker.com/

[10]

2018. Elastic Stack. (2018). https://www.elastic.co/guide/index.html

[11]

2018. etcd Documentation. (2018). https://coreos.com/etcd/

[12]

2018. GENI (Global Environment for Network Innovations), a virtual laboratory for networking and distributed systems research and education. (2018). https://www.geni.net/

[13]

2018. GitHub. (2018). https://github.com/

[14]

2018. The Go Programming Language. (2018). https://golang.org/

[15]

2018. Kubernetes | Production-Grade Container Orchestration. (2018). https://kubernetes.io/

[16]

2018. Kubernetes Federation Project. (2018). https://kubernetes.io/docs/concepts/cluster-administration/federation/

[17]

2018. The Kubernetes Package Manager: Kubernetes Helm. (2018). https://github.com/kubernetes/helm

[18]

2018. Minikube GitHub Repository. (2018). https://github.com/kubernetes/minikube

[19]

2018. The Pacific Research Platform. (2018). http://prp.ucsd.edu/

[20]

2018. Prometheus Monitoring and Alerting Toolkit. (2018). https://prometheus.io/

[21]

2018. RancherOS Website. (2018). https://rancher.com/rancher-os/

[22]

2018. SLATE Application Catalog. (2018). https://github.com/slateci/slate-catalog

[23]

2018. SLATE Architecture Doc. (2018). https://docs.google.com/document/d/18FlqV3WGmcz7fxr95aCUAgR-_qqzliQEAMF-AFTsuoE/edit?usp=sharing

[24]

2018. Squid. (2018). Retrieved 2018/03/26 from http://www.squid-cache.org

[25]

2018. XCache Documentation. (2018). http://slateci.io/XCache/

[26]

2018. YAML Ain't Markup Language. (2018). http://yaml.org/

[27]

E. Aprile et al. 2016. Physics reach of the XENON1T dark matter experiment. JCAP 1604, 04 (2016), 027. arXiv:physics.ins-det/1512.07501

[28]

E. Boyd A. Brown M. Grigoriev J. Metzger M. Swany M. Zekauskas B. Tierney, J. Boote and J. Zurawski. 2009. Instantiating a global network measurement framework. In SOSP Workshop on Real Overlays and Distributed Systems (ROADS'09). Big Sky, MT, USA.

[29]

Ilia Baldine, Yufeng Xin, Anirban Mandal, Paul Ruth, Chris Heerman, and Jeff Chase. 2012. ExoGENI: A Multi-domain Infrastructure-as-a-Service Testbed. In Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering. Springer Berlin Heidelberg, 97--113.

[30]

Mark Berman, Jeffrey S. Chase, Lawrence Landweber, Akihiro Nakao, Max Ott, Dipankar Raychaudhuri, Robert Ricci, and Ivan Seskar. 2014. GENI: A federated testbed for innovative network experiments. Computer Networks 61 (mar 2014), 5--23.

[31]

Brendan Burns, Brian Grant, David Oppenheimer, Eric Brewer, and John Wilkes. 2016. Borg, Omega, and Kubernetes. ACM Queue 14 (2016), 70--93. http://queue.acm.org/detail.cfm?id=2898444

Digital Library

[32]

D. Cooper, S. Santesson, S. Farrell, S. Boeyen, R. Housley, and W. Polk. 2008. Internet X.509 Public Key Infrastructure Certificate and Certificate Revocation List (CRL) Profile. RFC 5280. RFC Editor. http://www.rfc-editor.org/rfc/rfc5280.txt http://www.rfc-editor.org/rfc/rfc5280.txt.

[33]

Eli Dart, Lauren Rotman, Brian Tierney, Mary Hester, and Jason Zurawski. 2013. The Science DMZ. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '13. ACM Press.

Digital Library

[34]

Alvise Dorigo, P Elmer, Fabrizio Furano, and A Hanushevsky. 2005. XROOTD -A highly scalable architecture for data access. 4 (04 2005), 348--353.

[35]

V Garonne, R Vigne, G Stewart, M Barisits, T B eermann, M Lassnig, C Serfon, L Goossens, and A Nairz and. 2014. Rucio -- The next generation of large scale distributed system for ATLAS Data Management. Journal of Physics; Conference Series 513, 4 (jun 2014), 042021.

[36]

J. Mambretti, J. Chen, and F. Yeh 2015. Next Generation Clouds, the Chameleon Cloud Testbed, and Software Defined Networking (SDN). In 2015 International Conference on Cloud Computing Research and Innovation (ICCCRI). 73--79.

Digital Library

[37]

Nick McKeown, Tom Anderson, Hari Balakrishnan, Guru Parulkar, Larry Peterson, Jennifer Rexford, Scott Shenker, and Jonathan Turner. 2008. OpenFlow. ACM SIGCOMM Computer Communication Review 38, 2 (mar 2008), 69.

Digital Library

[38]

P M Mell and T Grance. 2011. The NIST definition of cloud computing. Technical Report.

[39]

Robert Ricci, Eric Eide, and The CloudLab Team. 2014. Introducing CloudLab: Scientific Infrastructure for Advancing Cloud Architectures and Applications. USENIX; login: 39, 6 (Dec. 2014). https://www.usenix.org/publications/login/dec14/ricci

[40]

S. Tuecke, R. Ananthakrishnan, K. Chard, M. Lidman, B. McCollam, S. Rosen, and I. Foster. 2016. Globus auth: A research identity and access management platform. In 2016 IEEE 12th International Conference on e-Science (e-Science). 203--212.

[41]

Abhishek Verma, Luis Pedrosa, Madhukar R. Korupolu, David Oppenheimer, Eric Tune, and John Wilkes. 2015. Large-scale cluster management at Google with Borg. In Proceedings of the European Conference on Computer Systems (EuroSys). Bordeaux, France.

Digital Library

Cited By

Trecakov SVon Wolff N(2024)AggieGrid: from idle PCs to a distributed High-Throughput Computing systemPractice and Experience in Advanced Research Computing 2024: Human Powered Computing10.1145/3626203.3670567(1-4)Online publication date: 17-Jul-2024
https://dl.acm.org/doi/10.1145/3626203.3670567
Aprile EAalbers JAbe KAhmed Maouloud SAlthueser LAndrieu BAngelino EAngevaare JAntochi VAntón Martin DArneodo FBalata MBaudis LBaxter ABazyk MBellagamba LBiondi RBismark ABrookes EBrown ABruenner SBruno GBudnik RBui TCai CCardoso JCassese FChiarini ACichon DCimental Chavez AColijn AConrad JCorrieri RCuenca-García JCussonneau JDadoun OD’Andrea VDecowski MDe Fazio BGangi PDiglio SDisdier JDouillet DEitel KElykov AFarrell SFerella AFerrari CFischer HFlierman MForm SFront DFulgione WFuselli CGaemers PGaior RRosso AGalloway MGao FGardner RGarroum NGlade-Beucke RGrandi LGrigat JGuan HGuerzoni MGuida MHammann RHiguera AHils CHoetzsch LHood NHowlett JHuhmann CIacovacci MIaquaniello GIven LItow YJakob JJoerg FJoy AKara MKavrigin PKazama SKobayashi MKoltman GKopec AKuger FLandsman HLang RLevinson LLi ILi SLiang SLindemann SLindner MLiu KLoizeau JLombardi FLong JLopes JMa YMacolino CMahlstedt JMancuso AManenti LMarignetti FMarrodán Undagoitia TMartella PMartens KMasbou JMasson DMasson EMastroianni SMele EMessina MMichinelli RMiuchi KMolinario AMoriyama SMorå KMosbacher YMurra MMüller JNi KNisi SOberlack UOrlandi DOthegraven RPaetsch BPalacio JParlati SPaschos PPellegrini QPeres RPeters CPienaar JPierre MPlante GPollmann TQi JQin JGarcía DRynge MShi JSingh RSanchez LSantos JSarnoff ISartorelli GSchreiner JSchulte DSchulte PSchulze Eißing HSchumann MScotto Lavina LSelvi MSemeria FShagin PShi SShockley ESilva MSimgen HStephen JStern MStillwell BTakeda ATan PTatananni DTerliuk AThers DToschi FTrinchero GTunnell CTönnies FValerius KVolta GWeinheimer CWeiss MWenz DWestermann JWittweg CWolf TWu VXing YXu DXu ZYamashita MYang LYe JYuan LZavattini GZhong MZhu T(2024)The XENONnT dark matter experimentThe European Physical Journal C10.1140/epjc/s10052-024-12982-584:8Online publication date: 7-Aug-2024
https://doi.org/10.1140/epjc/s10052-024-12982-5
Mamatas LSkaperas SSakellariou I(2024)ClusterSlice: A Zero-Touch Deployment Platform for the Edge Cloud Continuum2024 27th Conference on Innovation in Clouds, Internet and Networks (ICIN)10.1109/ICIN60470.2024.10494418(100-102)Online publication date: 11-Mar-2024
https://doi.org/10.1109/ICIN60470.2024.10494418
Show More Cited By

Index Terms

Building the SLATE Platform
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
      1. Grid computing

Recommendations

Developing Edge Services for Federated Infrastructure Using MiniSLATE
PEARC '19: Practice and Experience in Advanced Research Computing 2019: Rise of the Machines (learning)

Modern software development workflow patterns often involve the use of a developer's local machine as the first platform for testing code. SLATE mimics this paradigm with an implementation of a light-weight version, called MiniSLATE[? ], that runs ...
SLATE: Monitoring Distributed Kubernetes Clusters
PEARC '20: Practice and Experience in Advanced Research Computing 2020: Catch the Wave

The SLATE (Services Layer at the Edge) accelerates collaborative scientific computing through a secure container orchestration framework focused on the Science DMZ, enabling creation of advanced multi-institution platforms and novel science gateways. The ...
Building a Production Grid in Scandinavia

The aim of the NorduGrid project is to build and operate a production grid infrastructure in Scandinavia and Finland. By developing innovative middleware solutions, it enables a 24/7 production-level test bed. Through a common access layer, NorduGrid ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

PEARC '18: Proceedings of the Practice and Experience on Advanced Research Computing: Seamless Creativity

July 2018

652 pages

ISBN:9781450364461

DOI:10.1145/3219104

General Chair:
Sergiu Sanielevici
Pittsburgh Supercomputing Center

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 July 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

PEARC '18

PEARC '18: Practice and Experience in Advanced Research Computing

July 22 - 26, 2018

PA, Pittsburgh, USA

Acceptance Rates

PEARC '18 Paper Acceptance Rate 79 of 123 submissions, 64%;

Overall Acceptance Rate 133 of 202 submissions, 66%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
200
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)1

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Trecakov SVon Wolff N(2024)AggieGrid: from idle PCs to a distributed High-Throughput Computing systemPractice and Experience in Advanced Research Computing 2024: Human Powered Computing10.1145/3626203.3670567(1-4)Online publication date: 17-Jul-2024
https://dl.acm.org/doi/10.1145/3626203.3670567
Aprile EAalbers JAbe KAhmed Maouloud SAlthueser LAndrieu BAngelino EAngevaare JAntochi VAntón Martin DArneodo FBalata MBaudis LBaxter ABazyk MBellagamba LBiondi RBismark ABrookes EBrown ABruenner SBruno GBudnik RBui TCai CCardoso JCassese FChiarini ACichon DCimental Chavez AColijn AConrad JCorrieri RCuenca-García JCussonneau JDadoun OD’Andrea VDecowski MDe Fazio BGangi PDiglio SDisdier JDouillet DEitel KElykov AFarrell SFerella AFerrari CFischer HFlierman MForm SFront DFulgione WFuselli CGaemers PGaior RRosso AGalloway MGao FGardner RGarroum NGlade-Beucke RGrandi LGrigat JGuan HGuerzoni MGuida MHammann RHiguera AHils CHoetzsch LHood NHowlett JHuhmann CIacovacci MIaquaniello GIven LItow YJakob JJoerg FJoy AKara MKavrigin PKazama SKobayashi MKoltman GKopec AKuger FLandsman HLang RLevinson LLi ILi SLiang SLindemann SLindner MLiu KLoizeau JLombardi FLong JLopes JMa YMacolino CMahlstedt JMancuso AManenti LMarignetti FMarrodán Undagoitia TMartella PMartens KMasbou JMasson DMasson EMastroianni SMele EMessina MMichinelli RMiuchi KMolinario AMoriyama SMorå KMosbacher YMurra MMüller JNi KNisi SOberlack UOrlandi DOthegraven RPaetsch BPalacio JParlati SPaschos PPellegrini QPeres RPeters CPienaar JPierre MPlante GPollmann TQi JQin JGarcía DRynge MShi JSingh RSanchez LSantos JSarnoff ISartorelli GSchreiner JSchulte DSchulte PSchulze Eißing HSchumann MScotto Lavina LSelvi MSemeria FShagin PShi SShockley ESilva MSimgen HStephen JStern MStillwell BTakeda ATan PTatananni DTerliuk AThers DToschi FTrinchero GTunnell CTönnies FValerius KVolta GWeinheimer CWeiss MWenz DWestermann JWittweg CWolf TWu VXing YXu DXu ZYamashita MYang LYe JYuan LZavattini GZhong MZhu T(2024)The XENONnT dark matter experimentThe European Physical Journal C10.1140/epjc/s10052-024-12982-584:8Online publication date: 7-Aug-2024
https://doi.org/10.1140/epjc/s10052-024-12982-5
Mamatas LSkaperas SSakellariou I(2024)ClusterSlice: A Zero-Touch Deployment Platform for the Edge Cloud Continuum2024 27th Conference on Innovation in Clouds, Internet and Networks (ICIN)10.1109/ICIN60470.2024.10494418(100-102)Online publication date: 11-Mar-2024
https://doi.org/10.1109/ICIN60470.2024.10494418
Sim AKissel EHazen DGuok C(2024)Experiences in deploying in-network data cachesEPJ Web of Conferences10.1051/epjconf/202429507018295(07018)Online publication date: 6-May-2024
https://doi.org/10.1051/epjconf/202429507018
Mamatas LSkaperas SSakellariou I(2024)Clusterslice: Slicing resources for zero-touch Kubernetes-based experimentationFuture Generation Computer Systems10.1016/j.future.2024.06.038161(1-10)Online publication date: Dec-2024
https://doi.org/10.1016/j.future.2024.06.038
Dockendorf TBaer TJohnson D(2022)Early Experiences with Tight Integration of Kubernetes in an HPC EnvironmentPractice and Experience in Advanced Research Computing 2022: Revolutionary: Computing, Connections, You10.1145/3491418.3535150(1-4)Online publication date: 8-Jul-2022
https://dl.acm.org/doi/10.1145/3491418.3535150
Belgin MSarajlic SLara RCadonati LOtte ATaboada IBeyer GBonner NBrandon MBuffington PCoulter JJezghani ALeonard DLiu FManno PMoseley CNightingale TRahaman RSuda KWan PWeiner MWomack DZhou DMcNeill ABright NGardner RPaschos PBryant LStephen JClark JLin BTannenbaum TThain G(2022)Buzzard: Georgia Tech’s Foray into the Open Science GridPractice and Experience in Advanced Research Computing 2022: Revolutionary: Computing, Connections, You10.1145/3491418.3535135(1-5)Online publication date: 8-Jul-2022
https://dl.acm.org/doi/10.1145/3491418.3535135
Trecakov SVon Wolff N(2021)Doing more with less: Growth, improvements, and management of NMSU’s computing capabilitiesPractice and Experience in Advanced Research Computing 2021: Evolution Across All Dimensions10.1145/3437359.3465610(1-4)Online publication date: 17-Jul-2021
https://dl.acm.org/doi/10.1145/3437359.3465610
Carcassi GBreen JBryant LGardner RMckee SWeaver C(2020)SLATE: Monitoring Distributed Kubernetes ClustersPractice and Experience in Advanced Research Computing 2020: Catch the Wave10.1145/3311790.3401777(19-25)Online publication date: 26-Jul-2020
https://dl.acm.org/doi/10.1145/3311790.3401777
Musser JKissel ESwany MBreen JStidd JMcKee SMeekhof B(2020)Applying OSiRIS NMAL to Network Slices on SLATEEPJ Web of Conferences10.1051/epjconf/202024507055245(07055)Online publication date: 16-Nov-2020
https://doi.org/10.1051/epjconf/202024507055
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents