Improving Science Gateways usage reporting for XSEDE
Article No.: 109, Pages 1 - 4
Abstract
Science Gateways have gained wide use by research community by providing a rich and easy to use web interface to access and utilize complex cyberinfrastructure. Science Gateways are consuming an increasing proportion of computational capacity provided by XSEDE. A typical approach employed by Science Gateways is to use a single community account with a compute allocation to process compute jobs on behalf of their users. The computation usage for Science Gateways is compiled from batch job submission systems and reported by the XSEDE service providers. However, this reporting does not capture and provide any information about the user who actually initiated the computation, as the batch systems do not have record this information. To overcome this reporting limitation, Science Gateways utilize a separate pipeline to submit job-specific attributes to XSEDE, which is then later co-joined with batch system information submitted by the Service Providers to create detailed usage reports. In this article we describe improvements to the Gateway attribute reporting system, which better serves the needs of the growing number of Science Gateways by providing their operators a simpler and versatile interface to easily report a richer set of attributes and ultimately publish this information via XDMoD that enables various stake holders to assess resource utilization and their potential impact.
References
[1]
John Towns, Timothy Cockerill, Maytal Dahan, Ian Foster, Kelly Gaither, Andrew Grimshaw, Victor Hazlewood, Scott Lathrop, Dave Lifka, Gregory D. Peterson, Ralph Roskies, J. Ray Scott, and Nancy Wilkins-Diehr. 2014. XSEDE: Accelerating Scientific Discovery. Computing in Science & Engineering 16, 5 (2014), 62--74.
[2]
CIPRES. Retrieved Feb 19, 2019 from https://www.phylo.org
[3]
Miller, M.A., Pfeiffer, W., and Schwartz, T. (2010) "Creating the CIPRES Science Gateway for inference of large phylogenetic trees" in Proceedings of the Gateway Computing Environments Workshop (GCE), 14 Nov. 2010, New Orleans, LA pp 1--8.
[4]
OpenTopography: https://www.opentopography.org
[5]
Krishnan S, Crosby CJ, Nandigam V, Phan M, Cowart C, Baru C, Arrowsmith RJ. 2011. OpenTopography: A Services Oriented Architecture for Community Access to LIDAR Topography. Proceedings of the 2Nd International Conference on Computing for Geospatial Research & Applications.
[6]
NSG Portal: https://www.nsgportal.org
[7]
S Sivagnanam, A Majumdar, K Yoshimoto, V Astakhov, A Bandrowski, M. E. Martone, and N. T. Carnevale. Introducing the Neuroscience Gateway, IWSG, volume 993 of CEUR Workshop Proceedings, CEUR-WS.org, 2013.
[8]
Genepattern: http://software.broadinstitute.org/cancer/software/genepattern
[9]
I-TASSER: https://zhanglab.ccmb.med.umich.edu/I-TASSER/
[10]
Y Zhang. I-TASSER server for protein 3D structure prediction. BMC Bioinformatics, 9: 40 (2008).
[11]
GridChem: https://gridchem.org
[12]
Airavata: http://airavata.apache.org/development.html
[13]
Marru, Suresh, Marlon Pierce, Sudhakar Pamidighantam, and Chathuri Wimalasena. "Apache Airavata as a laboratory: architecture and case study for component-based gateway middleware." In Proceedings of the 1st Workshop on The Science of Cyberinfrastructure: Research, Experience, Applications and Models, pp. 19--26. ACM, 2015.
[14]
Galaxy: https://galaxyproject.org
[15]
Enis Afgan, Dannon Baker, Bérénice Batut, Marius van den Beek, Dave Bouvier, Martin Čech, John Chilton, Dave Clements, Nate Coraor, Björn Grüning, Aysam Guerler, Jennifer Hillman-Jackson, Vahid Jalili, Helena Rasche, Nicola Soranzo, Jeremy Goecks, James Taylor, Anton Nekrutenko, and Daniel Blankenberg. The Galaxy platform for accessible, reproducible and collaborative biomedical analyses: 2018 update, Nucleic Acids Research, Volume 46, Issue W1, 2 July 2018, Pages W537--W544.
[16]
GenApp: https://genapp.rocks
[17]
Emre H. Brookes. 2014. An Open Extensible Multi-Target Application Generation Tool for Simple Rapid Deployment of Multi-Scale Scientific Codes. In Proceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment (XSEDE '14). ACM, New York, NY, USA, Article 53, 6 pages.
[18]
HubZero: https://hubzero.org
[19]
M. McLennan and R. Kennell, "Hubzero: A platform for dissemination and collaboration in computational science and engineering," Computing in Science & Engineering, vol. 12, no. 2, pp. 48--53, 2010.
[20]
Nikolay A. Simakov, Joseph P. White, Robert L. DeLeon, Steven M. Gallo, Matthew D. Jones, Jeffrey T. Palmer, Benjamin Plessinger, and Thomas R. Furlani. 2018. "A Workload Analysis of NSF's Innovative HPC Resources Using XDMoD". https://arxiv.org/pdf/1801.04306
[21]
R. T. Fielding and R. N. Taylor (May 2002), "Principled Design of the Modern Web Architecture" (PDF), ACM Transactions on Internet Technology (TOIT) (New York: Association for Computing Machinery) 2 (2): 115--150
[22]
Stewart, C.A., Cockerill, T.M., Foster, I., Hancock, D., Merchant, N., Skidmore, E., Stanzione, D., Taylor, J., Tuecke, S., Turner, G., Vaughn, M., and Gaffney, N.I., Jetstream: a self-provisioned, scalable science and engineering cloud environment. 2015, In Proceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure. St. Louis, Missouri. ACM: 2792774. p. 1--8.
[23]
Kerberos: https://web.mit.edu/kerberos/
[24]
Curl: https://curl.haxx.se
Index Terms
- Improving Science Gateways usage reporting for XSEDE
Recommendations
Supporting Science Gateways Using Apache Airavata and SciGaP Services
PEARC '18: Proceedings of the Practice and Experience on Advanced Research Computing: Seamless CreativityThe Science Gateways Platform as a service (SciGaP.org) project provides a rapid development and stable hosting platform for a wide range of science gateways that focus on software as a service. Based on the open source Apache Airavata project, SciGaP ...
Comparing Open Ondemand and Jupyterhub as Interactive HPC Gateways
PEARC '23: Practice and Experience in Advanced Research Computing 2023: Computing for the Common GoodThe Minnesota Supercomputing Institute (MSI) at the University of Minnesota has adopted a goal of supporting Interactive high performance computing (HPC) as a first class service. For several years MSI has used Jupyterhub to provide a web gateway to ...
HPC-Europa single point of access as a framework for building science gateways: Research Articles
Science Gateways—Common Community Interfaces to Grid ResourcesOne of the goals of the HPC-Europa project is to provide users with a single point of access (SPA) to the resources of HPC centers in Europe. To this end, the HPC-Europa portal is being built to provide transparent, uniform, flexible and intuitive user ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © 2019 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 28 July 2019
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
PEARC '19
PEARC '19: Practice and Experience in Advanced Research Computing
July 28 - August 1, 2019
IL, Chicago, USA
Acceptance Rates
Overall Acceptance Rate 133 of 202 submissions, 66%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 68Total Downloads
- Downloads (Last 12 months)2
- Downloads (Last 6 weeks)0
Reflects downloads up to 01 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in