short-paper

Open access

Testing GitHub projects on custom resources using unprivileged Kubernetes runners

Authors:

Igor Sfiligoi,

Daniel McDonald,

Rob Knight,

Frank WürthweinAuthors Info & Claims

PEARC '23: Practice and Experience in Advanced Research Computing 2023: Computing for the Common Good

Pages 332 - 335

https://doi.org/10.1145/3569951.3597586

Published: 10 September 2023 Publication History

All formats PDF

Abstract

GitHub is a popular repository for hosting software projects, both due to ease of use and the seamless integration with its testing environment. Native GitHub Actions make it easy for software developers to validate new commits and have confidence that new code does not introduce major bugs. The freely available test environments are limited to only a few popular setups but can be extended with custom Action Runners. Our team had access to a Kubernetes cluster with GPU accelerators, so we explored the feasibility of automatically deploying GPU-providing runners there. All available Kubernetes-based setups, however, require cluster-admin level privileges. To address this problem, we developed a simple custom setup that operates in a completely unprivileged manner. In this paper we provide a summary description of the setup and our experience using it in the context of two Knight lab projects on the Prototype National Research Platform system.

References

[1]

KnightLab Home page, Retrieved March 30, 2023 from https://knightlab.ucsd.edu

Google Scholar

[2]

GitHub Home page, Retrieved March 30, 2023 from https://github.com

Google Scholar

[3]

Features - GitHub Actions, Retrieved March 30, 2023 from https://github.com/features/actions

Google Scholar

[4]

Igor Sfiligoi, George Armstrong, Antonio Gonzalez, Daniel McDonald, and Rob Knight. 2022. Optimizing UniFrac with OpenACC Yields Greater Than One Thousand Times Speed Increase. mSystems Vol. 7 e00028-22. https://doi.org/10.1128/msystems.00028-22

Crossref

Google Scholar

[5]

About self-hosted runners, Retrieved March 30, 2023 from https://docs.github.com/en/actions/hosting-your-own-runners/about-self-hosted-runners

Google Scholar

[6]

NRP User Guide, Retrieved March 30, 2023 from https://www.sdsc.edu/support/user_guides/nrp.html

Google Scholar

[7]

Kubernetes Home page, Retrieved March 30, 2023 from https://kubernetes.io

Google Scholar

[8]

awesome-runners repository, Retrieved March 30, 2023 from https://github.com/jonico/awesome-runners

Google Scholar

[9]

Github runners for the NRP, Retrieved March 30, 2023 from https://github.com/sfiligoi/nrp-runners

Google Scholar

[10]

Actions REST API, Retrieved March 30, 2023 from https://docs.github.com/en/rest/actions?apiVersion=2022-11-28

Google Scholar

[11]

Kubernetes Python Client, Retrieved March 30, 2023 from https://github.com/kubernetes-client/python

Google Scholar

[12]

Configure Service Accounts for Pods, Retrieved March 30, 2023 from https://kubernetes.io/docs/tasks/configure-pod-container/configure-service-account/

Google Scholar

[13]

Creating a personal access token, Retrieved March 30, 2023 from https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/creating-a-personal-access-token

Google Scholar

[14]

Nautilus Documentation - Storage Options, Retrieved March 30, 2023 from https://docs.nationalresearchplatform.org/userdocs/ storage/ceph-posix

Google Scholar

Cited By

View all

Abdulla HAlbalooshi F(2023)Automated Testing for DevOps in GitHub Environment: A Comprehensive Analysis2023 International Conference on Advanced Mechatronics, Intelligent Manufacture and Industrial Automation (ICAMIMIA)10.1109/ICAMIMIA60881.2023.10427702(833-838)Online publication date: 14-Nov-2023
https://doi.org/10.1109/ICAMIMIA60881.2023.10427702

Index Terms

Testing GitHub projects on custom resources using unprivileged Kubernetes runners
1. Applied computing
2. Software and its engineering
  1. Software creation and management

Recommendations

On Deprecated API Usages: An Exploratory Study of Top-Starred Projects on GitHub
Product-Focused Software Process Improvement
Abstract
A deprecated Application Programming Interface (API) is one that is no longer recommended to use by its original developers. While deprecated APIs (i.e., deprecated fields, methods, and classes) are still implemented, they can be removed in future ...
How often and what StackOverflow posts do developers reference in their GitHub projects?
MSR '19: Proceedings of the 16th International Conference on Mining Software Repositories

Stack Overflow (SO) is a popular Q&A forum for software developers, providing a large amount of copyable code snippets. While GitHub is an independent code collaboration platform, developers often reuse SO code in their GitHub projects. In this paper, ...
Evaluating Open Source IoT Platforms: A GitHub Analysis
SERP4IoT '24: Proceedings of the ACM/IEEE 6th International Workshop on Software Engineering Research & Practices for the Internet of Things

Internet of Things (IoT) platforms have emerged as key enablers for connected device deployment, providing core infrastructure capabilities that can be customized and extended. As IoT adoption continues accelerating across domains, understanding the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

PEARC '23: Practice and Experience in Advanced Research Computing 2023: Computing for the Common Good

July 2023

519 pages

ISBN:9781450399852

DOI:10.1145/3569951

Editors:
Robert Sinkovits
San Diego Supercomputer Center
,
Alana Romanella
University of Colorado Boulder
,
Shelley Knuth
University of Colorado Boulder
,
Ken Hackworth
Pittsburgh Supercomputing Center
,
Jeff Pummill
University of Arkansas

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 September 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Funding Sources

Conference

PEARC '23

Sponsor:

PEARC '23: Practice and Experience in Advanced Research Computing

July 23 - 27, 2023

OR, Portland, USA

Acceptance Rates

Overall Acceptance Rate 133 of 202 submissions, 66%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
153
Total Downloads

Downloads (Last 12 months)139
Downloads (Last 6 weeks)35

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Abdulla HAlbalooshi F(2023)Automated Testing for DevOps in GitHub Environment: A Comprehensive Analysis2023 International Conference on Advanced Mechatronics, Intelligent Manufacture and Industrial Automation (ICAMIMIA)10.1109/ICAMIMIA60881.2023.10427702(833-838)Online publication date: 14-Nov-2023
https://doi.org/10.1109/ICAMIMIA60881.2023.10427702

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

On Deprecated API Usages: An Exploratory Study of Top-Starred Projects on GitHub

How often and what StackOverflow posts do developers reference in their GitHub projects?

Evaluating Open Source IoT Platforms: A GitHub Analysis