research-article

TeraGrid resource selection tools: a road test

Authors:

Subhashini Sivagnanam,

Kenneth YoshimotoAuthors Info & Claims

TG '10: Proceedings of the 2010 TeraGrid Conference

Article No.: 20, Pages 1 - 6

https://doi.org/10.1145/1838574.1838594

Published: 02 August 2010 Publication History

Abstract

On a grid of computers, users often must decide between individual machines for job submission. Usually, the goal is to minimize time-to-completion. Several tools are available on TeraGrid to help users make this decision. In this paper, we use these tools to perform actual job submissions on TeraGrid machines. We evaluate the time-to-job-start effectiveness of these tools.

References

[1]

Nurmi, D., Mandal, A., Koelbel, C., Brevik, J., Wolski, R., Kennedy, K., Evaluation of a Workflow Scheduler Using Integrated Performance Modeling and Batch Queue Wait Time Prediction, Proceedings of SuperComputing 2006, November 2006, Tampa, FL

Digital Library

[2]

Nurmi, D., Brevik, J., Wolski, R., Queue Bounds Estimation from Time Series, 13th Workshop on Job Scheduling Strategies for Parallel Processing, June 2007, Seattle, WA

Digital Library

[3]

Casanova, H., Benefits and Drawbacks of Redundant Batch Requests, Journal of Grid Computing, 5(2), 235--250, 2007Tavel, P. 2007 Modeling and Simulation Design. AK Peters Ltd.

Digital Library

[4]

Frey, J., Tannenbaum, T., Foster, I., Livny, M., and Tuecke, S., Condor-G: A computation management agent for multi-institutional grids. In Proceedings of the Tenth IEEE Symposium on High Performance Distributed Computing (HPDC), pages 7--9, San Francisco, California, August 2001.

Digital Library

[5]

Brevik, J., Nurmi, D., Wolski, R., Predicting Bounds on Queueing Delay for Batch- scheduled Parallel Machines, Proceedings of ACM Principles and Practices of Parallel Programming (PPoPP) 2006, March, 2006, New York, NY

Digital Library

[6]

Lingrand, D., Montagnat, J., Glatard, T., Modeling user submission strategies on production grids. In: International Symposium on High Performance Distributed Computing (HPDC'09), Munchen, Germany (June 2009)

Digital Library

[7]

Lobo, D. A. and Pangrie, B. M. 1991. Redundant Operator Creation: A Scheduling Optimization Technique. Proceedings of the 28^th ACM/IEEE Design Automation Conference, 775--778. DOI= http://doi.acm.org/10.1145/127601.127768

Digital Library

[8]

Smith, W., Foster, I., and Taylor, V., Using Run-Time Predictions to Estimate Queue Wait Times and Improve Scheduler Performance. In D. G. Feitelson and L. Rudolph, editor, Proc. of 5th Workshop on Job Scheduling Strategies for Parallel Processing, volume 1659 of Lecture Notes in Computer Science, pages 202--219. Springer Verlag, 1999.

Digital Library

[9]

Subramani, V., Kettimuthu, R., Srinivasan, S., and Sadayappan, S., Distributed Job Scheduling on Computational Grids using Multiple Simultaneous Requests, in Proc. of 11th IEEE Symposium on High Performance Distributed Computing (HPDC 2002), pp.359--366, Edinburgh, Scotland, July 2002.

Digital Library

[10]

TeraGrid Metascheduling Page: https://www.teragrid.org/web/user-support/meta

[11]

QBETS webpage: http://nws.cs.ucsb.edu/ewiki/nws.php?id=Batch+Queue+Prediction

[12]

MCP webpage: http://www.sdsc.edu/scheduler/mcp/mcp.html

[13]

Condor-G webpage: http://www.cs.wisc.edu/condor/condorg/

[14]

TeraGrid HPC resources: https://www.teragrid.org/web/usersupport/compute_resources

[15]

Karnak from TeraGrid Round Table discussion: http://www.teragridforum.org/mediawiki/images/6/6f/QPred_11_2009_RoundTable.ppt

[16]

TeraGrid Portal: https://portal.teragrid.org/hpc-queue-prediction

Cited By

Souza APelckmans KGhoshal DRamakrishnan LTordsson JParashar MVlassov VIrwin DMohror K(2020)ASA - The Adaptive Scheduling ArchitectureProceedings of the 29th International Symposium on High-Performance Parallel and Distributed Computing10.1145/3369583.3392693(161-165)Online publication date: 23-Jun-2020
https://dl.acm.org/doi/10.1145/3369583.3392693
Zentner LClark SMadhavan KShivarajapura SFarnsworth VKlimeck GTowns JBrown SKatz D(2011)Automated grid probe system to improve end-to-end grid reliability for a science gatewayProceedings of the 2011 TeraGrid Conference: Extreme Digital Discovery10.1145/2016741.2016789(1-6)Online publication date: 18-Jul-2011
https://dl.acm.org/doi/10.1145/2016741.2016789

Index Terms

TeraGrid resource selection tools: a road test
1. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles
        Organizing principles for web applications

Recommendations

Efficient extension of gLite VOs with BOINC based desktop grids

The paper describes the results of the EU FP7 EDGI project concerning how to extend gLite VOs with public and institutional BOINC desktop grids. Beyond simply showing the integration architecture components and services, the main emphasis is on how this ...
Adding Standards Based Job Submission to a Commodity Grid Broker
ESCIENCE '08: Proceedings of the 2008 Fourth IEEE International Conference on eScience

The Condor matchmaker provides a powerful mechanism for matching together both users job requirements and resource providers requirements in such a manner that not only is a paring selected which satisfies both requirements but is optimal for both. This ...
GCM: a grid configuration manager for heterogeneous grid environments

Deploying grid technologies by distributing an application over several machines is widely emerging for large scientific simulations. While in the last couple of years distributed simulations were often executed on a pure demonstration level, currently ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

TG '10: Proceedings of the 2010 TeraGrid Conference

August 2010

177 pages

ISBN:9781605588186

DOI:10.1145/1838574

Co-chairs:
Richard Moore
SDSC
,
Daniel S. Katz
UC/ANL
,
Program Chair:
Shawn Brown
PSC

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Carnegie Mellon University: Carnegie Mellon University

In-Cooperation

SIGAPP: ACM Special Interest Group on Applied Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 August 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

TG '10

Sponsor:

Carnegie Mellon University

TG '10: TeraGrid 2010

August 2 - 5, 2010

Pennsylvania, Pittsburgh

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
97
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Souza APelckmans KGhoshal DRamakrishnan LTordsson JParashar MVlassov VIrwin DMohror K(2020)ASA - The Adaptive Scheduling ArchitectureProceedings of the 29th International Symposium on High-Performance Parallel and Distributed Computing10.1145/3369583.3392693(161-165)Online publication date: 23-Jun-2020
https://dl.acm.org/doi/10.1145/3369583.3392693
Zentner LClark SMadhavan KShivarajapura SFarnsworth VKlimeck GTowns JBrown SKatz D(2011)Automated grid probe system to improve end-to-end grid reliability for a science gatewayProceedings of the 2011 TeraGrid Conference: Extreme Digital Discovery10.1145/2016741.2016789(1-6)Online publication date: 18-Jul-2011
https://dl.acm.org/doi/10.1145/2016741.2016789

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents