research-article

Modeling user submission strategies on production grids

Authors:

Diane Lingrand,

Johan Montagnat,

Tristan GlatardAuthors Info & Claims

HPDC '09: Proceedings of the 18th ACM international symposium on High performance distributed computing

Pages 121 - 130

https://doi.org/10.1145/1551609.1551633

Published: 11 June 2009 Publication History

Abstract

Production-grid users experience many system faults as well as high and variable latencies due to the scale, complexity and sharing of such infrastructures. To improve performance, they adopt different submission strategies, that are potentially aggressive for the infrastructure.

This work studies the impact of three different strategies. It is based on a probabilistic modeling of these strategies which are evaluated according to their performance, measured as the reduction of the latency expectation, and the infrastructure overhead, measured as the additional number of submitted jobs. A strategy cost criterion is then derived.

Experiments are performed using real workload traces collected from the EGEE production infrastructure. Under these conditions, a good balance between high performance and low overhead can be found.

References

[1]

J. Andreeva, S. Campana, F. Fanzago, and J. Herrala. High-Energy Physics on the Grid: the ATLAS and CMS Experience. Journal of Grid Computing (JGC), 6(1):3--13, Mar. 2008.

[2]

G. Aparicio, I. Blanquer Espert, and V. Hernández Garcıa. A Highly Optimized Grid Deployment: the Metagenomic Analysis Example. In Global Healthgrid: e-Science Meets Biomedical INformatics (Healthgrid'08), pages 105--115, Chicago, USA, May 2008. Healthgrid, IOS Press.

[3]

H. Casanova. Benefits and Drawbacks of Redundant Batch Requests. Journal of Grid Computing (JGC), 2(5):888--903, 2007.

[4]

K. Christodoulopoulos, V. Gkamas, and E. A. Varvarigos. Statistical Analysis and Modeling of Jobs in a Grid Environment. Journal of Grid Computing (JGC), 6(1):77--101, Mar. 2008.

[5]

D. Feitelson. Workload modeling for performance evaluation, pages 114--141. LNCS vol 2459, Sept. 2002.

Digital Library

[6]

C. Germain, C. Loomis, J. T. Moscicki, and R. Texier. Scheduling for Responsive Grids. Journal of Grid Computing (JGC), 6(1):15--27, Mar. 2008.

[7]

T. Glatard, D. Lingrand, J. Montagnat, and M. Riveill. Impact of the execution context on Grid job performances. In International Workshop on Context-Awareness and Mobility in Grid Computing (WCAMG'07), pages 713--718, May 2007.

Digital Library

[8]

T. Glatard, J. Montagnat, and X. Pennec. Optimizing jobs timeouts on clusters and production grids. In CCGrid'07, pages 100--107, Rio de Janeiro, May 2007.

Digital Library

[9]

N. Jacq, V. Breton, H.-Y. Chen, L.-Y. Ho, M. Hofmann, V. Kasam, H.-C. Lee, Y. Legré, S. C. Lin, A. Maaý, E. Medernach, I. Merelli, L. Milanesi, G. Rastelli, M. Reichstadt, J. Salzeman, H. Schwichtenberg, Y.-T. Wu, and M. Zimmermann. Virtual screening on large scale grids. Parallel Computing, 23(4-5):289--301, 2007.

Digital Library

[10]

H. Li, D. Groep, and L. Walters. Workload Characteristics of a Multi-cluster Supercomputer. In Job Scheduling Strategies for Parallel Processing, pages 176--193. Springer Verlag, 2004.

Digital Library

[11]

D. Lingrand, J. Montagnat, and T. Glatard. Estimation of latency on production grid over several weeks. In ICT4Health, Manila, Philippines, Feb. 2008.

[12]

M. Niinimaki, X. Zhou, A. Depeursinge, A. Geissbuhler, and H. Muller. Building a Community Grid for Medical Image Analysis inside a Hospital, a Case Study. In S. Olabarriaga, D. Lingrand, and J. Montagnat, editors, MICCAI-Grid Workshop, pages 3--12, New York, NY, USA, Sept. 2008.

[13]

M. J. Pitkanen, X. Zhou, A. E. Hyvarinen, and H. Muller. Using the Grid for Enhancing the Performance of a Medical Image Search Engine. In 21st IEEE International Symposium on Computer-Based Medical Systems (CBMS'08), pages 367--372, Jyvaskyla, Finland, June 2008.

Digital Library

[14]

G. Sabin, R. Kettimuthu, A. Rajan, and P. Sadayappan. Schedulilng of Parallel Jobs in a Heterogeneous Multi-Site Environment. In JSSPP'03, volume LNCS 2872, pages 87--104, 2003.

[15]

J. Schopf and F. Berman. Stochastic Scheduling. In Supercomputing (SC'99), Portland, USA, 1999.

Digital Library

[16]

V. Subramani, R. Kettimuthu, S. Srinivasan, and P. Sadayappan. Distributed Job Scheduling on Computational Grids using Multiple Simultaneous Requests. In International Symposium on High Performance Distributed Computing (HPDC), pages 359--366, Edinburgh, Scotland, July 2002.

Digital Library

Cited By

Balderrama JSimonin MTedeschi C(2016)GinFlow: A Decentralised Adaptive Workflow Execution Manager2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS)10.1109/IPDPS.2016.63(923-932)Online publication date: May-2016
https://doi.org/10.1109/IPDPS.2016.63
Glatard TRousseau MRioux PAdalat REvans AReed DSun XFoster I(2014)Controlling the deployment of virtual machines on clusters and clouds for scientific computing in CBRAINProceedings of the 14th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing10.1109/CCGrid.2014.42(384-393)Online publication date: 26-May-2014
https://dl.acm.org/doi/10.1109/CCGrid.2014.42
Balderrama JHuu TMontagnat J(2012)Scalable and Resilient Workflow Executions on Production Distributed Computing InfrastructuresProceedings of the 2012 11th International Symposium on Parallel and Distributed Computing10.1109/ISPDC.2012.24(119-126)Online publication date: 25-Jun-2012
https://dl.acm.org/doi/10.1109/ISPDC.2012.24
Show More Cited By

Index Terms

Modeling user submission strategies on production grids
1. Computing methodologies
  1. Modeling and simulation
    1. Model development and analysis
      1. Modeling methodologies

Recommendations

DotGrid: a.NET-based cross-platform software for desktop grids

Grid infrastructures that have provided wide integrated use of resources are becoming the de facto computing platform for solving large-scale problems in science, engineering and commerce. In this evolution, desktop grid technologies allow the grid ...
Neuroscience instrumentation and distributed analysis of brain activity data: a case for eScience on global Grids: Research Articles

The distribution of knowledge (by scientists) and data sources (advanced scientific instruments), and the need for large-scale computational resources for analyzing massive scientific data are two major problems commonly observed in scientific ...
Job submission to grid computing environments
UK e-Science All Hands Meeting 2006

The problem of enabling scientist users to submit jobs to grid computing environments will eventually limit the usability of grids. The eMinerals project has tackled this problem by developing the 'my_condor_submit' (MCS) tool, which provides a simple ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HPDC '09: Proceedings of the 18th ACM international symposium on High performance distributed computing

June 2009

237 pages

ISBN:9781605585871

DOI:10.1145/1551609

General Chairs:
Dieter Kranzlmüller
Ludwig-Maximilians-Universität München, Leibniz Supercomputing Centre, Germany
,
Arndt Bode
Technische Universität München, Germany
,
Heinz-Gerd Hegering
Leibniz Supercomputing Centre, Germany
,
Program Chairs:
Henri Casanova
University of Hawaii at Manoa, USA
,
Michael Gerndt
Technische Universität München, Germany

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 June 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HPDC '09

Sponsor:

HPDC '09: International Symposium on High Performance Distributed Computing

June 11 - 13, 2009

Garching, Germany

Acceptance Rates

Overall Acceptance Rate 166 of 966 submissions, 17%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
210
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Balderrama JSimonin MTedeschi C(2016)GinFlow: A Decentralised Adaptive Workflow Execution Manager2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS)10.1109/IPDPS.2016.63(923-932)Online publication date: May-2016
https://doi.org/10.1109/IPDPS.2016.63
Glatard TRousseau MRioux PAdalat REvans AReed DSun XFoster I(2014)Controlling the deployment of virtual machines on clusters and clouds for scientific computing in CBRAINProceedings of the 14th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing10.1109/CCGrid.2014.42(384-393)Online publication date: 26-May-2014
https://dl.acm.org/doi/10.1109/CCGrid.2014.42
Balderrama JHuu TMontagnat J(2012)Scalable and Resilient Workflow Executions on Production Distributed Computing InfrastructuresProceedings of the 2012 11th International Symposium on Parallel and Distributed Computing10.1109/ISPDC.2012.24(119-126)Online publication date: 25-Jun-2012
https://dl.acm.org/doi/10.1109/ISPDC.2012.24
Zentner LClark SSmith PShivarajapura SFarnsworth VMadhavan KKlimeck G(2011)Practical Considerations in Cloud Utilization for the Science Gateway nanoHUB.org2011 Fourth IEEE International Conference on Utility and Cloud Computing10.1109/UCC.2011.46(287-292)Online publication date: Dec-2011
https://doi.org/10.1109/UCC.2011.46
Wang LKurze TTao JKunze Mvon Laszewski G(2011)On-demand service hosting on production grid infrastructuresThe Journal of Supercomputing10.1007/s11227-011-0666-566:3(1178-1193)Online publication date: 12-Aug-2011
https://doi.org/10.1007/s11227-011-0666-5
Sivagnanam SYoshimoto KMoore RKatz DBrown S(2010)TeraGrid resource selection toolsProceedings of the 2010 TeraGrid Conference10.1145/1838574.1838594(1-6)Online publication date: 2-Aug-2010
https://dl.acm.org/doi/10.1145/1838574.1838594
Collet PKřikava FMontagnat JBlay-Fornarino MManset DGermain-Renaud CJha SLoomis C(2010)Issues and scenarios for self-managing grid middlewareProceedings of the 2nd workshop on Grids meets autonomic computing10.1145/1809029.1809033(1-10)Online publication date: 7-Jun-2010
https://dl.acm.org/doi/10.1145/1809029.1809033
Tan WChing CCamarasu-Pop SCalvat PGlatard TGermain-Renaud CJha SLoomis C(2010)Two experiments with application-level quality of service on the EGEE gridProceedings of the 2nd workshop on Grids meets autonomic computing10.1145/1809029.1809031(11-20)Online publication date: 7-Jun-2010
https://dl.acm.org/doi/10.1145/1809029.1809031
Lingrand DMontagnat J(2010)Efficient Resubmission Strategies to Design Robust Grid Production EnvironmentsProceedings of the 2010 IEEE Sixth International Conference on e-Science10.1109/eScience.2010.11(198-205)Online publication date: 7-Dec-2010
https://dl.acm.org/doi/10.1109/eScience.2010.11
Kurze TWang LLaszewski GTao JKunze MKramer DKarl W(2010)Cyberaide onServeProceedings of the 2010 39th International Conference on Parallel Processing10.1109/ICPP.2010.47(395-403)Online publication date: 13-Sep-2010
https://dl.acm.org/doi/10.1109/ICPP.2010.47
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents