article

SCALEA-G: A unified monitoring and performance analysis system for the grid

Authors:

Hong-Linh Truong_c,

Thomas FahringerAuthors Info & Claims

Scientific Programming, Volume 12, Issue 4

Pages 225 - 237

https://doi.org/10.1155/2004/543965

Published: 01 December 2004 Publication History

Abstract

This paper describes SCALEA-G, a unified monitoring and performance analysis system for the Grid. SCALEA-G is implemented as a set of grid services based on the Open Grid Services Architecture (OGSA). SCALEA-G provides an infrastructure for conducting online monitoring and performance analysis of a variety of Grid services including computational and network resources, and Grid applications. Both push and pull models are supported, providing flexible and scalable monitoring and performance analysis. Source code and dynamic instrumentation are implemented to perform profiling and monitoring of Grid applications. A novel instrumentation request language for dynamic instrumentation and a standardized intermediate representation for binary code have been developed to facilitate the interaction between client and instrumentation services.

References

[1]

{1} Postgresql 7.1.2. http://www.postgresql.org/docs/.

[2]

{2} Sleepcat Berkeley DB, http://www.sleepycat.com.

[3]

{3} B. Tierney et al., A Grid Monitoring Architecture. Technical report, Performance Working Group, Grid Forum, January 2002, http://www-didc.lbl.gov/GGF-PERF/GMA-WG/ papers/GWD-GP-16-2.pdf.

[4]

{4} M. Baker and G. Smith, GridRM: An Extensible Resource Management System, in: Proceedings of IEEE International Conference on Cluster Computing (CLUSTER'03), Hong Kong, December 01-04 2003. IEEE Computer Society Press, pp. 207-215.

[5]

{5} Z. Balaton, P. Kacsuk, N. Podhorszki and F. Vajda, From Cluster Monitoring to Grid Monitoring Based on GRM, in: Proceedings. 7th EuroPar'2001 Parallel Processings, Manchester, UK, 2001, pp. 874-881.

[6]

{6} B. Balis, M. Bubak, W. Funika, T. Szepieniec and R. Wismüller, An infrastructure for Grid application monitoring, LNCS 2474 (2002), 41-49.

[7]

{7} M. Bubak, W. Funika and R. Wismüller, The CrossGrid performance analysis tool for interactive Grid applications, LNCS 2474 (2002), 50-60.

[8]

{8} B. Buck and J.K. Hollingsworth, An API for Runtime Code Patching, The International Journal of High Performance Computing Applications 14(4) (Winter 2000), 317-329.

Digital Library

[9]

{9} K. Czajkowski, S. Fitzgerald, I. Foster and C. Kesselman, Grid Information Services for Distributed Resource Sharing, in: Proceedings of the 10th IEEE International Symposium on High-Performance Distributed Computing (HPDC-10), IEEE Press, August 2001.

Digital Library

[10]

{10} L. DeRose, T. Hoover Jr. and J. Hollingsworth, The dynamic probe class library: An infrastucture for developing instrumentation for performance tools, in: Proceedings of the 15th International Parallel and Distributed Processing Symposium (IPDPS-01), Los Alamitos, CA, April 23-27 2001, pp. 66-66, IEEE Computer Society.

[11]

{11} Discovery and Monitoring Event Description (DAMED) Working Group, http://www-didc.lbl.gov/damed/.

[12]

{12} A. Cooke et al., R-GMA An Information Integration System for Grid Monitoring, in: Proceedings of 11th International Conference on Cooperative Information Systems (CoopIS 2003), Sicily, Italy, 3-7 November 2003.

[13]

{13} T. Fahringer, M. Gerndt, B. Mohr, M. Schulz, C. Seragiotto and H.-L. Truong, Monitoring and Instrumentation Requests for Fortran, Java, C and C++ Programs, APART Working group (http://www.kfa-juelich.de/apart/), Work in progress, August 2004.

[14]

{14} T. Fahringer, M. Gerndt, B. Mohr, M. Schulz, C. Seragiotto and H.-L. Truong, Standardized Intermediate Representation for Fortran, Java, C and C++ Programs, APART Working group (http://www.kfa-juelich.de/apart/), Work in progress, August 2004.

[15]

{15} I. Foster, C. Kesselman, J. Nick and S. Tuecke, Grid Services for Distributed System Integration, IEEE Computer (June 2002), 37-46.

[16]

{16} I. Foster, J. Frey, S. Graham, S. Tuecke, K. Czajkowski, D. Ferguson, F. Leymann, M. Nally, T. Storey, W. Vambenepe and S. Weerawarana, Modeling Stateful Resources with Web Services. Specification, Globus Alliance, Argonne National Laboratory, IBM, USC ISI, Hewlett-Packard, January 2004.

[17]

{17} M. Gerndt, R. Wismueller, Z. Balaton, G. Gombas, P. Kacsuk, Z. Nemeth, N. Podhorszki, H.-L. Truong, T. Fahringer, M. Bubak, E. Laure and T. Margalef, Performance Tools for the Grid: State of the Art and Future. Technical report, Research Report Series, Lehrstuhl fuer Rechnertechnik und Rechnerorganisation (LRR-TUM) Technische Universitaet Muenchen, (Vol. 30), Shaker Verlag, ISBN 3-8322-2413- 0, 2004.

[18]

{18} GGF Network Measurements Working Group, http://forge. gridforum.org/projects/nm-wg/.

[19]

{19} Global Grid Forum, http://www.gridforum.org/.

[20]

{20} Globus Project, http://www.globus.org.

[21]

{21} gSOAP: C/C++Web Services and Clients. http://www.cs.fsu. edu/engelen/soap.html.

[22]

{22} G. Laszewski, I. Foster, J. Gawor and P. Lane, A java commodity grid kit, Concurrency and Computation: Practice and Experience 13(643-662) (2001).

[23]

{23} M.L. Massie, B.N. Chun and D.E. Culler, The Ganglia Distributed Monitoring System: Design, Implementation, and Experience, Parallel Computing (May 2004).

[24]

{24} Paradyn Parallel Performance Tools, http://www.cs.wisc.edu/ paradyn/.

[25]

{25} H.-L. Truong and T. Fahringer, SCALEA: A Performance Analysis Tool for Parallel Programs, Concurrency and Computation: Practice and Experience 15(11-12) (2003), 1001- 1025.

[26]

{26} V. Welch, F. Siebenlist, I. Foster, J. Bresnahan, K. Czajkowski, J. Gawor, C. Kesselman, S. Meder, L. Pearlman and S. Tuecke, Security for Grid Services, in: 12th IEEE International Symposium on High Performance Distributed Computing (HPDC'03), Seattle, Washington, June 22-24 2003, pp. 48-57.

[27]

{27} R. Wolski, N. Spring and J. Hayes, The Network Weather Service: A Distributed Resource Performance Forecasting Service for Metacomputing, Future Generation Computing Systems 15 (1999), 757-768.

Digital Library

[28]

{28} XML Path Language, http://www.w3.org/tr/xpath.html.

[29]

{29} XML Schema, http://www.w3.org/xml/schema.

Cited By

Ardagna CAsal RDamiani EVu Q(2015)From Security to Assurance in the CloudACM Computing Surveys10.1145/276700548:1(1-50)Online publication date: 22-Jul-2015
https://dl.acm.org/doi/10.1145/2767005
Costa GSikora AJorba JMargalef T(2014)GMATEJournal of Grid Computing10.1007/s10723-013-9287-y12:2(371-398)Online publication date: 1-Jun-2014
https://dl.acm.org/doi/10.1007/s10723-013-9287-y
Balis BDyk GBubak M(2011)On-line grid monitoring based on distributed query processingProceedings of the 9th international conference on Parallel Processing and Applied Mathematics - Volume Part II10.1007/978-3-642-31500-8_14(131-140)Online publication date: 11-Sep-2011
https://dl.acm.org/doi/10.1007/978-3-642-31500-8_14
Show More Cited By

SCALEA-G: A unified monitoring and performance analysis system for the grid
1. General and reference
  1. Cross-computing tools and techniques
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles

Recommendations

Monitoring of Grid scientific workflows
Large-Scale Programming Tools and Environments

Scientific workflows are a means of conducting in silico experiments in modern computing infrastructures for e-Science, often built on top of Grids. Monitoring of Grid scientific workflows is essential not only for performance analysis but also to ...
K-WfGrid Distributed Monitoring and Performance Analysis Services for Workflows in the Grid
E-SCIENCE '06: Proceedings of the Second IEEE International Conference on e-Science and Grid Computing

Grid workflows for e-science are complex and prone to failures. However, there is a lack of performance monitoring and analysis tools for supporting the user as well as workflow middleware to monitor and understand the performance of complex ...
Online performance monitoring and analysis of grid scientific workflows
EGC'05: Proceedings of the 2005 European conference on Advances in Grid Computing

While existing work concentrates on developing QoS models of business workflows and Web services, few tools have been developed to support the monitoring and performance analysis of scientific workflows in Grids. This paper describes a Grid service for ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Scientific Programming

Scientific Programming Volume 12, Issue 4

AxGrids 2004

December 2004

70 pages

Issue’s Table of Contents

Publisher

IOS Press

Netherlands

Publication History

Published: 01 December 2004

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
3
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ardagna CAsal RDamiani EVu Q(2015)From Security to Assurance in the CloudACM Computing Surveys10.1145/276700548:1(1-50)Online publication date: 22-Jul-2015
https://dl.acm.org/doi/10.1145/2767005
Costa GSikora AJorba JMargalef T(2014)GMATEJournal of Grid Computing10.1007/s10723-013-9287-y12:2(371-398)Online publication date: 1-Jun-2014
https://dl.acm.org/doi/10.1007/s10723-013-9287-y
Balis BDyk GBubak M(2011)On-line grid monitoring based on distributed query processingProceedings of the 9th international conference on Parallel Processing and Applied Mathematics - Volume Part II10.1007/978-3-642-31500-8_14(131-140)Online publication date: 11-Sep-2011
https://dl.acm.org/doi/10.1007/978-3-642-31500-8_14
Balis BSlota RKitowski JBubak M(2011)On-Line monitoring of service-level agreements in the gridProceedings of the 2011 international conference on Parallel Processing - Volume 210.1007/978-3-642-29740-3_10(76-85)Online publication date: 29-Aug-2011
https://dl.acm.org/doi/10.1007/978-3-642-29740-3_10
Assuncao MOrgerie ALefevre L(2010)An Analysis of Power Consumption Logs from a Monitored Grid SiteProceedings of the 2010 IEEE/ACM Int'l Conference on Green Computing and Communications & Int'l Conference on Cyber, Physical and Social Computing10.1109/GreenCom-CPSCom.2010.46(61-68)Online publication date: 18-Dec-2010
https://dl.acm.org/doi/10.1109/GreenCom-CPSCom.2010.46
Zhang XSebag MGermain-Renaud C(2009)Multi-scale Real-Time Grid Monitoring with Job Stream MiningProceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid10.1109/CCGRID.2009.20(420-427)Online publication date: 18-May-2009
https://dl.acm.org/doi/10.1109/CCGRID.2009.20
Balis BBubak MŁabno B(2008)Monitoring of Grid scientific workflowsScientific Programming10.1155/2008/84935416:2-3(205-216)Online publication date: 1-Apr-2008
https://dl.acm.org/doi/10.1155/2008/849354
Gossa JPierson JBrunie L(2007)Adaptable distance-based decision-making support in dynamic cross-grid environmentProceedings of the 13th international Euro-Par conference on Parallel Processing10.5555/2391541.2391594(437-446)Online publication date: 28-Aug-2007
https://dl.acm.org/doi/10.5555/2391541.2391594
Nerieri FProdan RFahringer TTruong H(2006)Overhead Analysis of Grid Workflow ApplicationsProceedings of the 7th IEEE/ACM International Conference on Grid Computing10.1109/ICGRID.2006.310993(17-24)Online publication date: 28-Sep-2006
https://dl.acm.org/doi/10.1109/ICGRID.2006.310993
Balis BTruong HBubak MFahringer TGuzy KRozkwitalski K(2006)An instrumentation infrastructure for grid workflow applicationsProceedings of the 2006 Confederated international conference on On the Move to Meaningful Internet Systems: CoopIS, DOA, GADA, and ODBASE - Volume Part II10.1007/11914952_18(1305-1314)Online publication date: 29-Oct-2006
https://dl.acm.org/doi/10.1007/11914952_18
Show More Cited By

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents