article

An integration experience of a software architecture and a monitoring infrastructure to deploy applications with non-functional requirements in computing grids

Authors:

Alexandre Sztajnberg,

Rodrigo Souza Granja,

Jeane Cesário,

André Felipe Almeida MonteiroAuthors Info & Claims

Software—Practice & Experience, Volume 41, Issue 1

Pages 103 - 127

https://doi.org/10.1002/spe.1007

Published: 01 January 2011 Publication History

Abstract

Resource management is an important aspect to consider regarding applications that might have different non-functional or operational requirements, when running in distributed and heterogeneous environments. In this context, it is necessary to provide the means to specify the required resource constraints and an infrastructure that can adapt the applications in light of the changes in resource availability. We adopted a contract-based approach to describe and maintain parallel applications that have non-functional requirements in a Computing Grid context, called ZeliGrid. To form the supporting infrastructure we have designed a software architecture that integrates some of the Globus services, the LDAP and the NWS monitoring services. Some modules that map the contract approach into software artifacts were also integrated to this architecture. This paper addresses the architecture and integration issues of our approach, as well as how we put the pieces together highlighting deployment and implementation details, which have to consider diverse aspects such as monitoring, security and dynamic reconfiguration. Copyright © 2010 John Wiley & Sons, Ltd.

References

[1]

Foster I, Kesselman C, Tuecke S. The anatomy of the grid: enabling scalable virtual organizations. International Journal of Supez-computer Applications 2001; <b>15</b>(3):200-222.

Digital Library

[2]

Loques O, Sztajnberg A. A contract-based approach to describe and deploy non-functional adaptations in software architectures. Journal of the Brazilian Computing Society 2004; <b>10</b>(1):5-18.

[3]

Cardoso LT, Sztajnberg A, Loques OG. Self-adaptive applications using ADL contracts. The 2nd IEEE International Workshop on Self-managed Networks, Systems and Services (Lecture Notes in Computer Science, vol. 3996). Sringer: Berlin, Dublin, Ireland, 2006; 87-101.

Digital Library

[4]

Sztajnberg A, Loques OG. Self-adaptive configuration of an overlay-based application. ROADS--Real Overlays and Distributed Systems Workshop in Belim, 2007, Belém, PA, Brazil, 2007.

[5]

Lisbôa J, Loques OG. Consistent reconfiguration at the architectural level. Proceedings of the Brazilian Workshop on Fault Tolerance 2008 (WTF2008), Rio de Janeiro, Brazil, 2008; 211-223 (Portuguese).

[6]

Chalub FR, Braga C, Sztajnberg A. A formal semantics for a quality of service contract language. Electronic Notes in Theoretical Computer Science 2009; <b>203</b>:103-120.

Digital Library

[7]

Sztajnberg A, Rodrigues ALB, Bezerra LN, Loques OG, Copetti A, Carvalho ST. Applying context-aware techniques to design remote assisted living applications. International Journal of Functional Informatics and Personalised Medicine 2009; <b>2</b>(4):358-378.

[8]

Petrucci V, Sztajnberg A, Loques OG. Selecting resources in computing grids using utility functions. WCGA 2007. Proceedings of the IV Workshop on Computational Grids and Applications, Belém, Brazil, 2007 (Portuguese).

[9]

Granja RS, Sztajnberg A. ZeliGrid: uma arquitetura para a implantaçõao de aplicações com requisitos não-funcionais dinâmicos em Grades Computacionais. REIC--Revista Eletrônica de Iniciação Científica 2007, vol. VII: 10. Sociedade Brasileira de Computação, Brazil 2007 (Portuguese).

[10]

Cesário J, Sztajnberg A. Introducing checkpointing and migration mechanisms into a computing grid application infrastructure. Proceedings of the V Workshop on Operating Systems (WSO 2008), Belém, PA, Brazil, 2008; 189-198 (Portuguese).

[11]

Globus Alliance. Globus toolkit 2.4 release manuals. Available at: http://www.globus.org/toolkit/docs/2.4/ {August 2010}.

[12]

Wolski R, Spring N, Hayes J. The network weather service: A distributed resource performance forecasting service for metacomputing. Joural of Future Generation Computing Systems 1999; <b>15</b>(5-6):757-768.

Digital Library

[13]

Software man pages: Slapd. Available at: http://www.openldap.org/software/man.cgi?query=slapd {August 2010}.

[14]

Wolski R. Computational Grids: Feng Shui for the terminally rectilinear (Lecture Notes). Available at: http://www.cs.ucsb.edu/~richiclass/cs290I-grid/notes/ {August 2010}.

[15]

Yeong W, Howes T, Kille S. Lightweight directory access protocol. RFC 1777, 1995; 2-6. Available at: http://www.rfc-archive.org/getrfc.php?rfe=1777 {August 2010}.

[16]

Camargo YR, Goldchleger A, Kon F, Goldman A. Checkpointing BSP parallel applications on the integrade grid middleware. Concurrency and Computation--Practice and Experience 2006; <b>18</b>(6):567-579. Hoboken, NJ, EUA.

Digital Library

[17]

Obertelli G, Wolski R. Network weather service user's guide. Available at: http://nws.cs.ucsb.edu/users_guide.html {August 2010}.

[18]

Mills D. Network time protocol (version 3) specification, implementation and analysis. RFC 1305, 1992; 4-42. Available at: http://www.rfc-archive.org/getrfc.php?=rfc=1305 {August 2010}.

[19]

Institute for advanced professional studies. Network file system (NFS) protocol specifications. 2008. AvailabLe at: http://www.iaps.com/NFSv4.html {August 2010}.

[20]

Kovatch P, Smith W et al. Metascheduling requirements analysis team. TeraGrid, April 2007. Available at: http://www.teragridforum.org/mediawiki/images/b/b4/MetaschedRatReport.pdf {August 2010}.

[21]

Seidel J, Wäldrich O, Ziegler W, Wieder P, Yahyapour R. Using SLA for Resource management and scheduling-- A survey. CoreGRID, Technical Report # TR-0096, Institute on Resource Management and Scheduling, August 2007. Available at: http://www.coregrid.net/mambo/images/stories/TechnicalReports/tr-0096.pdf {August 2010}.

[22]

Gogouvitis SV, Kousiouris G, Konstanteli K, Polychniatis T, Menychtas A, Kyriazis D, Varvarigou T. Realtime-enabled workflow management in service oriented infrastructures. Proceeding of the 1st ACM Workshop on Analysis and Retrieval of Events/Actions and Workflows in Video Streams (AREA'08), Vancouver, Canada, October 2008; 119-124.

Digital Library

[23]

Krauter K, Buyya R, Maheswaranl M. A taxonomy and survey of grid resource management systems for distributed computing. Software Practice and Experience 2002; <b>32</b>(2):135-164.

Digital Library

[24]

Fahringer T, Jugravu A, Pllana S, Prodan R, Truong HL. ASKALON: A tool set for cluster and grid computing. Concurrency and Computation: Practice and Experience 2005; <b>17</b>(2-4):143-169.

Digital Library

[25]

Distributed and parallel systems group. ASKALON--Grid application development and computing environment. University of Innsbruck, 2007. Available at: http://www.dps.uibk.ac.at/projects/askalon/ {August 2010}.

[26]

Frey J, Tannenbaum T, Foster I et al. Condor-G: A computation management agent for multi-institutional grids. Proceedings of the 10th IEEE Symposium on High Performance Distributed Computing (HPDC10), São Francisco, California, August 2001.

Digital Library

[27]

GridWay.org. Distributed Systems Architecture Group. The GridWay Metascheduler. Universidad Complutense de Madrid, 2007. Available at: http://www.gridway.org {August 2010}.

[28]

McGough S, Young L, Afzal A, Newhouse S, Darlington J. Workflow Enactment in ICENI. U.K. E-science All Hands Meeting. IOP Publishing Ltd: Nottingham, U.K., 2004; 894-900.

[29]

McGough AS, Lee W, Darlington J. ICENI II Architecture. Proceedings of the UK E-science All Hands Meeting, Nottingham, U.K., 19-22 September 2005.

[30]

McGough AS, Lee W, Darlington J. Workflow Deployment in ICENI II. First International Workshop on Workflow Systems in E-science, (WSES06), Computational Science--ICCS 2006, University of Reading, U.K. (Lecture Note in Computer Science, vol. 3993). Springer: Berlin, 2006; 964-971.

Digital Library

[31]

Buyya R, Abramson D, Giddy J, Nimrod/G: An architecture for a resource management and scheduling. system in a global computational grid. Proceedings of the 4th international Conference on High Performance Computing in Asia-pacific Region. Beijing, China. IEEE Computer Society Press: U.S.A., 2000.

[32]

Abramson D, Sosic R, Giddy J, Hall B. Nimrod: A tool for performing parametised simulations using distributed workstations. The 4th IEEE Symposium on High Performance Distributed Computing, Virginia, U.S.A., 1995.

Digital Library

[33]

Campana S, Litmaath M, Sciabá A. LCG-2 Middleware Overview LHC Computing Grid. CERN-LCG-GDEIS- 498079, Version 1.0, 1 October 2004. Available at: http://www.grid.org.tr/servisler/dokumanlar/LCG-mw.pdf {August 2010}.

[34]

CERN.Worldwide LHC computing grid. 2008. Available at: http://lcg.web.cern.ch/lcg/ {August 2010}.

[35]

Cluster Resources Inc. Moab Grid Suite. 2009. Available at: http://www.clusterresources.com/pages/products/ moab-grid-suite.php {August 2010}.

[36]

Petrucci V, Loques OG, Mossé D. A framework for dynamic adaptation of power-aware server clusters. Proceedings of the 24th Annual ACM Symposium on Applied Computing (SAC'09), Honolulu, Hawaii, U.S.A., 2009; 1-8.

Digital Library

[37]

Woo N, Yeon HY, Park T. MPICH-GF: Transparent checkpointing and rollback-recovery for grid-enabled MPI processes. IEICE Transactions on Information and Systems 2004; <b>87</b>(7):1820-1828.

[38]

Camargo YR, Goldchleger A, Kon F, Goldman A. Checkpointing-based rollback recovery for parallel applications on the integrade grid middleware. ACM/I-FIP/USENIX 2nd International Workshop on Middleware for Grid Computing, Toronto, Canada, October 2004.

Digital Library

[39]

Silva H, Siqueira TF, Dalpiaz LR, Jansch-Pôrto IES, Weber TS. Implementação de urn Mecanismo de Recuperação por Retorno para o Ambiente de Computação OurGrid. Workshop de Tolerância a Falhas 2006, Curitiba, Brazil, 2006 (Portuguese).

[40]

Condor Manual. Condor's checkpoint mechanism. Available at: http://www.cs.wisc.edu/condor/manual/v6.8/ 4_2Condor_s_Checkpoint.html {August 2010}.

[41]

Ellahi TN, Hudzia B, McDermott L, Kechadi T. Transparent Migration of multi-threaded applications on a java based grid. The IASTED International Conference on Web Technologies, Applications, and Services (WTAS 2006), Alberta, Canada, July 2006.

[42]

Wang H, Zeng G, Lin S. A strong migration method of mobile agents based on Java. The 6th International Conference on Computer Supported Cooperative Work in Design, Ontario, Canada, 2001; 313-318.

[43]

Lopes RF, Silva FJS. Migration Transparency in a mobile agent based computational grid. Proceedings of the 5th WSEAS International Conference on Simulation, Modeling and Optimization, 1st WSEAS International Symposium on GRID COMPUTING, Corfu, Greece, August 2005; 31-36.

Digital Library

[44]

Chiba S: Nishizawa M. An easy-to-use toolkit for efficient java bytecode translators. Proceedings of the 2nd International Conference on Generative Programming and Component Engineering (GPCE '03) (Lecture Notes In Computer Science, vol. 2830). Springer: Berlin, Erfurt, Germany, 2003; 364-376.

Digital Library

[45]

Sirac SB. Making java applications mobile or persistent. The 6th USENIX Conference on Object-oriented Technologies and Systems (COOTS'01), San Antonio Texas, U.S.A., January-February 2001.

Digital Library

Cited By

Xiao PLiu D(2020)A Novel Cloud Monitoring Framework with Enhanced QoS SupportingInternational Journal of e-Collaboration10.4018/IJeC.201910010315:4(31-45)Online publication date: 1-Oct-2020
https://dl.acm.org/doi/10.4018/IJeC.2019100103
Liu C(2018)An intelligent planning technique-based software requirement analysisInternational Journal of Computational Science and Engineering10.1504/IJCSE.2016.07893413:3(285-295)Online publication date: 19-Dec-2018
https://dl.acm.org/doi/10.1504/IJCSE.2016.078934

An integration experience of a software architecture and a monitoring infrastructure to deploy applications with non-functional requirements in computing grids

Recommendations

MGC middleware for grid computing: the Globus Toolkit
ACAI '11: Proceedings of the International Conference on Advances in Computing and Artificial Intelligence

Grid computing has made substantial advances during the last decade. A major concern in Grid environments is dealing with the high degree of heterogeneity of resources that can range from laptops and PCs to supercomputers. The unified virtual view of ...
Grids and grid technologies for wide-area distributed computing

The last decade has seen a substantial increase in commodity computer and network performance, mainly as a result of faster hardware and more sophisticated software. Nevertheless, there are still problems, in the fields of science, engineering, and ...
Integration of multiple middlewares on a single computing resource

A concept for the integration of multiple grid middleware systems in a compute facility, such as a Linux cluster, was developed within the D-Grid Integration Project. Its aim was to allow concurrent job submission from different middlewares and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Software

Software Volume 41, Issue 1

January 2011

128 pages

ISSN:0038-0644

EISSN:1097-024X

Issue’s Table of Contents

Publisher

John Wiley & Sons, Inc.

United States

Publication History

Published: 01 January 2011

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xiao PLiu D(2020)A Novel Cloud Monitoring Framework with Enhanced QoS SupportingInternational Journal of e-Collaboration10.4018/IJeC.201910010315:4(31-45)Online publication date: 1-Oct-2020
https://dl.acm.org/doi/10.4018/IJeC.2019100103
Liu C(2018)An intelligent planning technique-based software requirement analysisInternational Journal of Computational Science and Engineering10.1504/IJCSE.2016.07893413:3(285-295)Online publication date: 19-Dec-2018
https://dl.acm.org/doi/10.1504/IJCSE.2016.078934

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents