Abstract
The discovery and selection of needed resources, taking into account optimization criteria, local policies, computing and storage availability, resource reservations, and grid dynamics, is a technological challenge in the emerging technology of grid computing.
The Condor Project’s ClassAd language is commonly adopted as a “lingua franca” for describing grid resources, but Condor itself does not make extensive use of Web Services. In contrast, the strongly service-oriented Globus Toolkit is implemented using the web services resource framework, and offers basic services for job submission, data replica and location, reliable file transfers and resource indexing, but does not provide a resource broker and matchmaking service.
In this paper we describe the development of a Resource Broker Service based on the Web Services technology offered by the Globus Toolkit version 4 (GT4). We implement a fully configurable and customizable matchmaking algorithm within a framework that allows users to direct complex queries to the GT4 index service and thus discover any published resource. The matchmaking algorithm supports both the native simple query form and the Condor ClassAd notation. We achieve this flexibility via a matchmaking API java class framework implemented on the extensible GT4 index service, which maps queries over ClassAds in a customizable fashion.
We show an example of the proposed grid application, namely an on demand weather and marine forecasting system. This system implements a Job Flow Scheduler and a Job Flow Description Language in order to access and exploit shared and distributed observations, model software, and 2D/3D graphical rendering resources. The system combines GT4 components and our Job Flow Scheduler and Resource Broker services to provide a fully grid-aware system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Foster, I.: Globus Toolkit Version 4: Software for Service-Oriented Systems. Journal of Computational Science and Technology 21(4), 523–530 (2006)
Allcock, W., et al.: The Globus Striped GridFTP Framework and Server. In: SC05 (November 2005)
The PSU/NCAR mesoscale model (MM5), Pennsylvania State University / National Center for Atmospheric Research, http://www.mmm.ucar.edu/mm5/mm5-home.html
Foster, I., Kesselman, C.: The Grid 2: Blueprint for a new Computing Infrastructure. Morgan Kaufmann, San Francisco (2003)
Liu, C., Foster, I.: A Constraint Language Approach to Matchmaking. In: Proceedings of the 14th International Workshop on Research Issues on Data Engineering (RIDE 2004), Boston (2004)
Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. Intl. J. High Performance Computing Applications 15(3), 200–222 (2001)
Schopf, J.M., et al.: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of the Globus Toolkit’s MDS4. Argonne National Laboratory Tech Report ANL/MCS-P1248-0405 (April 2005)
Thain, D., Tannenbaum, T., Livny, M.: Distributed Computing in Practice: The Condor Experience. Concurrency and Computation: Practice and Experience 17(2-4), 323–356 (2005)
Raman, R.: Matchmaking Frameworks for Distributed Resource Management. Ph.D. Dissertation (October 2000)
Raman, R., Livny, M., Solomon, M.: Matchmaking: Distributed Resource Management for High Throughput Computing. In: Proceedings of the Seventh IEEE International Symposium on High Performance Distributed Computing, Chicago, IL, July 28-31 (1998)
Ascione, I., et al.: A Grid Computing Based Virtual Laboratory for Environmental Simulations. In: Nagel, W.E., Walter, W.V., Lehner, W. (eds.) Euro-Par 2006. LNCS, vol. 4128, Springer, Heidelberg (2006)
Sotomayor, B., Childers, L.: Globus Toolkit 4: Programming Java Services. Morgan Kaufmann, San Francisco (2005)
Massie, M.L., Chunm, B.N., Culler, D.E.: The Ganglia Distributed Monitoring System: Design, Implementation, and Experience. Parallel Computing (2004)
Andreozzi, S., et al.: Glue schema specification version 1.3 draft 1, INFN (2006)
Raman, R., Livny, M., Solomon, M.: Policy Driven Heterogeneous Resource Co-Allocation with Gangmatching. In: Proceedings of the Twelfth IEEE International Symposium on High-Performance Distributed Computing, Seattle, WA (2003)
Andreozzi, S., et al.: GLUE Schema v1.2 Mapping to Old ClassAd Format, INFN (July 2006)
Deerwester, S., et al.: Indexing by latent semantic analysis. Journal of the Society for Information Science 41(6), 391–407 (1990)
Drineas, P., et al.: Clustering Large Graphs via the Singular Value Decomposition. Machine Learning 56, 9–33 (2004)
Dumais, S.T.: Using LSI for Information Retrieval, Information Filtering, and Other Things. In: Cognitive Technology Workshop, April 4-5 (1997)
Condor High Throughput Computing. Classified Advertisements. Univeristy of Wisconsin, http://www.cs.wisc.edu/condor/classad
Giunta, G., et al.: pPOM: A nested, scalable, parallel and Fortran 90 implementation of the Princeton Ocean Model. Envirnonmental Modelling & Software 22, 117–122 (2007)
Barone, G., et al.: An Operational Mesoscale Air Quality Model for the Campania Region. In: Proc. 3th GLOREAM Workshop, Annali Istituto Universitario Navale (special issue), June 2000, pp. 179–189 (2000)
Barone, G., et al.: Parallel software for air quality simulation in Naples area. J. Eviron. Manag. and Health 10, 209–215 (2000)
Giunta, G., Montella, R., Riccio, A.: Globus GT4 based Job Flow Scheduler and Resource Broker development for a grid computing based environmental simulations laboratory. Technical Report,2006 /07 Dept. of Applied Sciences, University of Naples ”Parthenope” (2006)
Resource Specification Language (RSL), Globus Alliance, http://www-unix.globus.org/developer/rsl-schema.html
Giunta, G., et al.: Modeling and computational issues for air/water quality problems. A grid computing approach. Il Nuovo Cimento 28C(2) (2005)
Andrews, T., et al.: IBM, Business Process Execution Language for Web Services Version 1.1 (2003), http://www.oasis-open.org
Active BPEL Engine Site, http://www.activebpel.org
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Montella, R. (2007). Development of a GT4-Based Resource Broker Service: An Application to On-demand Weather and Marine Forecasting. In: Cérin, C., Li, KC. (eds) Advances in Grid and Pervasive Computing. GPC 2007. Lecture Notes in Computer Science, vol 4459. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72360-8_18
Download citation
DOI: https://doi.org/10.1007/978-3-540-72360-8_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72359-2
Online ISBN: 978-3-540-72360-8
eBook Packages: Computer ScienceComputer Science (R0)