Abstract
While the Grid is becoming a common word in the context of distributed computing, users are still experiencing long phases of adaptability and increased complexity when using the system. Although users have access to multiple resources, selecting the optimal resource for their application and appropriately launching the job is a tedious process that not only proves difficult for the naïve user, but also leads to ineffective usage of the resources. A general-purpose resource broker that performs application specific resource selection on behalf of the user through a web interface is required. This paper describes the design and prototyping of such a resource broker that not only selects a matching resource based on user specified criteria but also uses the application performance characteristics on the resources enabling the user to execute applications transparently and efficiently thereby providing true virtualization.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Allcock, W., Bester, J., Bresnahan, J., Chervenak, A., Liming, L., Tuecke, S.: Draft GridFTP Protocol (2001), Last accessed, Available from, http://www-fp.mcs.anl.gov/dsl/GridFTP-Protocol-RFC-Draft.pdf
Buyya, R., Abramson, D., Giddy, J.: Nimrod-G: An Architecture for a Resource Management and Scheduling in a Global Computational Grid. In: Proceedings of 4th International Conference and Exhibition on High Performance Computing in Asia-Pacific Region (HPC ASIA 2000), Beijing, China, May 14-17 (2000)
Darling, A.E., Carey, L., Feng, W.-c.: The design, implementation and evaluation of mpiBLAST. In: Proceedings of ClusterWorld Conference & Expo in conjunction with the 4th International Conference on Linux Clusters: The HPC Revolution 2003, San Jose, CA (2003)
Foster, I., Kesselman, C., Tsudik, G., Tuecke, S.: A Security Architecture for Computational Grids. In: Proceedings of ACM Conference on Computer and Communications Security, San Francisco, CA, pp. 83–92. ACM Press, New York (1998)
Foster, I., Kesselman, C.: The Globus toolkit. In: Foster, I., Kesselman, C. (eds.) The Grid: Blueprint for a New Computing Infrastructure, San Francisco, California,Ch. 11, pp. 259–278 (1999)
Fran, B., Rich, W., Silvia, F., Jennifer, S., Gary, S.: Application-Level Scheduling on Distributed Heterogeneous Networks. In: Proceedings of Supercomputing 1996, Pittsburgh, PA, p. 28. ACM Press, New York (1996)
Ganglia, 6/1/2004, [Last accessed 6/15, 2004], Available from (2004), http://ganglia.sourceforge.net/
Wolfgang, G.: Sun Grid Engine: Towards Creating a Compute Power Grid. In: Proceedings of Proceedings of the 1st International Symposium on Cluster Computing and the Grid (CCGRID 2001), pp. 35–6. IEEE Computer Society, Los Alamitos (2001)
Grid Scheduling Architecture Research Group, [Last accessed 6/15, 2004], Available from (2004), http://forge.gridforum.org/projects/gsa-rg
IBM LoadLeveler: User’s Guide, International Business Machines (IBM) (September 1993)
Information Services/MDS, 6/14, [Last accessed 6/15, 2004], Available from (2004), http://www.globus.org/mds
Job Submission Description Language Working Group (JSDL-WG), 3/29, 2004, [Last accessed 6/15, 2004], Available from, http://www.epcc.ed.ac.uk/%7Eali/WORK/GGF/JSDL-WG/
Litzkow, M., Livny, M., Mutka, M.: Condor - A Hunter of Idle Workstations. In: Proceedings of 8th International Conference of Distributed Computing Systems, June 1988, pp. 104–11 (1988)
Novotny, J., Russell, M., Wehrens, O.: GridSphere: A Portal Framework for Building Collaborations. In: Proceedings of 1st International Middleware Conference, Rio de Janeiro, Brazil, June 16-20 (2003)
OGCE - Open Grid Computing Environments Collaboratory, 1/22, [Last accessed 6/15, 2004] (2004), Available from http://www.ogce.org/index.php
Sazonov, E.S.: Open source fuzzy inference engine for Java, [Last accessed 6/15, 2004], Available from, http://www.clarkson.edu/~esazonov/FuzzyEngine.htm
van Steen, M.: Nimrod-G Resource Broker for Service-Oriented Grid Computing, [Last accessed 6/15, 2004] print.htm (2004), Available from http://dsonline.computer.org/0107/departments/res0107_print.htm
Systems, Veridian, OpenPBS v2.3: The Portable Batch System Software (2004)
The MathWorks, Inc, What Is Fuzzy Logic?, [Last accessed 6/15, 2004] (2004), Available from, http://www.mathworks.nl/access/helpdesk/help/toolbox/fuzzy/index.html
Yang, L., Schopf, J.M., Foster, I.: Conservative Scheduling: Using Predicted Variance to Improve Scheduling Decisions in Dynamic Environments. In: Proceedings of Super Computing 2003, Phoenix, AZ. ACM Press, New York (2003)
Zhou, S.: LSF: Load Sharing in Large-scale Heterogeneous Distributed Systems. In: Proceedings of Workshop on Cluster Computing (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Afgan, E., Velusamy, V., Bangalore, P.V. (2005). Grid Resource Broker Using Application Benchmarking. In: Sloot, P.M.A., Hoekstra, A.G., Priol, T., Reinefeld, A., Bubak, M. (eds) Advances in Grid Computing - EGC 2005. EGC 2005. Lecture Notes in Computer Science, vol 3470. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11508380_70
Download citation
DOI: https://doi.org/10.1007/11508380_70
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26918-2
Online ISBN: 978-3-540-32036-4
eBook Packages: Computer ScienceComputer Science (R0)