Abstract
Strategies for scheduling parallel applications on a distributed system must trade-off processor application speed-up and resource efficiency. Most existing strategies focus mainly on achieving high application speed-up without taking into account the efficiency factor. This paper presents our experiences with a self-adaptive scheduling strategy that dynamically adjusts the number of resources used by an application based on performance measures gathered during its execution. The strategy seeks to maximize resource efficiency while minimizing the impact in loss of speedup. It also uses the measured times to decide how to assign tasks to resources. This work has been carried out in the context of opportunistic clusters of machines and we report the results achieved by our strategy when it was applied to an image thinning application run on a Condor pool.
This work was supported by the CICYT (contract TIC98-0433), by the Commission for Cultural, Educational and Scientific Exchange between the USA and Spain (project 99186) and partially supported by the Generalitat de Catalunya (Grup de Recerca consolidat 1999SGR86).
Chapter PDF
Similar content being viewed by others
References
D. Abramson, R. Sosic, J. Giddy and B. Hall, “Nimrod: a tool for performing parameterised simulations using distributed workstations”, Symposium on High Performance Distributed Computing, Virginia
J. Basney, B. Raman and M. Livny, “High throughput Monte Carlo”, Proceedings of the Ninth SLAM Conf. on Par. Proc. for Scientific Computing, San Antonio Texas, 1999.
H. Casanova, M. Kim, J. S. Plank and J. Dongarra, “Adaptive scheduling for task farming with Grid middleware”, International Journal of Supercomputer Applications and High-Performance Computing, pp. 231–240, Volume 13, Number 3, Fall 1999.
J.-P. Goux, S. Kulkarni, J. Linderoth, M. Yoder, “An enabling framework for master-worker applications on the computational grid”, Proceedings of the Ninth IEEE Symposium on High Performance Distributed Computing (HPDC9), pp. 43–50, 2000.
Z. Guo and R. Hall. “Fast Fully Parallel Thinning Algorithms”. CVGLP: Image Understanding. Vol. 55, No. 3, pp. 317–328, May 1992.
E. Heymann, M. A. Senar, E. Luque and M. Livny, “Evaluation of an Adaptive Scheduling Strategy for Master-Worker Applications on Clusters of Workstations”, Proc. of 7th Int. Conf. in High Perf (HiPC 2000), LNCS series, Vol. 1970, pp. 310–319, 2000.
E. Heymann, M. A. Senar, E. Luque and M. Livny, “Adaptive Scheduling for Master-Worker Applications on the Computational Grid”, Proc. of 2000 Int. Workshop on Grid Computing (GRID’2000), LNCS series, Vol. 1971, pp. 214–227, 2000.
M. Livny, J. Basney, R. Raman and T. Tannenbaum, “Mechanisms for high throughput computing”, SPEEDUP, 11, 1997.
J. Pruyne and M. Livny, “Interfacing Condor and PVM to harness the cycles of workstation clusters”, Journal on Future Generations of Computer Systems, Vol. 12, 1996.
G. Shao, R. Wolski and F. Berman, “Performance effects of scheduling strategies for Master/Slave distributed applications”, Tech. Rep. TR-CS98-598, University of California, San Diego, September 1998.
L. M. Silva and R. Buyya, “Parallel programming models and paradigms”, in R. Buyya (ed.), “High Performance Cluster Computing: Architectures and Systems: Volume 2”, Prentice Hall PTR, NJ, USA, 1999.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Heymann, E., Senar, M.A., Luque, E., Livny, M. (2001). Self-Adjusting Scheduling of Master-Worker Applications on Distributed Clusters. In: Sakellariou, R., Gurd, J., Freeman, L., Keane, J. (eds) Euro-Par 2001 Parallel Processing. Euro-Par 2001. Lecture Notes in Computer Science, vol 2150. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44681-8_106
Download citation
DOI: https://doi.org/10.1007/3-540-44681-8_106
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42495-6
Online ISBN: 978-3-540-44681-1
eBook Packages: Springer Book Archive