Abstract
In this paper, we present several methods for load balancing data in a SIMD computer. There are two types of approach; either global or local. With an easy example, we showed that dynamic load balancing for SIMD data-parallel computers can really improve the performance of the system and is as efficient as in the MIMD case. We plan to work on the constraint load balancing. For example, in image processing, a pixel value is not only dependent of its value but also of its neighbour values. In such cases, a pixel value is neighbour-dependent and must be moved with much care.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
A. Corradi, L. Leonardi, and F. Zambonelli. Load balancing strategies for massively parallel architectures. Parallel Processing Letters, 2, 1992.
George Cybenko. Dynamic load balancing for distributed memory multiprocessors. Journal of Parallel and Distributed Computing, 7, 1989.
Alan Dewdney. Computer recreations: A computer microscope zooms in for a look at the most complex object in mathematics. Scientific American, page 16, August 1985.
Raphael Finkel and Udi Manber. DIB-a distributed implementation of backtracking. ACM Transactions on Programming Languages and Systems, 9(2), 1987.
Cyril Fonlupt, Philippe Marquet, and Jean-Luc Dekeyser. Dynamic data redistribution on SIMD data-parallel computers. Technical report, Université de Lille I, Lille, France, 1993.
M.R. Garey and D.S. Johnson. Computers and Intractability: A Guide to the theory of NP-Completeness. Freeman, 1979.
Cyril Gavoille. Evaluation of the MasPar performances. Technical report, Ecole Normale Supérieure de Lyon, Lyon, France, February 1992.
Dimitris Gerogiannis and Stelios C. Orphanoudakis. Load balancing requirements in parallel implementation of image feature extraction tasks. IEEE Transactions on Parallel and Distributed Systems, 4(9):994, September 1993.
Wouter Joosen, Stijn Bijnens, and Pierre Verbaeten. A reusable load balancer for parallel search problems. In Euromicro 93, Barcelona, September 1993.
George Karypis and Vipin Kumar. Unstructured tree search on SIMD parallel computers: A summary of results. In Supercomputing 92, 1992.
Richard E. Korf. Depth-first iterative-deepening: An optimal admissible tree search. Artificial Intelligence, 27:97, 1985.
Vipin Kumar and V. Nageshwara Rao. Parallel depth first search. part II. Int'l Journal of Parallel Programming, 16(6), 1987.
F. Lin and R. Keller. The gradient model load balancing method. IEEE Transactions on Software Engeneering, 13(1):32, January 1987.
Ambuj Mahanti and Charles J. Daniels. A SIMD approach to parallel heuristic search. Artificial Intelligence, 60:243, 1993.
Lionel M. Ni, Chong-Wei Xu, and Thomas B. Gendreau. A distributed drafting algorithm for load balancing. IEEE Transactions on Software Engeneering, 11(10), October 1985.
D. Nicol and J. Saltz. Dynamic remapping of parallel computations with varying resource demands. IEEE Transactions on Computers, 37(9):1073, September 1988.
Curt Powley, Chris Ferguson, and Richard Korf. Depth-first heuristic search on a SIMD machine. Artificial Intelligence, 60, 1993.
Lutz Prechelt. Measurements of MasPar MP-1216A communication operations. Technical report, Universität Karlsruhe, 1992.
R.McConnell and R.H. Perrott. A hybrid load balancing scheme for distributed memory multiprocessors. Technical report, The Queen's University, Belfast, Northern Ireland, 1993.
Eli Shamir and Eli Upfal. A probabilistic approach to the load-sharing problem in distributed systems. Journal of Parallel and Distributed Computing, 4, 1987.
Sherryl Tomboulian and Matthew Pappas. Indirect addressing and load balancing for faster solution to mandelbrot set on SIMD architectures. In Frontiers 91, 1991.
Shirley A. William. Models for Parallel Systems. Wiley, 1990.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1994 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fonlupt, C., Marquet, P., Dekeyser, JL. (1994). A data-parallel view of the load balancing experimental results on MasPar MP-1. In: Gentzsch, W., Harms, U. (eds) High-Performance Computing and Networking. HPCN-Europe 1994. Lecture Notes in Computer Science, vol 797. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-57981-8_141
Download citation
DOI: https://doi.org/10.1007/3-540-57981-8_141
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-57981-6
Online ISBN: 978-3-540-48408-0
eBook Packages: Springer Book Archive