Abstract
The paper presents an approach to the performance analysis of heterogeneous parallel algorithms. As a typical heterogeneous parallel algorithm is just a modification of some homogeneous one, the idea is to compare the heterogeneous algorithm with its homogeneous prototype, and to assess the heterogeneous modification rather than to analyse the algorithm as an isolated entity. A criterion of optimality of heterogeneous parallel algorithms is suggested. A parallel algorithm of matrix multiplication on heterogeneous clusters is used to demonstrate the proposed approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Crandall, P., Quinn, M.: Block Data Decomposition for Data-Parallel Programming on a Heterogeneous Workstation Network. In: Proceedings of the Second International Symposium on High Performance Distributed Computing, Spokane, WA, USA, pp. 42–49 (1993)
Kaddoura, M., Ranka, S., Wang, A.: Array Decomposition for Nonuniform Computational Environments. Journal of Parallel and Distributed Computing 3, 91–105 (1996)
Kalinov, A., Lastovetsky, A.: Heterogeneous Distribution of Computations Solving Linear Algebra Problems on Networks of Heterogeneous Computers. Journal of Parallel and Distributed Computing 61, 520–535 (2001)
Beaumont, O., Boudet, V., Rastello, F., Robert, Y.: Matrix Multiplication on Heterogeneous Platforms. IEEE Transactions on Parallel and Distributed Systems 12, 1033–1051 (2001)
Fortune, S., Wyllie, J.: Parallelism in Random Access Machines. In: Proceedings of the 10th Annual Symposium on Theory of Computing, San Diego, CA, USA, pp. 114–118 (1978)
Valiant, L.G.: A Bridging Model for Parallel Computation. Communications of the Association for Computing Machinery 33, 103–111 (1990)
Culler, D.E., Karp, R.M., Patterson, D.A., Sahay, A., Schauser, K.E., Santos, E., Subramonian, R., von Eicken, T.: LogP: Towards a Realistic Model of Parallel Computation. In: Proceedings of the 4th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, San Diego, CA, USA (1993)
Lastovetsky, A.: Adaptive parallel computing on heterogeneous networks with mpC. Parallel Computing 28, 1369–1407 (2002)
Beaumont, O., Carter, L., Ferrante, J., Legrand, A., Robert, Y.: Bandwidth-Centric Allocation of Independent Tasks on Heterogeneous Platforms. In: Proceedings of 16th International Parallel and Distributed Processing Symposium, CD-ROM/Abstracts Proceedings, Fort Lauderdale, FL, USA, IEEE Computer Society Press, Los Alamitos (2002)
Blackford, L., Choi, J., Cleary, A., Demmel, J., Dhillon, I., Dongarra, J., Hammarling, S., Henry, G., Petitet, A., Stanley, K., Walker, D., Whaley, R.: ScaLAPACK: A Portable Linear Algebra Library for Distributed Memory Computers – Design Issues and Performance. In: Proceedings of the 1996 ACM/IEEE Supercomputing Conference, CD-ROM/Abstracts Proceedings, Pittsburgh, PA, USA, IEEE Computer Society Press, Los Alamitos (1996)
High Performance Fortran Language Specification, Version 2.0. High Performance Fortran Forum (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lastovetsky, A., Reddy, R. (2003). An Approach to Assessment of Heterogeneous Parallel Algorithms. In: Malyshkin, V.E. (eds) Parallel Computing Technologies. PaCT 2003. Lecture Notes in Computer Science, vol 2763. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45145-7_10
Download citation
DOI: https://doi.org/10.1007/978-3-540-45145-7_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40673-0
Online ISBN: 978-3-540-45145-7
eBook Packages: Springer Book Archive