Measuring the performance of parallel computers with distributed memory
Pages 941 - 951
Abstract
Basic techniques for measuring the performance of parallel computers with distributed memory are considered. The results obtained via the de-facto standard LINPACK benchmark suite are shown to be weakly related to the efficiency of applied parallel programs. As a result, models and methods of macro-piping computations proposed by V. M. Glushkov in the late 1970s become topical again. These results are presented in the context of the modern architecture of cluster complexes.
References
[1]
J. Dongarra, "Performance of various computers using standard linear equations software," LINPACK Benchmark Report, Univ. of Tennessee (2008).
[2]
V. M. Glushkov, Yu. V. Kapitonova, and A. A. Letichevskii, "Design theory of multiprocessor computer hardware and software," Cybernetics, No. 6, 811-822 (1978).
[3]
M. Baboulin, J. Dongarra, and S. Tomov, "Some issues in dense linear algebra for multicore and special purpose architectures," EECS Tech. Report LAWN #200 (2008).
[4]
A. Y. Grama, A. Gupta, and V. Kumar, "Isoefficiency: Measuring the scalability of parallel algorithms and architectures," EEE Computer Soc. Press, 1, No. 3, 12-21 (1993).
[5]
O. L. Perevozchikova, V. G. Tulchinsky, and R. A. Yushchenko, "Design and Optimization of Parallel Computers for Processing Mass Data," Cybernetics and Systems Analysis, No. 4, 559-569 (2006).
[6]
R. A. Iushchenko, "Estimation of efficiency of supercomputer architectures for various parallel programming patterns," Art. Intellig., No. 3, 447-453 (2007).
[7]
E. Gamma, R. Helm, R. Johnson, et al., Design Patterns: Elements of Reusable Object-Oriented Software, Addison-Wesley, New York (1995).
[8]
T. Mattson, B. Sanders, and B. L. Massingil, Patterns for Parallel Programming, Addison-Wesley, New York (2004).
[9]
R. Reussner, P. Sanders, L. Prechelt, et al., "SKaMPI: A detailed, accurate MPI benchmark," in: Proc. Int. Conf. "EuroPVM/MPI'98," Kluwer, Liverpool (1998), pp. 83-93.
[10]
H. Shan and J. Shalf, Using IOR to Analyze the I/O performance for HPC Platforms, Lawrence Berkeley Nat. Lab., Paper LBNL-62647 (2007) (http://repositories.cdlib.org/lbnl/LBNL-62647).
[11]
J. Dongarra, P. Luszczek, and A. Petitet, "The LINPACK Benchmark: Past, present, and future," Concurrency and Computation: Practice and Experience, 15, No. 9, 803-820 (2002).
[12]
P. Luszczek, J. J. Dongarra, D. Koester, et al., Introduction to the HPC Challenge Benchmark Suite, http://icl.cs.utk.edu/projectsfiles/hpcc/pubs/hpcc-challenge-benchmark05.pdf.
[13]
A. N. Khimich, I. N. Molchanov, V. I. Mova, O. L. Perevozchikova, et al., Numerical Software Support of the MIMD Computer Inparcom {in Russian}, Naukova Dumka, Kiev (2007).
[14]
R. A. Iushchenko, "Cluster control system for Inparcom complexes," Komp. Matem., No. 1, 96-103 (2007).
[15]
G. Bosilca, R. Delmas, J. Dongarra, and J. Langou, "Algorithmic based fault tolerance applied to high-performance computing," LAPACK Working Note, No. 205, 5-17 (2008).
[16]
M. Baboulin, A. Buttari, J. Dongarra, et al., "Accelerating scientific computations with mixed precision algorithms," Computational Physics, 35-49 (2008).
- Measuring the performance of parallel computers with distributed memory
Recommendations
Design and optimization of parallel computers for processing mass data
Problems of high-performance processing of mass cluster data are considered. Estimates of execution times of parallel data processing programs and a heuristic algorithm of optimization of cluster architectures for such problems are proposed.
The NYU Ultracomputer Designing an MIMD Shared Memory Parallel Computer
We present the design for the NYU Ultracomputer, a shared-memory MIMD parallel machine composed of thousands of autonomous processing elements. This machine uses an enhanced message switching network with the geometry of an Omega-network to approximate ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © Copyright © 2009 Springer Science+Business Media, Inc.
Publisher
Kluwer Academic Publishers
United States
Publication History
Published: 01 November 2009
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 16 Nov 2024
Other Metrics
Citations
View Options
View options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in