Abstract
Large scale irregular applications involve data arrays and other data structures that are too large to fit in main memory and hence reside on disks; such applications are called out-of-core applications. This paper presents techniques for implementing this kind of applications. In particular we present a design for a runtime system to efficiently support parallel execution of irregular out-of-core codes on distributed-memory systems. Furthermore, we describe the appropriate program transformations required to reduce the I/O overheads for staging data as well as for communication while maintaining load balance. The proposed techniques can be used by a parallelizing compiler or by users writing programs in node + message passing style. We have done a preliminary implementation of the techniques presented here. We introduce experimental results from a template CFD code to demonstrate the efficacy of the presented techniques.
The work described in this paper is being carried out as part of the research project “Language, Compiler and Advanced Data Structure Support for Parallel I/O Operations” supported by the Austrian Research Foundation (FWF Grant P11006-MAT).
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
P. Brezany and Alok Choudhary. Techniques and optimizations for developing irregular out-of-core applications on distributed-memory systems. Technical Report Version 1.0, Institute for Software Technology and Parallel Systems, University of Vienna, November 1996.
Alok Choudhary, Rajesh Bordawekar, Michael Harry, Rakesh Krishnaiyer, Ravi Ponnusamy, Tarvinder Singh, and Rajeev Thakur. PASSION: parallel and scalable software for input-output. Technical Report SCCS-636, ECE Dept., NPAC and CASE Center, Syracuse University, September 1994.
R. Das and J. Saltz. A manual for PARTI runtime primitives — Revision 2, December 1990.
R. Ponnusamy et al. A manual for the CHAOS runtime library. Technical report, University of Maryland, May 1994.
C. Koelbel. Compiling programs for nonshared memory machines. Technical Report Ph.D. Dissertation, Purdue University, West Lafayette, November 1990.
D. J. Mavriplis. Three dimensional unstructured multigrid for the Euler equations. In AIAA 10th Computational Fluid Dynamics Conference, pages paper 91–1549cp, June 1991.
R. Ponnusamy, J. Saltz, A. Choudhary, Y.-S. Hwang, and G. Fox. Runtime support and compilation methods for user-specified data distributions. IEEE Transactions on Parallel and Distributed Systems, August 1995.
Ravi Ponnusamy. Runtime Support and Compilation Methods for Irregular Computations on Distributed Memory Parallel Machines. PhD thesis, Department of Computer and Information Science, Syracuse University, Syracuse, NY, 1994.
J. Saltz, K. Crowley, R. Mirchandaney, and H. Berryman. Run-time scheduling and execution of loops on message passing machines. Journal of Parallel and Distributed Computing, 8(2):303–312, 1990.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Brezany, P., Choudhary, A., Dang, M. (1997). Parallelization of irregular out-of-core applications for distributed-memory systems. In: Hertzberger, B., Sloot, P. (eds) High-Performance Computing and Networking. HPCN-Europe 1997. Lecture Notes in Computer Science, vol 1225. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0031652
Download citation
DOI: https://doi.org/10.1007/BFb0031652
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-62898-9
Online ISBN: 978-3-540-69041-2
eBook Packages: Springer Book Archive