Abstract
Applications based on highly irregular, dynamically changing data structures cannot be handled efficiently with current High Performance Fortran and available HPF compilers. In order to support such applications, extensions of the language as well as sophisticated analysis and parallelization techniques are required. In this paper we introduce the Vienna HPF+ Compiler (VFC), a new source-to-source parallelization system for HPF+, an optimized version of HPF, which addresses the requirements of advanced irregular applications. In addition to extended data distribution and work distribution mechanisms, VFC supports various features of HPF+ to reduce preprocessing and communication overheads. The system provides powerful runtime parallelization strategies for complex loop nests with indirect array accesses which are common in irregular codes. Performance measurements show that the use of language features for communication schedule reuse results in a performance close to hand-written message passing programs.
The work described in this paper was partially supported by the ESPRIT IV Long Term Research Project 21033 “HPF+” of the European Commission.
Preview
Unable to display preview. Download preview PDF.
References
P. Banerjee, J. A. Chandy, M. Gupta, E. W. Hodges, J. G. Holm, A. Lain, D. J. Palermo, S. Ramaswamy, E. Su. The PARADIGM Compiler for Distributed-Memory Multicomputers, IEEE Computer, Vol. 28, Nr. 10, October 1995.
S. Barros, D. Dent, L. Isaksen, G. Robinson, G. Mozdzynski, and F. Wollenweber. The IFS model: A parallel production weather code. Parallel Computing 21, 1995.
S. Benkner. HPF+: High Performance Fortran for Advanced Industrial Applications. Proceedings HPCN'98, Amsterdam, April 1998.
S. Benkner, P. Mehrotra, J. Van Rosendale, and H. Zima. High-Level Management of Communication Schedules in HPF-Like Languages. NASA Contractor Report 201740, ICASE, Hampton, VA, September 1997.
S. Benkner, et.al. Vienna Fortran Compilation System. Version 1.2. User's Guide, Univ. of Vienna, Inst. f. Software Technology and Parallel Systems, February 1996.
S. Benkner. Handling Block-Cyclic Distributed Arrays in Vienna Fortran 90. IEEE Proc. International Conference on Parallel Architectures and Compilation Techniques (PACT'95) Limassol, Cyprus, June 1995
S. Benkner. Vienna Fortran 90 and its Compilation. Ph.D. Thesis. TR 94-8, University of Vienna, Institute for Software Technology and Parallel Systems, 1994.
T. Brandes, F. Zimmermann. ADAPTOR — A Transformation Tool for HPF Programs, In: Programming Environments for Massively Parallel Distributed Systems, Birkhaeuser Verlag, pp. 91–96, April 1994.
Brezany,P., Cheron,O., Sanjari,K., van Konijnenburg,E.: Processing Irregular Codes Containing Arrays with Multi-Dimensional Distributions by the PREPARE HPF Compiler. In Proceedings of the International Conference on High Performance Computing and Networking, Milan, May 1995.
Carpenter, B. Adlib: A Distributed Array Library to Support HPF Translation, Proc. 5th Workshop on Compilers for Parallel Computers, Malaga, June 1995.
B. Chapman, H. Zima, P. Mehrotra. Extending HPF for Advanced Data Parallel Applications. IEEE Parallel and Distributed Technology, Fall 1994.
B. Chapman, H. Zima, M. Haines, P. Mehrotra, J. Van Rosendale. OPUS: A Coordination Language for Multidisciplinary Applications. Journal of Scientific Programming, 1995.
J. Clinckemaillie, B. Elsner, G. Lonsdale, S. Meliciani, S. Vlachoutsis, F. de Bruyne, M. Holzner. Performance Issues of the Parallel PAM-CRASH Code. Journal of Supercomputing Applications and High-Performance Computing, Vol. 11, No. l, 1997.
High Performance Fortran Forum. High Performance Fortran Language Specification. Version 1.1 TR, Rice University, November 10, 1994.
High Performance Fortran Forum. High Performance Fortran Language Specification. Version 2.0 TR, Rice University, January 31, 1997.
ISO. Fortran 90 Standard, May 1991, ISO/IEC 1539:1991 (E)
R. Keryell, C. Ancourt, F. Coelho, B. Creusillet, F. Irigoin, and P. Jouvelot. PIPS: A Framework for Building Interprocedural Compilers, Parallelizers and Optimizers. Technical Report 289, CRI, Ecole des mines de Paris, April 1996.
J. Knoop and E. Mehofer. Interprocedural distribution assignment placement: More than just enhancing intraprocedural placing techniques. IEEE Proc. International Conference on Parallel Architectures and Compilation Techniques (PACT'97) San Francisco, CA, November 1997.
J. H. Merlin, D. B. Carpenter and A. J. G. Hey. SHPF: a Subset High Performance Fortran compilation system. Fortran Journal, pages 2–6, March/April 1996.
Message Passing Interface Forum. MPI: A Message-Passing Interface Standard Version 1.1, June 1995. MPI-2: Extensions to the Message-Passing Interface, July 1997.
H. Zima, P. Brezany, B. Chapman, P. Mehrotra, A. Schwald. Vienna Fortran — a language specification. ICASE Internal Report 21, ICASE, Hampton, VA, September 1992.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Benkner, S., Saniari, K., Sipkova, V., Velkov, B. (1998). Parallelizing irregular applications with the Vienna HPF- Compiler VFC. In: Sloot, P., Bubak, M., Hertzberger, B. (eds) High-Performance Computing and Networking. HPCN-Europe 1998. Lecture Notes in Computer Science, vol 1401. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0037209
Download citation
DOI: https://doi.org/10.1007/BFb0037209
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64443-9
Online ISBN: 978-3-540-69783-1
eBook Packages: Springer Book Archive