Abstract
This paper describes a programming model that integrates intra-node asynchronous task parallelism with inter-node MPI communications to address the hybrid parallelism challenges faced by future extreme scale systems. We explore the integration of MPI’s blocking and non-blocking communications with lightweight tasks. We also provide the implementation details of a non-blocking runtime execution model based on computation and communication workers.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Charles, P., et al.: X10: an Object-Oriented Approach to Non-Uniform Cluster Computing. In: Proceedings of OOPSLA, pp. 519–538. ACM, New York (2005)
Marjanović, V., Labarta, J., Ayguadé, E., Valero, M.: Overlapping communication and computation by using a hybrid mpi/smpss approach. In: Proceedings of the 24th ACM International Conference on Supercomputing, New York, NY, USA, pp. 5–16 (2010)
Sarkar, V., Harrod, W., Snavely, A.E.: Software challenges in extreme scale systems. Journal of Physics: Conference Series 180(1), 012045 (2009)
Thakur, R., Gropp, W.: Test suite for evaluating performance of multithreaded mpi communication. Parallel Computing 35(12), 608–617 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yan, Y., Chatterjee, S., Budimlic, Z., Sarkar, V. (2011). Integrating MPI with Asynchronous Task Parallelism. In: Cotronis, Y., Danalis, A., Nikolopoulos, D.S., Dongarra, J. (eds) Recent Advances in the Message Passing Interface. EuroMPI 2011. Lecture Notes in Computer Science, vol 6960. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24449-0_41
Download citation
DOI: https://doi.org/10.1007/978-3-642-24449-0_41
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24448-3
Online ISBN: 978-3-642-24449-0
eBook Packages: Computer ScienceComputer Science (R0)