Abstract
Data redistribution of parallel data representations has become an important factor of grid frameworks for scientific computing. Providing the developers with generalized interfaces for flexible parallel data redistribution is a major goal of this research. In this article we present the architecture and the implementation of the redistribution module of TGrid. TGrid is a grid-enabled runtime system for applications consisting of cooperating multiprocessor tasks (M-tasks). The data redistribution module enables TGrid components to transfer data structures to other components which may be located on the same local subnet or may be executed remotely. We show how the parallel data redistribution is designed to be flexible, extendible, scalable, and particularly easy-to-use. The article includes a detailed experimental analysis of the redistribution module by providing a comparison of throughputs which were measured for a large range of processors and for different interconnection networks.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Hunold, S., Rauber, T., Rünger, G.: TGrid – Grid Runtime Support for Hierarchically Structured Task-Parallel Programs. In: Proceedings of the Fifth International Workshop on Algorithms, Models and Tools for Parallel Computing on Heterogeneous Networks. IEEE Computer Society Press, Los Alamitos (2006)
Rauber, T., Rünger, G.: Tlib - A Library to Support Programming with Hierarchical Multi-Processor Tasks. Journal of Parallel and Distributed Computing 65, 347–360 (2005)
Hunold, S., Rauber, T., Rünger, G.: Multilevel Hierarchical Matrix Multiplication on Clusters. In: Proceedings of the 18th Annual ACM International Conference on Supercomputing, ICS 2004, pp. 136–145 (2004)
Rauber, T., Rünger, G.: M-Task-Programming for Heterogeneous Systems and Grid Environments. In: Proc. of the IPDPS Joint Workshop on High-Performance Grid Computing and High-Level Parallel Programming Models. IEEE, Los Alamitos (2005)
Beckman, P.H., Fasel, P.K., Humphrey, W.F., Mniszewski, S.M.: Efficient Coupling of Parallel Applications Using PAWS. In: HPDC 1998: Proceedings of the The Seventh IEEE International Symposium on High Performance Distributed Computing, Washington, DC, USA, p. 215. IEEE Computer Society, Washington (1998)
Larson, J., Jacob, R., Ong, E.: The Model Coupling Toolkit: A New Fortran90 Toolkit for Building Multiphysics Parallel Coupled Models. Int. J. High Perform. Comput. Appl. 19, 277–292 (2005)
Lee, J.-Y., Sussman, A.: High Performance Communication between Parallel Programs. In: IPDPS 2005: Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS 2005) - Workshop 4, p. 177.2. IEEE Computer Society Press, Washington (2005)
Bertrand, F., Bramley, R., Damevski, K.B., Kohl, J.A., Bernholdt, D.E., Larson, J.W., Sussman, A.: Data Redistribution and Remote Method Invocation in Parallel Component Architectures. In: Proceedings of the 19th International Parallel and Distributed Processing Symposium: IPDPS (2005), Best Paper Award
Zhang, L., Parashar, M.: Enabling efficient and flexible coupling of parallel scientific applications. In: International Parallel and Distributed Processing Symposium IPDPS 2006, Rhodes Island, Greece. IEEE Computer Society Press, Los Alamitos (2006)
Bertrand, F., Bramley, R.: DCA: A Distributed CCA Framework Based on MPI. In: 18th International Parallel and Distributed Processing Symposium (IPDPS 2004), Santa Fe, New Mexico, USA, pp. 90–97. IEEE Computer Society, Los Alamitos (2004)
Krishnan, S., Gannon, D.: XCAT3: A Framework for CCA Components as OGSA Services. In: 18th International Parallel and Distributed Processing Symposium (IPDPS 2004), CD-ROM / Abstracts Proceedings, Santa Fe, New Mexico, USA, 26-30 April 2004, pp. 90–97. IEEE Computer Society, Los Alamitos (2004)
Jeannot, E., Wagner, F.: Messages Scheduling for data Redistribution between Heterogeneous Clusters. In: Proceedings of the IASTED International Conference on Parallel and Distributed Computing and Systems (PDCS 2005) (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hunold, S., Rauber, T., Rünger, G. (2006). Design and Evaluation of a Parallel Data Redistribution Component for TGrid. In: Guo, M., Yang, L.T., Di Martino, B., Zima, H.P., Dongarra, J., Tang, F. (eds) Parallel and Distributed Processing and Applications. ISPA 2006. Lecture Notes in Computer Science, vol 4330. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11946441_58
Download citation
DOI: https://doi.org/10.1007/11946441_58
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-68067-3
Online ISBN: 978-3-540-68070-3
eBook Packages: Computer ScienceComputer Science (R0)