Abstract
The LogP model was used to measure the effects of latency, occupancy and bandwidth on distributed memory multiprocessors. The idea was to characterize distributed memory multiprocessor using these key parameters, studying their impacts on performance in simulation environments. This work proposes a new model, based on LogP, that describes the impacts on performance of applications executing on a heterogeneous cluster. This model can be used, in a near future, to help choose the best way to split a parallel application to be executed on this architecture. The model considers that a heterogeneous cluster is composed by distinct types of processors, accelerators and networks.
The authors would like to thank UFJF, FAPEMIG, CAPES, and CNPq.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alexandrov, A., Ionescu, M.F., Schauser, K.E., Scheiman, C.: LogGP: incorporating long messages into the logP model one step closer towards a realistic model for parallel computation. In: Proceedings of the seventh annual ACM symposium on Parallel algorithms and architectures, pp. 95–105. ACM (1995)
Bailey, D.H., Barszcz, E., Barton, J.T., Browning, D.S., Carter, R.L., Dagum, L., Fatoohi, R.A., Frederickson, P.O., Lasinski, T.A., Schreiber, R.S., et al.: The NAS parallel benchmarks. Int. J. High Perform. Comput. Appl. 5(3), 63–73 (1991)
Bosque, J.L., Pastor, L.: A parallel computational model for heterogeneous clusters. IEEE Trans. Parallel Distrib. Syst. 17(12), 1390 (2006)
Culler, D., Karp, R., Patterson, D., Sahay, A., Schauser, K.E., Santos, E., Subramonian, R., Von Eicken, T.: LogP: towards a realistic model of parallel computation, vol. 28. ACM (1993)
Doerfler, D., Brightwell, R.: Measuring MPI send and receive overhead and application availability in high performance network interfaces. In: Mohr, B., Träff, J.L., Worringen, J., Dongarra, J. (eds.) EuroPVM/MPI 2006. LNCS, vol. 4192, pp. 331–338. Springer, Heidelberg (2006). doi:10.1007/11846802_46
Holt, C., Heinrich, M., Singh, J.P., Rothberg, E., Hennessy, J.: The effects of latency, occupancy, and bandwidth in distributed shared memory multiprocessors. Stanford University, Computer Systems Laboratory (1995)
Kielmann, T., Bal, H.E., Verstoep, K.: Fast measurement of LogP parameters for message passing platforms. In: Rolim, J. (ed.) IPDPS 2000. LNCS, vol. 1800, pp. 1176–1183. Springer, Heidelberg (2000). doi:10.1007/3-540-45591-4_162
Lastovetsky, A., Mkwawa, I.H., O’Flynn, M.: An accurate communication model of a heterogeneous cluster based on a switch-enabled ethernet network. In: 12th International Conference on Parallel and Distributed Systems, ICPADS 2006, vol. 2, p. 6. IEEE (2006)
Lastovetsky, A., Rychkov, V.: Building the communication performance model of heterogeneous clusters based on a switched network. In: IEEE International Conference on Cluster Computing, 2007, pp. 568–575. IEEE (2007)
LeVeque, R.: Finite Difference Methods for Ordinary and Partial Differential Equations: Steady-State and Time-Dependent Problems (Classics in Applied Mathematics Classics in Applied Mathemat). Society for Industrial and Applied Mathematics, Philadelphia, PA, USA (2007)
Martin, R.P., Vahdat, A.M., Culler, D.E., Anderson, T.E.: Effects of communication latency, overhead, and bandwidth in a cluster architecture, vol. 25. ACM (1997)
Pigozzo, A.B., Macedo, G.C., Santos, R.W., Lobosco, M.: On the computational modeling of the innate immune system. BMC Bioinform. 14(Suppl 6), S7 (2007)
Rocha, P.A.F., Xavier, M.P., Pigozzo, A.B., M. Quintela, B., Macedo, G.C., Santos, R.W., Lobosco, M.: A three-dimensional computational model of the innate immune system. In: Murgante, B., Gervasi, O., Misra, S., Nedjah, N., Rocha, A.M.A.C., Taniar, D., Apduhan, B.O. (eds.) ICCSA 2012. LNCS, vol. 7333, pp. 691–706. Springer, Heidelberg (2012). doi:10.1007/978-3-642-31125-3_52
Soares, T.M., Xavier, M.P., Pigozzo, A.B., Campos, R.S., Santos, R.W., Lobosco, M.: Performance evaluation of a human immune system simulator on a GPU cluster. In: Malyshkin, V. (ed.) PaCT 2015. LNCS, vol. 9251, pp. 458–468. Springer, Heidelberg (2015). doi:10.1007/978-3-319-21909-7_44
Valiant, L.G.: A bridging model for parallel computation. Commun. ACM 33(8), 103–111 (1990)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Soares, T.M., dos Santos, R.W., Lobosco, M. (2016). A Parallel Model for Heterogeneous Cluster. In: Carretero, J., et al. Algorithms and Architectures for Parallel Processing. ICA3PP 2016. Lecture Notes in Computer Science(), vol 10049. Springer, Cham. https://doi.org/10.1007/978-3-319-49956-7_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-49956-7_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-49955-0
Online ISBN: 978-3-319-49956-7
eBook Packages: Computer ScienceComputer Science (R0)