Abstract
Parallel asynchronous iterative algorithms relax synchronization and communication requirements, and can potentially extend Desktop Grids beyond embarrassingly parallel applications to support a broader class of parallel iterative applications. This paper presents the design and implementation of CometG, a decentralized (peer-to-peer) computational infrastructure that extends Desktop Grid environments to support these applications. CometG provides a decentralized and scalable tuple space, efficient communication and coordination support, and application-level abstractions that can be used to implement Desktop Grid applications based on parallel asynchronous iterative algorithms using the master-worker/BOT paradigm. The deployment and evaluations of CometG and a CometG-based application in a wide-area environment using the PlanetLab [7] test bed, as well as a campus network are presented.
Similar content being viewed by others
Abbreviations
- BOT:
-
bag of task
- PDE:
-
partial differential equation
References
‘Boinc.’ http://boinc.berkeley.edu/
‘Climatprediction.net.’ http://climateapps2.oucs.ox. ac.uk/cpdnboinc/download_main.php
‘Folding@Home.’ http://folding.stanford.edu/
‘mpiJava.’ http://www.hpjava.org/mpiJava.html
‘Predictor@Home.’ http://predictor.scripps.edu/
‘Project JXTA.’ http://www.jxta.org
‘Project PlanetLab.’ http://www.planet-lab.org
‘SETI@Home.’ http://setiathome.ssl.berkeley.edu/
‘XtremWeb.’ http://xw.lri.fr:4330/XtremWeb/
Antoniu, G., Hatcher, P., Jan, M., Noblet, D.P.: Evaluation of JXTA communication layers. In: Proceedings of the Fifth International Workshop on Global and Peer-to-Peer Computing (2005)
Bahi, J., Contassot-Vivier, S., Couturier, R.: Dynamic load balancing and efficient load estimators for asynchronous iterative algorithms. IEEE Trans. Parallel Distrib. Syst. 16(4), 289–299 (2005)
Bahi, J., Contassot-Vivier, S., Couturier, R. Vernier, F.: A decentralized convergence detection algorithm for asynchronous parallel iterative algorithms. IEEE Trans. Parallel Distrib. Syst. 16(1), 4–13 (2005)
Bahi, J.M., Domas, S., Mazouzi, K.: Combination of Java and asynchronism for the Grid: a comparative study based on a parallel power method. In: Proceedings of 18th International Parallel and Distributed Processing Symposium (2004)
Bakken, D.E., Schlichting, R.D.: Supporting fault-tolerant parallel programming in Linda. IEEE Trans. Parallel Distrib. Syst. 6(3), 287–302 (1995)
Baudet, G.M.: Asynchronous iterative methods for multiprocessors. J. ACM 25(2), 226–244 (1978)
Bertsekas, D.P., Tsitsiklis, J.N.: Convergence rate and termination of asynchronous iterative algorithms. In: Proceedings of the 3rd International Conference on Supercomputing, pp. 461–470 (1989)
Bertsekas, D.P., Tsitsiklis, J.N.: Parallel and distributed computation: Numerical methods. Athena Scientific (1997)
Browne, J.C., Yalamanchi, M., Kane, K., Sankaralingam, K.: General parallel computations on desktop grid and P2P systems. In: Proceedings of the 7th Workshop on Workshop on Languages, Compilers, and Run-time Support for Scalable Systems, pp. 1–8 (2004)
Carriero, N., Gelernter, D.: Linda in context. Commun. ACM 32(4), 444–459 (1989)
Cristian, F.: Understanding fault-tolerant distributed systems. Commun. ACM 34(2), 56–78 (1991)
Cristian, F., Fetzer, C.: The timed asynchronous distributed system model. IEEE Trans. Parallel Distrib. Syst. 10(6), 642–657 (1999)
Frommer, A., Szyld, D.: On asynchronous iterations. J. Comput. Appl. Math. 123(1), 201–216 (2000)
Gelernter, D.: Generative communication in Linda. ACM Trans. Program. Lang. Syst. 7(1), 80–112 (1985)
Huet, F., Caromel, D., Bal, H.E.: A high performance Java middleware with a real application. In: Proceedings of the Supercomputing Conference (2004)
Kondo, D., Taufer, M., Brooks, C., Casanova, H., Chien, A.: Characterizing and evaluating Desktop Grids: an empirical study. In: Proceedings of the International Parallel and Distributed Processing Symposium (2004)
Kreyszig, E.: Advanced Engineering Mathematics. Wiley (1998)
Li, Z., Parashar, M.: Comet: a scalable coordination space for decentralized distributed environments. In: Proceedings of the 2nd International Workshop on Hot Topics in Peer-to-Peer Systems, pp. 104–112 (2005)
Moon, B., Jagadish, H.V., Faloutsos, C., Saltz, J.H.: Analysis of the clustering properties of the Hilbert space-filling curve. IEEE Trans. Knowl. Data Eng. 13(1), 124–141 (2001)
Nieuwpoort, R.V., Maassen, J., Kielmann, T., Bal, H.E.: Satin: simple and efficient Java-based Grid programming. Scalable Computing: Practice and Experience 6(3), 19–32 (2005)
Obreiter, P.: Extending truple spaces towards a middleware for eCommerce. Thesis, University of Karlsruhe (2000)
Oliveira, L., Lopes, L., Silva, F.: \(P^{3}\): parallel peer-to-peer an internet parallel programming environment. In: Proceedings of the Workshop on Web Engineering and Peer-to-Peer Computing (2002)
Plaat, A.: Optimizing parallel applications for wide-area clusters. In: Proceedings of the 12th. International Parallel Processing Symposium, p. 784 (1998)
Sankaralingam, K., Yalamanchi, M., Sethumadhavan, S., Browne, J.C.: Pagerank computation and keyword search on distributed systems and P2P networks. J. Grid Computing 1(3), 291–307 (2003)
Schmidt, C., Parashar, M.: Enabling flexible queries with guarantees in P2P systems. IEEE Internet Computing, Special issue on Information Dissemination on the Web (3), 19–26 (2004)
Sterck, H.D., Markel, R.S., Phol, T., Rüde, U.: A lightweight Java taskspaces framework for scientific computing on computational Grids. In: Proceedings of the ACM symposium on Applied computing, pp. 1024–1030 (2003)
Stoica, I., Morris, R., Karger, D., Kaashoek, F., Balakrishnan, H.: Chord: a scalable peer-to-peer lookup service for internet applications. In: Proceedings of the ACM SIGCOMM Conference (2001)
Tolksdorf, R., Glaubitz, D.: Coordinating web-based systems with documents in XMLSpaces. In: Proceedings of the 6th International Conference on Cooperative Information Systems (2001)
Wilkinson, B., Allen, M.: Parallel programming: Techniques and applications using networked workstations and parallel computers. Prentice Hall (2004)
World Wide Web Consortium. Document Object Model (DOM) Level 2 Core Specification. W3C Recommendation (2000). http://www.w3.org/TR/DOM-Level-2-Core
Yalamanchilli, N., Cohen, W.W.: Communication performance of Java-based parallel virtual machines. Concurrency – Practice and Experience 10(11–13), 1189–1196 (1998)
Zhang, Y., Li, X.S., Marques, O.: Towards an automatic and application-based eigensolver selection. In: LACSI Symposium (2005) accepted
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, Z., Parashar, M. A Decentralized Computational Infrastructure for Grid-Based Parallel Asynchronous Iterative Applications. J Grid Computing 4, 355–372 (2006). https://doi.org/10.1007/s10723-006-9033-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10723-006-9033-9