Abstract
Peer-to-peer (P2P) computing offers new opportunities for building highly distributed data systems. Unlike client-server computing, P2P can operate without central coordination and offer important advantages such as a very dynamic environment where peers can join and leave the network at any time; direct and fast communication between peers, and scale up to large number of peers. However, most deployed P2P systems have severe limitations: file-level sharing, read-only access, simple search and poor scaling. In this paper, we discuss the issues of providing high-level data management services (schema, queries, replication, availability, etc.) in a P2P system. This implies revisiting distributed database technology in major ways. We illustrate how we address some of these issues in the APPA data management system under development in the Atlas group.
Work partially funded by project MDP2P (Massive Data in P2P) [ 15] of the ACI “Masses de Données” of the French ministry of research.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Aberer, K., et al.: P-Grid: a self-organizing structured P2P system. SIGMOD Record 32(3) (2003)
Abiteboul, S., et al.: Dynamic XML documents with distribution and replication. In: SIGMOD Conf. (2003)
Akbarinia, R., Martins, V., Pacitti, E., Valduriez, P.: Replication and query processing in the APPA data management system. Submitted for publication (2004)
Anceaume, E., Gradinariu, M., Roy, M.: Self-organizing systems case study : peer-to-peer systems. In: DISC Conf. (2003)
Chockler, G., Keidar, I., Vitenberg, R.: Group communication specifications: a comprehensive study. ACM Computing Surveys 33, 427–469 (2001)
Clarke, et al.: Protecting Free Expression Online with Freenet. IEEE Internet Computing 6(1) (2002)
Daswani, N., Garcia-Molina, H., Yang, B.: Open problems in data-sharing peer-to-peer systems. In: Int. Conf. on Database Theory (2003)
Gnutella., http://www.gnutelliums.com/
Huebsch, R., et al.: Querying the Internet with PIER. In: VLDB Conf. (2003)
Iamnitchi, A., Ripeanu, M., Foster I.T.: Locating data in (small world?) peer-to-peer scientific collaborations. In: Int. workshop on P2P Systems, IPTPS (2002)
ICQ., http://www.icq.com/
JXTA., http://www.jxta.org/
Kazaa., http://www.kazaa.com/
Levy, A., Rajaraman, A., Ordille J.J.: Querying heterogeneous information sources using source descriptions. In: VLDB Conf. (1996)
MDP2P, http://www.sciences.univ-nantes.fr/info/recherche/ATLAS/MDP2P/
Naspter., http://www.napster.com/
Nejdl, W., Siberski, W., Sintek, M.: Design issues and challenges for RDF- and schema-based peer-to-peer systems. SIGMOD Record 32(3) (2003)
Ooi, B., Shu, Y., Tan, K.-L.: Relational data sharing in peer-based data management systems. SIGMOD Record 32(3) (2003)
Özsu, T., Valduriez, P.: Principles of Distributed Database Systems, 2nd edn. Prentice Hall, Englewood Cliffs (1999)
Pacitti, E., Dedieu, O.: Algorithms for optimistic replication on the Web. Journal of the Brazilian Computing Society 8(2) (2002)
Pacitti, E., Simon, E.: Update propagation strategies to improve freshness in lazy master replicated databases. The VLDB Journal 8(3-4) (2000)
Pacitti, E., Özsu, T., Coulon, C.: Preventive multi-master replication in a cluster of autonomous databases. In: Kosch, H., Böszörményi, L., Hellwagner, H. (eds.) Euro-Par 2003. LNCS, vol. 2790, pp. 318–327. Springer, Heidelberg (2003)
Preguiça, N., Shapiro, M., Matheson, C.: Semantics-based reconciliation for collaborative and mobile environments. In: CoopIS Conf. (2003)
Ratnasamy, S., et al.: A scalable content-addressable network. In: Proc. of SIGCOMM (2001)
SETI@home., http://www.setiathome.ssl.berkeley.edu/
Shapiro, M.: A simple framework for understanding consistency with partial replication. Technical Report, Microsoft Research (2004)
Stoica, et al.: Chord: A scalable peer-to-peer lookup service for internet applications. In: Proc. of SIGCOMM (2001)
Tanaka, P.V.: The Ecobase environmental information system: applications, architecture and open issues. ACM SIGMOD Record 3(5-6) (2000)
Tatarinov, et al.: The Piazza peer data management project. SIGMOD Record 32(3) (2003)
Tomasic, L., Raschid, P.V.: Scaling access to heterogeneous data sources with DISCO. IEEE Trans. on Knowledge and Data Engineering 10(5) (1998)
Valduriez, P.: Parallel Database Systems: open problems and new issues. Int. Journal on Distributed and Parallel Databases 1(2) (1993)
Yang, H.G.-M.: Designing a super-peer network. In: Int. Conf. on Data Engineering (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Valduriez, P., Pacitti, E. (2005). Data Management in Large-Scale P2P Systems. In: Daydé, M., Dongarra, J., Hernández, V., Palma, J.M.L.M. (eds) High Performance Computing for Computational Science - VECPAR 2004. VECPAR 2004. Lecture Notes in Computer Science, vol 3402. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11403937_9
Download citation
DOI: https://doi.org/10.1007/11403937_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25424-9
Online ISBN: 978-3-540-31854-5
eBook Packages: Computer ScienceComputer Science (R0)