Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3465084.3467932acmconferencesArticle/Chapter ViewAbstractPublication PagespodcConference Proceedingsconference-collections
research-article

Time-Optimal Construction of Overlay Networks

Published: 23 July 2021 Publication History

Abstract

We show how to construct an overlay network of constant degree and diameter O(log n) in time O(log n) starting from an arbitrary weakly connected graph. We assume a synchronous communication network in which nodes can send messages to nodes they know the identifier of and establish new connections by sending node identifiers. If the initial network's graph is weakly connected and has constant degree, then our algorithm constructs the desired topology with each node sending and receiving only O(log n) messages in each round in time O(log n), w.h.p., which beats the currently best O(log3/2 n) time algorithm of [Götte et al., SIROCCO'19]. Since the problem cannot be solved faster than by using pointer jumping for O(log n) rounds (which would even require each node to communicate Ω(n) bits), our algorithm is asymptotically optimal. We achieve this speedup by using short random walks to repeatedly establish random connections between the nodes that quickly reduce the conductance of the graph using an observation of [Kwok and Lau, APPROX'14].
Additionally, we show how our algorithm can be used to efficiently solve graph problems in hybrid networks [Augustine et al., SODA'20]. Motivated by the idea that nodes possess two different modes of communication, we assume that communication of the initial edges is unrestricted. In contrast, only polylogarithmically many messages can be communicated over edges that have been established throughout an algorithm's execution. For an (undirected) graph G with arbitrary degree, we show how to compute connected components, a spanning tree, and biconnected components in time O(log n), w.h.p. Furthermore, we show how to compute an MIS in time O(log d + log log n), w.h.p., where d is the initial degree of G.

Supplementary Material

MP4 File (PODC_p260.mp4)
Presentation video for PODC 2021

References

[1]
Dana Angluin, James Aspnes, Jiang Chen, Yinghua Wu, and Yitong Yin. Fast Construction of Overlay Networks. In Proc. of the 17th Annual ACM Symposium on Parallelism in Algorithms and Architectures (SPAA), pages 145--154, 2005.
[2]
James Aspnes and Gauri Shah. Skip graphs. In Proc. of the 14th ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 384--393, 2003.
[3]
James Aspnes and Yinghua Wu. O(logn)-time overlay network construction from graphs with out-degree 1. In Eduardo Tovar, Philippas Tsigas, and Hacè ne Fouchal, editors, Proc. of the 11th International Conference on Principles of Distributed Systems (OPODIS), volume 4878 of Lecture Notes in Computer Science, pages 286--300. Springer, 2007.
[4]
Sepehr Assadi, Xiaorui Sun, and Omri Weinstein. Massively parallel algorithms for finding well-connected components in sparse graphs. In Peter Robinson and Faith Ellen, editors, Proc. of the 2019 ACM Symposium on Principles of Distributed Computing (PODC), pages 461--470. ACM, 2019.
[5]
John Augustine, Keerti Choudhary, Avi Cohen, David Peleg, Sumathi Sivasubramaniam, and Suman Sourav. Distributed graph realizations textdagger. In 2020 IEEE International Parallel and Distributed Processing Symposium (IPDPS), New Orleans, LA, USA, May 18-22, 2020, pages 158--167. IEEE, 2020.
[6]
John Augustine, Mohsen Ghaffari, Robert Gmyr, Kristian Hinnenthal, Fabian Kuhn, Jason Li, and Christian Scheideler. Distributed computation in node-capacitated networks. In Proc. of the 31st Annual ACM Symposium on Parallelism in Algorithms and Architectures (SPAA), 2019.
[7]
John Augustine, Kristian Hinnenthal, Fabian Kuhn, Christian Scheideler, and Philipp Schneider. Shortest paths in a hybrid network model. In Proceedings of the Fourteenth Annual ACM-SIAM Symposium on Discrete Algorithms, pages 1280--1299. SIAM, 2020.
[8]
John Augustine, Gopal Pandurangan, Peter Robinson, Scott T. Roche, and Eli Upfal. Enabling robust and efficient distributed computation in dynamic peer-to-peer networks. In Proc. of 56th IEEE Annual Symposium on Foundations of Computer Science (FOCS), pages 350--369, 2015.
[9]
John Augustine and Sumathi Sivasubramaniam. Spartan: A framework for sparse robust addressable networks. In Proc. of the 32nd IEEE International Parallel and Distributed Processing Symposium (IPDPS), pages 1060--1069, 2018.
[10]
Leonid Barenboim, Michael Elkin, Seth Pettie, and Johannes Schneider. The locality of distributed symmetry breaking. Journal of the ACM, 63(3):20:1--20:45, 2016.
[11]
Soheil Behnezhad, Sebastian Brandt, Mahsa Derakhshan, Manuela Fischer, Taghi Hajiaghayi, Mohammad, Richard M Karp, and Jara Uitto. Massively parallel computation of matching and mis in sparse graphs. In Proceedings of the 2019 ACM Symposium on Principles of Distributed Computing, pages 481--490, 2019.
[12]
Andrew Berns, Sukumar Ghosh, and Sriram V. Pemmaraju. Building self-stabilizing overlay networks with the transitive closure framework. Theor. Comput. Sci., 512:2--14, 2013.
[13]
Sebastian Brandt, Manuela Fischer, and Jara Uitto. Breaking the linear-memory barrier in mpc: Fast mis on trees with strongly sublinear memory. In International Colloquium on Structural Information and Communication Complexity, pages 124--138. Springer, 2019.
[14]
Keren Censor-Hillel, Eldar Fischer, Gregory Schwartzman, and Yadu Vasudev. Fast distributed algorithms for testing graph properties. Distributed Computing, 32(1):41--57, 2019.
[15]
K. A.Wong Chong, Yijie Han, and Tak Wah Lam. Concurrent threads and optimal parallel minimum spanning trees algorithm. Journal of the ACM, 48:297--323, 2001.
[16]
Maximilian Drees, Robert Gmyr, and Christian Scheideler. Churn- and dos-resistant overlay networks based on network reconfiguration. In Proc. of the 28th ACM Symposium on Parallelism in Algorithms and Architectures (SPAA), pages 417--427, 2016.
[17]
Michael Elkin and Ofer Neiman. Efficient algorithms for constructing very sparse spanners and emulators. ACM Transactions on Algorithms (TALG), 15(1):1--29, 2018.
[18]
Michael Feldmann, Kristian Hinnenthal, and Christian Scheideler. Fast hybrid network algorithms for shortest paths in sparse graphs. In Proceedings of the 24th International Conference on Principles of Distributed Systems (OPODIS), pages 31:1--31:16, 2020.
[19]
Michael Feldmann, Christian Scheideler, and Stefan Schmid. Survey on algorithms for self-stabilizing overlay networks. ACM Computing Surveys, 53(4), 2020.
[20]
Hendrik Fichtenberger and Yadu Vasudev. A two-sided error distributed property tester for conductance. In 43rd International Symposium on Mathematical Foundations of Computer Science (MFCS 2018). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, 2018.
[21]
Mohsen Ghaffari. An improved distributed algorithm for maximal independent set. In Proceedings of the 27th annual ACM-SIAM symposium on Discrete algorithms (SODA), pages 270--277. SIAM, 2016.
[22]
Mohsen Ghaffari, Themis Gouleakis, Christian Konrad, Slobodan Mitrović, and Ronitt Rubinfeld. Improved massively parallel computation algorithms for mis, matching, and vertex cover. In Proceedings of the 2018 ACM Symposium on Principles of Distributed Computing, pages 129--138, 2018.
[23]
Mohsen Ghaffari, Christoph Grunau, and Ce Jin. Improved mpc algorithms for mis, matching, and coloring on trees and beyond. arXiv preprint arXiv:2002.09610, 2020.
[24]
Seth Gilbert, Gopal Pandurangan, Peter Robinson, and Amitabh Trehan. Dconstructor: Efficient and robust network construction with polylogarithmic overhead. In Proc. of ACM Symposium on Principles of Distributed Computing (PODC), pages 438--447. ACM, 2020.
[25]
Christos Gkantsidis, Milena Mihail, and Amin Saberi. Random walks in peer-to-peer networks. In Proc. of the 23rd Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM). IEEE, 2004.
[26]
Robert Gmyr, Kristian Hinnenthal, Christian Scheideler, and Christian Sohler. Distributed Monitoring of Network Properties: The Power of Hybrid Networks. In Proc. of the 44th International Colloquium on Automata, Languages, and Programming (ICALP), pages 137:1--137:15, 2017.
[27]
Thorsten Götte, Kristian Hinnenthal, and Christian Scheideler. Faster construction of overlay networks. In International Colloquium on Structural Information and Communication Complexity (SIROCCO), pages 262--276. Springer, 2019.
[28]
Thorsten Gö tte, Kristian Hinnenthal, Christian Scheideler, and Julian Werthmann. Time-optimal construction of overlay networks. arXiv preprint arXiv:2009.03987, 2020.
[29]
Thorsten Gö tte, Vipin Ravindran Vijayalakshmi, and Christian Scheideler. Always be Two Steps Ahead of Your Enemy. In Proc. of the 33rd IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2019.
[30]
Shay Halperin and Uri Zwick. Optimal Randomized EREW PRAM Algorithms for Finding Spanning Forests. Journal of Algorithms, 39(1):1--46, 2001.
[31]
Riko Jacob, André a W. Richa, Christian Scheideler, Stefan Schmid, and Hanjo Täubig. Skip: A self-stabilizing skip graph. Journal of the ACM, 61(6):36:1--36:26, 2014.
[32]
David R Karger. Minimum cuts in near-linear time. Journal of the ACM (JACM), 47(1):46--76, 2000.
[33]
Fabian Kuhn and Philipp Schneider. Computing shortest paths and diameter in the hybrid network model. In Proc. of the 39th Annual ACM Symposium on Principles of Distributed Computing (PODC), pages 109--118. ACM, 2020.
[34]
Tsz Chiu Kwok and Lap Chi Lau. Lower bounds on expansions of graph powers. In Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques (APPROX/RANDOM 2014). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, 2014.
[35]
Jakub Łkacki, Slobodan Mitrović, Krzysztof Onak, and Piotr Sankowski. Walking randomly, massively, and efficiently. In Proceedings of the 52nd Annual ACM SIGACT Symposium on Theory of Computing, pages 364--377, 2020.
[36]
Ching Law and Kai-Yeung Siu. Distributed construction of random expander networks. In Proceedings IEEE INFOCOM 2003, The 22nd Annual Joint Conference of the IEEE Computer and Communications Societies, San Franciso, CA, USA, March 30 - April 3, 2003, pages 2133--2143. IEEE Computer Society, 2003.
[37]
James R Lee, Shayan Oveis Gharan, and Luca Trevisan. Multiway spectral partitioning and higher-order cheeger inequalities. Journal of the ACM (JACM), 61(6):1--30, 2014.
[38]
Sixue Cliff Liu, Robert E. Tarjan, and Peilin Zhong. Connected components on a PRAM in log diameter time. In Christian Scheideler and Michael Spear, editors, Proc. of the 32nd ACM Symposium on Parallelism in Algorithms and Architectures (SPAA), Virtual Event, USA, July 15-17, 2020, pages 359--369. ACM, 2020.
[39]
László Lovász and Miklós Simonovits. The mixing rate of markov chains, an isoperimetric inequality, and computing the volume. In Proc. of 31st Annual Symposium on Foundations of Computer Science (FOCS), pages 346--354. IEEE, 1990.
[40]
Gary L. Miller, Richard Peng, Adrian Vladu, and Shen Chen Xu. Improved parallel algorithms for spanners and hopsets. In Proc. of the 27th ACM symposium on Parallelism in Algorithms and Architectures (SPAA), pages 192--201, 2015.
[41]
Yves Métivier, John Michael Robson, Saheb-Djahromi Nasser, and Akka Zemmari. An optimal bit complexity randomized distributed mis algorithm. In International Colloquium on Structural Information and Communication Complexity (SIROCCO), pages 323--337. Springer, 2009.
[42]
Scott Oaks and Li Gong. Jxta in a Nutshell. O'Reilly & Associates, Inc., USA, 2002.
[43]
Seth Pettie and Vijaya Ramachandran. A randomized time-work optimal parallel algorithm for finding a minimum spanning forest. SIAM Journal on Computing, 31:1879--1895, 2002.
[44]
Peter Robinson. Being fast means being chatty: The local information cost of graph spanners. In Proceedings of the 15th ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 2105--2120, 2021.
[45]
Antony I. T. Rowstron and Peter Druschel. Pastry: Scalable, decentralized object location, and routing for large-scale peer-to-peer systems. In Proc. of IFIP/ACM International Conference on Distributed Systems Platforms (Middleware), pages 329--350, 2001.
[46]
Atish Das Sarma, Anisur Rahaman Molla, Gopal Pandurangan, and Eli Upfal. Fast distributed pagerank computation. In International Conference on Distributed Computing and Networking, pages 11--26. Springer, 2013.
[47]
Alistair Sinclair. Algorithms for random generation and counting: a Markov chain approach. Springer Science & Business Media, 2012.
[48]
Ion Stoica, Robert Tappan Morris, David R. Karger, M. Frans Kaashoek, and Hari Balakrishnan. Chord: A scalable peer-to-peer lookup service for internet applications. In Proc. of the 2018 Conference of the ACM Special Interest Group on Data Communication (SIGCOMM), pages 149--160, 2001.
[49]
Robert E Tarjan and Uzi Vishkin. An efficient parallel biconnectivity algorithm. SIAM Journal on Computing, 14(4):862--874, 1985.

Cited By

View all
  • (2024)The complexity of growing a graphJournal of Computer and System Sciences10.1016/j.jcss.2024.103587(103587)Online publication date: Sep-2024
  • (2023)Almost universally optimal distributed Laplacian solvers via low-congestion shortcutsDistributed Computing10.1007/s00446-023-00454-036:4(475-499)Online publication date: 31-Jul-2023

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
PODC'21: Proceedings of the 2021 ACM Symposium on Principles of Distributed Computing
July 2021
590 pages
ISBN:9781450385480
DOI:10.1145/3465084
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 July 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. distributed protocol
  2. expander
  3. peer-to-peer network
  4. randomized algorithm

Qualifiers

  • Research-article

Funding Sources

Conference

PODC '21
Sponsor:

Acceptance Rates

Overall Acceptance Rate 740 of 2,477 submissions, 30%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)37
  • Downloads (Last 6 weeks)6
Reflects downloads up to 29 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)The complexity of growing a graphJournal of Computer and System Sciences10.1016/j.jcss.2024.103587(103587)Online publication date: Sep-2024
  • (2023)Almost universally optimal distributed Laplacian solvers via low-congestion shortcutsDistributed Computing10.1007/s00446-023-00454-036:4(475-499)Online publication date: 31-Jul-2023

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media