Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/1142473.1142541acmconferencesArticle/Chapter ViewAbstractPublication PagesmodConference Proceedingsconference-collections
Article

Extensible optimization in overlay dissemination trees

Published: 27 June 2006 Publication History

Abstract

We introduce XPORT, a profile-driven distributed data dissemination system that supports an extensible set of data types, profile types, and optimization metrics. XPORT efficiently implements a generic tree-based overlay network, which can be customized per application using a small number of methods that encapsulate application-specific data filtering, profile aggregation, and optimization logic. The clean separation between the "plumbing" and "application" enables the system to uniformly support disparate dissemination-based applications.We first provide an overview of the basic XPORT model and architecture. We then describe in detail an extensible optimization framework, based on a two-level aggregation model, that facilitates easy specification of a wide range of commonly used performance goals. We discuss distributed tree transformation protocols that allow XPORT to iteratively optimize its operation to achieve these goals under changing network and application conditions. Finally, we demonstrate the flexibility and the effectiveness of XPORT using real-world data and experimental results obtained from both prototype-based LAN emulation and deployment on PlanetLab.

References

[1]
M. M. Astrahan, M. W. Blasgen, D. D. Chamberlin, K. P. Eswaran, J. Gray, P. P. Griffiths, W. F. K. III, R. A. Lorie, P. R. McJones, J. W. Mehl, G. R. Putzolu, I. L. Traiger, B. W. Wade, and V. Watson. System R: Relational approach to database management. ACM Transactions on Database Systems, 1(2):97--137, 1976.
[2]
S. Banerjee, C. Kommareddy, K. Kar, S. Bhattacharjee, and S. Khuller. Construction of an efficient overlay multicast infrastructure for real-time applications. In INFOCOM, 2003.
[3]
A. Carzaniga, D. S. Rosenblum, and A. L. Wolf. Design and evaluation of a wide-area event notification service. ACM Transactions on Computer Systems, 19(3):332--383, Aug. 2001.
[4]
A. Carzaniga and A. L. Wolf. Forwarding in a content-based network. In SIGCOMM, 2003.
[5]
M. Castro, P. Druschel, A.-M. Kermarrec, A. Nandi, A. I. T. Rowstron, and A. Singh. Splitstream: High-bandwidth multicast in cooperative environments. In SOSP, 2003.
[6]
R. Chand and P. Felber. Scalable protocol for content-based routing in overlay networks. In NCA, 2003.
[7]
Y. Diao and M. J. Franklin. Query processing for high-volume xml message brokering. In VLDB, 2003.
[8]
Y. Diao, S. Rizvi, and M. J. Franklin. Towards an internet-scale xml dissemination service. In VLDB, 2004.
[9]
J. M. Hellerstein, J. F. Naughton, and A. Pfeffer. Generalized search trees for database systems. In VLDB, 1995.
[10]
E. Kohler, R. Morris, B. Chen, J. Jannotti, and M. F. Kaashoek. The Click modular router. ACM Transactions on Computer Systems, 18(3):263--297, August 2000.
[11]
D. Kostic, A. Rodriguez, J. R. Albrecht, and A. Vahdat. Bullet: High bandwidth data dissemination using an overlay mesh. In SOSP, 2003.
[12]
B. T. Loo, T. Condie, J. M. Hellerstein, P. Maniatis, T. Roscoe, and I. Stoica. Implementing declarative overlays. In SOSP, 2005.
[13]
O. Papaemmanouil, Y. Ahmad, U. Cetintemel, J. Jannotti, and Y. Yildirim. Extensible profile-driven data dissemination. Technical report, Brown University, CS-06-05, 2006.
[14]
O. Papaemmanouil, Y. Ahmad, U. Cetintemel, J. Jannotti, and Y. Yildirim. XPORT: Extensible profile-driven overlay routing trees (demonstration). In SIGMOD, 2006.
[15]
O. Papaemmanouil and U. Cetintemel. Semcast: Semantic multicast for content-based data dissemination. In ICDE, 2005.
[16]
A. Rodriguez, C. Killian, S. Bhat, D. Kostic, and A. Vahdat. Macedon: Methodology for automatically creating, evaluating, and designing overlay networks. In NSDI, 2004.
[17]
A. Rodriguez, D. Kostic, and A. Vahdat. Scalability in adaptive multi-metric overlays. In ICDCS, 2004.
[18]
D. Sandler, A. Mislove, A. Post, and P. Druschel. Feedtree: Sharing web micronews with peer-to-peer event notification. In IPTPS, Ithaca, New York, Feb. 2005.
[19]
P. M. Schwarz, W. Chang, J. C. Freytag, G. M. Lohman, J. McPherson, C. Mohan, and H. Pirahesh. Extensibility in the starburst database system. In OODBS, 1986.
[20]
Y. Zhou, B. C. Ooi, K.-L. Tan, and F. Yu. Adaptive reorganization of coherency-preserving dissemination tree for streaming data. In ICDE, 2006.

Cited By

View all

Index Terms

  1. Extensible optimization in overlay dissemination trees

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGMOD '06: Proceedings of the 2006 ACM SIGMOD international conference on Management of data
    June 2006
    830 pages
    ISBN:1595934340
    DOI:10.1145/1142473
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 June 2006

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. dissemination
    2. overlay networks

    Qualifiers

    • Article

    Conference

    SIGMOD/PODS06
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 785 of 4,003 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)3
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 12 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2021)Optimizing All-to-All Data Transmission in WANsIEEE Transactions on Network and Service Management10.1109/TNSM.2021.307102518:3(3677-3690)Online publication date: Sep-2021
    • (2020)Optimizing All-to-All Data Transmission in WANs2020 IEEE International Conference on Blockchain and Cryptocurrency (ICBC)10.1109/ICBC48266.2020.9169394(1-9)Online publication date: May-2020
    • (2018)Publish/Subscribe Over StreamsEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_284(2937-2943)Online publication date: 7-Dec-2018
    • (2017)Distributed Publish/Subscribe Query Processing on the Spatio-Textual Data Stream2017 IEEE 33rd International Conference on Data Engineering (ICDE)10.1109/ICDE.2017.154(1095-1106)Online publication date: Apr-2017
    • (2017)Publish/Subscribe Over StreamsEncyclopedia of Database Systems10.1007/978-1-4899-7993-3_284-2(1-6)Online publication date: 19-Jan-2017
    • (2015)ClouDiAThe VLDB Journal — The International Journal on Very Large Data Bases10.1007/s00778-014-0375-924:5(633-653)Online publication date: 1-Oct-2015
    • (2013)Efficient content-based routing with network topology inferenceProceedings of the 7th ACM international conference on Distributed event-based systems10.1145/2488222.2488262(51-62)Online publication date: 29-Jun-2013
    • (2013)Intralayer Communication for Tree-Based Overlay NetworksProceedings of the 2013 42nd International Conference on Parallel Processing10.1109/ICPP.2013.118(995-1003)Online publication date: 1-Oct-2013
    • (2011)Flexible tree-based Application-Layer MulticastProceedings of the 2011 17th IEEE International Conference on Networks10.1109/ICON.2011.6168468(159-164)Online publication date: 14-Dec-2011
    • (2011)Subscriber assignment for wide-area content-based publish/subscribeProceedings of the 2011 IEEE 27th International Conference on Data Engineering10.1109/ICDE.2011.5767882(267-278)Online publication date: 11-Apr-2011
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media