article

The feasibility of supporting large-scale live streaming applications with dynamic application end-points

Authors:

Kunwadee Sripanidkulchai,

Hui ZhangAuthors Info & Claims

ACM SIGCOMM Computer Communication Review, Volume 34, Issue 4

Pages 107 - 120

https://doi.org/10.1145/1030194.1015480

Published: 30 August 2004 Publication History

Abstract

While application end-point architectures have proven to be viable solutions for large-scale distributed applications such as distributed computing and file-sharing, there is little known about its feasibility for more bandwidth-demanding applications such as live streaming. Heterogeneity in bandwidth resources and dynamic group membership, inherent properties of application end-points, may adversely affect the construction of a usable and efficient overlay. At large scales, the problems become even more challenging. In this paper, we study one of the most prominent architectural issues in overlay multicast: the feasibility of supporting large-scale groups using an application end-point architecture. We look at three key requirements for feasibility: (i) are there enough resources to construct an overlay, (ii) can a stable and connected overlay be maintained in the presence of group dynamics, and (iii) can an efficient overlay be constructed? Using traces from a large content delivery network, we characterize the behavior of users watching live audio and video streams. We show that in many common real-world scenarios, all three requirements are satisfied. In addition, we evaluate the performance of several design alternatives and show that simple algorithms have the potential to meet these requirements in practice. Overall, our results argue for the feasibility of supporting large-scale live streaming using an application end-point architecture.

References

[1]

Akamai. http://www.akamai.com/.]]

[2]

S. Banerjee, B. Bhattacharjee, and C. Kommareddy. Scalable Application Layer Multicast. In Proceedings of ACM SIGCOMM, August 2002.]]

Digital Library

[3]

C. M. Bishop. Neural Networks for Pattern Recognition. Clarendon Press, Oxford, 1995.]]

Digital Library

[4]

M. Castro, P. Druschel, A. Kermarrec, A. Nandi, A. Rowstron, and A. Singh. SplitStream: High-bandwidth Content Distribution in Cooperative Environments. In Proceedings of SOSP, 2003.]]

Digital Library

[5]

M. Castro, P. Druschel, A. Kermarrec, and A. Rowstron. Scribe: A Large-Scale and Decentralized Application-Level Multicast Infrastructure. In IEEE Journal on Selected Areas in Communications Vol. 20 No. 8, Oct 2002.]]

Digital Library

[6]

Y. Chu, J. Chuang, and H. Zhang. A Case for Taxation in Peer-to-Peer Streaming Broadcast. In ACM SIGCOMM Workshop on Practice and Theory of Incentives and Game Theory in Networked Systems (PINS), 2004.]]

Digital Library

[7]

Y. Chu, A. Ganjam, T. S. E. Ng, S. G. Rao, K. Sripanidkulchai, J. Zhan, and H. Zhang. Early Experience with an Internet Broadcast System Based on Overlay Multicast. In Proceedings of USENIX, 2004.]]

Digital Library

[8]

Y. Chu, S. G. Rao, and H. Zhang. A Case for End System Multicast. In Proceedings of ACM Sigmetrics, June 2000.]]

Digital Library

[9]

P. Francis. Yoid: Your Own Internet Distribution, http://www.aciri.org/yoid/. April 2000.]]

[10]

A. Ganjam and H. Zhang. Connectivity Restrictions in Overlay Multicast. In Proceedings of NOSSDAV, 2004.]]

Digital Library

[11]

V. K. Goyal. Multiple Description Coding: Compression Meets the Network. IEEE Signal Processing Magazine, Vol. 18, pages 74--93, 2001.]]

[12]

J. Jannotti, D. Gifford, K. L. Johnson, M. F. Kaashoek, and J. W. O'Toole Jr. Overcast: Reliable Multicasting with an Overlay Network. In Proceedings of the Fourth Symposium on Operating System Design and Implementation (OSDI), October 2000.]]

Digital Library

[13]

D. Kostic, A. Rodriguez, J. Albrecht, and A. Vahdat. Bullet: High Bandwidth Data Dissemination Using an Overlay Mesh. In Proceedings of SOSP, 2003.]]

Digital Library

[14]

J. Liebeherr and M. Nahas. Application-layer Multicast with Delaunay Triangulations. In Proceedings of IEEE Globecom, November 2001.]]

[15]

S. McCanne, V. Jacobson, and M. Vetterli. Receiver-driven layered multicast. In Proceedings of ACM SIGCOMM, August 1996.]]

Digital Library

[16]

T. S. E. Ng and H. Zhang. Predicting Internet Network Distance with Coordinates-Based Approaches. In Proceedings of INFOCOM, June 2002.]]

[17]

T.S.E. Ng, Y. Chu, S.G. Rao, K. Sripanidkulchai, and H. Zhang. Measurement-Based Optimization Techniques for Bandwidth-Demanding Peer-to-Peer Systems. In Proceedings of IEEE Infocom, 2003.]]

[18]

V. N. Padmanabhan, H. J. Wang, P. A. Chou, and K. Sripanidkulchai. Distributing Streaming Media Content Using Cooperative Networking. In Proceedings of NOSSDAV, May 2002.]]

Digital Library

[19]

Planetlab. http://www.planet-lab.org/.]]

[20]

S. Ratnasamy, M. Handley, R. Karp, and S. Shenker. Application-level Multicast using Content-Addressable Networks. In Proceedings of NGC, 2001.]]

Digital Library

[21]

Real broadcast network. http://www.real.com/.]]

[22]

R. Renesse, Y. Minsky, and M. Hayden. A Gossip-Style Failure Detection Service. Technical Report TR98-1687, Cornell University Computer Science, 1998.]]

Digital Library

[23]

J. Rosenberg, J. Weinberger, C. Huitema, and R. Mahy. STUN -Simple Traversal of UDP Through Network Address Translators. IETF-Draft, December 2002.]]

Digital Library

[24]

W. Wang, D. Helder, S. Jamin, and L. Zhang. Overlay Optimizations for End-host Multicast. In Proceedings of Fourth International Workshop on Networked Group Communication (NGC), October 2002.]]

[25]

S. Q. Zhuang, B. Y. Zhao, J. D. Kubiatowicz, and A. D. Joseph. Bayeux: An Architecture for Scalable and Fault-Tolerant Wide-Area Data Dissemination. In Proceedings of NOSSDAV, April 2001.]]

Digital Library

Cited By

Liu QTang RRen HPei Y(2019)Optimizing multicast routing tree on application layer via an encoding-free non-dominated sorting genetic algorithmApplied Intelligence10.1007/s10489-019-01547-9Online publication date: 6-Sep-2019
https://doi.org/10.1007/s10489-019-01547-9
Rodriguez-Gil LOrduña PGarcía-Zubia JLópez-De-Ipiña D(2018)Interactive live-streaming technologies and approaches for web-based applicationsMultimedia Tools and Applications10.1007/s11042-017-4556-677:6(6471-6502)Online publication date: 1-Mar-2018
https://dl.acm.org/doi/10.1007/s11042-017-4556-6
Budhkar STamarapalli V(2018)Delay Management in Mesh-Based P2P Live Streaming Using a Three-Stage Peer Selection StrategyJournal of Network and Systems Management10.1007/s10922-017-9420-526:2(401-425)Online publication date: 1-Apr-2018
https://dl.acm.org/doi/10.1007/s10922-017-9420-5
Show More Cited By

Index Terms

The feasibility of supporting large-scale live streaming applications with dynamic application end-points
1. Hardware
  1. Communication hardware, interfaces and storage
2. Networks

Recommendations

The feasibility of supporting large-scale live streaming applications with dynamic application end-points
SIGCOMM '04: Proceedings of the 2004 conference on Applications, technologies, architectures, and protocols for computer communications

While application end-point architectures have proven to be viable solutions for large-scale distributed applications such as distributed computing and file-sharing, there is little known about its feasibility for more bandwidth-demanding applications ...
Challenges and Approaches in Large-Scale P2P Media Streaming

Large-scale multimedia streaming over the Internet requires an enormous amount of server and network resources. Traditional client-server approaches allocate a dedicated stream from the server for each client request, which is expensive and doesn't ...
Scalable Live Streaming Service Based on Interoverlay Optimization

In order to provide scalable live-streaming services, we propose an Inter-Overlay Optimization scheme, IOO. Instead of selecting better paths in the same overlay, IOO constructs efficient paths using peers in different overlays, so as to (i) improve ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGCOMM Computer Communication Review

ACM SIGCOMM Computer Communication Review Volume 34, Issue 4

October 2004

385 pages

ISSN:0146-4833

DOI:10.1145/1030194

Issue’s Table of Contents

SIGCOMM '04: Proceedings of the 2004 conference on Applications, technologies, architectures, and protocols for computer communications
August 2004
402 pages
ISBN:1581138628
DOI:10.1145/1015467
General Chair:
Raj Yavatkar
Intel Corporation
,
Program Chairs:
Ellen Zegura
Georgia Institute of Technology
,
Jennifer Rexford
AT&T Labs -- Research

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 August 2004

Published in SIGCOMM-CCR Volume 34, Issue 4

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

219
Total Citations
View Citations
1,802
Total Downloads

Downloads (Last 12 months)133
Downloads (Last 6 weeks)17

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Liu QTang RRen HPei Y(2019)Optimizing multicast routing tree on application layer via an encoding-free non-dominated sorting genetic algorithmApplied Intelligence10.1007/s10489-019-01547-9Online publication date: 6-Sep-2019
https://doi.org/10.1007/s10489-019-01547-9
Rodriguez-Gil LOrduña PGarcía-Zubia JLópez-De-Ipiña D(2018)Interactive live-streaming technologies and approaches for web-based applicationsMultimedia Tools and Applications10.1007/s11042-017-4556-677:6(6471-6502)Online publication date: 1-Mar-2018
https://dl.acm.org/doi/10.1007/s11042-017-4556-6
Budhkar STamarapalli V(2018)Delay Management in Mesh-Based P2P Live Streaming Using a Three-Stage Peer Selection StrategyJournal of Network and Systems Management10.1007/s10922-017-9420-526:2(401-425)Online publication date: 1-Apr-2018
https://dl.acm.org/doi/10.1007/s10922-017-9420-5
Gu WZhang XGong BZhang WWang L(2015)VMCast: A VM-Assisted Stability Enhancing Solution for Tree-Based Overlay MulticastPLOS ONE10.1371/journal.pone.014288810:11(e0142888)Online publication date: 12-Nov-2015
https://doi.org/10.1371/journal.pone.0142888
Cui JZhang WHuang FWu L(2015)Hierarchical Adaptive Recovery Algorithm in Mobile ALMFrontiers in Internet Technologies10.1007/978-3-662-46826-5_8(95-105)Online publication date: 18-Apr-2015
https://doi.org/10.1007/978-3-662-46826-5_8
Magharei NRejaie RRimac IHilt VHofmann M(2014)ISP-Friendly Live P2P StreamingIEEE/ACM Transactions on Networking10.1109/TNET.2013.225784022:1(244-256)Online publication date: 1-Feb-2014
https://dl.acm.org/doi/10.1109/TNET.2013.2257840
Cabrero SMelendi DGarcía RPañeda XGarcía V(2012)Deployment of Live Audio Services on FTTx NetworksNext Generation Data Communication Technologies10.4018/978-1-61350-477-2.ch010(227-248)Online publication date: 2012
https://doi.org/10.4018/978-1-61350-477-2.ch010
Azarpira HYousefi S(2012)On optimal topology in hierarchical P2P live video streaming networks6th International Symposium on Telecommunications (IST)10.1109/ISTEL.2012.6483067(644-649)Online publication date: Nov-2012
https://doi.org/10.1109/ISTEL.2012.6483067
Liu BQiu FCao YChang BCui YXue Y(2011)Maximizing Resilient Throughput in Peer-to-Peer NetworkCommunications and Network10.4236/cn.2011.3302103:03(168-183)Online publication date: 2011
https://doi.org/10.4236/cn.2011.33021
Fu ASadeghi P(2011)r-Regular P2P Broadcast Networks: Optimal Delay and Throughput Using Network Coding2011 IEEE International Conference on Communications (ICC)10.1109/icc.2011.5963471(1-5)Online publication date: Jun-2011
https://doi.org/10.1109/icc.2011.5963471
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents