research-article

Free access

Practical, Real-time Centralized Control for CDN-based Live Video Delivery

Authors:

Matthew K. Mukerjee,

Srinivasan Seshan,

Hui ZhangAuthors Info & Claims

SIGCOMM '15: Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication

Pages 311 - 324

https://doi.org/10.1145/2785956.2787475

Published: 17 August 2015 Publication History

Abstract

Live video delivery is expected to reach a peak of 50 Tbps this year. This surging popularity is fundamentally changing the Internet video delivery landscape. CDNs must meet users' demands for fast join times, high bitrates, and low buffering ratios, while minimizing their own cost of delivery and responding to issues in real-time. Wide-area latency, loss, and failures, as well as varied workloads ("mega-events" to long-tail), make meeting these demands challenging.

An analysis of video sessions concluded that a centralized controller could improve user experience, but CDN systems have shied away from such designs due to the difficulty of quickly handling failures, a requirement of both operators and users. We introduce VDN, a practical approach to a video delivery network that uses a centralized algorithm for live video optimization. VDN provides CDN operators with real-time, fine-grained control. It does this in spite of challenges resulting from the wide-area (e.g., state inconsistency, partitions, failures) by using a hybrid centralized+distributed control plane, increasing average bitrate by 1.7x and decreasing cost by 2x in different scenarios.

Supplementary Material

WEBM File (p311-mukerjee.webm)

Download
143.90 MB

References

[1]

Ooyala global video index q3 2013. http://go.ooyala.com/rs/OOYALA/images/Ooyala-Global-Video-Index-Q3--2013.pdf.

[2]

Private conversation with Bruce Maggs, vice president, research at Akamai.

[3]

Private conversation with Hui Zhang, chief executive officer, at Conviva.

[4]

Twitch. http://twitch.tv.

[5]

Twitch is 4th in peak us internet traffic. http://blog.twitch.tv/2014/02/twitch-community-4th-in-peak-us-internet-traffic/.

[6]

I. Sodagar. The MPEG-DASH Standard for Multimedia Streaming Over the Internet. IEEE Multimedia (2011).

Digital Library

[7]

Akamai. Akamai investor summit: 2013. http://www.akamai.com/dl/investors/2013_ir_summit_presentation.pdf.

[8]

Amazon. Amazon Elastic Compute Cloude (Amazon EC2). http://aws.amazon.com/ec2/.

[9]

Balachandran, A., Sekar, V., Akella, A., Seshan, S., Stoica, I., and Zhang, H. A quest for an internet video quality-of-experience metric. In Proceedings of the 11th ACM Workshop on Hot Topics in Networks (New York, NY, USA, 2012), HotNets-XI, ACM, pp. 97--102.

Digital Library

[10]

Balachandran, A., Sekar, V., Akella, A., Seshan, S., Stoica, I., and Zhang, H. Developing a predictive model of quality of experience for internet video. In Proc. ACM SIGCOMM (2013), ACM, pp. 339--350.

Digital Library

[11]

Bashore, A. Twitch stats. http://stats.twitchapps.com/.

[12]

Castro, M., Druschel, P., Kermarrec, A.-M., Nandi, A., Rowstron, A., and Singh, A. Splitstream: high-bandwidth multicast in cooperative environments. In ACM SIGOPS Operating Systems Review (2003), vol. 37, ACM, pp. 298--313.

Digital Library

[13]

Chowdhury, M., Zaharia, M., Ma, J., Jordan, M. I., and Stoica, I. Managing data transfers in computer clusters with orchestra. SIGCOMM CCR 41, 4 (2011), 98.

Digital Library

[14]

Chu, Y., Rao, S., Seshan, S., and Zhang, H. Enabling conferencing applications on the internet using an overlay muilticast architecture. ACM SIGCOMM computer communication review 31, 4 (2001), 55--67.

Digital Library

[15]

Fortz, B., Rexford, J., and Thorup, M. Traffic engineering with traditional ip routing protocols. Communications Magazine, IEEE 40, 10 (2002), 118--124.

Digital Library

[16]

Foundation, A. Apache HTTP Server Project.\ http://httpd.apache.org/.

[17]

Frank, B., Poese, I., Lin, Y., Smaragdakis, G., Feldmann, A., Maggs, B., Rake, J., Uhlig, S., and Weber, R. Pushing cdn-isp collaboration to the limit. ACM SIGCOMM CCR 43, 3 (2013).

Digital Library

[18]

Freedman, M. J. Experiences with coralcdn: A five-year operational view. In Proc. USENIX NSDI (2010).

Digital Library

[19]

Ganjam, A., Siddiqui, F., Zhan, J., Liu, X., Stoica, I., Jiang, J., Sekar, V., and Zhang, H. C3: Internet-scale control plane for video quality optimization. In 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15) (Oakland, CA, May 2015), USENIX Association, pp. 131--144.

Digital Library

[20]

Ghorbani, S., and Caesar, M. Walk the line: consistent network updates with bandwidth guarantees. In Proc. HotSDN (2012), ACM, pp. 67--72.

Digital Library

[21]

Gurobi. Gurobi optimization. http://www.gurobi.com/.

[22]

Han, D., Andersen, D., Kaminsky, M., Papagiannaki, D., and Seshan, S. Hulu in the neighborhood. In Proc. COMSNETS (Jan. 2011), pp. 1 --10.

[23]

Hong, C.-Y., Kandula, S., Mahajan, R., Zhang, M., Gill, V., Nanduri, M., and Wattenhofer, R. Achieving high utilization with software-driven wan. In Proc. ACM SIGCOMM (2013).

Digital Library

[24]

Huang, C., Wang, A., Li, J., and Ross, K. W. Measuring and evaluating large-scale cdns. In Proc. ACM IMC (2008).

[25]

Jain, S., Kumar, A., Mandal, S., Ong, J., Poutievski, L., Singh, A., Venkata, S., Wanderer, J., Zhou, J., Zhu, M., et al. B4: Experience with a globally-deployed software defined wan. In Proc. ACM SIGCOMM (2013).

Digital Library

[26]

Jannotti, J., Gifford, D. K., Johnson, K. L., Kaashoek, M. F., et al. Overcast: reliable multicasting with on overlay network. In Proc. 4th conference on Symposium on Operating System Design & Implementation (2000).

Digital Library

[27]

Jiang, J., Sekar, V., and Zhang, H. Improving fairness, efficiency, and stability in http-based adaptive video streaming with festive. In Proc. ACM CoNEXT (2012).

Digital Library

[28]

Katta, N. P., Rexford, J., and Walker, D. Incremental consistent updates. In Proc. HotSDN (2013), ACM.

Digital Library

[29]

Kontothanassis, L., Sitaraman, R., Wein, J., Hong, D., Kleinberg, R., Mancuso, B., Shaw, D., and Stodolsky, D. A transport layer for live streaming in a content delivery network. Proceedings of the IEEE 92, 9 (2004), 1408--1419.

[30]

Kostić, D., Rodriguez, A., Albrecht, J., and Vahdat, A. Bullet: High bandwidth data dissemination using an overlay mesh. In ACM SIGOPS Operating Systems Review (2003), vol. 37, ACM, pp. 282--297.

Digital Library

[31]

Lamport, L. The part-time parliament. ACM Trans. Comput. Syst. 16, 2 (May 1998), 133--169.

Digital Library

[32]

Liu, X., Dobrian, F., Milner, H., Jiang, J., Sekar, V., Stoica, I., and Zhang, H. A case for a coordinated internet video control plane. In Proc. ACM SIGCOMM (2012), pp. 359--370.

Digital Library

[33]

Liu, Y., Zhang, H., Gong, W., and Towsley, D. On the interaction between overlay routing and underlay routing. In INFOCOM 2005. 24th Annual Joint Conference of the IEEE Computer and Communications Societies. Proceedings IEEE (2005), vol. 4, IEEE, pp. 2543--2553.

[34]

McGeer, R. A safe, efficient update protocol for openflow networks. In Proc. HotSDN (2012), ACM, pp. 61--66.

Digital Library

[35]

Nygren, E., Sitaraman, R. K., and Sun, J. The akamai network: a platform for high-performance internet applications. ACM SIGOPS Operating Systems Review 44, 3 (2010), 2--19.

Digital Library

[36]

Prasad, R., Dovrolis, C., Murray, M., and Claffy, K. Bandwidth estimation: metrics, measurement techniques, and tools. Network, IEEE 17, 6 (2003), 27--35.

Digital Library

[37]

Sandvine. Global internet phenomena report: 1h 2014. https://www.sandvine.com/downloads/general/global-internet-phenomena/2014/1h-2014-global-internet-phenomena-report.pdf.

[38]

Spangler, T. World cup sets new internet-video streaming records for espn, univision, and akamai. http://variety.com/2014/digital/news/world-cup-sets-new-internet-video-streaming-record-1201221997/.

[39]

Strauss, J., Katabi, D., and Kaashoek, F. A measurement study of available bandwidth estimation tools. In Proceedings of the 3rd ACM SIGCOMM Conference on Internet Measurement (New York, NY, USA, 2003), IMC '03, ACM, pp. 39--44.

Digital Library

[40]

Su, A.-J., and Kuzmanovic, A. Thinning akamai. In Proc. ACM IMC (2008).

Digital Library

[41]

Team, T. How twitch fits in amazon's strategy. http://www.forbes.com/sites/greatspeculations/2014/08/28/how-twitch-fits-in-amazons-strategy/.

[42]

Wang, L., Park, K., Pang, R., Pai, V. S., and Peterson, L. L. Reliability and security in the codeen content distribution network. In Proc. USENIX ATC, General Track (2004).

Digital Library

[43]

Xu, D., Kulkarni, S. S., Rosenberg, C., and keung Chai, H. A cdn-p2p hybrid architecture for cost-effective streaming media distribution. Computer Networks 44 (2004), 353--382.

Digital Library

[44]

YouTube. Live encoder settings, bitrates and resolutions. https://support.google.com/youtube/answer/2853702?hl=en.

[45]

Yu, M., Jiang, W., Li, H., and Stoica, I. Tradeoffs in cdn designs for throughput oriented traffic. In Proc. ACM CoNEXT (2012), ACM, pp. 145--156.

Digital Library

Cited By

Das IDas PDebnath PChanda MNath S(2025)A Survey on NSF Future Internet Architecture (FIA) for MobilityFirst (MF), Named Data Networking (NDN), NEBULA, and eXpressive Internet Architecture (XIA)Power Devices and Internet of Things for Intelligent System Design10.1002/9781394311613.ch10(225-269)Online publication date: 13-Feb-2025
https://doi.org/10.1002/9781394311613.ch10
Zhang RWang HShi SPang XPeng YXue ZLiu JBagchi SZhang Y(2024)Enhancing resource management of the world's largest PCDN system for on-demand video streamingProceedings of the 2024 USENIX Conference on Usenix Annual Technical Conference10.5555/3691992.3692050(951-965)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691992.3692050
Yuan LGong WFang Y(2024)Native WiFi BackscatterIEEE/ACM Transactions on Networking10.1109/TNET.2024.340908132:5(3888-3900)Online publication date: Oct-2024
https://doi.org/10.1109/TNET.2024.3409081
Show More Cited By

Index Terms

Practical, Real-time Centralized Control for CDN-based Live Video Delivery
1. Networks
  1. Network algorithms
    1. Control path algorithms
      1. Traffic engineering algorithms
  2. Network types
    1. Overlay and other logical network structures

Recommendations

Practical, Real-time Centralized Control for CDN-based Live Video Delivery
SIGCOMM'15

Live video delivery is expected to reach a peak of 50 Tbps this year. This surging popularity is fundamentally changing the Internet video delivery landscape. CDNs must meet users' demands for fast join times, high bitrates, and low buffering ratios, ...
Enabling near real-time central control for live video delivery in CDNs
SIGCOMM'14

User-created live video streaming is marking a fundamental shift in the workload of live video delivery. However, live-video-specific challenges and the viral nature of user-created content makes it difficult for current CDNs to deliver 1) high-quality, ...
Enabling near real-time central control for live video delivery in CDNs
SIGCOMM '14: Proceedings of the 2014 ACM conference on SIGCOMM

User-created live video streaming is marking a fundamental shift in the workload of live video delivery. However, live-video-specific challenges and the viral nature of user-created content makes it difficult for current CDNs to deliver 1) high-quality, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGCOMM '15: Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication

August 2015

684 pages

ISBN:9781450335423

DOI:10.1145/2785956

General Chairs:
Steve Uhlig
Queen Mary University of London, UK
,
Olaf Maennel
Tallinn U. of Technology in Estonia, Estonia
,
Program Chairs:
Brad Karp
University College London, UK
,
Jitendra Padhye
Microsoft, USA

ACM SIGCOMM Computer Communication Review Volume 45, Issue 4
SIGCOMM'15
October 2015
659 pages
ISSN:0146-4833
DOI:10.1145/2829988
Editors:
Konstantina Papagiannaki
Telefonica Research, Barcelona, Spain
,
Katerina Argyraki
EPFL, Switzerland
,
Hitesh Ballani
Microsoft Research Cambridge, UK
,
Fabián Bustamante
Northwestern University, USA
,
Joseph Camp
SMU, USA
,
Augustin Chaintreau
Columbia University, USA
,
Phillipa Gill
Stony Brook University, USA
,
Marco Mellia
Politecnico di Torino, Italy
,
Bhaskaran Raman
IIT Bombay, India
,
Joel Sommers
Colgate University, USA
,
Aline Carneiro Viana
INRIA, France
Issue’s Table of Contents

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 August 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

SIGCOMM '15

Sponsor:

SIGCOMM

SIGCOMM '15: ACM SIGCOMM 2015 Conference

August 17 - 21, 2015

London, United Kingdom

Acceptance Rates

SIGCOMM '15 Paper Acceptance Rate 40 of 242 submissions, 17%;

Overall Acceptance Rate 462 of 3,389 submissions, 14%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

95
Total Citations
View Citations
1,469
Total Downloads

Downloads (Last 12 months)313
Downloads (Last 6 weeks)23

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Das IDas PDebnath PChanda MNath S(2025)A Survey on NSF Future Internet Architecture (FIA) for MobilityFirst (MF), Named Data Networking (NDN), NEBULA, and eXpressive Internet Architecture (XIA)Power Devices and Internet of Things for Intelligent System Design10.1002/9781394311613.ch10(225-269)Online publication date: 13-Feb-2025
https://doi.org/10.1002/9781394311613.ch10
Zhang RWang HShi SPang XPeng YXue ZLiu JBagchi SZhang Y(2024)Enhancing resource management of the world's largest PCDN system for on-demand video streamingProceedings of the 2024 USENIX Conference on Usenix Annual Technical Conference10.5555/3691992.3692050(951-965)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691992.3692050
Yuan LGong WFang Y(2024)Native WiFi BackscatterIEEE/ACM Transactions on Networking10.1109/TNET.2024.340908132:5(3888-3900)Online publication date: Oct-2024
https://doi.org/10.1109/TNET.2024.3409081
Wang JGao Y(2024)QoE optimization based on Adaptive Bitrate Control for Multi-party Interactive Live Streaming2024 27th International Conference on Computer Supported Cooperative Work in Design (CSCWD)10.1109/CSCWD61410.2024.10580564(291-296)Online publication date: 8-May-2024
https://doi.org/10.1109/CSCWD61410.2024.10580564
Song JChen BSong BYing AHu Y(2023)FlowBot: A Learning-Based Co-bottleneck Flow Detector for Video Servers2023 IEEE 31st International Conference on Network Protocols (ICNP)10.1109/ICNP59255.2023.10355638(1-12)Online publication date: 10-Oct-2023
https://doi.org/10.1109/ICNP59255.2023.10355638
Hu QPeng QShang JLi YHe J(2023)EBA: An Adaptive Large Neighborhood Search-Based Approach for Edge Bandwidth AllocationCollaborative Computing: Networking, Applications and Worksharing10.1007/978-3-031-24383-7_14(249-268)Online publication date: 25-Jan-2023
https://doi.org/10.1007/978-3-031-24383-7_14
Li JLi ZLu RXiao KLi SChen JYang JZong CChen AWu QSun CTyson GLiu HKuipers FOrda A(2022)LiveNetProceedings of the ACM SIGCOMM 2022 Conference10.1145/3544216.3544236(812-825)Online publication date: 22-Aug-2022
https://dl.acm.org/doi/10.1145/3544216.3544236
Zhao YZhang YLi YZhou YChen CYang TCui BIves ZBonifati AEl Abbadi A(2022)MinMax Sampling: A Near-optimal Global Summary for Aggregation in the Wide AreaProceedings of the 2022 International Conference on Management of Data10.1145/3514221.3526160(744-758)Online publication date: 10-Jun-2022
https://dl.acm.org/doi/10.1145/3514221.3526160
Li RWang JXu CYu TWang JWu HZheng K(2022)Distributed Routing Controller for Large-scale Live Video Streams in Real-Time NetworksGLOBECOM 2022 - 2022 IEEE Global Communications Conference10.1109/GLOBECOM48099.2022.10000918(1-6)Online publication date: 4-Dec-2022
https://doi.org/10.1109/GLOBECOM48099.2022.10000918
Kalan R(2021)Improving Quality of HTTP Adaptive Streaming with Server and Network-Assisted DASH2021 17th International Conference on Network and Service Management (CNSM)10.23919/CNSM52442.2021.9615507(244-248)Online publication date: 25-Oct-2021
https://doi.org/10.23919/CNSM52442.2021.9615507
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten