Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3343031.3351013acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Livesmart: A QoS-Guaranteed Cost-Minimum Framework of Viewer Scheduling for Crowdsourced Live Streaming

Published: 15 October 2019 Publication History

Abstract

Viewer scheduling among different CDN providers in crowdsourced live streaming (CLS) service is especially challenging due to the large-scale dynamic viewers as well as the time-variant performance of the content delivery network. A practical scheduling method should tackle the following challenges: 1) accurate modeling of viewer patterns and CDN performance; 2) intelligent workload offloading to save costs while guaranteeing the quality of service (QoS); 3) and ease of integration with practical CDN infrastructure in CLS platforms.
In this paper, we propose Livesmart, a novel framework that facilitates a QoS-guaranteed cost-efficient approach for CLS services. Specifically, we address the first challenge by carefully designing deep neural networks which make Livestream capture the environment dynamics without any presumptions; we then tackle the second challenge by leveraging the Model Predictive Control (MPC) method which enables Livesmart to make decisions in a long-term way. For the last challenge, we propose a probability shift model based on the realistic CLS delivery structure, thus empowering Livesmart to be practically deployed. We collect real-world data in cooperation with Kuaishou, one of the largest CLS provider in China, and evaluate Livesmart with trace-driven experiments. In comparison with prevalent methods, Livesmart can significantly reduce the CDN bandwidth costs (24.97%-63.45%) and improve the average QoS (5.79%-7.63%).

References

[1]
Vijay Kumar Adhikari and et al. 2012. A tale of three CDNs: An active measurement study of Hulu and its CDNs. In Computer Communications Workshops (INFOCOM WKSHPS), 2012 IEEE Conference on. IEEE, 7--12.
[2]
Vijay Kumar Adhikari, Yang Guo, Fang Hao, Matteo Varvello, Volker Hilt, Moritz Steiner, and Zhili Zhang. 2012. Unreeling netflix: Understanding and improving multi-CDN movie delivery. (2012), 1620--1628.
[3]
Yonghwan Bang, June-Koo Kevin Rhee, KyungSoo Park, Kyongchun Lim, Giyoung Nam, John D Shinn, Jongmin Lee, Sungmin Jo, Ja-Ryeong Koo, Jonggyu Sung, et al. 2016. CDN interconnection service trial: implementation and analysis. IEEE Communications Magazine 54, 6 (2016), 94--100.
[4]
Timm Böttger, Felix Cuadrado, Gareth Tyson, Ignacio Castro, and Steve Uhlig. 2018. Open connect everywhere: A glimpse at the internet ecosystem through the lens of the netflix cdn. ACM SIGCOMM Computer Communication Review 48, 1 (2018), 28--34.
[5]
Fei Chen, Cong Zhang, FengWang, and Jiangchuan Liu. 2015. Crowdsourced live streaming over the cloud. In 2015 IEEE Conference on Computer Communications (INFOCOM). IEEE, 2524--2532.
[6]
Florin Dobrian, Asad K Awan, Dilip Antony Joseph, Aditya Ganjam, Jibin Zhan, Vyas Sekar, Ion Stoica, and Hui Zhang. 2013. Understanding the impact of video quality on user engagement. Communications of The ACM 56, 3 (2013), 91--99.
[7]
Chongwu Dong, Yin Jia, Hua Peng, Xiaoxing Yang, and Wushao Wen. 2018. A Novel Distribution Service Policy for Crowdsourced Live Streaming in Cloud Platform. IEEE Transactions on Network and Service Management 15 (2018), 679-- 692.
[8]
Daniel James Edwards and TP Hart. 1961. The alpha-beta heuristic. (1961).
[9]
Jian He, DiWu, Yupeng Zeng, Xiaojun Hei, and YonggangWen. 2013. Toward optimal deployment of cloud-assisted video distribution services. IEEE transactions on circuits and systems for video technology 23, 10 (2013), 1717--1728.
[10]
Nicolas Herbaut, Daniel Négru, Yiping Chen, Pantelis A Frangoudis, and Adlen Ksentini. 2016. Content delivery networks as a virtual network function: A win-win ISP-CDN collaboration. In 2016 IEEE Global Communications Conference (GLOBECOM). IEEE, 1--6.
[11]
Junchen Jiang, Vyas Sekar, Henry Milner, Davis Shepherd, Ion Stoica, and Hui Zhang. 2016. {CFA}: A Practical Prediction System for Video QoE Optimization. In 13th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 16). 137--150.
[12]
Junchen Jiang, Shijie Sun, Vyas Sekar, and Hui Zhang. 2017. Pytheas: Enabling data-driven quality of experience optimization using group-based explorationexploitation. In 14th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 17). 393--406.
[13]
Hongqiang Harry Liu, Ye Wang, Yang Richard Yang, Hao Wang, and Chen Tian. 2012. Optimizing cost and performance for content multihoming. In Proceedings of the ACM SIGCOMM 2012 conference on Applications, technologies, architectures, and protocols for computer communication. ACM, 371--382.
[14]
Xi Liu, Florin Dobrian, Henry Milner, Junchen Jiang, Vyas Sekar, Ion Stoica, and Hui Zhang. 2012. A case for a coordinated internet video control plane. acm special interest group on data communication 42, 4 (2012), 359--370.
[15]
Zoltán Ádám Mann. 2015. Allocation of virtual machines in cloud data centers a survey of problem models and optimization algorithms. Acm Computing Surveys (CSUR) 48, 1 (2015), 11.
[16]
Haitian Pang, Zhi Wang, Chen Yan, Qinghua Ding, and Lifeng Sun. 2017. First Mile in Crowdsourced Live Streaming: A Content Harvest Network Approach. (2017), 101--109.
[17]
Haitian Pang, Cong Zhang, Fangxin Wang, Han Hu, Zhi Wang, Jiangchuan Liu, and Lifeng Sun. 2018. Optimizing Personalized Interaction Experience in Crowd-Interactive Livecast: A Cloud-Edge Approach. In 2018 ACM Multimedia Conference on Multimedia Conference. ACM, 1217--1225.
[18]
James Blake Rawlings and David Q Mayne. 2009. Model predictive control: Theory and design. Nob Hill Pub. Madison, Wisconsin.
[19]
Andrew Trask and et al. 2018. Neural arithmetic logic units. In Advances in Neural Information Processing Systems. 8046--8055.
[20]
Feng Wang, Jiangchuan Liu, Minghua Chen, and Haiyang Wang. 2016. Migration towards cloud-assisted live media streaming. IEEE/ACM Transactions on networking 24, 1 (2016), 272--282.
[21]
Jason Min Wang, Jun Zhang, and Brahim Bensaou. 2014. Content multi-homing: An alternative approach. In 2014 IEEE International Conference on Communications (ICC). IEEE, 3118--3123.
[22]
Zhi Wang, Lifeng Sun, Chuan Wu, Wenwu Zhu, and Shiqiang Yang. 2014. Joint online transcoding and geo-distributed delivery for dynamic adaptive streaming. (2014), 91--99.
[23]
Bo Yan, Shu Shi, Yong Liu, Weizhe Yuan, Haoqin He, Rittwik Jana, Yang Xu, and H Jonathan Chao. 2017. LiveJack: Integrating CDNs and Edge Clouds for Live Content Broadcasting. In Proceedings of the 25th ACM international conference on Multimedia. ACM, 73--81.
[24]
Zidong Yang, Ji Hu, Yuanchao Shu, Peng Cheng, Jiming Chen, and Thomas Moscibroda. 2016. Mobility modeling and prediction in bike-sharing systems. In Proceedings of the 14th annual international conference on mobile systems, applications, and services. ACM, 165--178.
[25]
Zheng Zhang, Ming Zhang, Albert G Greenberg, Y Charlie Hu, Ratul Mahajan, and Blaine Christian. 2010. Optimizing cost and performance in online service provider networks. (2010), 3--3.
[26]
Yifei Zhu, Jiangchuan Liu, Zhi Wang, and Cong Zhang. 2017. When Cloud Meets Uncertain Crowd: An Auction Approach for Crowdsourced Livecast Transcoding. (2017), 1372--1380.

Cited By

View all
  • (2024)Seer: Proactive Revenue-Aware Scheduling for Live Streaming Services in Crowdsourced Cloud-Edge PlatformsIEEE INFOCOM 2024 - IEEE Conference on Computer Communications10.1109/INFOCOM52122.2024.10621424(1801-1810)Online publication date: 20-May-2024
  • (2024)Smart Data-Driven Proactive Push to Edge Network for User-Generated VideosIEEE INFOCOM 2024 - IEEE Conference on Computer Communications10.1109/INFOCOM52122.2024.10621410(511-520)Online publication date: 20-May-2024
  • (2023)Practical Cloud-Edge Scheduling for Large-Scale Crowdsourced Live StreamingIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2023.326773134:7(2055-2071)Online publication date: Jul-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '19: Proceedings of the 27th ACM International Conference on Multimedia
October 2019
2794 pages
ISBN:9781450368896
DOI:10.1145/3343031
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. content delivery networks
  2. crowdsourced live streaming
  3. neural networks

Qualifiers

  • Research-article

Funding Sources

  • Kwai-Tsinghua Joint Project
  • NSFC
  • National Key R\&D Program of China

Conference

MM '19
Sponsor:

Acceptance Rates

MM '19 Paper Acceptance Rate 252 of 936 submissions, 27%;
Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)34
  • Downloads (Last 6 weeks)3
Reflects downloads up to 12 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Seer: Proactive Revenue-Aware Scheduling for Live Streaming Services in Crowdsourced Cloud-Edge PlatformsIEEE INFOCOM 2024 - IEEE Conference on Computer Communications10.1109/INFOCOM52122.2024.10621424(1801-1810)Online publication date: 20-May-2024
  • (2024)Smart Data-Driven Proactive Push to Edge Network for User-Generated VideosIEEE INFOCOM 2024 - IEEE Conference on Computer Communications10.1109/INFOCOM52122.2024.10621410(511-520)Online publication date: 20-May-2024
  • (2023)Practical Cloud-Edge Scheduling for Large-Scale Crowdsourced Live StreamingIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2023.326773134:7(2055-2071)Online publication date: Jul-2023
  • (2023)Bi-Criteria Approximation for a Multi-Origin Multi-Channel Auto-Scaling Live Streaming CloudIEEE Transactions on Multimedia10.1109/TMM.2022.315209325(2839-2850)Online publication date: 1-Jan-2023
  • (2023)Who is the Rising Star? Demystifying the Promising Streamers in Crowdsourced Live StreamingIEEE INFOCOM 2023 - IEEE Conference on Computer Communications10.1109/INFOCOM53939.2023.10228881(1-10)Online publication date: 17-May-2023
  • (2023)A Review on Software Defined Content Delivery Network: A Novel Combination of CDN and SDNIEEE Access10.1109/ACCESS.2023.326773711(43822-43843)Online publication date: 2023
  • (2022)A primer for neural arithmetic logic modulesThe Journal of Machine Learning Research10.5555/3586589.358677423:1(8390-8447)Online publication date: 1-Jan-2022
  • (2022)Intelligent Video Ingestion for Real-time Traffic MonitoringACM Transactions on Sensor Networks10.1145/352951118:3(1-13)Online publication date: 14-Sep-2022
  • (2022)AggCast: Practical Cost-effective Scheduling for Large-scale Cloud-edge Crowdsourced Live StreamingProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3547807(3026-3034)Online publication date: 10-Oct-2022
  • (2022)Exploiting Danmu Interactions for Optimizing Crowdsourced Livecast Services2022 7th International Conference on Big Data Analytics (ICBDA)10.1109/ICBDA55095.2022.9760307(198-203)Online publication date: 4-Mar-2022
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media