Reviving Peer-to-Peer Networking for Scalable Crowdsourced Live Video Streaming
Authors: 
Huanhuan Zhang, Congkai An, Anfu Zhou, Chaoyue Li, Xi Liu, Jialiang Pei, Yifan Zhu, Liang Liu, Huadong MaAuthors Info & Claims
Pages 3205 - 3220
Abstract
The rising crowdsourced live video streaming (CLVS) poses great challenges to Internet transport scalability, where a broadcaster’s live video is expected to reach thousands and even millions of viewers in real time. To accommodate such huge concurrent video traffic, the de-facto solution is to employ content delivery network (CDN), which distributes the traffic spatially relative to end viewers, using geographically distributed servers. However, our measurement study over a top operational CLVS platform reveals that CDN is not scalable enough, i.e., it loses efficacy, particularly during busy time and leads to tremendous QoE degradation, e.g., 33.3% video bitrate reduction, in comparison to network idle time. In this work, we propose Spider, which revives the peer-to-peer (P2P) networking principle to extend the scalability of CLVS system. Beyond traditional P2P for elastic data transmission, Spider retrofits P2P to meet the stringent low-latency requirements of CLVS: proposing a “pair-push” streaming mode to tame the excessive signaling latency; designing a QoE-driven peer pairing algorithm to tackle the Internet path variation and CLVS viewer dynamics. We implement, deploy and evaluate Spider in real-world over 20.9 thousand video sessions. Compared to the de-facto CDN solution, Spider achieves remarkable gains, e.g., video stall rate reductions of 52.57%, video quality gains of 8.22%, and even 66% CDN bandwidth saving. The results validate the feasibility and practicability of embracing P2P for low-latency live video communication for the first time.
References
[1]
(2016). Facebook Internal Cdn for Broadcasting Live Video. [Online]. Available: https://www.bizety.com/2016/10/11/facebook-internal-cdn-broadcasting-live-video/
[2]
A. D’Alconzo, P. Casas, P. Fiadino, A. Bar, and A. Finamore, “Who to blame when Youtube is not working? Detecting anomalies in CDN-provisioned services,” in Proc. Int. Wireless Commun. Mobile Comput. Conf. (IWCMC), Nicosia, Cyprus, Aug. 2014, pp. 435–440.
[3]
(2020). An Introduction to Bilibili. [Online]. Available: https://lillianli.substack.com/p/an-introduction-to-bilibili-?s=r
[4]
(2021). Alibaba Bolsters Livestream Retail With New Cdn Tech Launch. [Online]. Available: https://powerretail.com.au/in-focus/alibaba-bolsters-livestream-retail-with-new-cdn-tech-launch/
[5]
(2021). Video Streaming Market Size, Share and Trends Analysis Report. [Online]. Available: https://www.grandviewresearch.com/industry-analysis/video-streaming-market
[6]
(2022). Video Latency in Live Streaming. [Online]. Available: https://aws.amazon.com/cn/media/tech/video-latency-in-live-streaming/
[7]
(2021). The Future of Ultra Low-latency Video Streaming. [Online]. Available: https://api.video/blog/video-trends/the-future-of-ultra-low-latency-video-streaming
[8]
A. Zhouet al., “Learning to coordinate video codec with transport protocol for mobile video telephony,” in Proc. 25th Annu. Int. Conf. Mobile Comput. Netw., Oct. 2019, p. 29.
[9]
W.-S. Wunget al., “Twitch’s CDN as an open population ecosystem,” in Proc. Asian Internet Eng. Conf., Dec. 2021, pp. 56–63.
[10]
(2021). Five Things We Know About Fastly, the Company That Brought Down the Internet for an Hour. [Online]. Available: https://www.businessofbusiness.com/articles/five-things-we-know-about-fastly-the-company-that-brought-down-the-internet-for-an-hour/
[11]
(2021). Webrtc Home. [Online]. Available: https://webrtc.org/
[12]
(2019). How Much Does It Cost to Maintain Twitch Infrastructure. [Online]. Available: https://trembit.com/blog/how-much-does-it-cost-to-maintain-twitch
[13]
(2016). Alibaba Cloud Cdn Pricing. [Online]. Available: https://docs-aliyun.cn-hangzhou.oss.aliyun-Inc.com/pdf/cdn-billing-intl-en-2016-07-15.pdf
[14]
B. Cohen, “Incentives build robustness in BitTorrent,” in Proc. Workshop Econ. Peer-to-Peer Syst., vol. 6, 2003, pp. 68–72.
[15]
H. Chen, X. Li, and J. Han, “Maze: A social peer-to-peer networking,” in Proc. IEEE Int. Conf. e-commerce Technol. Dyn. E-Business, Sep. 2004, pp. 290–293.
[16]
G. Zhang, W. Liu, X. Hei, and W. Cheng, “Unreeling Xunlei Kankan: Understanding hybrid CDN-P2P video-on-demand streaming,” IEEE Trans. Multimedia, vol. 17, no. 2, pp. 229–242, Feb. 2015.
[17]
J. Zhou, L. Tang, K. Li, H. Wang, and Z. Zhou, “A low-latency peer-to-peer approach for massively multiplayer games,” in Proc. Int. Workshop Agents P2P Comput., vol. 4118, Z. Despotovic, S. Joseph, and C. Sartori, Eds. Utrecht, The Netherlands. Cham, Switzerland: Springer, Jul. 2005, pp. 120–131.
[18]
C. Probst, A. Disterhöft, and K. Graffi, “Chunked-swarm: Divide and conquer for real-time bounds in video streaming,” in Proc. Conf. Internet Things Smart Spaces, vol. 9247, S. I. Balandin, S. D. Andreev, and Y. Koucheryavy, Eds. St. Petersburg, Russia. Cham, Switzerland: Springer, 2015, pp. 198–210.
[19]
Z. Tong, R. Fengyuan, W. Cheng, L. Xiaohui, S. Ran, and L. Xiaolan, “Modeling and analyzing the influence of chunk size variation on bitrate adaptation in DASH,” in Proc. IEEE INFOCOM-IEEE Conf. Comput. Commun., May 2017, pp. 1–9.
[20]
Y. Huang, T. Z. J. Fu, D.-M. Chiu, J. C. S. Lui, and C. Huang, “Challenges, design and analysis of a large-scale p2p-vod system,” in Proc. ACM SIGCOMM Conf. Data Commun., Seattle, WA, USA, Aug. 2008, pp. 375–388.
[21]
(2022). P2P Media Loader for Hls. [Online]. Available: https://github.com/Novage/p2p-media-loader
[22]
(2021). RTMP Streaming: The Real-time Messaging Protocol. [Online]. Available: https://www.wowza.com/blog/rtmp-streaming-real-time-messaging-protocol
[23]
(2021). RTSP: The Real-time Streaming Protocol. [Online]. Available: https://www.wowza.com/blog/rtsp-the-real-time-streaming-protocol-explained
[24]
H. Zhanget al., “OnRL: Improving mobile video telephony via online reinforcement learning,” in Proc. 26th Annu. Int. Conf. Mobile Comput. Netw., London, U.K., Sep. 2020, p. 29.
[25]
H. Zhanget al., “Loki: Improving long tail performance of learning-based real-time video adaptation by fusing rule-based models,” in Proc. 27th Annu. Int. Conf. Mobile Comput. Netw., New Orleans, LA, USA, Oct. 2021, pp. 775–788.
[26]
S. Fouladi, J. Emmons, E. Orbay, C. Wu, R. S. Wahby, and K. Winstein, “Salsify: Low-latency network video through tighter integration between a video codec and a transport protocol,” in Proc. 15th USENIX Symp. Netw. Syst. Design Implement. (NSDI), 2018, pp. 267–282.
[27]
H. Zhang, A. Zhou, and H. Ma, “Improving mobile interactive video QoE via two-level online cooperative learning,” IEEE Trans. Mobile Comput., vol. 22, no. 10, pp. 5900–5917, Oct. 2023.
[28]
M. Zhang, L. Zhao, Y. Tang, J.-G. Luo, and S.-Q. Yang, “Large-scale live media streaming over peer-to-peer networks through global internet,” in Proc. ACM Workshop Adv. Peer Peer Multimedia Streaming, Nov. 2005, pp. 21–28.
[29]
X. Zhang, J.-c. Lin, B. Li, Tak-Shing, and P. Yum, “Coolstreaming/DONet: A data-driven overlay network for peer-to-peer live media streaming,” in Proc. IEEE 24th Annu. Joint Conf. IEEE Comput. Commun. Societies., Mar. 2005, pp. 2102–2111.
[30]
N. Magharei and R. Rejaie, “PRIME: Peer-to-peer receiver-driven mesh-based streaming,” IEEE/ACM Trans. Netw., vol. 17, no. 4, pp. 1052–1065, Aug. 2009.
[31]
(2022). What is Hls Streaming and When Should You Use It. [Online]. Available: https://www.dacast.com/blog/hls-streaming-protocol/
[32]
H. Zhang, A. Zhou, R. Ma, J. Lu, and H. Ma, “Arsenal: Understanding learning-based wireless video transport via in-depth evaluation,” IEEE Trans. Veh. Technol., vol. 70, no. 10, pp. 10832–10844, Oct. 2021.
[33]
(2021). Big Buck Bunny Video. [Online]. Available: https://dash.akamaized.net/akamai/bbb_30fps/bbb_30fps_3840x2160_12000k.mp4
[34]
(2021). Rise of Beauty. [Online]. Available: https://www.youtube.com/watch?v=oima7dLTNGU
[35]
(2021). Srs Framework. [Online]. Available: https://github.com/ossrs/srs
[36]
(2021). Real-time Transport Protocol. [Online]. Available: https://en.wikipedia.org/wiki/Real-time_Transport_Protocol
[37]
(2022). Stun, Turn, and Ice. [Online]. Available: https://anyconnect.com/stun-turn-ice/
[38]
H.-C. Wang, C. Chen, and S.-H. Lu, “An SDN-based NAT traversal mechanism for end-to-end IoT networking,” in Proc. 20th Asia–Pacific Netw. Oper. Manage. Symp. (APNOMS), Matsue, Japan, Sep. 2019, pp. 1–4.
[39]
K. J. Archer and R. V. Kimes, “Empirical characterization of random forest variable importance measures,” Comput. Statist. Data Anal., vol. 52, no. 4, pp. 2249–2260, Jan. 2008.
[40]
R. Genuer, “Variable selection using random forests,” Pattern Recognit. Lett., vol. 31, no. 14, pp. 2225–2236, Oct. 2010.
[41]
G. Celik, S. C. Borst, P. A. Whiting, and E. Modiano, “Dynamic scheduling with reconfiguration delays,” Queueing Syst., vol. 83, nos. 1–2, pp. 87–129, Jun. 2016.
[42]
H. Liuet al., “Scheduling techniques for hybrid circuit/packet networks,” in Proc. 11th ACM Conf. Emerg. Netw. Exp. Technol., Dec. 2015, p. 41.
[43]
H. Zhu, M. Zhou, and R. Alkins, “Group role assignment via a Kuhn-Munkres algorithm-based solution,” IEEE Trans. Syst. Man, Cybern. A, Syst. Humans, vol. 42, no. 3, pp. 739–750, May 2012.
[44]
(2018). Kuhn-Munkres Algorithm. [Online]. Available: https://brilliant.org/wiki/hungarian-matching/
[45]
X. Yanget al., “Fast and light bandwidth testing for internet users,” in Proc. 18th USENIX Symp. Netw. Syst. Design Implement., J. Mickens and R. Teixeira, Eds. Berkeley, CA, USA: USENIX Association, Apr. 2021, pp. 1011–1026.
[46]
(2022). Introduction of Nat Traversal. [Online]. Available: https://en.wikipedia.org/wiki/NAT_traversal
[47]
(2022). Flask Development. [Online]. Available: https://flask.palletsprojects.com/en/2.0.x/
[48]
(2022). Traffic Control Howto V1.0.2. [Online]. Available: https://tldp.org/HOWTO/Traffic-Control-HOWTO/intro.html
[49]
T. Zhang, J. Wang, J. Huang, J. Chen, Y. Pan, and G. Min, “Tuning the aggressive TCP behavior for highly concurrent HTTP connections in intra-datacenter,” IEEE/ACM Trans. Netw., vol. 25, no. 6, pp. 3808–3822, Dec. 2017.
[50]
H. Wang, G. Tang, K. Wu, and J. Wang, “PLVER: Joint stable allocation and content replication for edge-assisted live video delivery,” IEEE Trans. Parallel Distrib. Syst., vol. 33, no. 1, pp. 218–230, Jan. 2022.
[51]
G. Zhang, J. Y. B. Lee, K. Liu, H. Hu, and V. Aggarwal, “A unified framework for flexible playback latency control in live video streaming,” IEEE Trans. Parallel Distrib. Syst., vol. 32, no. 12, pp. 3024–3037, Dec. 2021.
[52]
R.-X. Zhanget al., “A practical learning-based approach for viewer scheduling in the crowdsourced live streaming,” ACM Trans. Multimedia Comput., Commun., Appl., vol. 16, no. 2s, pp. 1–22, Apr. 2020.
[53]
R. Torres, A. Finamore, J. R. Kim, M. Mellia, M. M. Munafo, and S. Rao, “Dissecting video server selection strategies in the Youtube CDN,” in Proc. 31st Int. Conf. Distrib. Comput. Syst., Jun. 2011, pp. 248–257.
[54]
N. Cardwell, Y. Cheng, C. S. Gunn, S. H. Yeganeh, and V. Jacobson, “BBR: Congestion-based congestion control,” Commun. ACM, vol. 60, no. 2, pp. 58–66, 2017.
[55]
G. Carlucci, L. De Cicco, S. Holmer, and S. Mascolo, “Congestion control for web real-time communication,” IEEE/ACM Trans. Netw., vol. 25, no. 5, pp. 2629–2642, Oct. 2017.
[56]
K. Spiteri, R. Urgaonkar, and R. K. Sitaraman, “BOLA: Near-optimal bitrate adaptation for online videos,” IEEE/ACM Trans. Netw., vol. 28, no. 4, pp. 1698–1711, Aug. 2020.
[57]
J. Kim, Y. Jung, H. Yeo, J. Ye, and D. Han, “Neural-enhanced live streaming: Improving live video ingest via online learning,” in Proc. Annu. Conf. ACM Special Interest Group Data Commun. Appl., Technol., Archit., Protocols Comput. Commun., Jul. 2020, pp. 107–125.
[58]
F. Chen, C. Zhang, F. Wang, and J. Liu, “Crowdsourced live streaming over the cloud,” in Proc. IEEE Conf. Comput. Commun. (INFOCOM), Apr. 2015, pp. 2524–2532.
[59]
R.-X. Zhanget al., “AggCast: Practical cost-effective scheduling for large-scale cloud-edge crowdsourced live streaming,” in Proc. 30th ACM Int. Conf. Multimedia, 2022, pp. 3026–3034.
[60]
Y. Wanget al., “TrafAda: Cost-aware traffic adaptation for maximizing bitrates in live streaming,” IEEE/ACM Trans. Netw., vol. 32, no. 1, pp. 96–109, Feb. 2024.
[61]
R. Schollmeier, “A definition of peer-to-peer networking for the classification of peer-to-peer architectures and applications,” in Proc. 1st Int. Conf. Peer Peer Comput., 2001, pp. 101–102.
[62]
(2022). Napster. [Online]. Available: https://www.britannica.com/topic/Napster
[63]
(2001). The Death Spiral of Napster Begins. [Online]. Available: https://www.history.com/this-day-in-history/the-death-spiral-of-napster-begins
[64]
(2022). The Internet Archive. [Online]. Available: https://archive.org/about/
[65]
(2012). Over 1,000,000 Torrents of Downloadable Books, Music, and Movies. [Online]. Available: https://blog.archive.org/2012/08/07/over-1000000-torrents-of-downloadable-books-music-and-movies/
[66]
(2012). Exclusive: A Behind-the-Scenes Look At Facebook Release Engineering. [Online]. Available: https://arstechnica.com/information-technology/2012/04/exclusive-a-behind-the-scenes-look-at-facebook-release-engineering/
[67]
M. Wang and B. Li, “R2: Random push with random network coding in live peer-to-peer streaming,” IEEE J. Sel. Areas Commun., vol. 25, no. 9, pp. 1655–1666, Dec. 2007.
[68]
D. Xu, S. S. Kulkarni, C. Rosenberg, and H.-K. Chai, “Analysis of a CDN–P2P hybrid architecture for cost-effective streaming media distribution,” Multimedia Syst., vol. 11, no. 4, pp. 383–399, Apr. 2006.
[69]
H. Yinet al., “Livesky: Enhancing CDN with P2P,” ACM Trans. Multim. Comput. Commun. Appl., vol. 6, no. 3, pp. 16:1–16:19, 2010.
[70]
F. Wang, J. Liu, and Y. Xiong, “Stable peers: Existence, importance, and application in peer-to-peer live video streaming,” in Proc. IEEE INFOCOM 27th Conf. Comput. Commun., Apr. 2008, pp. 1364–1372.
[71]
S. Guha and P. Francis, “Characterization and measurement of TCP traversal through NATs and firewalls,” in Proc. 5th ACM SIGCOMM Conf. Internet Meas. (IMC), 2005, pp. 199–211.
[72]
Z. Yu, X. Liu, and G. Wang, “A survey of consensus and incentive mechanism in blockchain derived from P2P,” in Proc. IEEE 24th Int. Conf. Parallel Distrib. Syst. (ICPADS), Singapore, Dec. 2018, pp. 1010–1015.
[73]
S. A. Ansari, K. Pal, M. C. Govil, M. Ahmed, T. Chawla, and A. Choudhary, “Score-based incentive mechanism (SIM) for live multimedia streaming in peer-to-peer network,” Multimedia Tools Appl., vol. 80, no. 13, pp. 19263–19290, May 2021.
[74]
(2022). Bittorrent (BTT)White Paper. [Online]. Available: https://www.bittorrent.com/btt/btt-docs/BitTorrent_(BTT)_White_Paper_v0.8.7_Feb_2019.pdf
Index Terms
- Reviving Peer-to-Peer Networking for Scalable Crowdsourced Live Video Streaming
Index terms have been assigned to the content through auto-classification.
Recommendations
Live peer-to-peer streaming with scalable video coding and networking coding
MMSys '10: Proceedings of the first annual ACM SIGMM conference on Multimedia systemsWe present the design of a peer-to-peer (P2P) live streaming system that uses scalable video coding as well as network coding. The proposed design enables flexible customization of video streams to support heterogeneous receivers, highly utilizes upload ...
Scalable peer-to-peer streaming for live entertainment content
We present a system for streaming live entertainment content over the Internet originating from a single source to a scalable number of consumers without resorting to centralized or provider-provisioned resources. The system creates a peer-to-peer ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
1063-6692 © 2024 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See https://www.ieee.org/publications/rights/index.html for more information.
Publisher
IEEE Press
Publication History
Published: 26 March 2024
Published in TON Volume 32, Issue 4
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 10Total Downloads
- Downloads (Last 12 months)10
- Downloads (Last 6 weeks)5
Reflects downloads up to 16 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in