research-article

Scoring High: Analysis and Prediction of Viewer Behavior and Engagement in the Context of 2018 FIFA WC Live Streaming

Authors:

Nikolas Wehner,

Michael Seufert,

Sebastian Egger-Lampl,

Raimund SchatzAuthors Info & Claims

MM '20: Proceedings of the 28th ACM International Conference on Multimedia

Pages 807 - 815

https://doi.org/10.1145/3394171.3414016

Published: 12 October 2020 Publication History

Abstract

Large-scale events pose severe challenges to live video streaming service providers, who need to cope with high, peaking viewer numbers and the resulting fluctuating resource demands, keeping high levels of Quality of Experience (QoE) to avoid end-user frustration and churn. In this paper, we analyze a unique dataset consisting of more than a million 2018 FIFA World Cup mobile live streaming sessions, collected at a large national public broadcaster. Different from previous work, we analyze QoE and user engagement as well as their interaction, in dependency to specific soccer match events, which have the potential to trigger flash crowds during a match. Flash crowds are a particular challenge to video service providers, since they cause sudden load peaks and consequently, the likelihood of quality problems. We further exploit the data to model viewer engagement over the course of a soccer match, and show that client counts follow very similar patterns of change across all matches. We believe that the analysis as well as the resulting models are valuable sources of insight for service providers, equipping them with tools for customer-centric resource and capacity management.

Supplementary Material

MP4 File (3394171.3414016.mp4)

The presentation video for the paper "Scoring High: Analysis and Prediction of Viewer Behavior and Engagement in the Context of 2018 WC Live Streaming" at the ACM MM 2020 conference.

Download
41.74 MB

References

[1]

Adnan Ahmed, Zubair Shafiq, Harkeerat Bedi, and Amir Khakpour. 2017. Suffering from buffering? Detecting QoE impairments in live video streams. In 2017 IEEE 25th International Conference on Network Protocols (ICNP). IEEE, 1--10.

[2]

Adnan Ahmed, Zubair Shafiq, and Amir Khakpour. 2016. QoE analysis of a large-scale live video streaming event. In Proceedings of the 2016 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Science. 395--396.

Digital Library

[3]

Alcardo Alex Barakabitze, Nabajeet Barman, Arslan Ahmad, Saman Zadtootaghaj, Lingfen Sun, Maria G. Martini, and Luigi Atzori. 2019. QoE Management of Multimedia Streaming Services in Future Networks: A Tutorial and Survey. IEEE Communications Surveys & Tutorials (2019), 1--1. https://doi.org/10.1109/COMST.2019.2958784

[4]

Cisco. 2018. Cisco Visual Networking Index: Forecast and Trends, 2017--2022. (2018). https://www.cisco.com/c/en/us/solutions/collateral/executive-perspectives/annual-internet-report/white-paper-c11--741490.pdf

[5]

Florian Dobrian, Vyas Sekar, Asad Awan, Ion Stoica, Dilip Joseph, Aditya Ganjam, Jibin Zhan, and Hui Zhang. 2011. Understanding the Impact of Video Quality on User Engagement. In Proceedings of the ACM SIGCOMM. Toronto, Canada.

Digital Library

[6]

Jeffrey Erman and K.K. Ramakrishnan. 2013. Understanding the Super-Sized Traffic of the Super Bowl. In Proceedings of the 2013 Conference on Internet Measurement Conference (IMC '13). Association for Computing Machinery, New York, NY, USA, 353--360. https://doi.org/10.1145/2504730.2504770

[7]

Marie-Neige Garcia, Dominika Dytko, and Alexander Raake. 2014. Quality Impact Due to Initial Loading, Stalling, and Video Bitrate in Progressive Download Video Services. In Proceedings of the 6th International Workshop on Quality of Multimedia Experience (QoMEX). IEEE, Singapore.

[8]

Deepti Ghadiyaram, Janice Pan, and Alan C Bovik. 2015. A Time-varying Subjective Quality Model for Mobile Streaming Videos with Stalling Events. In Applications of Digital Image Processing XXXVIII.

[9]

Thiago Guarnieri, Jussara Almeida, and Alex Vieira. 2019. An Adaptation Aware Model to Predict Engagement on HTTP Adaptive Live Streaming. In 2019 IEEE Symposium on Computers and Communications (ISCC). IEEE, 1--6.

[10]

Thiago Guarnieri, Idilio Drago, Alex B Vieira, Italo Cunha, and Jussara Almeida. 2017. Characterizing QoE in large-scale live streaming. In GLOBECOM 2017--2017 IEEE Global Communications Conference. IEEE, 1--7.

[11]

Jian He, Yonggang Wen, Jianwei Huang, and Di Wu. 2013. On the cost--QoE tradeoff for cloud-based video streaming under Amazon EC2's pricing models. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 24, 4 (2013), 669--680.

[12]

Tobias Hoßfeld, Sebastian Egger, Raimund Schatz, Markus Fiedler, Kathrin Masuch, and Charlott Lorentzen. 2012. Initial Delay vs. Interruptions: Between the Devil and the Deep Blue Sea. In Proceedings of the 4th International Workshop on Quality of Multimedia Experience (QoMEX). Yarra Valley, Australia.

[13]

Tobias Hoßfeld, Raimund Schatz, Michael Seufert, Matthias Hirth, Thomas Zinner, and Phuoc Tran-Gia. 2011. Quantification of YouTube QoE via Crowdsourcing. In Proceedings of the International Workshop on Multimedia Quality of Experience - Modeling, Evaluation, and Directions (MQoE). Dana Point, CA, USA.

Digital Library

[14]

Tobias Hoßfeld, Michael Seufert, Christian Sieber, and Thomas Zinner. 2014. Assessing Effect Sizes of Influence Factors Towards a QoE Model for HTTP Adaptive Streaming. In Proceedings of the 6th International Workshop on Quality of Multimedia Experience (QoMEX). Singapore.

[15]

Tobias Hoßfeld, Lea Skorin-Kapov, Yoram Haddad, Peter Pocta, Vasilios A Siris, Andrej Zgank, and Hugh Melvin. 2015. Can context monitoring improve QoE? A case study of video flash crowds in the internet of services. In 2015 IFIP/IEEE International Symposium on Integrated Network Management (IM). IEEE, 1274--1277.

[16]

S Shunmuga Krishnan and Ramesh K Sitaraman. 2013. Video Stream Quality Impacts Viewer Behavior: Inferring Causality Using Quasi-experimental Designs. IEEE/ACM Transactions on Networking, Vol. 21, 6 (2013), 2001--2014.

Digital Library

[17]

Pierre Lebreton, Kimiko Kawashima, Kazuhisa Yamagishi, and Jun Okamoto. 2018. Study on viewing time with regards to quality factors in adaptive bitrate video streaming. In 2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP). IEEE, 1--6.

[18]

Blazej Lewcio, Benjamin Belmudez, Amir Mehmood, Marcel W"altermann, and Sebastian Möller. 2011. Video Quality in Next Generation Mobile Networks -- Perception of Time-varying Transmission. In Proceedings of the IEEE International Workshop Technical Committee on Communications Quality and Reliability (CQR). Naples, FL, USA.

[19]

Zhenyu Li, Gaogang Xie, Mohamed Ali Kaafar, and Kave Salamatian. 2015. User behavior characterization of a large-scale mobile live streaming system. In Proceedings of the 24th International Conference on World Wide Web. 307--313.

Digital Library

[20]

Ning Liu, Huajie Cui, S-H Gary Chan, Zhipeng Chen, and Yirong Zhuang. 2014. Dissecting user behaviors for a simultaneous live and VoD IPTV system. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 10, 3 (2014), 1--16.

Digital Library

[21]

Eliseu César Miguel, Ítalo Cunha, Cristiano M Silva, Fernando Carvalho, and Sérgio VA Campos. 2017. Resource-constrained P2P streaming overlay construction for efficient joining under flash crowds. In 2017 IEEE Symposium on Computers and Communications (ISCC). IEEE, 639--644.

[22]

Pengpeng Ni, Ragnhild Eg, Alexander Eichhorn, Carsten Griwodz, and Pål Halvorsen. 2011. Flicker Effects in Adaptive Video Streaming to Handheld Devices. In Proceedings of the 19th ACM International Conference on Multimedia (MM). Scottsdale, AZ, USA.

Digital Library

[23]

Ozgur Oyman and Sarabjot Singh. 2012. Quality of Experience for HTTP Adaptive Streaming Services. IEEE Communications Magazine, Vol. 50, 4 (2012), 20--27.

[24]

Yining Qi and Mingyuan Dai. 2006. The Effect of Frame Freezing and Frame Skipping on Video Quality. In Proceedings of the 2nd International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP). Pasadena, CA, USA.

[25]

Julius Rückert, Björn Richerzhagen, Eduardo Lidanski, Ralf Steinmetz, and David Hausheer. 2015. Topt: Supporting flash crowd events in hybrid overlay-based live streaming. In 2015 IFIP Networking Conference (IFIP Networking). IEEE, 1--9.

[26]

Michael Seufert, Sebastian Egger, Martin Slanina, Thomas Zinner, Tobias Hoßfeld, and Phuoc Tran-Gia. 2015. A Survey on Quality of Experience of HTTP Adaptive Streaming. IEEE Communications Surveys & Tutorials, Vol. 17, 1 (2015).

[27]

Michael Seufert, Sarah Wassermann, and Pedro Casas. 2019. Considering User Behavior in the Quality of Experience Cycle: Towards Proactive QoE-aware Traffic Management. IEEE Communications Letters, Vol. PP (01 2019), 1--1. https://doi.org/10.1109/LCOMM.2019.2914038

[28]

Michael Seufert, Nikolas Wehner, Florian Wamser, Pedro Casas, Alessandro D'Alconzo, and Phuoc Tran-Gia. 2017. Unsupervised QoE Field Study for Mobile YouTube Video Streaming with YoMoApp. In Proceedings of the 9th International Conference on Quality of Multimedia Experience (QoMEX). Erfurt, Germany.

[29]

Muhammad Zubair Shafiq, Jeffrey Erman, Lusheng Ji, Alex X. Liu, Jeffrey Pang, and Jia Wang. 2014. Understanding the Impact of Network Dynamics on Mobile Video User Engagement. In Proceedings of the ACM SIGMETRICS. Austin, TX, USA.

Digital Library

[30]

Maria Torres Vega, Cristian Perra, Filip De Turck, and Antonio Liotta. 2018. A Review of Predictive Quality of Experience Management in Video Streaming Services. IEEE Transactions on Broadcasting, Vol. 64, 2 (Jun 2018), 432--445. https://doi.org/10.1109/TBC.2018.2822869

[31]

Huyen TT Tran, Thang Vu, Nam Pham Ngoc, and Truong Cong Thang. 2016. A Novel Quality Model for HTTP Adaptive Streaming. In Proceedings of the 6th IEEE International Conference on Communications and Electronics (ICCE). Ha Long, Vietnam.

[32]

Fei Wang, Zesong Fei, Jing Wang, Yifan Liu, and Zhikun Wu. 2017. HAS QoE Prediction Based on Dynamic Video Features with Data Mining in LTE Network. Science China Information Sciences, Vol. 60, 4 (2017), 042404.

[33]

Hao Yin, Xuening Liu, Feng Qiu, Ning Xia, Chuang Lin, Hui Zhang, Vyas Sekar, and Geyong Min. 2009. Inside the bird's nest: measurements of large-scale live VoD from the 2008 olympics. In Proceedings of the 9th ACM SIGCOMM conference on Internet measurement. 442--455.

Digital Library

[34]

Kai Zeng, Hojatollah Yeganeh, and Zhou Wang. 2016. Quality-of-experience of Streaming Video: Interactions between Presentation Quality and Playback Stalling. In Proceedings of the IEEE International Conference on Image Processing (ICIP). Phoenix, AZ, USA.

Cited By

Wanat DJanowski LDe Moor K(2023)Behavior as a Function of Video Quality in an Ecologically Valid ExperimentProceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3597235(415-418)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3597235
Ali MAsghar RUllah IAhmed ANoor WBaber J(2022)Towards intelligent P2P IPTV overlay management through classification of peersPeer-to-Peer Networking and Applications10.1007/s12083-021-01288-yOnline publication date: 5-Jan-2022
https://doi.org/10.1007/s12083-021-01288-y

Index Terms

Scoring High: Analysis and Prediction of Viewer Behavior and Engagement in the Context of 2018 FIFA WC Live Streaming
1. Computing methodologies
  1. Machine learning
    1. Machine learning approaches
      1. Classification and regression trees
2. Networks
  1. Network performance evaluation
    1. Network measurement
    2. Network performance analysis

Recommendations

Why do audiences choose to keep watching on live video streaming platforms? An explanation of dual identification framework

Live video streaming has been a global economic and social phenomenon in recent years. Many streaming platforms such as Twitch and YouTube Live have been founded and demonstrated unprecedented growth across the world. Yet, researchers have paid ...
Using Interaction Data to Predict Engagement with Interactive Media
MM '21: Proceedings of the 29th ACM International Conference on Multimedia

Media is evolving from traditional linear narratives to personalised experiences, where control over information (or how it is presented) is given to individual audience members. Measuring and understanding audience engagement with this media is ...
A New Scheme for QoE Management of Live Video Streaming in Cloud Environment
Image and Video Technology
Abstract
Live video streaming process consumes very large data storage and takes very long time, so it requires big data storage and computing infrastructures for implementation. Accordingly, the use of cloud computing is becoming a common practice ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '20: Proceedings of the 28th ACM International Conference on Multimedia

October 2020

4889 pages

ISBN:9781450379885

DOI:10.1145/3394171

General Chairs:
Chang Wen Chen
Chinese University of Hong Kong, Shenzhen, China
,
Rita Cucchiara
UNIMORE, Italy
,
Xian-Sheng Hua
Alibaba Group, China
,
Program Chairs:
Guo-Jun Qi
Futurewei Technologies, USA
,
Elisa Ricci
UNITN & Fondazione Bruno Kessler, Italy
,
Zhengyou Zhang
Tencent, China
,
Roger Zimmermann
National University of Singapore, Singapore

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 October 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM '20

Sponsor:

SIGMM

MM '20: The 28th ACM International Conference on Multimedia

October 12 - 16, 2020

WA, Seattle, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
254
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)6

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wanat DJanowski LDe Moor K(2023)Behavior as a Function of Video Quality in an Ecologically Valid ExperimentProceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3597235(415-418)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3597235
Ali MAsghar RUllah IAhmed ANoor WBaber J(2022)Towards intelligent P2P IPTV overlay management through classification of peersPeer-to-Peer Networking and Applications10.1007/s12083-021-01288-yOnline publication date: 5-Jan-2022
https://doi.org/10.1007/s12083-021-01288-y

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents