Energy and QoE Optimization for Mobile Video Streaming with Adaptive Brightness Scaling
Authors: 
Daibo Liu, Chao Qian, Huigui Rong, Siwang Zhou, Chaocan Xiang, Hongbo JiangAuthors Info & Claims
Article No.: 101, Pages 1 - 24
Abstract
Brightness scaling (BS) is an emerging and promising technique with outstanding energy efficiency on mobile video streaming. However, existing BS-based approaches totally neglect the inherent interaction effect between BS factor, video bitrate and environment context. Their combined impact on user’s visual perception in mobile scenario, leading to inharmonious between energy consumption and user’s quality of experience (QoE). In this paper, we propose PEO, a novel user-Perception-based video Experience Optimization for energy-constrained mobile video streaming, by jointly considering the inherent connection between a device’s state of motion, video quality and the resulting user-perceived quality. Specifically, by capturing the motion of the on-the-run device, PEO first infers the optimal bitrate and BS factor, therefore avoiding bitrate-inefficiency for energy saving while guaranteeing the user-perceived QoE. On that basis, we formulate the device motion-aware and user perception-aware video streaming as an optimization problem where we present an optimal algorithm to maximize the object function and adapt to user preference, and thus propose an online bitrate selection algorithm. Our evaluation (based on trace analysis and user study) shows that, compared with state-of-the-art techniques, PEO can raise the perceived quality by 23.8%-41.3% and save up to 25.2% energy consumption.
References
[1]
2023. AccuBattery. (2023). Retrieved November 20, 2023 from https://accubatteryapp.com
[2]
2023. Android. (2023). Retrieved November 20, 2023 from https://developer.android.com/docs
[3]
2023. Axiomatic Systems Bento4. (2023). Retrieved November 20, 2023 from https://www.bento4.com/
[4]
2023. Big Buck Bunny. (2023). Retrieved November 20, 2023 from https://peach.blender.org
[5]
2023. Cisco Annual Internet Report (2018–2023) White Paper. (2023). Retrieved November 20, 2023 from https://www.cisco.com/c/en/us/solutions/collateral/executive-perspectives/annual-internet-report/white-paper-c11-741490.html
[6]
2023. Dash Industry Forum. (2023). Retrieved November 20, 2023 from https://github.com/Dash-Industry-Forum/dash.js/
[7]
2023. FFmpeg. (2023). Retrieved November 20, 2023 fromhttps://www.ffmpeg.org/
[8]
2023. YUV Color Space. (2023). Retrieved November 20, 2023 fromhttps://en.wikipedia.org/wiki/YUV
[9]
Sorath Asnani, Maria Giulia Canu, Laura Farinetti, and Bartolomeo Montrucchio. 2021. On producing energy-efficient and contrast-enhanced images for OLED-based mobile devices. Pervasive Mob. Comput. 75 (2021), 101384.
[10]
Anand Bhojan. 2018. Adaptive video content manipulation for OLED display power management. In Proceedings of the 15th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services, MobiQuitous 2018, 5-7 November 2018, New York City, NY, USA, Henning Schulzrinne and Pan Li (Eds.). ACM, 236–245.
[11]
El-Fadel Bonfoh, Samir Medjiah, and Christophe Chassot. 2018. A parsimonious monitoring approach for link bandwidth estimation within SDN-based networks. In 4th IEEE Conference on Network Softwarization and Workshops, NetSoft 2018, Montreal, QC, Canada, June 25-29, 2018. IEEE, 512–516.
[12]
Chao Cai, Henglin Pu, Menglan Hu, Rong Zheng, and Jun Luo. 2021. Acoustic software defined platform: A versatile sensing and general benchmarking platform. IEEE Transactions on Mobile Computing (2021).
[13]
Yetong Cao, Chao Cai, Anbo Yu, Fan Li, and Jun Luo. 2023. EarAce: Empowering versatile acoustic sensing via earable active noise cancellation platform. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 2 (2023), 1–23.
[14]
Xianda Chen, Tianxiang Tan, Guohong Cao, and Thomas F. La Porta. 2022. Context-aware and energy-aware video streaming on smartphones. IEEE Trans. Mob. Comput. 21, 3 (2022), 862–877.
[15]
Xiang Chen, Jian Zheng, Yiran Chen, Mengying Zhao, and Chun Jason Xue. 2012. Quality-retaining OLED dynamic voltage scaling for video streaming applications on mobile devices. In The 49th Annual Design Automation Conference 2012, DAC’12, San Francisco, CA, USA, June 3-7, 2012. ACM, 1000–1005.
[16]
Xavier Corbillon, Gwendal Simon, Alisa Devlic, and Jacob Chakareski. 2017. Viewport-adaptive navigable 360-degree video delivery. In IEEE International Conference on Communications, ICC 2017, Paris, France, May 21-25, 2017. IEEE, 1–7.
[17]
Cheryl L. Evans and J. Steven Smethers. 2001. Streaming into the future: A Delphi study of broadcasters’ attitudes toward cyber radio stations. Journal of Radio Studies 8, 1 (2001), 5–28.
[18]
Mohammad Ashraful Hoque, Matti Siekkinen, and Jukka K. Nurminen. 2014. Energy efficient multimedia streaming to mobile devices - A survey. IEEE Commun. Surv. Tutorials 16, 1 (2014), 579–597.
[19]
Te-Yuan Huang, Ramesh Johari, Nick McKeown, Matthew Trunnell, and Mark Watson. 2014. A buffer-based approach to rate adaptation: Evidence from a large video streaming service. In ACM SIGCOMM 2014 Conference, SIGCOMM’14, Chicago, IL, USA, August 17-22, 2014. ACM, 187–198.
[20]
Wenjie Huang, Zhiwei Zhao, Zi Wang, Geyong Min, Zheng Chang, Luwei Fu, and Hancong Duan. 2023. Adaptive mobile recharge scheduling with rapid data sharing in wireless rechargeable networks. IEEE Transactions on Mobile Computing (2023).
[21]
Yang Li, Hao Lin, Zhenhua Li, Yunhao Liu, Feng Qian, Liangyi Gong, Xianlong Xin, and Tianyin Xu. 2021. A nationwide study on cellular reliability: Measurement, analysis, and enhancements. In Proceedings of the 2021 ACM SIGCOMM 2021 Conference. 597–609.
[22]
Yu-Ting Lin, Eduardo Mucelli Rezende Oliveira, Sana Ben Jemaa, and Salah-Eddine Elayoubi. 2017. Machine learning for predicting QoE of video streaming in mobile networks. In IEEE International Conference on Communications, ICC 2017, Paris, France, May 21-25, 2017. IEEE, 1–6.
[23]
Jianqi Liu, Zhiwei Zhao, Xiangyang Luo, Pan Li, Geyong Min, and Huiyong Li. 2024. SlaugFL: Efficient edge federated learning with selective GAN-based data augmentation. IEEE Transactions on Mobile Computing (2024).
[24]
Qian Liu, Zhisheng Yan, and Chang Wen Chen. 2016. Cloud-based video streaming with systematic mobile display energy saving: Rate-distortion-display energy profiling. In 2016 IEEE International Conference on Image Processing, ICIP 2016, Phoenix, AZ, USA, September 25-28, 2016. IEEE, 1504–1508.
[25]
Hongzi Mao, Ravi Netravali, and Mohammad Alizadeh. 2017. Neural adaptive video streaming with Pensieve. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication, SIGCOMM 2017, Los Angeles, CA, USA, August 21-25, 2017. ACM, 197–210.
[26]
Ricky K. P. Mok, Edmond W. W. Chan, and Rocky K. C. Chang. 2011. Measuring the quality of experience of HTTP video streaming. In Proceedings of the 12th IFIP/IEEE International Symposium on Integrated Network Management, IM 2011, Dublin, Ireland, 23-27 May 2011. IEEE, 485–492.
[27]
Afshin Taghavi Nasrabadi, Anahita Mahzari, Joseph D. Beshay, and Ravi Prakash. 2017. Adaptive 360-degree video streaming using scalable video coding. In Proceedings of the 2017 ACM on Multimedia Conference, MM 2017, Mountain View, CA, USA, October 23-27, 2017. ACM, 1689–1697.
[28]
Ida Nurcahyani and M. Taufiq Nur Huda. 2020. Implementation analysis of available bandwidth estimation for multimedia service on VANET network using A-STAR routing protocol. In 2020 3rd International Conference on Information and Communications Technology (ICOIACT). IEEE, 446–450.
[29]
Jian Qiao, Yejun He, and Xuemin Sherman Shen. 2016. Proactive caching for mobile video streaming in millimeter wave 5G networks. IEEE Trans. Wirel. Commun. 15, 10 (2016), 7187–7198.
[30]
Ahmad Rahmati and Lin Zhong. 2007. Context-for-wireless: Context-sensitive energy-efficient wireless data transfer. In Proceedings of the 5th International Conference on Mobile Systems, Applications, and Services (MobiSys 2007), San Juan, Puerto Rico, June 11-13, 2007. ACM, 165–178.
[31]
Md. Musfequs Salehin and Manoranjan Paul. 2016. Human visual field based saliency prediction method using Eye Tracker data for video summarization. In 2016 IEEE International Conference on Multimedia & Expo Workshops, ICME Workshops 2016, Seattle, WA, USA, July 11-15, 2016. IEEE Computer Society, 1–6.
[32]
Michael Seufert, Pedro Casas, Nikolas Wehner, Li Gang, and Kuang Li. 2019. Stream-based machine learning for real-time QoE analysis of encrypted video streaming traffic. In 22nd Conference on Innovation in Clouds, Internet and Networks and Workshops, ICIN 2019, Paris, France, February 19-21, 2019. IEEE, 76–81.
[33]
Kevin Spiteri, Rahul Urgaonkar, and Ramesh K. Sitaraman. 2020. BOLA: Near-optimal bitrate adaptation for online videos. IEEE/ACM Trans. Netw. 28, 4 (2020), 1698–1711.
[34]
Thomas Stockhammer. 2011. Dynamic adaptive streaming over HTTP -: Standards and design principles. In Proceedings of the Second Annual ACM SIGMM Conference on Multimedia Systems, MMSys 2011, Santa Clara, CA, USA, February 23-25, 2011. ACM, 133–144.
[35]
Wei Sun, Xiongkuo Min, Guangtao Zhai, Ke Gu, Siwei Ma, and Xiaokang Yang. 2022. Dynamic backlight scaling considering ambient luminance for mobile videos on LCD displays. IEEE Trans. Mob. Comput. 21, 1 (2022), 110–124.
[36]
Xiao Sun, Zongqing Lu, Wenjie Hu, and Guohong Cao. 2015. SymDetector: Detecting sound-related respiratory symptoms using smartphones. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2015, Osaka, Japan, September 7-11, 2015. ACM, 97–108.
[37]
Yi Sun, Xiaoqi Yin, Junchen Jiang, Vyas Sekar, Fuyuan Lin, Nanshu Wang, Tao Liu, and Bruno Sinopoli. 2016. CS2P: Improving video bitrate selection and adaptation with data-driven throughput prediction. In Proceedings of the ACM SIGCOMM 2016 Conference, Florianopolis, Brazil, August 22-26, 2016. ACM, 272–285.
[38]
Ramona Trestian, Arghir-Nicolae Moldovan, Olga Ormond, and Gabriel-Miro Muntean. 2012. Energy consumption analysis of video streaming to Android mobile devices. In 2012 IEEE Network Operations and Management Symposium, NOMS 2012, Maui, HI, USA, April 16-20, 2012. IEEE, 444–452.
[39]
Bjørn J. Villa and Poul E. Heegaard. 2013. Group based traffic shaping for adaptive HTTP video streaming by segment duration control. In 27th IEEE International Conference on Advanced Information Networking and Applications, AINA 2013, Barcelona, Spain, March 25-28, 2013. IEEE Computer Society, 830–837.
[40]
Vladimir Vukadinovic and Gunnar Karlsson. 2010. Video streaming performance under proportional fair scheduling. IEEE J. Sel. Areas Commun. 28, 3 (2010), 399–408.
[41]
Zi Wang, Zhiwei Zhao, Geyong Min, Xinyuan Huang, Qiang Ni, and Rong Wang. 2018. User mobility aware task assignment for mobile edge computing. Future Gener. Comput. Syst. 85 (2018), 1–8.
[42]
Jiyan Wu, Bo Cheng, Ming Wang, and Junliang Chen. 2017. Quality-aware energy optimization in wireless video communication with multipath TCP. IEEE/ACM Trans. Netw. 25, 5 (2017), 2701–2718.
[43]
Jiyan Wu, Bo Cheng, Chau Yuen, Yanlei Shang, and Junliang Chen. 2015. Distortion-aware concurrent multipath transfer for mobile video streaming in heterogeneous wireless networks. IEEE Trans. Mob. Comput. 14, 4 (2015), 688–701.
[44]
Kazuhisa Yamagishi and Takanori Hayashi. 2017. Parametric quality-estimation model for adaptive-bitrate-streaming services. IEEE Trans. Multim. 19, 7 (2017), 1545–1557.
[45]
Zhisheng Yan and Chang Wen Chen. 2016. RnB: Rate and brightness adaptation for rate-distortion-energy tradeoff in HTTP adaptive streaming over mobile devices. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking, MobiCom 2016, New York City, NY, USA, October 3-7, 2016. ACM, 308–319.
[46]
Zhisheng Yan, Qian Liu, Tong Zhang, and Chang Wen Chen. 2018. CrowdDBS: A crowdsourced brightness scaling optimization for display energy reduction in mobile video. IEEE Trans. Mob. Comput. 17, 11 (2018), 2536–2549.
[47]
Xinlei Yang, Xianlong Wang, Zhenhua Li, Yunhao Liu, Feng Qian, Liangyi Gong, Rui Miao, and Tianyin Xu. 2021. Fast and light bandwidth testing for internet users. In 18th USENIX Symposium on Networked Systems Design and Implementation (NSDI 21). 1011–1026.
[48]
Xiaoqi Yin, Abhishek Jindal, Vyas Sekar, and Bruno Sinopoli. 2015. A control-theoretic approach for dynamic adaptive video streaming over HTTP. In Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication, SIGCOMM 2015, London, United Kingdom, August 17-21, 2015. ACM, 325–338.
[49]
Haibo Zhang, Prasanna Venkatesh Rengasamy, Shulin Zhao, Nachiappan Chidambaram Nachiappan, Anand Sivasubramaniam, Mahmut T. Kandemir, Ravi R. Iyer, and Chita R. Das. 2017. Race-to-sleep + content caching + display caching: A recipe for energy-efficient video streaming on handhelds. In Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO 2017, Cambridge, MA, USA, October 14-18, 2017. ACM, 517–531.
[50]
Jingyu Zhang, Zhi-Jie Wang, Song Guo, Dingyu Yang, Gan Fang, Chunyi Peng, and Minyi Guo. 2018. Power consumption analysis of video streaming in 4G LTE networks. Wirel. Networks 24, 8 (2018), 3083–3098.
[51]
Zhiwei Zhao, Wei Dong, Geyong Min, Gonglong Chen, Tao Gu, and Jiajun Bu. 2018. Towards repeatable wireless network simulation using performance aware Markov model. In 2018 IEEE Conference on Computer Communications, INFOCOM 2018, Honolulu, HI, USA, April 16-19, 2018. IEEE, 2168–2176.
[52]
Xiao Zhu, Subhabrata Sen, and Z. Morley Mao. 2021. Livelyzer: Analyzing the first-mile ingest performance of live video streaming. In MMSys’21: 12th ACM Multimedia Systems Conference, Istanbul, Turkey, 28 September 2021-1 October 2021. ACM, 36–50.
Index Terms
- Energy and QoE Optimization for Mobile Video Streaming with Adaptive Brightness Scaling
Recommendations
Towards energy-aware DASH for mobile video
MoVid '15: Proceedings of the 7th ACM International Workshop on Mobile VideoAdvances in computing hardware and novel multimedia applications have urged the development of handheld mobile devices such as smartphones and tablets. Videos are accounting as the highest data traffic on handheld devices. With this significant increase ...
QoE and energy consumption evaluation of adaptive video streaming on mobile device
2017 14th IEEE Annual Consumer Communications & Networking Conference (CCNC)Dynamic Adaptive Streaming over HTTP (DASH) is a standard for media streaming that has been largely adopted, as it allows improved quality of experience (QoE) and the streaming host only needs to adopt conventional web server infrastructure. Despite DASH'...
Can You See What I See? Quality-of-Experience Measurements of Mobile Live Video Broadcasting
Broadcasting live video directly from mobile devices is rapidly gaining popularity with applications like Periscope and Facebook Live. The quality of experience (QoE) provided by these services comprises many factors, such as quality of transmitted ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Journal Family
Publication History
Published: 08 July 2024
Online AM: 12 June 2024
Accepted: 21 May 2024
Revised: 12 January 2024
Received: 26 November 2023
Published in TOSN Volume 20, Issue 4
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- National Natural Science Foundation of China
- Hunan Provincial Natural Science Foundation of China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 181Total Downloads
- Downloads (Last 12 months)181
- Downloads (Last 6 weeks)49
Reflects downloads up to 25 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in