Gaze- and qoe-aware video streaming solutions for mobile VR
Authors: 
Pietro Lungaro, Konrad Tollmar, Ashutosh Mittal, Alfredo Fanghella ValeroAuthors Info & Claims
Article No.: 85, Pages 1 - 2
Abstract
This demo showcases a novel approach to content delivery for 360° video streaming. It exploits information from connected eye-trackers embedded in the users' VR HMDs. The presented technology enables the delivery of high quality, in real time, around the users' fixations points while lowering the image quality everywhere else. The goal of the proposed approach is to substantially reduce the overall bandwidth requirements for supporting VR video experiences while delivering high levels of user perceived quality.
The network connection between the VR system and the content server is in this demo emulated, allowing users to experience the QoE performances achievable with datarates and RTTs in the range of current 4G and upcoming 5G networks. Users can further control additional service parameters, including video types, content resolution in the foveal region and background and size of the foveal region. At the end of each run, users are presented with a summary of the amount of bandwidth consumed with the used system settings and a comparison with the cost of current content delivery solutions. The overall goal of this demo is to provide a tangible experience of the tradeoffs among bandwidth, RTT and QoE for the mobile provision of future data intensive VR services.
References
[1]
A. Aijaz, M. Dohler, A. H. Aghvami, V. Friderikos, and M. Frodigh. 2017. Realizing the Tactile Internet: Haptic Communications over Next Generation 5G Cellular Networks. IEEE Wireless Communications - Networking and Internet Architecture (2017). https://doi.org/abs/1510.02826
[2]
J.A. Boluda, F. Pardo, T. Kayser, J.J. Perez, and J. Pelechano. 1996. A new foveated space-variant camera for robotic applications. In Proceedings of the Third IEEE International Conference on Electronics, Circuits, and Systems (ICECS '96). IEEE, Rodos, Greece.
[3]
C. Concolato, J. Le Feuvre, F. Denoual, E. Nassor, N. Ouedraogo, and J. Taquet. 2017. Adaptive streaming of hevc tiled videos using mpeg-dash. IEEE Transactions on Circuits and Systems for Video Technology (2017).
[4]
Xavier Corbillon and et. al. 2016. Viewport-Adaptive Navigable 360-Degree Video Delivery. CoRR abs/1609.08042 (2016). http://arxiv.org/abs/1609.08042
[5]
Tarek El-Ganainy and Mohamed Hefeeda. 2016. Streaming Virtual Reality Content. CoRR abs/1612.08350 (2016). http://arxiv.org/abs/1612.08350
[6]
B. Guenter, M. Finch, S. Drucker, D. Tan, and J. Snyder. 2012. Foveated 3D Graphics. ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012 31, 6 (Nov. 2012).
[7]
ITU-T H.265 (V4) 2016. High efficiency video coding. Standard. International Telecommunication Union. https://www.itu.int/rec/T-REC-H.265-201612-I/en
[8]
E. Kuzyakov and D. Pio. 2016. Next-generation video encoding techniques for 360 video and VR. (2016). https://code.facebook.com/posts/1126354007399553/next-generation-video-encoding-techniques-for-360-video-and-vr/
[9]
F. Qian, L. Ji, B. Han, and V. Gopalakrishnan. 2016. Optimizing 360 Video Delivery over Cellular Networks. In Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Challenges (ATC '16). ACM, New York, NY, USA, 1--6.
[10]
G. J. Sullivan, J. Ohm, Woo-Jin Han, and T. Wiegand. 2012. Overview of the High Efficiency Video Coding (HEVC) Standard. IEEE Transactions on Circuits and Systems for Video Technology 22, 12 (Dec 2012), 1649--1668.
Index Terms
- Gaze- and qoe-aware video streaming solutions for mobile VR
Recommendations
Efficient, QoE aware delivery of 360° videos on VR headsets over mobile links
VALUETOOLS '20: Proceedings of the 13th EAI International Conference on Performance Evaluation Methodologies and ToolsVirtual reality headsets have been in a great demand in the past years due to the immersive experience it can now provide to the users. An immersive experience of high quality, however, requires a high bandwidth connection. The latest generation of ...
Exploitation of producer intent in relation to bandwidth and QoE for online video streaming services
NOSSDAV '15: Proceedings of the 25th ACM Workshop on Network and Operating Systems Support for Digital Audio and VideoThis paper is the product of recent advances in research on users' intent during multimedia content retrieval. Our goal is to save bandwidth while streaming video clips from a browsable on-demand service, while maintaining or even improving the users' ...
QoE measurement of mobile YouTube video streaming
MoViD '10: Proceedings of the 3rd workshop on Mobile video deliveryThe scope of this paper is the interdisciplinary measurement and modeling of Quality of Experience (QoE) related to mobile YouTube video streaming in Living Lab environment. The paper introduces the implementation of a QoE measurement framework on the ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
November 2017
437 pages
ISBN:9781450355483
DOI:10.1145/3139131
- General Chairs:
- Morten Fjeld,
- Marco Fratarcangeli,
- Daniel Sjölie,
- Program Chairs:
- Oliver Staadt,
- Jonas Unger
Copyright © 2017 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 08 November 2017
Check for updates
Author Tags
Qualifiers
- Abstract
Conference
VRST '17: 23rd ACM Symposium on Virtual Reality Software and Technology
November 8 - 10, 2017
Gothenburg, Sweden
Acceptance Rates
Overall Acceptance Rate 66 of 254 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 228Total Downloads
- Downloads (Last 12 months)5
- Downloads (Last 6 weeks)0
Reflects downloads up to 12 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in