Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Optimal inter-view rate allocation for multi-view video plus depth over MPEG-DASH using QoE measures and paired comparison

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Rapid advances in compression and transmission technologies enabled multi-view video streaming over the Internet through state-of-the-art MPEG standards such as dynamic adaptive streaming over HTTP (DASH) and high-efficiency video coding. Yet, standards for subjective and objective measurement of quality of experience (QoE) are lagging in the area. The MPEG-DASH system requires constant bitrate (CBR) coding and an efficient rate control strategy in order to increase QoE. Multi-view video plus depth format is preferable due to high compression gain but quality of intermediate view is crucial, strictly depending on performance of inter/intra-view rate allocation as well as rendering algorithms. We propose to find optimal ratio for inter-view rate allocation in CBR using our previously developed objective QoE measures using depth maps and structural similarities. To assess small differences and discriminate similar quality levels, a new subjective assessment methodology is also proposed as a multiple stimuli plus simultaneous presentation for paired comparison. The results show that the unequal rate allocation is superior to the equal rate allocation in terms of objective QoE as 0.012–0.04 (which translates into a bit rate saving of 15–24%) and subjective QoE as 0.3–0.5. Furthermore, a very high correlation is achieved between the new QoE measures and paired comparison results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Merkle, P., Smolic, A., Müller, K., Wiegand, T.: Multi-view video plus depth representation and coding. In: Proceedings of IEEE International Conference on Image Processing (ICIP’07), San Antonio, TX, USA, pp. 201–204 (Sept. 2007)

  2. Fehn, C.: Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV. In: Proceedings of SPIE Stereoscopic Displays and Virtual Reality Systems XI, vol. 5291, p. 93104 (2004)

  3. Zhu, C., Zhao, Y., Yu, L., Tanimoto, M.: 3D-TV System with Depth-Image Based Rendering: Architectures Techniques and Challenges. Springer, New York (2013)

    Book  Google Scholar 

  4. Müller, K., Smolic, A., Dix, K., Merkle, P., Wiegand, T.: Coding and intermediate view synthesis of multi-view video plus depth. In: Proceedings of IEEE International Conference on Image Processing (ICIP’09) (2009)

  5. Hamza, A., Hefeeda, M.: A DASH-based free viewpoint video streaming system. In: Proceedings of Network and Operating System Support on Digital Audio and Video Workshop, p. 55 (2013)

  6. Oztas, B., Pourazad, M.T., Nasiopoulos, P., Sodagar, I., Leung, V.C.M.: A rate adaptation approach for streaming multiview plus depth content. In: International Conference on Computing, Networking and Communications (ICNC), no. Mvd, pp. 1006–1010 (2014)

  7. Su, T., Sobhani, A., Yassine, A., Shirmohammadi, S., Javadtalab, A.: A DASH-based HEVC multi-view video streaming system. J. Real Time Image Process. 12(2), 329–342 (2016)

    Article  Google Scholar 

  8. Ozcinar, C., Anbarjafari, G.: Dynamic bitrate allocation of interactive real-time streamed multi-view video with view-switch prediction. Signal Image Video Process. 11, 1279–1285 (2017)

    Article  Google Scholar 

  9. Sodagar, I., Vetro, A.: The MPEG-DASH Standard for Multimedia Streaming over the Internet. IEEE Computer Society Industry and Standards (2011)

  10. Duanmu, Z., Rehman, A., Zeng, K., Wang, Z.: Quality-of-experience prediction for streaming video. In: Proceedings of IEEE International Conference on Multimedia and Expo (ICME’16), Seattle, WA, USA (July 2016)

  11. Qi, F., Zhao, D., Fan, X., Jiang, T.: Stereoscopic video quality assessment based on visual attention and just-noticeable difference models. Signal Image Video Process. 10, 737–744 (2016)

    Article  Google Scholar 

  12. Şenol, E., Özbek, N.: Quality of experience measurement of compressed multi-view video. Signal Process. Image Commun. 57, 147–156 (2017)

    Article  Google Scholar 

  13. Recommendation ITU-R P.910: Subjective Video Quality Assessment Methods for Multimedia Applications. ITU-R Recommendations (2008)

  14. Bosc, E., Riou, P., Pressigout, M., Morin, L.: Bit-rate allocation between texture and depth: influence of data sequence characteristics. In: 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), 2012 (2012)

  15. Bosc, E., Racapé, F., Jantet, V., Riou, P., Pressigout, M., Morin, L.: A study of depth/texture bit-rate allocation in multi-view video plus depth compression. Ann. Telecommun. 68(11–12), 615–625 (2013)

    Article  Google Scholar 

  16. Vetro, A., Pandit, P., Kimata, H., Smolic, A., Wang, Y.-K.: Joint Draft 8.0 on Multiview Video Coding. JVT-AB204 (2008)

  17. Sullivan, G.J., Ohm, J.-R., Han, J.-R., Wiegand, T.: Overview of highly efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(7), 1649–1668 (2012)

    Article  Google Scholar 

  18. Liu, Y., Huang, Q., Ma, S., Zhao, D., Gao, W., Ci, S., Tang, H.: A novel rate control technique for multiview video plus depth based 3D video coding. IEEE Trans. Broadcast. 57(2), 562–571 (2011)

    Article  Google Scholar 

  19. Sullivan, G.J., Boyce, J.M., Chen, Y., Ohm, J.-R., Segall, C.A., Vetro, A.: Standardized extensions of high efficiency video coding (HEVC). IEEE J. Sel. Top. Signal Process. 7(6), 1001–1016 (2013)

    Article  Google Scholar 

  20. Zhang, L., Tech, G., Wegner, K., Yea, S.: 3D-HEVC Test Model 5. JCT-3V (2013)

  21. Rusanovskyy, D., Müller, K., Vetro, A.: Common Test Condition of 3DV Core Experiments. JCT-3V, Stockholm (2012)

  22. Li, B., Li, H., Li, L., Zhang, J.: Rate control by R-lambda model for HEVC. In: ITU-T SG16 Contribution, JCTVC-K0103, pp. 1–5, Shanghai (2012)

  23. Tanimoto Laboratory: FTV Test Sequences, Nagoya University, JP. http://www.tanimoto.nuee.nagoya-u.ac.jp/. Accessed 1 Apr 2018

  24. Fraunhofer Heinrich Hertz Institute: 3D-HEVC Reference Software [Online] (2015). https://hevc.hhi.fraunhofer.de/3dhevc. Accessed 1 Apr 2018

  25. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Proc. 13(4), 600–612 (2004)

    Article  Google Scholar 

  26. Li, J., Kaller, O., Simone, F.D., Hakala, J., Juzska, D., Callet, P.L.: Cross-lab study on preference of experience in 3DTV: influence from display technology and test environment. 5th IEEE QoMEX Workshop: Quality of Multimedia Experience (2013)

  27. Recommendation ITU-R BT.2021: Subjective Methods for the Assessment of Stereoscopic 3DTV Systems. ITU-R Recommendations (2012)

  28. Li, J., Barkowsky, M., Le Callet, P.: Analysis and improvement of a paired comparison method in the application of 3DTV subjective experiment. In: IEEE International Conference on Image Processing (ICIP 2012), pp. 1–4 (2012)

  29. Lee, J., De Simone, F., Ebrahimi, T.: Subjective quality evaluation via paired comparison: application to scalable video coding. IEEE Trans. Multimed. 13(5), 882–893 (2011)

    Article  Google Scholar 

  30. Lee, J., Goldmann, L., Ebrahimi, T.: Paired comparison-based subjective quality assessment of stereoscopic images. Multimed. Tools Appl. 67, 31–48 (2012)

    Article  Google Scholar 

  31. Li, J., Barkowsky, M., Callet, P.L.: Subjective assessment methodology for preference of experience in 3dtv. 11th IEEE IVMSP Workshop: 3D Image/Video Technologies and Applications, Jun 2013, Seoul, South Korea, pp. 1–4 (2013)

  32. Bradley, R., Terry, M.: Rank analysis of incomplete block designs: I. The method of paired comparisons. Biometrika 39(3/4), 324–345 (1952)

    Article  MathSciNet  MATH  Google Scholar 

  33. Şenol, E., Özbek, N.: Time-efficient subjective testing methodology for 3D video quality assessment. In: Proceedings of IEEE International Conference on Image Processing (ICIP’16), Phoenix, Arizona, USA (Sept. 2016)

  34. Wickelmaier, F., Schmid, C.: A matlab function to estimate choice model parameters from paired comparison data. Behav. Res. Methods 36(1), 29–40 (2004)

    Article  Google Scholar 

  35. De Silva, V., Arachchi, H.K., Ekmekcioglu, E., Kondoz, A.: Toward an impairment metric for stereoscopic video: a full-reference video quality metric to assess compressed stereoscopic video. IEEE Trans. Image Process. 22(9), 3392–3404 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  36. Bjøntegaard, G.: Calculation of average PSNR differences between RD curves, document VCEG-M33. Presented at the VCEG Meeting, Austin, TX, USA (Apr. 2001)

  37. Aflaki, P., Hannuksela, M.M., Gabbouj, M.: Subjective quality assessment of asymmetric stereoscopic 3D video. Signal Image Video Process. 9, 331–345 (2015)

    Article  Google Scholar 

  38. Su, T., Javadtalab, A., Yassine, A., Shirmohammadi, S.: A DASH-based 3d multi-view video rate control system. In: International Conference on Signal Processing and Communication Systems (ICSPCS), no. 8, pp. 14–19 (2014)

Download references

Author information

Authors and Affiliations

  1. Department of Electrical & Electronics Engineering, Ege University, Izmir, Turkey

    Nükhet Özbek & Engin Şenol

Authors
  1. Nükhet Özbek
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Engin Şenol
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nükhet Özbek.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 2518 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Özbek, N., Şenol, E. Optimal inter-view rate allocation for multi-view video plus depth over MPEG-DASH using QoE measures and paired comparison. SIViP 13, 1215–1223 (2019). https://doi.org/10.1007/s11760-019-01464-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-019-01464-x

Keywords

Search

Navigation