Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

ALP: Adaptive Loss Protection Scheme with Constant Overhead for Interactive Video Applications

Published: 07 January 2015 Publication History

Abstract

There has been an increasing demand for interactive video transmission over the Internet for applications such as video conferencing, video calls, and telepresence applications. These applications are increasingly moving towards providing High Definition (HD) video quality to users. A key challenge in these applications is to preserve the quality of video when it is transported over best-effort networks that do not guarantee lossless transport of video packets. In such conditions, it is important to protect the transmitted video by using intelligent and adaptive protection schemes. Applications such as HD video conferencing require live interaction among participants, which limits the overall delay the system can tolerate. Therefore, the protection scheme should add little or no extra delay to video transport. We propose a novel Adaptive Loss Protection (ALP) scheme for interactive HD video applications such as video conferencing and video chats. This scheme adds negligible delay to the transmission process and is shown to achieve better quality than other schemes in lossy networks. The proposed ALP scheme adaptively applies four different protection modes to cope with the dynamic network conditions, which results in high video quality in all network conditions. Our ALP scheme consists of four protection modes; each of these modes utilizes a protection method. Two of the modes rely on the state-of-the-art protection methods, and we propose a new Integrated Loss Protection (ILP) method for the other two modes. In the ILP method we integrate three factors for distributing the protection among packets. These three factors are error propagation, region of interest and header information. In order to decide when to switch between the protection modes, a new metric is proposed based on the effectiveness of each mode in performing protection, rather than just considering network statistics such as packet loss rate. Results show that by using this metric not only the overall quality will be improved but also the variance of quality will decrease. One of the main advantages of the proposed ALP scheme is that it does not increase the bit rate overhead in poor network conditions. Our results show a significant gain in video quality, up to 3dB PSNR improvement is achieved using our scheme, compared to protecting all packets equally with the same amount of overhead.

Supplementary Material

a25-calagari-apndx.pdf (calagari.zip)
Supplemental movie, appendix, image and software files for, ALP: Adaptive Loss Protection Scheme with Constant Overhead for Interactive Video Applications

References

[1]
Andres Albanese, Johannes Blomer, Jeff Edmonds, Michael Luby, and Madhu Sudan. 1996. Priority encoding transmission. IEEE Trans. Inf. Theory 42, 6, 1737--1744.
[2]
Hemantha Kodikara Arachchi, Warnakulasuriya Anil Chandana Fernando, S. Panchadcharam, and W. A. Rajitha Jayaruwan Weerakkody. 2006. Unequal error protection technique for ROI based H.264 video coding. In Proceedings of the IEEE Canadian Conference on Electrical and Computer Engineering (CCECE'06). 2033--2036.
[3]
Ali Borji, Dicky N. Sihite, and Laurent Itti. 2012. Salient object detection: A benchmark. In Proceedings of the 12th European Conference on Computer Vision (ECCV'12). Springer, 414--429.
[4]
Kiana Calagari, Mohammad Reza Pakravan, and Shervin Shirmohammadi. 2012. ROI-based protection scheme for high definition interactive video applications. In Proceedings of the 20th ACM International Conference on Multimedia (ACM MM'12). ACM, 1033--1036.
[5]
Diep Thang Cao, Thuc Hai Nguyen, and Linh Giang Nguyen. 2013. Improving the video transmission quality over IP network. In Proceedings of the 5th International Conference on Ubiquitous and Future Networks (ICUFN'13). IEEE, 570--575.
[6]
Qian Chen, Li Song, Xiaokang Yang, and Wenjun Zhang. 2007. Robust region-of-interest scalable coding with leaky prediction in H.264/AVC. In Proceedings of the IEEE Workshop on Signal Processing Systems. IEEE, 357--362.
[7]
Bogdan Ciubotaru, G. Muntean, and George Ghinea. 2009. Objective assessment of region of interest-aware adaptive multimedia streaming quality. IEEE Trans. Broadcasting 55, 2, 202--212.
[8]
Yves Dhondt, Peter Lambert, and Rik Van de Walle. 2006. A flexible macroblock scheme for unequal error protection. In Proceedings of the IEEE International Conference on Image Processing. IEEE, 829--832.
[9]
E. O. Elliott. 1963. Estimates of error rates for codes on burst-noise channels. Bell Syst. Tech. J. 42, 5, 1977--1997.
[10]
Ivan Alen Fernandez, Christophe De Vleeschouwer, George Toma, and Laurent Schumacher. 2012. An interactive video streaming architecture featuring bitrate adaptation. J. Commun. 7, 4, 265--280.
[11]
Edgar N. Gilbert. 1960. Capacity of a burst-noise channel. Bell Syst. Tech. J. 39, 5, 1253--1265.
[12]
Bernd Girod, Klaus W. Stuhlmueller, M. Link, and U. Horn. 1998. Packet-loss-resilient Internet video streaming. In Proceedings of SPIE Visual Communications and Image Processing. SPIE, 833--844.
[13]
Erik Hjelmås and Boon Kee Low. 2001. Face detection: A survey. Comput. Vision Image Understanding 83, 3, 236--274.
[14]
Rein-Lien Hsu, Mohamed Abdel-Mottaleb, and Anil K. Jain. 2002. Face detection in color images. IEEE Trans. Pattern Anal. Mach. Intell. 24, 5, 696--706.
[15]
Tz-Huan Huang, Kai-Yin Cheng, and Yung-Yu Chuang. 2009. A collaborative benchmark for region of interest detection algorithms. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'09). IEEE, 296--303.
[16]
Abbas Javdtalab, Mona Omidyeganeh, Shervin Shirmohammandi, and Mojtaba Hosseini. 2011. A rate control algorithm for x264 high definition video conferencing. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'11). IEEE, 1--6.
[17]
Mohammad Kazemi, Shervin Shirmohammadi, and Khosrow Haj Sadeghi. 2014. A review of multiple description coding techniques for error-resilient video delivery. Multimedia Syst. 20, 3, 283--309.
[18]
Pei-Jun Lee and Yi-Jie Shih. 2009. Fast inter-frame coding with intra skip strategy in H.264 video coding. IEEE Trans. Consum. Electron. 55, 1, 158--164.
[19]
Yihua Lou, Ting Yao, Yongquan Chen, and Wenjun Wu. 2013. A novel scheme of ROI detection and transcoding for mobile devices in high-definition videoconferencing. In Proceedings of the 5th Workshop on Mobile Video (MoVid'13). ACM, 31--36.
[20]
Aditya Mavlankar, David Varodayan, and Bernd Girod. 2007. Region-of-interest prediction for interactively streaming regions of high resolution video. In Proceedings of the 16th International Packet Video Workshop (PV'07). IEEE, 68--77.
[21]
Gabriel-Miro Muntean, Gheorghita Ghinea, and Timothy Noel Sheehan. 2008. Region of Interest-based adaptive multimedia streaming scheme. IEEE Trans. Broadcasting 54, 2, 296--303.
[22]
Abdelhamid Nafaa, Tarik Taleb, and Liam Murphy. 2008. Forward error correction strategies for media streaming over wireless networks. IEEE Commun. Mag. 46, 1, 72--79.
[23]
Wilfried Osberger and Anthony J. Maeder. 1998. Automatic identification of perceptually important regions in an image. In Proceedings of the 14th International Conference on Pattern Recognition. IEEE, 701--704.
[24]
Timothy Porter and Xiao-Hong Peng. 2011. HYBRID TCP/UDP video transport for H.264/AVC content delivery in burst loss networks. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'11). IEEE, 1--5.
[25]
Horacio Sanson, Alvaro Neira, Luis Loyola, and Mitsuji Matsumoto. 2010. PR-SCTP for real time H.264/AVC video streaming. In Proceedings of the 12th International Conference on Advanced Communication Technology (ICACT'10). IEEE, 59--63.
[26]
Wei Song, Dian W. Tjondronegoro, Shu-Hsien Wang, and Michael J. Docherty. 2010. Impact of zooming and enhancing region of interests for optimizing user experience on mobile sports video. In Proceedings of the International Conference on Multimedia (ACM MM'10). ACM, 321--330.
[27]
Klaus Stuhlmuller, Niko Farber, Michael Link, and Bernd Girod. 2000. Analysis of video transmission over lossy channels. IEEE J. Selected Areas Commun. 18, 6, 1012--1032.
[28]
Hui Su. 2009. Intra-skip in inter-frame coding of H.264/AVC. Int. J. Digital Multimedia Broadcasting.
[29]
Nikolaos Thomos, Savvas Argyropoulos, Nikolaos V. Boulgouris, and Michael G. Strintzis. 2006. Robust transmission of H.264/AVC video using adaptive slice grouping and unequal error protection. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'06). IEEE, 593--596.
[30]
Paul Viola and Michael J. Jones. 2004. Robust real-time face detection. Int. J. Computer Vision 57, 2, 137--154.
[31]
Xiaolong Wang, Kun Tang, and Huijuan Cui. 2010. A novel unequal error protection scheme for ROI based video coding in H.264/AVC. In Proceedings of the 2nd International Conference on Computer Modeling and Simulation (ICCMS'10). IEEE, 175--178.
[32]
Yu Wang, Xuan Jing, Jo Yew Tham, Kwong Huang Goh, and Wei Siong Lee. 2011. Error-resilient slice interleaving for robust video transmission over bursty loss channels. In Proceedings of the 17th IEEE International Conference on Networks (ICON'11). IEEE, 41--46.
[33]
Yao Wang and Qin-Fan Zhu. 1998. Error control and concealment for video communication: A review. Proc. IEEE 86, 5, 974--997.
[34]
Stephan Wenger. 2003. H.264/AVC over IP. IEEE Trans. Circuits Syst. Video Technol. 13, 7, 645--656.
[35]
Thomas Wiegand, Gary J. Sullivan, Gisle Bjontegaard, and Ajay Luthra. 2003. Overview of the H.264/AVC video coding standard. IEEE Trans. Circuits Syst. Video Technol. 13, 7, 560--576.
[36]
Dapeng Wu, Yiwei Thomas Hou, and Ya-Qin Zhang. 2000. Transporting real-time video over the Internet: Challenges and approaches. Proc. IEEE 88, 12, 1855--1877.
[37]
Yi-Fei Xu and Hai-Bo Hu. 2013. Development of a network adaptive H.264/AVC medical video transmission system. Int. J. Future Computer Commun. 2, 4, 292--295.
[38]
Cha Zhang and Zhengyou Zhang. 2010. A survey of recent advances in face detection. Tech. Rep. MSR-TR-2010-66. Microsoft Research Technical Report, Redmond, WA.
[39]
Xingjun Zhang and Xiaohong Peng. 2009. An unequal packet loss protection scheme for H.264/AVC video transmission. In Proceedings of the 23rd International Conference on Information Networking (ICOIN'09). IEEE, 195--199.
[40]
Xingjun Zhang, Xiaohong Peng, Scott Fowler, and Dajun Wu. 2010. Robust H.264/AVC video transmission using data partitioning and unequal loss protection. In Proceedings of the 10th IEEE International Conference on Computer and Information Technology (CIT'10). IEEE, 2471--2477.
[41]
Xingjun Zhang, Xiaohong Peng, Dajun Wu, Tim Porter, and Richard Haywood. 2009. A hierarchical unequal packet loss protection scheme for robust H.264/AVC transmission. In Proceedings of the 6th IEEE Consumer Communications and Networking Conference (CCNC'09). IEEE, 1--5.
[42]
Yanchun Zhong, Heng Li, and Jialei Bi. 2010. A feedback-based method for adaptive ROI protection in H.264/AVC. In Proceedings of the 5th International Conference on Digital Information Management (ICDIM'10). 145--151.

Cited By

View all
  • (2020) Adaptive streaming of HD and 360 videos over software defined radios Pervasive and Mobile Computing10.1016/j.pmcj.2020.101215(101215)Online publication date: Jul-2020
  • (2016)Toward an Adaptive Screencast PlatformACM Transactions on Multimedia Computing, Communications, and Applications10.1145/288677812:5s(1-23)Online publication date: 8-Nov-2016

Index Terms

  1. ALP: Adaptive Loss Protection Scheme with Constant Overhead for Interactive Video Applications

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Multimedia Computing, Communications, and Applications
    ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 11, Issue 2
    December 2014
    197 pages
    ISSN:1551-6857
    EISSN:1551-6865
    DOI:10.1145/2716635
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 January 2015
    Accepted: 01 August 2014
    Revised: 01 July 2014
    Received: 01 January 2014
    Published in TOMM Volume 11, Issue 2

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Adaptive video protection
    2. FEC
    3. FMO
    4. H.264/AVC
    5. HD video
    6. ROI
    7. ULP
    8. data partitioning
    9. error propagation
    10. interactive video
    11. slicing

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2020) Adaptive streaming of HD and 360 videos over software defined radios Pervasive and Mobile Computing10.1016/j.pmcj.2020.101215(101215)Online publication date: Jul-2020
    • (2016)Toward an Adaptive Screencast PlatformACM Transactions on Multimedia Computing, Communications, and Applications10.1145/288677812:5s(1-23)Online publication date: 8-Nov-2016

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media