Nothing Special   »   [go: up one dir, main page]

skip to main content
article

Compressed domain visual information retrieval based on I-frames in HEVC

Published: 01 March 2017 Publication History

Abstract

Compressed domain retrieval is important in the retrieval of HEVC coded videos, because full decompression of HEVC coded videos is very time consuming. In this paper, a texture based retrieval method is proposed for either video retrieval of HEVC coded videos or image retrieval of coded images as HEVC I-frames. The various prediction unit sizes and high number of prediction modes which are employed in I-frame coding of HEVC, provides higher information about the texture of the coded picture compared to the I-frame coding in H.264/AVC. The proposed texture based image retrieval method for HEVC coded visual information is based on histograms of prediction modes and prediction unit sizes. This method achieves 0.34 ANMRR in the image retrieval experiments and 0.33 ANMRR in the conducting video retrieval experiments, which are better compared to the other compressed domain retrieval methods based on H.264/AVC. On the other hand, the experimental evaluations indicate good robustness of the proposed method against variations in quantization parameter and image intensity. Moreover, the timing analysis indicates that feature extraction time by the proposed method is about 35 % of the decoding time of a coded video.

References

[1]
Akrami F, Zargari F (2014) An efficient compressed domain video indexing method. Multimed Tools Appl 72(1):705---721
[2]
Babu RV, Tom M, Wadekar P (2016) A Survey on compressed domain video analysis techniques. Multimed Tools Appl 75(2):1043---1078
[3]
Dissanayake MB, Abeyrathna DLB (2015) Performance comparison of HEVC and H.264/AVC standards in broadcasting environments. J Inf Process Syst 11(3):483---494
[4]
Divakaran A, Vetro A, Asai K, Nishikawa H (2000) Video browsing system based on compressed domain feature extraction. IEEE Trans Consum Electron 46(3):637---644
[5]
Gao L, Song J, Zou F, Zhang D, Shao J (2015) Scalable multimedia retrieval by deep learning hashing with relative similarity learning. Proceedings of the 23rd ACM international conference on Multimedia, New York, USA
[6]
Garcia R, Kalva H, Raton B (2013) Human mobile-device interaction on HEVC and H.264 subjective evaluation for video use in mobile environment. IEEE International Conference on Consumer Electronics (ICCE)
[7]
H.264/AVC Reference Software, available on: http://iphome.hhi.de/suehring/tml/download/> Last seen on June 2015
[8]
H.265/HEVC Reference Software, available on:<https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/branches/> Last seen on June 2015
[9]
INRIA HOLIDAY Dataset, available on: <https://lear.inrialpes.fr/~jegou/data.php> Last seen on Jan 2015
[10]
Jiang J, Weng Y, Li P (2006) Dominant colour extraction in DCT domain. Image Vis Comput 24(2):1269---1277
[11]
Joint video Team(JVT) of ISO/IEC MPEG & ITU-T VCEG, (2009) H.264/14496-10 AVC Reference Software Manual. 31st Meeting, London, UK, 28 June 3 July, 2009
[12]
JTC 1/SC 29; ISO Standards, (2005) MPEG-7: Multimedia Content Description Interface, April 2005
[13]
Kim IK, Min J, Lee T, Han WJ, Park JH (2012) Block partitioning structure in the HEVC standard. IEEE Trans Circ Syst Video Technol Vol. 22, No. 12
[14]
Lu ZM, Li SZ, Burkhardt H (2006) A content-based image retrieval scheme In JPEG compressed domain. Int J Innov Comput, Inf Control 2, NO 4
[15]
Manjunath BS, Salembier P, Sikora T (2002) Introduction to MPEG-7 multimedia content description interface., pp 177---280
[16]
Mehrabi M, Zargari F, Ghanbari M (2012) Compressed domain content based retrieval using H.264 DC-pictures. Multimed Tools Appl 60(2):443---453
[17]
Oxford Buildings Dataset, available on: <http://www.robots.ox.ac.uk/~vgg/data/oxbuildings/>, Last seen on Jan 2015
[18]
Rao KR, Kim DN, Hewang JJ (2013) Video coding standards, Springer, pp. 125---148
[19]
Rodriguez MD, Ahmed J, Shah M (2008) Action MACH: a spatio-temporal maximum average correlation height filter for action recognition. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, pp 1---8
[20]
Simone FD, Goldmann L, Lee JS, Ebrahimi T (2011) Towards high efficiency video coding: subjective evaluation of potential coding technologies. J Vis Commun Image Represent 22:734---748
[21]
Smeulders AWM, Worring M, Santini S, Gupta A, Jain R (2000) Content-based image retrieval at the end of the early years. IEEE Trans Patterns Anal Mach Intell 22:1349---1380
[22]
Song J, Gao L, Yan Y, Zhang D, Sebe N (2015) Supervised hashing with pseudo labels for scalable multimedia retrieval. Proceedings of the 23rd ACM international conference on Multimedia, New York, USA
[23]
Song J, Yang Y, Huang Z, Shen HT, Hong R (2011) Multiple feature hashing for real-time large scale near-duplicate video retrieval. MM '11 Proceedings of the 19th ACM international conference on Multimedia, New York, USA
[24]
Soomro K, Zamir AR (2014) Action recognition in realistic sports videos. Computer Vision in Sports. Springer International Publishing
[25]
Sullivan GJ, Ohm JR, Han WJ, Wiegand T (2012) Overview of the High Efficiency Video Coding (HEVC) Standard. IEEE Transactions on Circuits And Systems For Video Technology, Vol. 22, NO 12
[26]
Sze V, Budagavi M, Sullivan GJ (2014) High Efficiency Video Coding (HEVC), algorithms and architectures. Springer International Publishing, Switzerland
[27]
Wang RJ, Yang YT, Chang PC (2014) Content-based image retrieval using H.264 intra coding features. J Vis Commun Image Represent 25:963---969
[28]
Wien M (2015) High efficiency video coding, coding tool and specification. Springer, Berlin Heidelberg
[29]
www.h265.net, Last seen on June 2015
[30]
Zargari F, Mehrabi M, Ghanbari M (2008) A robust compressed domain Feature vector for texture based image retrieval. Content-Based Multimedia Indexing, International Workshop on, pp. 489---495
[31]
Zargari F, Mehrabi M, Ghanbari M (2010) Compressed domain texture based visual information retrieval method for I-frame coded pictures. IEEE Trans Consum Electron 56(2):728---736
[32]
Zargari F, Mehrabi M, Moin MS (2007) Compressed domain texture retrieval based on I-Frame coding in H.264. 2007 IEEE International Conference on Multimedia and Expo, Beijing, pp 831---834
[33]
Zargari F, Mosleh A, Ghanbari M (2008) A fast and efficient compressed domain JPEG2000 image retrieval method. IEEE Trans Consum Electron 54(4):1886---1893
[34]
Zargari F, Rahmani F (2015) Visual information retrieval in HEVC compressed domain. 23rd Iranian Conference on Electrical Engineering, ICEE
[35]
Zhu M (2004) Recall, precision, and average precision, Dept. Stat. Actuarial Sci., Univ. Waterloo, CA, Tech. Rep. 9

Cited By

View all
  • (2019)HEVC intra frame based compressed domain video summarizationProceedings of the International Conference on Artificial Intelligence, Information Processing and Cloud Computing10.1145/3371425.3371450(1-7)Online publication date: 19-Dec-2019
  • (2019)Compressed Domain Video Abstraction Based on I-Frame of HEVC Coded VideosCircuits, Systems, and Signal Processing10.1007/s00034-018-0932-338:4(1695-1716)Online publication date: 1-Apr-2019

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Multimedia Tools and Applications
Multimedia Tools and Applications  Volume 76, Issue 5
March 2017
1428 pages

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 March 2017

Author Tags

  1. Compressed domain
  2. HEVC
  3. Prediction modes
  4. Prediction unit size
  5. Texture based retrieval

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2019)HEVC intra frame based compressed domain video summarizationProceedings of the International Conference on Artificial Intelligence, Information Processing and Cloud Computing10.1145/3371425.3371450(1-7)Online publication date: 19-Dec-2019
  • (2019)Compressed Domain Video Abstraction Based on I-Frame of HEVC Coded VideosCircuits, Systems, and Signal Processing10.1007/s00034-018-0932-338:4(1695-1716)Online publication date: 1-Apr-2019

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media