Article

Event on demand with MPEG-21 video adaptation system

Authors:

Liang-Tien Chia,

Jesse S. JinAuthors Info & Claims

MM '06: Proceedings of the 14th ACM international conference on Multimedia

Pages 921 - 930

https://doi.org/10.1145/1180639.1180843

Published: 23 October 2006 Publication History

Abstract

In this paper, we present an event-on-demand (EoD)video adaptation system. The proposed system supports users in deciding their events of interest and considers network conditions to adapt video source by event selection and frame dropping.Firstly, events are detected by audio/video analysis and annotated by the description schemes (DSs)provided by MPEG-7 Multimedia Description Schemes (MDSs). And then, to achieve a generic adaptation solution, the adaptation is developed following MPEG-21 Digital Item Adaptation (DIA)framework. We look at early release of the MPEG-21 Reference Software on XML generation and develop our own system for EoD video adaptation in three steps:1) the event information is parsed from MPEG-7 annotation XML file together with bitstream to generate generic Bitstream Syntax Description (gBSD). 2) Users' preference, Network Characteristic and Adaptation QoS (AQoS) are considered for making adaptation decision. 3) adaptation engine automatically parses adaptation decisions and gBSD to achieve adaptation.Unlike most existing adaptation work, the system adapts video of events with interest according to users' preference. Implementation following MPEG-7 and MPEG-21 standards provides a generic video adaptation solution. gBSD based adaptation avoids complex video computation. 30 students from various departments were invited to test the system and their responses has been positive.

References

[1]

Mpeg-21 digital item adaptation. ISO/IEC Final Standard Draft ISO/IEC 21000-7:2004(E),ISO/IEC JTC 1/SC 29/WG 11/N5895, 2004.

[2]

Information technology -multimedia framework (mpeg-21)-part 8: Reference software. ISO/IEC Final Standard Draft ISO/IEC 21000-8:2005(E), ISO/IEC JTC 1/SC 29/WG 11/N5895, 2005.

[3]

E. Amir and S. McCanne. An active service framework and its application to real-time multimedia transcoding. SIGCOMM, 28(4):178--189, October 1998.

Digital Library

[4]

S. Benyaminovich, O. Hadar, and E. Kaminsky. Optimal transrating via dct coefficients modification and dropping. Proc.of 3rd Conference on Information Technology: Research and Education, pages 100--104, June 2005.

[5]

S.-F. Chang, D. Zhong, and R. Kumar. Real-time content-based adaptive streaming of sports video. IEEE Workshop Content-Based Access to Video/Image Library, IEEE CVPR Conf., December 2001.

Digital Library

[6]

D. Cotroneo, G. Paolillo, C. Pirro, and S. Russo. A user-driven adaptation strategy for mobile video streaming applications. In Proceedings of 25th IEEE International Conference on Distributed Computing Systems Workshops, pages 338--344.

Digital Library

[7]

K.-T. Fung, Y.-L. Chan, and W.-C. Siu. New architecture for dynamic frame-skipping transcoder. IEEE Trans. on Image Processing, 11(8).

Digital Library

[8]

J. Gecsei. Adaptation in distributed multimedia systems. IEEE Multimedia, 4(2):58--66, April 1997.

Digital Library

[9]

V.K. Goyal. Multiple description coding: Compression meets the network. IEEE Signal Processing Magazine, 18(5):74--93, September 2001.

[10]

R. Han, P. Bhagwat, R. Lamaire, T. Mummert, V. Perret, and J. Rubas. Dynamic adaptation in an image transcoding proxy for mobile web browsing. IEEE Personal Communications, 5(6):9--17, December 1998.

[11]

M. Hicks, A. Nagarajan, and R. van Renesse. User-specified adaptive scheduling in a streaming media network. In Proceedings 2003 International Conference on Multimedia and Expo, pages 281--284.

[12]

S. Khan, K.F. Li, and E.G. Manning. The utility model for adaptive multimedia systems. In International Conference on Multimedia Modeling, pages 111--126.

[13]

J.-G. Kim, Y. Wang, and S.-F. Chang. Content-adaptive utility-based video adaptation. In Proceedings 2003 International Conference on Multimedia and Expo, pages 281--284.

Digital Library

[14]

W. Li. Overview of fine granularity scalability in mpeg-4 video standard. IEEE trans. on Circuits and Systems for Video Technology, 11(3):301--317, March 2001.

Digital Library

[15]

S. Liu, M. Xu, H. Yi, L.-T. Chia, and D. Rajan. Multi-modal semantic analysis and annotation for basketball video. Special Issue on Information Mining from Multimedia Databases of EURASIP Journal on Applied Signal Processing.

Digital Library

[16]

B.S. Manjunath, P. Salembier, and T. Sikora. Introduction to mpeg-7: Multimedia content description interface. 2002.

Digital Library

[17]

M. Metso, A. Koivisto, and J. Sauvola. A content model for the mobile adaptation of multimedia information. Journal of VLSI Signal Processing, 29(1):115--128, August 2001.

Digital Library

[18]

D. Mukherjee, G. Kuo, and A. Said. Structured scalable meta-formats (ssm)version 2.0 for content agnostic digital item adaptation -principles and complete syntax. April 2003.

[19]

M. Naghshineh and M. Willebeek-LeMair. End-to-end qos provisioning in multimedia wireless/mobile networks using an adaptive framework. IEEE Communication Magazine, 35(11):72--81, November 1997.

Digital Library

[20]

G. Panis and A.H. et. al. Bitstream syntax description: A tool for multimedia resource adaptation within mpeg-21. Signal Processing: Image Communication, 18(8):721--747, September 2003.

[21]

J.-T. Park, J.-W. Baek, and J.W.-K. Hong. Management of service level agreements for multimedia internet service using a utility model. IEEE Communications Magazine, 39(5):100--106, May 2001.

Digital Library

[22]

K. Shen and E.J. Delp. Wavelet based rate scalable video compression. IEEE trans. on Circuits and Systems for Video Technology, 9(1):109--122, Febrary 1999.

Digital Library

[23]

X. Wang and H. Schulzrinne. An integrated resource negotiation, pricing, and qos adaptation framework for multimedia applications. IEEE Journal on Selected Areas in Communications, 18(12):2514--2529, December 2000.

Digital Library

[24]

Z. Wang and C. Jan. Quality of service routing for supporting multimedia applications. IEEE Journal on Selected Area Communications, 14(7):1228--1234, September 1996.

Digital Library

[25]

J. Xin, C.W. Lin, and M.-T. Sun. Digital video transcoding. Proc. of the IEEE, 93(1):84--97, Janaury 2005.

[26]

W. Yuan, K. Nahrstedta, S.V. Advea, D.L. Jonesb, and R.H. Kravetsa. Design and evaluation of a cross-layer adaptation framework for mobile multimedia systems. In Proceeding of SPIE-the International Society for Optical Engineering, pages 1--13.

Cited By

Xu MHe XPeng YJin JLuo SChia LHu Y(2012)Content on demand video adaptation based on MPEG-21 digital item adaptationEURASIP Journal on Wireless Communications and Networking10.1186/1687-1499-2012-1042012:1Online publication date: 13-Mar-2012
https://doi.org/10.1186/1687-1499-2012-104
Yan WKieran DRafatirad SJain R(2011)A comprehensive study of visual event computingMultimedia Tools and Applications10.1007/s11042-010-0560-955:3(443-481)Online publication date: 1-Dec-2011
https://dl.acm.org/doi/10.1007/s11042-010-0560-9
Thomas-Kerr JRitz CBurnett I(2009)Semantic-aware delivery of multimedia2009 9th International Symposium on Communications and Information Technology10.1109/ISCIT.2009.5341055(1498-1503)Online publication date: Sep-2009
https://doi.org/10.1109/ISCIT.2009.5341055
Show More Cited By

Index Terms

Event on demand with MPEG-21 video adaptation system
1. Information systems
  1. World Wide Web
    1. Web applications
    2. Web services
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles
        Organizing principles for web applications

Recommendations

MPEG-21 based temporal video adaptation for heterogeneous devices and mobile environments
ICME'09: Proceedings of the 2009 IEEE international conference on Multimedia and Expo

In the era of Universal Multimedia Access (UMA), applications like video conferencing, surveillance and streaming are challenged by the multiplicity of devices. Since adaptation is the newly applied practice for digital video content customization, in ...
A model for preference-driven multimedia adaptation decision-making in the MPEG-21 framework

This paper deals with automatic multimedia adaptation decision-making techniques based on preferences. The paper gathers well-known general-purpose preferences representation and elicitation methods from the literature. It also reviews preference-driven ...
Personalized video adaptation framework (PIAF): high-level semantic adaptation

Despite much work on Universal Multimedia Experience (UME), existing video adaptation approaches cannot yet be considered as truly user-centric, mostly due to their poor handling of semantic user preferences. Indeed, these works mainly concentrate on ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '06: Proceedings of the 14th ACM international conference on Multimedia

October 2006

1072 pages

ISBN:1595934472

DOI:10.1145/1180639

General Chairs:
Klara Nahrstedt
UIUC
,
Matthew Turk
UCSB
,
Program Chairs:
Yong Rui
Microsoft Research
,
Wolfgang Klas
Universität Wien
,
Ketan Mayer-Patel
UNC

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM06

Sponsor:

MM06: The 14th ACM International Conference on Multimedia 2006

October 23 - 27, 2006

CA, Santa Barbara, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
398
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xu MHe XPeng YJin JLuo SChia LHu Y(2012)Content on demand video adaptation based on MPEG-21 digital item adaptationEURASIP Journal on Wireless Communications and Networking10.1186/1687-1499-2012-1042012:1Online publication date: 13-Mar-2012
https://doi.org/10.1186/1687-1499-2012-104
Yan WKieran DRafatirad SJain R(2011)A comprehensive study of visual event computingMultimedia Tools and Applications10.1007/s11042-010-0560-955:3(443-481)Online publication date: 1-Dec-2011
https://dl.acm.org/doi/10.1007/s11042-010-0560-9
Thomas-Kerr JRitz CBurnett I(2009)Semantic-aware delivery of multimedia2009 9th International Symposium on Communications and Information Technology10.1109/ISCIT.2009.5341055(1498-1503)Online publication date: Sep-2009
https://doi.org/10.1109/ISCIT.2009.5341055
Agius HAngelides M(2009)From MPEG-7 user interaction tools to hanging basket modelsMultimedia Tools and Applications10.1007/s11042-008-0238-841:3(375-406)Online publication date: 1-Feb-2009
https://dl.acm.org/doi/10.1007/s11042-008-0238-8
Thomas-Kerr JBurnett IRitz C(2007)Intelligent Multimedia Delivery? It’s a question of semantics2007 International Symposium on Communications and Information Technologies10.1109/ISCIT.2007.4392065(473-478)Online publication date: Oct-2007
https://doi.org/10.1109/ISCIT.2007.4392065

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents