short-paper

A smart video player with content-based fast-forward playback

Authors:

Junfeng Jiang,

Xiao-Ping ZhangAuthors Info & Claims

MM '11: Proceedings of the 19th ACM international conference on Multimedia

Pages 1061 - 1064

https://doi.org/10.1145/2072298.2071938

Published: 28 November 2011 Publication History

Get Access

Abstract

In this paper, we develop a video player to allow the users to do fast-forward playback based on the semantic video content. The whole system has two modules, processing and playing. In the processing part, we present a video time density function (VTDF) to describe the temporal dynamics of video data first. A VTDF-based temporal quantization method is then developed to find the best quanta and partition in the time domain. The optimal quanta are used to extract key frames. The optimal number of key frames is determined by a temporal mean square error (TMSE)-based criterion. In the playing module, we combine the key frame sequence and a set of parameters together and feed them into a triangle-based transition function to generate the sampled frames in a non-uniform way. A built video player will play all sampled frames in its intelligent fast-forward mode for a given fast-forward speed factor. The implementation of video player demonstrates the feasibility of proposed method in practice.

References

[1]

C. Cotsaces, N. Nikolaidis and I. Pitas, "Video shot boundary detection and condensed representation: a review," IEEE Signal Processing Magazine, vol.23, No.2, 2006.

Crossref

Google Scholar

[2]

Paul Over, Alan F. Smeaton, and Philip Kelly, "The trecvid rushes summarization evaluation pilot," in Proc. of ACM Multimedia, Sep. 2007.

Google Scholar

[3]

B.-T. Truong and S. Venkatesh, "Video abstraction: a systematic review and classification," ACM Trans. on Multimedia Computing, Communications and Applications, vol.3, No.1, Feb. 2007.

Digital Library

Google Scholar

[4]

B.-W. Chen, J.-C. Wang and J.-F. Wang, "A novel video summarization based on mining the story-structure and semantic relations among concept entities," IEEE Trans. on Multimedia, vol.11, No.2, pp.295--312, 2009.

Digital Library

Google Scholar

[5]

X. Zhu, J. Fan, A.-K. Elmagarmid, and X. Wu, "Hierarchical video summarization and content description joint semantic and visual similarity," ACM Multimedia System, 2003.

Digital Library

Google Scholar

[6]

J. Jiang, X.-P. Zhang, "Gaussian mixture vector quantization-based video summarization using independent component analysis," in Proc. of IEEE Int. Work. on Multimedia Signal Processing (MMSP), Oct. 2010.

Google Scholar

[7]

Z. Xiong, R. Radhakrishnan, A. Divakaran, Y. Rui, and T.-S. Huang, "A unified framework for video summarization, browsing and retrieval," Elsevier Academic Press, 2006.

Digital Library

Google Scholar

[8]

S. Benini, P. Migliorati, and R. Leonardi, "Hidden Markov models for video skim generation," In Proc. of the 8th Int. Work. on Image Analysis for Multimedia Interactive Services, Jun. 2007.

Digital Library

Google Scholar

[9]

Y.-F. Ma, L. Lu, H.-J. Zhang, and M. Li, "A user attention model for video summarization," in Proc. of ACM Multimedia, Dec. 2002.

Digital Library

Google Scholar

[10]

J. Jiang, X.-P. Zhang, "A new player-enabled rapid video navigation method using temporal quantization and repeated weighted boosting search," in Proc. of the 7th IEEE Computer Society Work. on Perceptual Organization in Computer Vision (POCV) in conjunction with CVPR 2010.

Google Scholar

[11]

K-Y Cheng, S-J Luo, B-Y Chen, and H-H Chu, "SmartPlayer: user-centric video fast-forwarding," in Proc. of the 27th Int. Conf. on Human Factors in Computing Systems, 2009.

Digital Library

Google Scholar

[12]

J. Zhou and X.-P. Zhang. "An ICA mixture hidden Markov model for video content analysis," IEEE Trans. on Circuits and Systems for Video Technology, pp.1576--1586, 2008.

Digital Library

Google Scholar

[13]

Z. Cernekova, I. Pitas, and C. Nikou. "Information theory-based shot cut/fade detection and video summarization," IEEE Trans. on Circuits and Systems for Video Technology, 2006.

Digital Library

Google Scholar

Cited By

View all

Lan SWang ZWei ERoy-Chowdhury AZhu Q(2024)Collaborative Multi-Agent Video Fast-ForwardingIEEE Transactions on Multimedia10.1109/TMM.2023.327585326(1041-1054)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMM.2023.3275853
Lan SWang ZRoy-Chowdhury AWei EZhu QWen Chen CCucchiara RHua XQi GRicci EZhang ZZimmermann R(2020)Distributed Multi-agent Video Fast-forwardingProceedings of the 28th ACM International Conference on Multimedia10.1145/3394171.3413767(1075-1084)Online publication date: 12-Oct-2020
https://dl.acm.org/doi/10.1145/3394171.3413767
Lan SPanda RZhu QRoy-Chowdhury A(2018)FFNet: Video Fast-Forwarding via Reinforcement Learning2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition10.1109/CVPR.2018.00708(6771-6780)Online publication date: Jun-2018
https://doi.org/10.1109/CVPR.2018.00708
Show More Cited By

Index Terms

A smart video player with content-based fast-forward playback
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
2. Information systems
  1. Information retrieval
    1. Document representation

Recommendations

A content-based rapid video playback method using motion-based video time density function and temporal quantization
SAPMIA '10: Proceedings of the 2010 ACM workshop on Social, adaptive and personalized multimedia interaction and access

In this paper, we propose a new content-based rapid video playback method using motion-based video time density function (MVTDF) and temporal quantization. In particular, we formulate the rapid video playback problem as a generic sampling problem. We ...
A content-based video fast-forward playback method using video time density function and rate distortion theory
ICME '11: Proceedings of the 2011 IEEE International Conference on Multimedia and Expo

In this paper, we propose a new video summary method using video time density function (VTDF) and rate distortion theory. The whole system has two main modules, processing and playing. In the processing part, we apply VTDF to describe the temporal ...
A GP-based Video Game Player
GECCO '15: Proceedings of the 2015 Annual Conference on Genetic and Evolutionary Computation

A general video game player is an an agent that can learn to play different video games with no specific domain knowledge. We are working towards developing a GP-based general video game player. Our system currently extracts game state features from ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MM '11: Proceedings of the 19th ACM international conference on Multimedia

November 2011

944 pages

ISBN:9781450306164

DOI:10.1145/2072298

General Chairs:
K. Selçuk Candan
Arizona State University, USA
,
Sethuraman Panchanathan
Arizona State University, USA
,
Balakrishnan Prabhakaran
University of Texas at Dallas, USA
,
Program Chairs:
Hari Sundaram
Arizona State University, USA
,
Wu-Chi Feng
Portland State University, USA
,
Nicu Sebe
University of Trento, Italy

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MM '11

Sponsor:

SIGMM

MM '11: ACM Multimedia Conference

November 28 - December 1, 2011

Arizona, Scottsdale, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
147
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Lan SWang ZWei ERoy-Chowdhury AZhu Q(2024)Collaborative Multi-Agent Video Fast-ForwardingIEEE Transactions on Multimedia10.1109/TMM.2023.327585326(1041-1054)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMM.2023.3275853
Lan SWang ZRoy-Chowdhury AWei EZhu QWen Chen CCucchiara RHua XQi GRicci EZhang ZZimmermann R(2020)Distributed Multi-agent Video Fast-forwardingProceedings of the 28th ACM International Conference on Multimedia10.1145/3394171.3413767(1075-1084)Online publication date: 12-Oct-2020
https://dl.acm.org/doi/10.1145/3394171.3413767
Lan SPanda RZhu QRoy-Chowdhury A(2018)FFNet: Video Fast-Forwarding via Reinforcement Learning2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition10.1109/CVPR.2018.00708(6771-6780)Online publication date: Jun-2018
https://doi.org/10.1109/CVPR.2018.00708
Dong LXu QWu SSong XSchoeffmann KSbert M(2016)An Overview+Detail Surveillance Video Player: Information-Based Adaptive Fast-ForwardAdvances in Multimedia Information Processing - PCM 201610.1007/978-3-319-48896-7_36(366-375)Online publication date: 27-Nov-2016
https://doi.org/10.1007/978-3-319-48896-7_36
Schoeffmann KAhlström DBailer WCobârzan CHopfgartner FMcGuinness KGurrin CFrisson CLe DDel Fabro MBai HWeiss W(2013)The Video Browser Showdown: a live evaluation of interactive video search toolsInternational Journal of Multimedia Information Retrieval10.1007/s13735-013-0050-8Online publication date: 31-Dec-2013
https://doi.org/10.1007/s13735-013-0050-8

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

A content-based rapid video playback method using motion-based video time density function and temporal quantization

A content-based video fast-forward playback method using video time density function and rate distortion theory

A GP-based Video Game Player