article

Video shot boundary detection: Seven years of TRECVid activity

Authors:

Alan F. Smeaton,

Aiden R. DohertyAuthors Info & Claims

Computer Vision and Image Understanding, Volume 114, Issue 4

Pages 411 - 418

https://doi.org/10.1016/j.cviu.2009.03.011

Published: 01 April 2010 Publication History

Abstract

Shot boundary detection (SBD) is the process of automatically detecting the boundaries between shots in video. It is a problem which has attracted much attention since video became available in digital form as it is an essential pre-processing step to almost all video analysis, indexing, summarisation, search, and other content-based operations. Automatic SBD was one of the tracks of activity within the annual TRECVid benchmarking exercise, each year from 2001 to 2007 inclusive. Over those seven years we have seen 57 different research groups from across the world work to determine the best approaches to SBD while using a common dataset and common scoring metrics. In this paper we present an overview of the TRECVid shot boundary detection task, a high-level overview of the most significant of the approaches taken, and a comparison of performances, focussing on one year (2005) as an example.

References

[1]

Hanjalic, A., Shot-boundary detection: unraveled and resolved?. Circuits and Systems for Video Technology IEEE Transactions on. v12 i2. 90-105.

[2]

Joyce, R. and Liu, B., Temporal segmentation of video using frame and histogram space. IEEE Transactions on Multimedia. v8 i1. 130-140.

[3]

Zhang, H., Kankanhalli, A. and Smoliar, S., Automatic partitioning of full-motion video. Multimedia Systems. v1. 10-28.

Digital Library

[4]

Lu, H. and Tan, Y., An effective post-refinement method for shot boundary detection. IEEE Transactions on Circuits and Systems for Video Technology. v15 i11. 1407-1421.

[5]

Heng, W. and Ngan, K., Shot boundary refinement for long transition in digital video sequence. IEEE Transactions on Multimedia. v4 i4. 434-445.

[6]

Tan, Y., Nagamani, J. and Lu, H., Modified Kolmogorov-Smirnov metric for shot boundary detection. Electronics Letters. v39 i18. 1313-1315.

[7]

Nesvadba, J., Ernst, F., Perhavc, J., Benois-Pineau, J. and Primaux, L., Comparison of shot boundary detectors. In: Int. Conf. for Multimedia and Expo, Amsterdam, The Netherlands. pp. 6-8.

[8]

A.F. Smeaton, P. Over, W. Kraaij, Evaluation campaigns and TRECVid, in: MIR'06: Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval, ACM Press, New York, NY, USA, 2006, pp. 321-330.

Digital Library

[9]

A. Lee, VirtualDub home page, http://www.virtualdub.org/index.html.

[10]

R. Ruiloba, P. Joly, S. Marchand-Maillet, G. Quenot, Towards a Standard Protocol for the Evaluation of Video-to-Shots Segmentation Algorithms, European Workshop on Content Based Multimedia Indexing. Toulouse, France: URL: http://clips.image.fr/mrim/georges.quenot/articles/cbmi99b.ps.

[11]

Y. Ma, J. Sheng, Y. Chen, H.-J. Zhang, MSR-Asia at TREC-10 Video Track: Shot Boundary Detection Task, Proceedings of TREC-10.

[12]

Doherty, A.R. and Smeaton, A.F., Automatically segmenting lifelog data into events. In: WIAMIS: 9th International Workshop on Image Analysis for Multimedia Interactive Services, IEEE Computer Society, Washington, DC, USA. pp. 20-23.

Digital Library

[13]

K. McDonald, A.F. Smeaton, A comparison of score, rank and probability-based fusion methods for video shot retrieval, in: CIVR 2005 - International Conference on Image and Video Retrieval, W.-K. Leow et al. (Eds.), LNCS 3568, Springer, 2005, pp. 61-70.

[14]

C. Cai, K.M. Lam, Z. Tan, TRECVID2005 Experiments in the Hong Kong Polytechnic University: shot boundary detection based on a multi-step comparison scheme, in: TRECVID 2005 Workshop Notebook Papers, National Institute of Standards and Technology, MD, USA, 2005.

[15]

Lewis, A. and Knowles, G., Video compression using 3D wavelet transforms. Electronics Letters. v26 i6. 396-398.

[16]

A. Amir, The IBM Shot Boundary Detection System at TRECVID 2003, in: TRECVID 2005 Workshop Notebook Papers, National Institute of Standards and Technology, MD, USA, 2003.

[17]

G. Quenot, D. Moraru, L. Besacier, CLIPS at TRECVid: Shot Boundary Detection and Feature Detection, TRECVID 2003 Workshop Notebook Papers, Gaithersburg, MD, USA (2003) 18-21.

[18]

Manly, B., . 1997. Bootstrap and Monte Carlo Methods in Biology, 1997.2nd ed. Chapman and Hall, London, UK.

[19]

A. Smeaton, W. Kraaij, P. Over, TRECVID 2003-an overview, TRECVID 2003 Workshop Notebook Papers, Gaithersburg, MD, USA.

[20]

W. Kraaij, A. Smeaton, P. Over, TRECVID 2004-An Overview, TRECVID 2004 Workshop Notebook Papers, Gaithersburg, MD, USA.

[21]

P. Over, T. Ianeva, W. Kraaij, A. Smeaton, TRECVID 2005-An Overview, TRECVID 2005 Workshop Notebook Papers, Gaithersburg, MD, USA.

[22]

P. Over, T. Ianeva, W. Kraaij, A. Smeaton, TRECVID 2006-An Overview, TRECVID 2006 Workshop Notebook Papers, Gaithersburg, MD, USA.

[23]

P. Over, G. Awad, W. Kraaij, A. Smeaton, TRECVID 2007-Overview, TRECVID 2007 Workshop Notebook Papers, Gaithersburg, MD, USA.

Cited By

Finol GGabriel AGarcía-López PGracia-Tinedo RLiu LDocea RKirchner MBodenstedt S(2024)StreamSense: Policy-driven Semantic Video Search in Streaming SystemsProceedings of the 25th International Middleware Conference Industrial Track10.1145/3700824.3701097(29-35)Online publication date: 2-Dec-2024
https://dl.acm.org/doi/10.1145/3700824.3701097
Soucek TLokoc JCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)TransNet V2: An Effective Deep Network Architecture for Fast Shot Transition DetectionProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3685517(11218-11221)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3685517
Yuan YZhang J(2023)Shot Boundary Detection Using Color Clustering and Attention MechanismACM Transactions on Multimedia Computing, Communications, and Applications10.1145/359592319:6(1-23)Online publication date: 12-Jul-2023
https://dl.acm.org/doi/10.1145/3595923
Show More Cited By

Recommendations

Shot Boundary Detection in Videos Using Saliency based Statistical Model
ICVGIP '18: Proceedings of the 11th Indian Conference on Computer Vision, Graphics and Image Processing

Video indexing and retrieval play a vital role in video management systems involving modules such as shot boundary detection, key frame extraction, and feature representation. Among these modules, Video Shot Boundary Detection (VSBD) is the important ...
Shot Boundary Detection: An Information Saliency Approach
CISP '08: Proceedings of the 2008 Congress on Image and Signal Processing, Vol. 2 - Volume 02

This paper proposes a new approach for shot boundary detection using information saliency. Both temporal and spatial saliency are considered to generate an information saliency map (ISM). The shot detection (both abrupt changes and gradual transitions) ...
Shot Boundary Detection with Spatial-Temporal Convolutional Neural Networks
Pattern Recognition and Computer Vision
Abstract
Nowadays, digital videos have been widely leveraged to record and share various events and people’s daily life. It becomes urgent to provide automatic video semantic analysis and management for convenience. Shot boundary detection (SBD) plays a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Computer Vision and Image Understanding

Computer Vision and Image Understanding Volume 114, Issue 4

April, 2010

92 pages

ISSN:1077-3142

Issue’s Table of Contents

Copyright © Elsevier Inc. © 2009.

Publisher

Elsevier Science Inc.

United States

Publication History

Published: 01 April 2010

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

74
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Finol GGabriel AGarcía-López PGracia-Tinedo RLiu LDocea RKirchner MBodenstedt S(2024)StreamSense: Policy-driven Semantic Video Search in Streaming SystemsProceedings of the 25th International Middleware Conference Industrial Track10.1145/3700824.3701097(29-35)Online publication date: 2-Dec-2024
https://dl.acm.org/doi/10.1145/3700824.3701097
Soucek TLokoc JCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)TransNet V2: An Effective Deep Network Architecture for Fast Shot Transition DetectionProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3685517(11218-11221)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3685517
Yuan YZhang J(2023)Shot Boundary Detection Using Color Clustering and Attention MechanismACM Transactions on Multimedia Computing, Communications, and Applications10.1145/359592319:6(1-23)Online publication date: 12-Jul-2023
https://dl.acm.org/doi/10.1145/3595923
Gupta DSharma A(2023)A comprehensive study of automatic video summarization techniquesArtificial Intelligence Review10.1007/s10462-023-10429-z56:10(11473-11633)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1007/s10462-023-10429-z
Liu YQiao LYin DJiang ZJiang XJiang DRen BMagalhães Jdel Bimbo ASatoh SSebe NAlameda-Pineda XJin QOria VToni L(2022)OS-MSL: One Stage Multimodal Sequential Link Framework for Scene Segmentation and ClassificationProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3547839(6269-6277)Online publication date: 10-Oct-2022
https://dl.acm.org/doi/10.1145/3503161.3547839
Raval KGoyani M(2022)A survey on event detection based video summarization for cricketMultimedia Tools and Applications10.1007/s11042-022-12834-y81:20(29253-29281)Online publication date: 1-Aug-2022
https://dl.acm.org/doi/10.1007/s11042-022-12834-y
Chakraborty SThounaojam DSinha N(2021)A Shot boundary Detection Technique based on Visual Colour InformationMultimedia Tools and Applications10.1007/s11042-020-09857-880:3(4007-4022)Online publication date: 1-Jan-2021
https://dl.acm.org/doi/10.1007/s11042-020-09857-8
Chakraborty SThounaojam D(2021)SBD-Duo: a dual stage shot boundary detection technique robust to motion and illumination effectMultimedia Tools and Applications10.1007/s11042-020-09683-y80:2(3071-3087)Online publication date: 1-Jan-2021
https://dl.acm.org/doi/10.1007/s11042-020-09683-y
Rotman DYaroker YAmrani EBarzelay UBen-Ari RWen Chen CCucchiara RHua XQi GRicci EZhang ZZimmermann R(2020)Learnable Optimal Sequential Grouping for Video Scene DetectionProceedings of the 28th ACM International Conference on Multimedia10.1145/3394171.3413612(1958-1966)Online publication date: 12-Oct-2020
https://dl.acm.org/doi/10.1145/3394171.3413612
Fourati MJedidi AGargouri F(2020)A survey on description and modeling of audiovisual documentsMultimedia Tools and Applications10.1007/s11042-020-09589-979:45-46(33519-33546)Online publication date: 1-Dec-2020
https://dl.acm.org/doi/10.1007/s11042-020-09589-9
Show More Cited By

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents