Article

Merging storyboard strategies and automatic retrieval for improving interactive video search

Authors:

Michael G. Christel,

Rong YanAuthors Info & Claims

CIVR '07: Proceedings of the 6th ACM international conference on Image and video retrieval

Pages 486 - 493

https://doi.org/10.1145/1282280.1282351

Published: 09 July 2007 Publication History

Get Access

Abstract

The Carnegie Mellon University Informedia group has enjoyed consistent success with TRECVID interactive search using traditional storyboard interfaces for shot-based retrieval. For TRECVID 2006 the output of automatic search was included for the first time with storyboards, both as an option for an interactive user and in a different run as the sole means of access. The automatic search makes use of relevance-based probabilistic retrieval models to determine weights for combining retrieval sources when addressing a given topic. Storyboard-based access using automatic search output outperformed extreme video retrieval interfaces of manual browsing with resizable pages and rapid serial visualization of keyframes that used the same output. Further, the full Informedia interface with automatic search results as an option along with other query mechanisms scored significantly better than all other TRECVID 2006 interactive search systems. Attributes of the automatic search and interactive search systems are discussed to further optimize shot-based retrieval from news corpora.

References

[1]

Campbell, M., Ebadollahi, S., Naphade, M., Natsev, A., Smith, J. R., Tesic, J., Xie, L., Haubold, A. IBM Research TRECVID-2006 Video Retrieval System. In NIST TREC Video Retrieval Online Proceedings. NIST, 2006, //www-nlpir.nist.gov/projects/tvpubs/tv6.papers/ibm.pdf.

Google Scholar

[2]

Christel, M., and Moraveji, N. Finding the Right Shots: Assessing Usability and Performance of a Digital Video Library Interface. In Proc. ACM Multimedia (New York, NY, Oct. 2004), ACM Press, New York, 2004, 732--739.

Digital Library

Google Scholar

[3]

Christel, M., and Conescu, R. Mining Novice User Activity with TRECVID Interactive Retrieval Tasks. In LNCS 4071: Proc. Image and Video Retrieval (CIVR) (Tempe, AZ, July 2006), Springer, Berlin, 2006, 21--30.

Digital Library

Google Scholar

[4]

Chua, T.-S., Neo, S.-Y., Li, K.-Y., Wang, G., Shi, R., Zhao, M., Xu, H. TRECVID 2004 Search and Feature Extraction Task by NUS PRIS. In NIST TREC Video Retrieval Online Proceedings. NIST, Gaithersburg, MD, 2004, http://www-nlpir.nist.gov/projects/tvpubs/tvpapers04/nus.pdf.

Google Scholar

[5]

Hauptmann, A. G., Lin, W.-H., Yan, R., Yang, J., and Chen, M.-Y. Extreme video retrieval: joint maximization of human and computer performance. In Proc. ACM Multimedia (Santa Barbara, CA, Oct. 2006), ACM Press, New York, NY, 2006, 385--394.

Digital Library

Google Scholar

[6]

Kraaij, W., Over, P., Ianeva, T., and Smeaton, A. TRECVID 2006 - An Introduction. In TRECVID Online Proceedings, //www-nlpir.nist.gov/projects/tvpubs/tv6.papers/tv6intro.pdf.

Google Scholar

[7]

Naphade, M., Smith, J. R., Tesic, J., Chang, S.-F., Hsu, W., Kennedy, L., Hauptmann, A. and Curtis, J. Large-Scale Concept Ontology for Multimedia. IEEE MultiMedia 13(3), 2006, 86--91.

Digital Library

Google Scholar

[8]

Snoek, C., Worring, M., Koelma, D., and Smeulders, A. Learned Lexicon-Driven Interactive Video Retrieval. In LNCS 4071: Proc. Image and Video Retrieval (CIVR) (Tempe, AZ, July 2006), Springer, Berlin, 2006, 11--20.

Digital Library

Google Scholar

[9]

Snoek, C., Worring, M., Koelma, D., and Smeulders, A. A Learned Lexicon-Driven Paradigm for Interactive Video Retrieval. IEEE Trans. Multimedia 9(2), Feb. 2007, 280--292.

Digital Library

Google Scholar

[10]

Yan, R., Yang, J., and Hauptmann, A. Learning Query-Class Dependent Weights in Automatic Video Retrieval. In Proc. ACM Multimedia (New York, NY, Oct. 2004), ACM Press, New York, NY, 2004, 548--555.

Digital Library

Google Scholar

[11]

Yan, R., and Hauptmann, A. G. Efficient margin-based rank learning algorithms for information retrieval. In LNCS 4071: Proc. Image and Video Retrieval (CIVR) (Tempe, AZ, July 2006), Springer, Berlin, 2006, 113--122.

Digital Library

Google Scholar

Cited By

View all

Rusu ARusu A(2024)Script-to-Storyboard-to-Story Reel Framework2024 28th International Conference Information Visualisation (IV)10.1109/IV64223.2024.00067(350-355)Online publication date: 22-Jul-2024
https://doi.org/10.1109/IV64223.2024.00067
Lokoč JBailer WSchoeffmann KMuenzer BAwad G(2018)On Influential Trends in Interactive Video Retrieval: Video Browser Showdown 2015–2017IEEE Transactions on Multimedia10.1109/TMM.2018.283011020:12(3361-3376)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1109/TMM.2018.2830110
Cobârzan CSchoeffmann KBailer WHürst WBlaźEk ALokoăź JVrochidis SBarthel KRossetto L(2017)Interactive video search toolsMultimedia Tools and Applications10.1007/s11042-016-3661-276:4(5539-5571)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1007/s11042-016-3661-2
Show More Cited By

Index Terms

Merging storyboard strategies and automatic retrieval for improving interactive video search
1. Information systems
  1. Information retrieval
  2. Information systems applications
    1. Multimedia information systems

Recommendations

Carnegie Mellon University traditional informedia digital video retrieval system
CIVR '07: Proceedings of the 6th ACM international conference on Image and video retrieval

The Carnegie Mellon University Informedia group has enjoyed consistent success with TRECVID interactive search using traditional storyboard interfaces for shot-based retrieval. For TRECVID 2006 the output of automatic search was included for the first ...
A Learned Lexicon-Driven Paradigm for Interactive Video Retrieval

Effective video retrieval is the result of interplay between interactive query selection, advanced visualization of results, and a goal-oriented human user. Traditional interactive video retrieval approaches emphasize paradigms, such as query-by-keyword ...
Multimodal Video Retrieval with the 2017 IMOTION System
ICMR '17: Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval

The IMOTION system is a multimodal content-based video search and browsing application offering a rich set of query modes on the basis of a broad range of different features. It is able to scale with the size of the collection due to its underlying ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CIVR '07: Proceedings of the 6th ACM international conference on Image and video retrieval

July 2007

655 pages

ISBN:9781595937339

DOI:10.1145/1282280

General Chairs:
Nicu Sebe
Univ. of Amsterdam, The Netherlands
,
Marcel Worring
Univ. of Amsterdam, The Netherlands

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 July 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CIVR07

Sponsor:

SIGMM

CIVR07: International Conference on Image and Video Retrieval 2007

July 9 - 11, 2007

Amsterdam, The Netherlands

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
381
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Rusu ARusu A(2024)Script-to-Storyboard-to-Story Reel Framework2024 28th International Conference Information Visualisation (IV)10.1109/IV64223.2024.00067(350-355)Online publication date: 22-Jul-2024
https://doi.org/10.1109/IV64223.2024.00067
Lokoč JBailer WSchoeffmann KMuenzer BAwad G(2018)On Influential Trends in Interactive Video Retrieval: Video Browser Showdown 2015–2017IEEE Transactions on Multimedia10.1109/TMM.2018.283011020:12(3361-3376)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1109/TMM.2018.2830110
Cobârzan CSchoeffmann KBailer WHürst WBlaźEk ALokoăź JVrochidis SBarthel KRossetto L(2017)Interactive video search toolsMultimedia Tools and Applications10.1007/s11042-016-3661-276:4(5539-5571)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1007/s11042-016-3661-2
Schoeffmann KHudelist MHuber J(2015)Video Interaction ToolsACM Computing Surveys10.1145/280879648:1(1-34)Online publication date: 29-Sep-2015
https://dl.acm.org/doi/10.1145/2808796
Schoeffmann KHopfgartner FZhou XSmeaton ATian QBulterman DShen HMayer-Patel KYan S(2015)Interactive Video SearchProceedings of the 23rd ACM international conference on Multimedia10.1145/2733373.2807417(1321-1322)Online publication date: 13-Oct-2015
https://dl.acm.org/doi/10.1145/2733373.2807417
de Rooij OWorring M(2013)Active Bucket Categorization for High Recall Video RetrievalIEEE Transactions on Multimedia10.1109/TMM.2013.223789415:4(898-907)Online publication date: 1-Jun-2013
https://dl.acm.org/doi/10.1109/TMM.2013.2237894
Rooij OWorring M(2012)Efficient targeted search using a focus and context video browserACM Transactions on Multimedia Computing, Communications, and Applications10.1145/2379790.23797938:4(1-19)Online publication date: 30-Nov-2012
https://dl.acm.org/doi/10.1145/2379790.2379793
Hürst WDarzentas DIp HRui Y(2012)Quantity versus qualityProceedings of the 2nd ACM International Conference on Multimedia Retrieval10.1145/2324796.2324849(1-8)Online publication date: 5-Jun-2012
https://dl.acm.org/doi/10.1145/2324796.2324849
Luan HZheng YWang MChua T(2011)VisionGoInformation Sciences: an International Journal10.1016/j.ins.2011.05.018181:19(4197-4213)Online publication date: 1-Oct-2011
https://dl.acm.org/doi/10.1016/j.ins.2011.05.018
Deufemia VGiordano MPolese GTortora G(2011)A Dialogue Interface for Investigating Human Activities in Surveillance VideosInformation Technology and Innovation Trends in Organizations10.1007/978-3-7908-2632-6_24(209-217)Online publication date: 9-May-2011
https://doi.org/10.1007/978-3-7908-2632-6_24
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Carnegie Mellon University traditional informedia digital video retrieval system

A Learned Lexicon-Driven Paradigm for Interactive Video Retrieval

Multimodal Video Retrieval with the 2017 IMOTION System