Article

Dynamic pictorial ontologies for video digital libraries annotation

Authors:

Alberto Del Bimbo,

Costantino Grana,

Rita CucchiaraAuthors Info & Claims

MS '07: Workshop on multimedia information retrieval on The many faces of multimedia semantics

Pages 47 - 56

https://doi.org/10.1145/1290067.1290076

Published: 28 September 2007 Publication History

Abstract

In this paper, we present the dynamic pictorial ontology paradigm for video annotation. Ontologies are often used to describe a given domain for different goals, including description of multimedia data. In the case of video annotation, the visual knowledge cannot be described using only abstract concepts but is more effectively represented in a visual form. To this aim, we introduce visual concepts, elicited from the data set as the most representative prototypes that specialize abstract concepts. The ontology created is intrinsically dynamic since it must embrace the perceptual and visual experience during annotation. Thus visual concepts can change, adapting to the multimedia content analyzed. Motivation for this new ontology paradigm are discussed together with a proposal of a framework for ontology creation, maintenance, and automatic annotation of video. The creation and usage of dynamic pictorial ontologies have been tested for soccer domain exploiting low level perceptual features and higher level domain features.

References

[1]

S. Dasiopoulou, V. K. Papastathis, V. Mezaris, I. Kompatsiaris, M. G. Strintzis, "An Ontology Framework For Knowledge-Assisted Semantic Video Analysis and Annotation", Proc.of 4th International Workshop on SemAnnot at the 3rd International Semantic Web Conference, Hiroshima, Japan, 2004.

[2]

S. Dasiopoulou, V. Mezaris, I. Kompatsiaris, V. K. Papastathis M. G. Strintzis, "Knowledge-Assisted Semantic Video Object Detection", IEEE Transactions on Circuits and Systems for Video Technology, Special Issue on Analysis and Understanding for Video Adaptation, vol. 15, no. 10, pp. 1210--1224, October 2005

Digital Library

[3]

C. Tsinaraki, P. Polydoros, S. Christodoulakis, "Interoperability support for Ontology-based Video Retrieval Applications", Proc of Conference on Image and Video Retrieval (CIVR), 2004

[4]

A. Jaimes, J.R. Smith, "Semi-automatic, data-driven construction of multimedia ontologies", Proc. of International Conference on Multimedia and Expo (ICME), 2003.

Digital Library

[5]

T. h. Athanasiadis, V. Tzouvaras, K. Petridis, F. Precioso, Y. Avrithis Y. Kompatsiaris, "Using a Multimedia Ontology Infrastructure for Semantic Annotation of Multimedia Content", Proc. of 5th International Workshop on Knowledge Markup and Semantic Annotation (SemAnnot '05), Galway, Ireland, November 2005

[6]

"Towards a common multimedia ontology framework" analysis of the contribution 27/4/06 report on ACEMedia project

[7]

"Ontological and Epistemological Foundations", report on DELOS project http://www.idi.ntnu.no/grupper/su/publ/html/totland/ch032.htm

[8]

R. Hirschheim, H. Klein, K. Lyytinen, "Information Systems Development and Data Modeling - Conceptual and Philosophical Foundations", Cambridge University Press, Cambridge, UK, 289 pages, 1995

Digital Library

[9]

E. G. Guba, Y. S. Lincoln, "Competing Paradigms in Qualitative Research", in (Denzin and Lincoln, 1994), pp. 105--117, 1994

[10]

L. Wittgenstein, "Tractatus Logico-Philosophicus", Hypertext Translated from the German by C.K. Ogden http://kfs.org/~jonathan/witt/tlph.html 200

Digital Library

[11]

Y. Zhai, J. Liu, X. Cao, A. Basharat, A. Hakeem, S. Ali, M. Shah, C. Grana, R.Cucchiara, "Video Understanding and Content-based Retrieval", TREC Video Retrieval Evaluation Online Proceedings, http://wwwnlpir.nist.gov/projects/tvpubs/tv.pubs.org.html, 2005

[12]

C. Grana, R. Cucchiara, "Linear Transition Detection as a Unified Shot Detection Approach" in IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, n. 4, pp. 483--489, 2007

Digital Library

[13]

M. Bertini, R. Cucchiara, A. Del Bimbo C. Torniai, "Video Annotation with Pictorially Enriched Ontologies". In Proc. of International Conference on Multimedia and Expo (ICME), 2005.

[14]

C. Grana, R.Vezzani, R. Cucchiara, "Enhancing HSV Histograms with achromatic points detection in video retrieval", Proc. of Conference on Image and Video Retrieval (CIVR), 2007

Digital Library

[15]

D. Zhou, J. Li, H. Zha, "A new Mallows distance based metric for comparing clusterings", Proc. of the 22nd international conference on Machine Learning, Bonn, Germany, 2005

Digital Library

[16]

M. Bertini, A. Del Bimbo C.Torniai, "Automatic Video Annotation using Ontologies Extended with Visual Information", Proc. of ACM Multimedia, November 2005

Digital Library

[17]

J. C. Bezdek, "Pattern Recognition with Fuzzy Objective Function Algorithms", Plenum Press, New York, 1981

Digital Library

[18]

A. Jaimes, B. Tseng, J. Smith, "Modal keywords, Ontologies, and Reasoning for Video Understanding" in Proc. of Conference on Image and Video Retrieval (CIVR), July 2003

Digital Library

[19]

A. Benitez, S.-F. Chang, "Automatic Multimedia Knowledge Discovery, Summarization and Evaluation" IEEE Transactions on Multimedia, Submitted

[20]

J. Kender, M. Naphade, "Visual Concepts for News Story Tracking: Analyzing and Exploiting the NIST TRECVID Video Annotation Experiment" in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 1174--1181, 2005

Digital Library

[21]

M. Naphade, J. Smith, J. Tesic, S. Chang, L. Kennedy, A. Hauptmann, J. Curtis, "Large-scale Concepts Ontology for Multimedia", IEEE Multimedia, vol. 13, no.3, pp. 86--91, July-Sept 2006

Digital Library

[22]

D. Lenat, R. Guha, "Building Large Knowledge-based Systems: Representation and Inference in the Cyc Project". Reading, MA (USA): Addison-Wesley, 1990.

Digital Library

[23]

J. Strintzis, S. Bloehdorn, S. Handschuh, S. Staab, N. Simou, V. Tzouvaras, K. Petridis, I. Kompatsiaris, Y. Avrithis, "Knowledge representation for semantic multimedia content analysis and reasoning," in Proc. of European Workshop on the Integration of Knowledge, Semantics and Digital Media Technology, Nov. 2004.

[24]

S. Vembu, M. Kiesel, M. Sintek, S. Bauman, "Towards bridging the semantic gap in multimedia annotation and retrieval," in Proc. of First International Workshop on Semantic Web Annotations for Multimedia (SWAMM), Edinburgh (Scotland), May 2006.

[25]

V. Mezaris, I. Kompatsiaris, N. Boulgouris, M. Strintzis, "Real-time compressed-domain spatiotemporal segmentation and ontologies for video indexing and retrieval," IEEE Transactions on Circuits and Systems for Video Technology, vol. 14,no. 5, pp. 606--621, 2004.

Digital Library

[26]

N. Simou, C. Saathoff, S. Dasiopoulou, E. Spyrou, N. Voisine, V. Tzouvaras, I. Kompatsiaris, Y. Avrithis, S. Staab, "An ontology infrastructure for multimedia reasoning," in Proc. International Workshop VLBV, Sardinia (Italy), September, 2005.

Digital Library

[27]

D. Kosmopoulos, S. Petridis, I. Pratikakis, V. Gatos, S. Perantonis, V. Karkaletsis, G. Paliouras, "Knowledge Acquisition from Multimedia Content using an Evolution Framework," in Proc. of 3rd IFIP Conference on Artificial Intelligence Applications & Innovations (AIAI), June, 2006.

[28]

K. Petridis, S. Bloehdorn, C. Saathoff, N. Simou, S. Dasiopoulou, V. Tzouvaras, S. Handschuh, Y. Avrithis, I. Kompatsiaris, S. Staab, "Knowledge Representation and Semantic Annotation of Multimedia Content," IEE Proceedings on Vision Image and Signal Processing, Special issue on Knowledge-based Digital Media Processing, vol. 153, no. 3, pp. 255--262, June 2006.

[29]

C. Snoek, B. Huurnink, L. Hollink, M. de Rijke, G. Schreiber, M. Worring, "Adding semantics to detectors for video retrieval," IEEE Transactions on Multimedia, vol. 9, no. 5, August, 2007.

Digital Library

[30]

C. Grana, D. Bulgarelli, R. Cucchiara, "Video clip clustering for assisted creation of mpeg-7 pictorially enriched ontologies," in Proc. Second International Symposium on Communications, Control and Signal Processing (ISCCSP), Marrakech, Morocco, March 2006.

Cited By

Siemens RArbuckle ASeatter LEl Khatib REl Hajj T(2017)The Value of Plurality in ‘The Network with a Thousand Entrances’International Journal of Humanities and Arts Computing10.3366/ijhac.2017.019011:2(153-173)Online publication date: Oct-2017
https://doi.org/10.3366/ijhac.2017.0190
Kazi Tani MGhomari ALablack ABilasco I(2017)OVIS: ontology video surveillance indexing and retrieval systemInternational Journal of Multimedia Information Retrieval10.1007/s13735-017-0133-z6:4(295-316)Online publication date: 18-Sep-2017
https://doi.org/10.1007/s13735-017-0133-z
Kazi Tani MLablack AGhomari ABilasco I(2015)Events Detection Using a Video-Surveillance Ontology and a Rule-Based ApproachComputer Vision - ECCV 2014 Workshops10.1007/978-3-319-16181-5_21(299-308)Online publication date: 20-Mar-2015
https://doi.org/10.1007/978-3-319-16181-5_21
Show More Cited By

Index Terms

Dynamic pictorial ontologies for video digital libraries annotation
1. Applied computing
  1. Computers in other domains
    1. Digital libraries and archives
2. Information systems
  1. Information systems applications
    1. Digital libraries and archives
    2. Multimedia information systems
      1. Multimedia databases

Recommendations

Multimedia ontology learning for automatic annotation and video browsing
MIR '08: Proceedings of the 1st ACM international conference on Multimedia information retrieval

In this work, we offer an approach to combine standard multimedia analysis techniques with knowledge drawn from conceptual metadata provided by domain experts of a specialized scholarly domain, to learn a domain-specific multimedia ontology from a set ...
RDF-powered semantic video annotation tools with concept mapping to Linked Data for next-generation video indexing: a comprehensive review

Video annotation tools are often compared in the literature, however, most reviews mix unstructured, semi-structured, and the very few structured annotation software. This paper is a comprehensive review of video annotations tools generating structured ...
Video Annotation and Retrieval Using Ontologies and Rule Learning

An approach for automatic annotation and retrieval of video content uses semantic concept classifiers and ontologies to permit expanded queries to synonyms and concept specializations.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MS '07: Workshop on multimedia information retrieval on The many faces of multimedia semantics

September 2007

100 pages

ISBN:9781595937827

DOI:10.1145/1290067

General Chairs:
Farshad Fotouhi
Wayne State University, USA
,
William Grosky
University of Michigan-Dearborn, USA
,
Peter Stanchev
Kettering University, USA

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 September 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM07

Sponsor:

MM07: The 15th ACM International Conference on Multimedia 2007

September 28, 2007

Bavaria, Augsburg, Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
470
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Siemens RArbuckle ASeatter LEl Khatib REl Hajj T(2017)The Value of Plurality in ‘The Network with a Thousand Entrances’International Journal of Humanities and Arts Computing10.3366/ijhac.2017.019011:2(153-173)Online publication date: Oct-2017
https://doi.org/10.3366/ijhac.2017.0190
Kazi Tani MGhomari ALablack ABilasco I(2017)OVIS: ontology video surveillance indexing and retrieval systemInternational Journal of Multimedia Information Retrieval10.1007/s13735-017-0133-z6:4(295-316)Online publication date: 18-Sep-2017
https://doi.org/10.1007/s13735-017-0133-z
Kazi Tani MLablack AGhomari ABilasco I(2015)Events Detection Using a Video-Surveillance Ontology and a Rule-Based ApproachComputer Vision - ECCV 2014 Workshops10.1007/978-3-319-16181-5_21(299-308)Online publication date: 20-Mar-2015
https://doi.org/10.1007/978-3-319-16181-5_21
(2014)BibliographySemantic Multimedia Analysis and Processing10.1201/b17080-21(421-512)Online publication date: 18-Jun-2014
https://doi.org/10.1201/b17080-21
Kazi Tani MGhomari ALablack ABelhadef HBilasco I(2014)An ontology based approach for inferring multiple object events in surveillance domain2014 Science and Information Conference10.1109/SAI.2014.6918219(404-409)Online publication date: Aug-2014
https://doi.org/10.1109/SAI.2014.6918219
Kanimozhi TChristy A(2013)Incorporating ontology and SPARQL for semantic image annotation2013 IEEE CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGIES10.1109/CICT.2013.6558056(26-31)Online publication date: Apr-2013
https://doi.org/10.1109/CICT.2013.6558056
Panteli ATsinaraki CRagia LKazasis FChristodoulakis S(2011)Mobile Multimedia Event Capturing and Visualization (MOME)Proceedings of the 2011 Fifth FTRA International Conference on Multimedia and Ubiquitous Engineering10.1109/MUE.2011.29(101-106)Online publication date: 28-Jun-2011
https://dl.acm.org/doi/10.1109/MUE.2011.29
Ballan LBertini MBimbo ASeidenari LSerra G(2011)Event detection and recognition for semantic annotation of videoMultimedia Tools and Applications10.1007/s11042-010-0643-751:1(279-302)Online publication date: 1-Jan-2011
https://dl.acm.org/doi/10.1007/s11042-010-0643-7
Lorenzatti AAbel MFiorini SBernardes AScherer C(2010)Ontological primitives for visual knowledgeProceedings of the 20th Brazilian conference on Advances in artificial intelligence10.5555/1929622.1929624(1-10)Online publication date: 23-Oct-2010
https://dl.acm.org/doi/10.5555/1929622.1929624
Zhu TBakshi APrasanna VGomadam K(2010)Applying Semantic Web Techniques to Reservoir EngineeringProceedings of the 2010 Seventh International Conference on Information Technology: New Generations10.1109/ITNG.2010.183(586-591)Online publication date: 12-Apr-2010
https://dl.acm.org/doi/10.1109/ITNG.2010.183
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents