short-paper

Modeling the semantic content of the socio-tagged images based on the extended conceptual graphs formalism

Authors:

Mariam Bouchakwa,

Ikram AmousAuthors Info & Claims

MoMM '16: Proceedings of the 14th International Conference on Advances in Mobile Computing and Multi Media

Pages 35 - 39

https://doi.org/10.1145/3007120.3007160

Published: 28 November 2016 Publication History

Abstract

With the emergence of Web 2.0, the volume of multimedia documents, particularly the socio-tagged images, has become very considerable. This has made it the annotation and interrogation process of this type of documents a consuming and elusive task. A promising solution is to design methods allowing to model the semantic content of socio-tagged images in order to facilitate their annotation and the research process. Thus, we present in this paper a conceptual modeling approach of the semantic content of these images. First, our idea consists in expanding the conceptual graphs formalism in order to represent the relationships between the concepts and those that are between the concepts and their properties. Second, we use the extended graph to model the semantic content of the socio-tagged images. Experimental studies are conducted on a collection of 25.000 socio-tagged images shared in Flickr. The results demonstrate the effectiveness of our proposed approach.

References

[1]

S. Aditya, Y. Yang, C. Baral, C. Fermuller, and Y. Aloimonos. From Images to Sentences through Scene Description Graphs using Commonsense Reasoning and Knowledge. In: CVPR, 2015.

[2]

A. Benafia, R. Maamri, Z. Sahnoun, S. Saadaoui, and Y. Saadna. A Representation model of images based on graphs and automatic Instantiation of its Skeletal Configuration. In: IIMSS, 2011.

[3]

A. N. Bhute and B. B. Meshram. Text Based Approach For Indexing And Retrieval Of Image And Video: A Review. In: AVC, 2014.

[4]

M. Charhad. Modèles de documents vidéo basés sur le formlisme des graphes conceptuels pour l'indexation et la recherche par le contenu sémantique. PhD thesis Joseph Fourier University-Grenoble I, 2005.

[5]

R. T. Jaouachi, M. T. Khemakhem, N. Hernandez, O. Haemmerlé, and M. Ben Jemaa. Semantic Annotation of Images Extracted from the Web using RDF Patterns and a Domain Ontology. In: ICEIS, 2015.

Digital Library

[6]

J. Johnson, R. Krishna, M. Stark, L.-J. Li, D. A. Shamma, M. S. Bernstein, and L. Fei-Fei. In: Image retrieval using scene graphs. In: CVPR, 2015.

[7]

J. L. Klavans, R. Guerra, and R. LaPlante. Beyond Flickr: Not All Image Tagging Is Created Equal. In: AAAI, 2011.

Digital Library

[8]

A. Ksibi, A. Ben Ammar, and C. Ben Amar. Effective concept detection using second order co-occurence flickr context similarity measure socfcs. In: CBMI, 2012.

[9]

G. Kulkarni, V. Premraj, V. Ordonez, S. Dhar, S. Li, Y. Choi, A. C. Berg, and T. Berg. Babytalk: Understanding and generating simple image descriptions. In: TPAMI, 2013

Digital Library

[10]

D. Liu, X.-S. Hua, M. Wang, and H.-J. Zhang. Image retagging. In: ACM MM, 2010.

Digital Library

[11]

N. Magesh and P. Thangaraj. Semantic image retrieval based on ontology and SPARQL query. In: ICACT, 2011.

[12]

H. Mousselly-Sergieh, E. Egyed-Zsigmond, G. Gianini, M. Döller, H. Kosch, and J.-M. Pinon. Tag Similarity in Folksonomies. In: INFORSID, 2013.

[13]

N. Prabhu and R. Venkatesh Babu, "Attribute-Graph: A Graph based approach to Image Ranking. In: ICCV, 2015.

Digital Library

[14]

X. Rui, M. Li, Z. Li, W.-Y. Ma, and N. Yu. Bipartite graph reinforcement model for web image annotation. In: ACM MM, 2007.

Digital Library

[15]

J. F. Sowa. Conceptual structures: information processing in mind and machine. Addison-Wesley publishing company, 1984.

Digital Library

[16]

L. Xu and X. Wang. Semantic Description of Cultural Digital Images: Using a Hierarchical Model and Controlled Vocabulary. D-Lib Mag, 2015.

Cited By

Bouchakwa MAyadi YAmous I(2020)An ambiguous tag-based query reformulation technique for an effective semantic-based social image researchProcedia Computer Science10.1016/j.procs.2020.08.053176(508-520)Online publication date: 2020
https://doi.org/10.1016/j.procs.2020.08.053
Bouchakwa MAyadi YAmous I(2020)A review on visual content-based and users’ tags-based image annotation: methods and techniquesMultimedia Tools and Applications10.1007/s11042-020-08862-1Online publication date: 9-May-2020
https://doi.org/10.1007/s11042-020-08862-1
Bouchakwa MAyadi YAmous I(2019)Multi-level diversification approach of semantic-based image retrieval resultsProgress in Artificial Intelligence10.1007/s13748-019-00195-xOnline publication date: 22-Jun-2019
https://doi.org/10.1007/s13748-019-00195-x

Index Terms

Modeling the semantic content of the socio-tagged images based on the extended conceptual graphs formalism
1. Information systems
  1. Information retrieval
    1. Document representation
  2. Information systems applications
    1. Multimedia information systems

Recommendations

Human Intelligence in the Process of Semantic Content Creation

Despite significant progress over the last years the large-scale adoption of semantic technologies is still to come. One of the reasons for this state of affairs is assumed to be the lack of useful semantic content, a prerequisite for almost every IT ...
Concepts and semantic relations in information science

Concept-based information retrieval and knowledge representation are in need of a theory of concepts and semantic relations. Guidelines for the construction and maintenance of knowledge organization systems (KOS) (such as ANSI-NISO Z39.19-2005 in the ...
CRCTOL: A semantic-based domain ontology learning system

Domain ontologies play an important role in supporting knowledge-based applications in the Semantic Web. To facilitate the building of ontologies, text mining techniques have been used to perform ontology learning from texts. However, traditional ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MoMM '16: Proceedings of the 14th International Conference on Advances in Mobile Computing and Multi Media

November 2016

363 pages

ISBN:9781450348065

DOI:10.1145/3007120

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

@WAS: International Organization of Information Integration and Web-based Applications and Services

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

MoMM '16

MoMM '16: 14th International Conference on Advances in Mobile Computing and Multi Media

November 28 - 30, 2016

Singapore, Singapore

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
29
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 29 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bouchakwa MAyadi YAmous I(2020)An ambiguous tag-based query reformulation technique for an effective semantic-based social image researchProcedia Computer Science10.1016/j.procs.2020.08.053176(508-520)Online publication date: 2020
https://doi.org/10.1016/j.procs.2020.08.053
Bouchakwa MAyadi YAmous I(2020)A review on visual content-based and users’ tags-based image annotation: methods and techniquesMultimedia Tools and Applications10.1007/s11042-020-08862-1Online publication date: 9-May-2020
https://doi.org/10.1007/s11042-020-08862-1
Bouchakwa MAyadi YAmous I(2019)Multi-level diversification approach of semantic-based image retrieval resultsProgress in Artificial Intelligence10.1007/s13748-019-00195-xOnline publication date: 22-Jun-2019
https://doi.org/10.1007/s13748-019-00195-x

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents