research-article

Tag recommendation for georeferenced photos

Authors:

Bruno MartinsAuthors Info & Claims

LBSN '11: Proceedings of the 3rd ACM SIGSPATIAL International Workshop on Location-Based Social Networks

Pages 57 - 64

https://doi.org/10.1145/2063212.2063229

Published: 01 November 2011 Publication History

Abstract

This paper presents methods for annotating georeferenced photos with descriptive tags, exploring the annotations for other georeferenced photos which are available at online repositories like Flickr. Specifically, by using the geospatial coordinates associated to the photo which we want to annotate, we start by collecting the photos from an online repository which were taken from nearby locations. Next, and for each tag associated to the collected photos, we compute a set of relevance estimators with basis on factors such as the tag frequency, the geospatial proximity of the photo, the image content similarity, and the number of different users employing the tag. The multiple estimators can then be combined through supervised learning to rank methods such as Rank-Boost or AdaRank, or through unsupervised rank aggregation methods well-known in the information retrieval literature, namely the CombSUM or the CombMNZ approaches. The most relevant tags are finally suggested. Experimental results with a collection of photos collected from Flickr attest for the adequacy of the proposed approaches.

References

[1]

J. Ah-Pine. On data fusion in information retrieval using different aggregation operators. Web Intelligence and Agent Systems, 9(1), 2011.

Digital Library

[2]

C. Burges, T. Shaked, E. Renshaw, A. Lazier, M. Deeds, N. Hamilton, and G. Hullender. Learning to rank using gradient descent. In Proceedings of the 22nd international conference on Machine learning, 2005.

Digital Library

[3]

C. B. Yang, M. Dong, and J. Hua. Region-based image annotation using asymmetrical support vector machine-based multiple-instance learning. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2006.

Digital Library

[4]

V. Conitzer. Computational aspects of preference aggregation. PhD thesis, Carnegie Mellon University, 2006.

Digital Library

[5]

D. J. Crandall, L. Backstrom, D. Huttenlocher, and J. Kleinberg. Mapping the world's photos. In Proceedings of the 18th international conference on World Wide Web, 2009.

Digital Library

[6]

C. Cusano, G. Ciocca, and R. Schettini. Image annotation using SVM. Internet Imaging V, 2003.

[7]

C. Dwork, R. Kumar, M. Naor, and D. Sivakumar. Rank aggregation methods for the web. In Proceedings of the 10th International Conference on World Wide Web, 2001.

Digital Library

[8]

M. Farah and D. Vanderpooten. An outranking approach for rank aggregation in information retrieval. In Proceedings of the 30th Annual Anternational ACM SIGIR Conference on Research and Development in Information Retrieval, 2007.

Digital Library

[9]

S. L. Feng, R. Manmatha, and V. Lavrenko. Multiple bernoulli relevance models for image and video annotation. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004.

Digital Library

[10]

E. A. Fox and J. A. Shaw. Combination of multiple searches. In Proceedings of the 2nd Text Retrieval Conference, 1994.

[11]

Y. Freund, R. Iyer, R. E. Schapire, and Y. Singer. An efficient boosting algorithm for combining preferences. Journal of Machine Learning Research, 4, December 2003.

Digital Library

[12]

Y. Ganjisaffar. Tree Ensembles for Learning to Rank. PhD thesis, University of California, Irvine, 2011.

Digital Library

[13]

N. Garg and I. Weber. Personalized, interactive tag recommendation for Flickr. In Proceedings of the 2008 ACM Conference on Recommender Systems, 2008.

Digital Library

[14]

J. Hays and A. Efros. IM2GPS: Estimating geographic information from a single image. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2008.

[15]

P. Heymann, D. Ramage, and H. Garcia-Molina. Social tag prediction. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2008.

Digital Library

[16]

T. Joachims. Optimizing search engines using clickthrough data. In Proceedings of the 9th ACM Conference on Knowledge Discovery and Data Mining, 2002.

Digital Library

[17]

R. Jäschke, L. Marinho, A. Hotho, L. Schmidt-Thieme, and G. Stumme. Tag recommendations in folksonomies. In Proceedings of the 11th European Conference on Principles and Practice of Knowledge Discovery in Databases, 2007.

Digital Library

[18]

L. Kennedy, S.-F. Chang, and I. Kozintsev. To search or to label?: Predicting the performance of search-based automatic image classifiers. In Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval, 2006.

Digital Library

[19]

J. Kleban, E. Moxley, J. Xu, and B. S. Manjunath. Global annotation on georeferenced photographs. In Proceeding of the ACM International Conference on Image and Video Retrieval, 2009.

Digital Library

[20]

A. Klementiev, D. Roth, K. Small, and I. Titov. Unsupervised rank aggregation with domain-specific expertise. In Proceedings of the 21st International Joint Conference on Artifical Intelligence, 2009.

Digital Library

[21]

R. Krestel, P. Fankhauser, and W. Nejdl. Latent Dirichlet allocation for tag recommendation. In Proceedings of the 3rd ACM Conference on Recommender Systems, 2009.

Digital Library

[22]

O. Kucuktunc, S. Sevil, A. Tosun, H. Zitouni, P. Duygulu, and F. Can. Tag suggestr: Automatic photo tag expansion using visual information for photo sharing websites. In International Conference on Semantic and Digital Media Technologies, 2008.

Digital Library

[23]

H. Li. Learning to Rank for Information Retrieval and Natural Language Processing. Morgan & Claypool Publishers, 2011.

Digital Library

[24]

P. Li, C. Burges, and Q. Wu. Learning to rank using multiple classification and gradient boosting. In Proceedings of the 21st Conference on Advances in Neural Information Processing Systems, 2008.

[25]

S. Lindstaedt, R. Mörzinger, R. Sorschag, V. Pammer, and G. Thallinger. Automatic image annotation using visual content and folksonomies. Multimedia Tools and Applications, 42(1), 2009.

Digital Library

[26]

S. Lindstaedt, V. Pammer, R. Mörzinger, R. Kern, H. Mülner, and C. Wagner. Recommending tags for pictures based on text, visual content and user context. In Proceedings of the 3rd International Conference on Internet and Web Applications and Services, 2008.

Digital Library

[27]

J. Liu, B. Wang, H. Lu, and S. Ma. A graph-based image annotation framework. Pattern Recognition Letters, 29(4), 2007.

Digital Library

[28]

T. Liu. Learning to rank for information retrieval. Foundations and Trends in Information Retrieval, 3(3), 2009.

[29]

C. D. Manning, P. Raghavan, and H. Schtze. Introduction to Information Retrieval. Cambridge University Press, 2008.

Digital Library

[30]

D. Metzler and W. B. Croft. Linear feature-based models for information retrieval. Information Retrieval, 10, 2007.

Digital Library

[31]

E. Moxley, J. Kleban, and B. S. Manjunath. SpiritTagger: A geo-aware tag suggestion tool mined from Flickr. In Proceeding of the 1st ACM International Conference on Multimedia Information Retrieval, 2008.

Digital Library

[32]

M. Naaman and R. Nair. Zonetag's collaborative tag suggestions: What is this person doing in my phone? IEEE MultiMedia, 15(3), 2008.

Digital Library

[33]

T. Qin, T.-Y. Liu, X.-D. Zhang, D.-S. Wang, W.-Y. Xiong, and H. Li. Learning to rank relational objects and its application to web search. In Proceeding of the 17th International Conference on World Wide Web, 2008.

Digital Library

[34]

S. G. Sevil, O. Kucuktunc, P. Duygulu, and F. Can. Automatic tag expansion using visual similarity for photo sharing websites. Multimedia Tools Applications, 49(1), 2010.

Digital Library

[35]

B. Sigurbjörnsson and R. van Zwol. Flickr tag recommendation based on collective knowledge. In Proceedings of the 17th International World Wide Web Conference, 2008.

Digital Library

[36]

D. Sorokina, R. Caruana, and M. Riedewald. Additive groves of regression trees. In Proceedings of the 18th European Conference on Machine Learning, 2007.

Digital Library

[37]

R. C. Veltkamp and M. Tanase. Content-based image retrieval systems: A survey. Technical report, Department of Computing Science, Utrecht University, 2002.

[38]

L. Wu, X.-S. Hua, N. Yu, W.-Y. Ma, and S. Li. Flickr distance. In Proceeding of the 16th ACM international conference on Multimedia, 2008.

Digital Library

[39]

J. Xu and H. Li. AdaRank: A boosting algorithm for information retrieval. In Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, 2007.

Digital Library

[40]

Y. Yue, T. Finley, F. Radlinski, and T. Joachims. A support vector method for optimizing average precision. In Proceedings of the 30th ACM SIGIR international Conference on Research and Development in Information Retrieval, 2007.

Digital Library

Cited By

Nitta NNakamura KBabaguchi N(2020)Constructing Geospatial Concept Graphs from Tagged Images for Geo-Aware Fine-Grained Image RecognitionISPRS International Journal of Geo-Information10.3390/ijgi90603549:6(354)Online publication date: 27-May-2020
https://doi.org/10.3390/ijgi9060354
Luberg APindis JTammet TChbeir RManolopoulos YAkerkar RMizera-Pietraszko J(2020)Sights, titles and tagsProceedings of the 10th International Conference on Web Intelligence, Mining and Semantics10.1145/3405962.3405987(149-158)Online publication date: 30-Jun-2020
https://dl.acm.org/doi/10.1145/3405962.3405987
Hasanuzzaman MWay ADolog PVojtas PBonchi FHelic D(2017)Place-Type Detection in Location-Based Social NetworksProceedings of the 28th ACM Conference on Hypertext and Social Media10.1145/3078714.3078722(75-83)Online publication date: 4-Jul-2017
https://dl.acm.org/doi/10.1145/3078714.3078722
Show More Cited By

Index Terms

Tag recommendation for georeferenced photos
1. Human-centered computing
  1. Visualization
    1. Visualization application domains
      1. Geographic visualization
2. Information systems
  1. Information retrieval
    1. Retrieval models and ranking
    2. Retrieval tasks and goals
  2. Information systems applications
    1. Spatial-temporal systems

Recommendations

Tag recommendation for social bookmarking: Probabilistic approaches
Principles and Practice of Multi-Agent Systems

Tagging has become increasingly popular with the explosion of user-created content on the web. A 'tag' can be defined as a group of keywords that makes organizing, browsing and searching for content more efficient. Users apply tags to a variety of web-...
Flickr tag recommendation based on collective knowledge
WWW '08: Proceedings of the 17th international conference on World Wide Web

Online photo services such as Flickr and Zooomr allow users to share their photos with family, friends, and the online community at large. An important facet of these services is that users manually annotate their photos using so called tags, which ...
Folksonomy link prediction based on a tripartite graph for tag recommendation

Nowadays social tagging has become a popular way to annotate, search, navigate and discover online resources, in turn leading to the sheer amount of user-generated metadata. This paper addresses the problem of recommending suitable tags during ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

LBSN '11: Proceedings of the 3rd ACM SIGSPATIAL International Workshop on Location-Based Social Networks

November 2011

103 pages

ISBN:9781450310338

DOI:10.1145/2063212

General Chairs:
Christian S. Jensen
Aarhus University, Denmark
,
Wang-Chien Lee
Pennsylvania State University
,
Program Chairs:
Yu Zheng
Microsoft Research Asia, China
,
Mohamed F. Mokbel
University of Minnesota

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSPATIAL: ACM Special Interest Group on Spatial Information

In-Cooperation

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Fundação para a Ciência e a Tecnologia

Conference

GIS '11

Sponsor:

SIGSPATIAL

GIS '11: 19th SIGSPATIAL International Conference on Advances in Geographic Information Systems

November 1, 2011

Illinois, Chicago

Acceptance Rates

Overall Acceptance Rate 8 of 15 submissions, 53%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
363
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nitta NNakamura KBabaguchi N(2020)Constructing Geospatial Concept Graphs from Tagged Images for Geo-Aware Fine-Grained Image RecognitionISPRS International Journal of Geo-Information10.3390/ijgi90603549:6(354)Online publication date: 27-May-2020
https://doi.org/10.3390/ijgi9060354
Luberg APindis JTammet TChbeir RManolopoulos YAkerkar RMizera-Pietraszko J(2020)Sights, titles and tagsProceedings of the 10th International Conference on Web Intelligence, Mining and Semantics10.1145/3405962.3405987(149-158)Online publication date: 30-Jun-2020
https://dl.acm.org/doi/10.1145/3405962.3405987
Hasanuzzaman MWay ADolog PVojtas PBonchi FHelic D(2017)Place-Type Detection in Location-Based Social NetworksProceedings of the 28th ACM Conference on Hypertext and Social Media10.1145/3078714.3078722(75-83)Online publication date: 4-Jul-2017
https://dl.acm.org/doi/10.1145/3078714.3078722
Yeo JCho HPark JHwang S(2017)Multimodal KB Harvesting for Emerging Spatial EntitiesIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2017.265180529:5(1073-1086)Online publication date: 1-May-2017
https://dl.acm.org/doi/10.1109/TKDE.2017.2651805
Li ZLi Z(2017)Personalized Tag RecommendationUnderstanding-Oriented Multimedia Content Analysis10.1007/978-981-10-3689-7_4(75-99)Online publication date: 27-May-2017
https://doi.org/10.1007/978-981-10-3689-7_4
Bao JZheng Y(2017)Location-Based Recommendation SystemsEncyclopedia of GIS10.1007/978-3-319-17885-1_1580(1145-1153)Online publication date: 12-May-2017
https://doi.org/10.1007/978-3-319-17885-1_1580
Lee SMasoud MBalaji JBelkasim SSunderraman RMoon S(2016)A survey of tag-based information retrievalInternational Journal of Multimedia Information Retrieval10.1007/s13735-016-0115-66:2(99-113)Online publication date: 9-Dec-2016
https://doi.org/10.1007/s13735-016-0115-6
Giannopoulos GKaragiannakis NSkoutas DAthanasiou S(2016)Learning to Classify Spatiotextual Entities in MapsProceedings of the 13th International Conference on The Semantic Web. Latest Advances and New Domains - Volume 967810.1007/978-3-319-34129-3_33(539-555)Online publication date: 29-May-2016
https://dl.acm.org/doi/10.1007/978-3-319-34129-3_33
Bao JZheng Y(2016)Location-Based Recommendation SystemsEncyclopedia of GIS10.1007/978-3-319-23519-6_1580-1(1-9)Online publication date: 29-Apr-2016
https://doi.org/10.1007/978-3-319-23519-6_1580-1
Bui THan YPark SPark S(2015)Detection of POI boundaries through geographical topics2015 International Conference on Big Data and Smart Computing (BIGCOMP)10.1109/35021BIGCOMP.2015.7072827(162-169)Online publication date: Feb-2015
https://doi.org/10.1109/35021BIGCOMP.2015.7072827
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten