research-article

A visual analysis of the relationship between word concepts and geographical locations

Authors:

Hidetoshi Kawakubo,

Bingyu QiuAuthors Info & Claims

CIVR '09: Proceedings of the ACM International Conference on Image and Video Retrieval

Article No.: 13, Pages 1 - 8

https://doi.org/10.1145/1646396.1646414

Published: 08 July 2009 Publication History

Abstract

In this paper, we describe two methods to analyze the relationship between word concepts and geographical locations by using a large amount of geotagged images on the photo sharing Web sites such as Flickr.

Firstly, we propose using both image region entropy and geolocation entropy to analyze relations between location and visual features, and in the experiment we found that concepts with low image entropy tends to have high geo-location entropy and vice versa.

Secondly, we propose a novel method to select representative photographs for regions in the worldwide dimensions, which helps detect cultural differences over the world regarding word concepts with high geo-location entropy. In the proposed method, at first, we extracts the most relevant images by clustering and evaluation on the visual features. Then, based on geographic information of the images, representative regions are automatically detected. Finally, we select and generate a set of representative images for the representative regions by employing the Probabilistic Latent Semantic Analysis (PLSA) modelling. The results show the ability of our approach to mine regional representative photographs and cultural differences over the world.

References

[1]

S. Andrews, I. Tsochantaridis, and T. Hofmann. Support Vector Machines for Multiple-Instance Learning. In Advances in Neural Information Processing Systems, pages 577--584, 2003.

[2]

K. Barnard, P. Duygulu, N. d. Freitas, D. Forsyth, D. Blei, and M. Jordan. Matching words and pictures. Journal of Machine Learning Research, 3: 1107--1135, 2003.

Digital Library

[3]

L. Cao, J. Luo, H. Kautz, and T. Huang. Annotating collections of geotagged photos using hierarchical event and scene models. In Proc. of IEEE Computer Vision and Pattern Recognition, 2008.

[4]

M. Cristani, A. Perina, U. Castellani, and V. Murino. Geo-located image analysis using latent representations. In Proc. of IEEE Computer Vision and Pattern Recognition, 2008.

Digital Library

[5]

G. Csurka, C. Bray, C. Dance, and L. Fan. Visual categorization with bags of keypoints. In Proc. of ECCV Workshop on Statistical Learning in Computer Vision, pages 59--74, 2004.

[6]

Y. Deng and B. S. Manjunath. Unsupervised segmentation of color-texture regions in images and video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(8): 800--810, 2001.

Digital Library

[7]

J. Hays and A. A. Efros. IM2GPS: Estimating geographic information from a single image. In Proc. of IEEE Computer Vision and Pattern Recognition, 2008.

[8]

T. Hofmann. Unsupervised learning by probabilistic latent semantic analysis. Machine Learning, 43: 177--196, 2001.

[9]

A. Jaffe, M. Naaman, T. Tassa, and M. Davis. Generating summaries and visualization for large collections of geo-referenced photographs. In Proc. of ACM SIGMM International Workshop on Multimedia Information Retrieval, pages 89--98, 2006.

Digital Library

[10]

D. Joshi and J. Luo. Inferring generic activities and events from image content and bags of geo-tags. In Proc. of ACM International Conference on Image and Video Retrieval, 2008.

Digital Library

[11]

L. Kennedy and M. Naaman. Generating diverse and representative image search results for landmarks. In Proc. of the International World Wide Web Conference, pages 297--306, 2008.

Digital Library

[12]

M. Koskela, A. F. Smeaton, and J. Laaksonen. Measuring concept similarities in multimedia ontologies: Analysis and evaluations. IEEE Transaction on Multimedia, 9(5): 912--922, 2007.

Digital Library

[13]

D. G. Lowe. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2): 91--110, 2004.

Digital Library

[14]

J. Luo, J. Yu, D. Joshi, and W. Hao. Event recognition: Viewing the world with a third eye. In Proc. of ACM International Conference Multimedia, 2008.

Digital Library

[15]

M. Naaman, Y. J. Song, A. Paepcke, and H. Garcia-Molina. Automatic organization for digital photographs with geographic coordinates. In Proc. of ACM International Conference Multimedia, pages 53--62, 2004.

Digital Library

[16]

M. Naphade, J. R. Smith, J. Tesic, S. F. Chang, W. Hsu, L. Kennedy, A. Hauptmann, and J. Curtis. Large-scale concept ontology for multimedia. IEEE Transaction on Multimedia, 13(3): 86--91, 2006.

Digital Library

[17]

E. Nowak, F. Jurie, W. Triggs, and M. Vision. Sampling strategies for bag-of-features image classification. In Proc. of European Conference on Computer Vision, pages IV: 490--503, 2006.

Digital Library

[18]

T. Quack, B. Leibe, and L. V. Gool. World-scale mining of objects and events from community photo collections. In Proc. of ACM International Conference on Image and Video Retrieval, pages 47--56, 2008.

Digital Library

[19]

R. Raguram and S. Lazebnik. Computing iconic summaries of general visual concepts. In Proc. of IEEE CVPR Workshop on Internet Vision, 2008.

[20]

I. Simon, N. Snavely, and S. M. Seitz. Scene summarization for online image collections. In Proc. of IEEE International Conference on Computer Vision, 2007.

[21]

K. Toyama, R. Logan, A. Roseway, and P. Anandan. Geographic location tags on digital images. In Proc. of ACM International Conference Multimedia, pages 156--166, 2003.

Digital Library

[22]

K. Yaegashi and K. Yanai. Can geotags help image recognition? In Proc. of Pacific-Rim Symposium on Image and Video Technology, 2009.

Digital Library

[23]

K. Yanai. Image collector II: An over-one-thousand-image-gathering system. In Proc. of the Twelfth International World Wide Web Conference, 2003.

[24]

K. Yanai and K. Barnard. Image region entropy: A measure of "visualness" of web images associated with one concept. In Proc. of ACM International Conference Multimedia, pages 420--423, 2005.

Digital Library

[25]

J. Yu and J. Luo. Leveraging probabilistic season and location context models for scene understanding. In Proc. of ACM International Conference on Image and Video Retrieval, pages 169--178, 2008.

Digital Library

[26]

J. Yuan, J. Luo, H. Kautz, and Y. Wu. Mining GPS traces and visual words for event classification. In Proc. of ACM SIGMM International Workshop on Multimedia Information Retrieval, 2008.

Digital Library

Cited By

Zheng YZha ZChua T(2018)Research and applications on georeferenced multimediaMultimedia Tools and Applications10.1007/s11042-010-0630-z51:1(77-98)Online publication date: 30-Dec-2018
https://dl.acm.org/doi/10.1007/s11042-010-0630-z
Luo JJoshi DYu JGallagher A(2018)Geotagging in multimedia and computer vision--a surveyMultimedia Tools and Applications10.1007/s11042-010-0623-y51:1(187-211)Online publication date: 30-Dec-2018
https://dl.acm.org/doi/10.1007/s11042-010-0623-y
Leung RVu HRong J(2017)Understanding tourists’ photo sharing and visit pattern at non-first tier attractions via geotagged photosInformation Technology & Tourism10.1007/s40558-017-0078-317:1(55-74)Online publication date: 6-Mar-2017
https://doi.org/10.1007/s40558-017-0078-3
Show More Cited By

Index Terms

A visual analysis of the relationship between word concepts and geographical locations
1. Information systems
  1. Information retrieval

Recommendations

An analysis of the relation between visual concepts and geo-locations using geotagged images on the web
ICME'09: Proceedings of the 2009 IEEE international conference on Multimedia and Expo

Recently, a large number of geotagged images are available on photo sharing Web sites such as Flickr. In this paper, we propose image region entropy and geo-location entropy for analyzing the relation between visual concepts and geographical locations ...
Detecting cultural differences using consumer-generated geotagged photos
LOCWEB '09: Proceedings of the 2nd International Workshop on Location and the Web

We propose a novel method to detect cultural differences over the world automatically by using a large amount of geotagged images on the photo sharing Web sites such as Flickr. We employ the state-of-the-art object recognition technique developed in the ...
Constructing places from spatial footprints
GEOCROWD '12: Proceedings of the 1st ACM SIGSPATIAL International Workshop on Crowdsourced and Volunteered Geographic Information

Place is an essential concept in human discourse. It is people's interaction and experience with their surroundings that identify place from non-place in space. This paper explores the use of spatial footprints as a record of human interaction with the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CIVR '09: Proceedings of the ACM International Conference on Image and Video Retrieval

July 2009

383 pages

ISBN:9781605584805

DOI:10.1145/1646396

Conference Chairs:
Yiannis Kompatsiaris
CERTH-ITI, Greece
,
Stephane Marchand-Maillet
Univ. of Geneva, Switzerland
,
Program Chairs:
Yannis Avrithis
NTUA, Greece
,
Noel O Connor
DCU, Ireland
,
Daniel Gatica-Perez
Idiap Research Institute, Switzerland
,
Tat-Seng Chua
National University of Singapore, Singapore

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

In-Cooperation

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 July 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CIVR '09

Sponsor:

SIGMM

CIVR '09: CIVR '09 - International Conference on Image and Video Retrieval

July 8 - 10, 2009

Santorini, Fira, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
510
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zheng YZha ZChua T(2018)Research and applications on georeferenced multimediaMultimedia Tools and Applications10.1007/s11042-010-0630-z51:1(77-98)Online publication date: 30-Dec-2018
https://dl.acm.org/doi/10.1007/s11042-010-0630-z
Luo JJoshi DYu JGallagher A(2018)Geotagging in multimedia and computer vision--a surveyMultimedia Tools and Applications10.1007/s11042-010-0623-y51:1(187-211)Online publication date: 30-Dec-2018
https://dl.acm.org/doi/10.1007/s11042-010-0623-y
Leung RVu HRong J(2017)Understanding tourists’ photo sharing and visit pattern at non-first tier attractions via geotagged photosInformation Technology & Tourism10.1007/s40558-017-0078-317:1(55-74)Online publication date: 6-Mar-2017
https://doi.org/10.1007/s40558-017-0078-3
Barnard K(2016)Computational Methods for Integrating Vision and LanguageSynthesis Lectures on Computer Vision10.2200/S00705ED1V01Y201602COV0076:1(1-227)Online publication date: 20-Apr-2016
https://doi.org/10.2200/S00705ED1V01Y201602COV007
To HNguyen KShahabi CAli MNewsam SRenz MTrajcevski GRavada S(2016)Differentially private publication of location entropyProceedings of the 24th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems10.1145/2996913.2996985(1-10)Online publication date: 31-Oct-2016
https://dl.acm.org/doi/10.1145/2996913.2996985
Spyrou EMylonas P(2016)A survey on Flickr multimedia research challengesEngineering Applications of Artificial Intelligence10.1016/j.engappai.2016.01.00651:C(71-91)Online publication date: 1-May-2016
https://dl.acm.org/doi/10.1016/j.engappai.2016.01.006
Yanai K(2015)[Invited Paper] A Review of Web Image MiningITE Transactions on Media Technology and Applications10.3169/mta.3.1563:3(156-169)Online publication date: 2015
https://doi.org/10.3169/mta.3.156
Yin YShen ZZhang LZimmermann R(2015)Spatial-Temporal Tag Mining for Automatic Geospatial Video AnnotationACM Transactions on Multimedia Computing, Communications, and Applications10.1145/265898111:2(1-21)Online publication date: 7-Jan-2015
https://dl.acm.org/doi/10.1145/2658981
Thomee BDe Francisci Morales GFerres LRossi GAlmeida VHerder E(2014)Automatic discovery of global and local equivalence relationships in labeled geo-spatial dataProceedings of the 25th ACM conference on Hypertext and social media10.1145/2631775.2631794(158-168)Online publication date: 1-Sep-2014
https://dl.acm.org/doi/10.1145/2631775.2631794
Song YZhang YCao JTang JGao XLi J(2014)A Unified Geolocation Framework for Web VideosACM Transactions on Intelligent Systems and Technology10.1145/25339895:3(1-22)Online publication date: 17-Jul-2014
https://dl.acm.org/doi/10.1145/2533989
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents