research-article

From usage to annotation: analysis of personal photo albums for semantic photo understanding

Authors:

Philipp Sandhaus,

Susanne BollAuthors Info & Claims

WSM '09: Proceedings of the first SIGMM workshop on Social media

Pages 27 - 34

https://doi.org/10.1145/1631144.1631151

Published: 23 October 2009 Publication History

Abstract

With photo albums we aim to capture personal events such as weddings, vacations, and parties of family and friends. By arranging photo prints, captions and paper souvenirs such as tickets over the pages of a photo book we tell a story to capture and share our memories. The photo memories captured in such a photo book tell us a lot about the content and the relevance of the photos for the user. The way in which we select photos and arrange them in the photo book reveal a lot about the events, persons and places on the photos: captions describe content, closeness and arrangement of photos express relations between photos and their content. These semantics of our personal stories, however, are canned in the photo book but would form a very valuable asset for understanding and annotating our personal media collection.

In this paper, we present the results of the analysis of a large repository of digitally mastered photo books to learn about the usage of digital photos. From our analysis of the books' content we derive additional semantics for photos, groups of photos and entire photo albums. With this semantic knowledge not only additional metadata can be provided for the organization of the personal photo collection. Also, we can characterize photo books and support users to create even more handsome photo books from large media collections.

References

[1]

S. Boll, P. Sandhaus, A. Scherp, and S. Thieme. Metaxa context- and content-driven metadata enhancement for personal photo books. In T.-J. Cham, J. Cai, C. Dorai, D. Ra jan, T.-S. Chua, and L.-T. Chia, editors, Advances in Multimedia Modeling, volume 4351 of LNCS, pages 332--343. Springer, 2007.

Digital Library

[2]

S. Boll, P. Sandhaus, A. Scherp, and U. Westermann. Semantics, content, and structure of many for the creation of personal photo albums. In ACM Multimedia, page 641, Augsburg, Bavaria, Germany, September 2007.

Digital Library

[3]

M. R. Boutell and J. Luo. Beyond pixels: Exploiting camera metadata for photo classification. Pattern Recognition, 38(6):935--946, 2005.

Digital Library

[4]

L. Cao, J. Luo, and T. S. Huang. Annotating photo collections by label propagation according to multiple similarity cues. In MM '08: Proceeding of the 16th ACM international conference on Multimedia, pages 121--130, New York, NY, USA, 2008. ACM.

Digital Library

[5]

G. Carneiro, A. B. Chan, and P. J. Moreno. Supervised learning of semantic classes for image annotation and retrieval. IEEE Trans. Pattern Anal. Mach. Intel l., 29(3):394--410, 2007.

Digital Library

[6]

CeWe Color. CeWe Photobook, 2009. http://www.my-cewe-photobook.com.

[7]

R. Datta, J. L. W. Ge, and J. Z. Wang. Image retrieval: Ideas, influences, and trends of the new age. ACM Computing Surveys, 2007, 2007.

Digital Library

[8]

D. Frohlich, S. Wall, and G. Kiddle. Collaborative Photowork: Challenging the Boundaries Between Photowork and Phototalk. In Proc. of CHI Workshop on Col located Social Practices Surrounding Photos, 2008.

[9]

a. Jo ao Magalh F. Ciravegna, and S. Ruger. Exploring multimedia in a keyword space. In MM '08: Proceeding of the 16th ACM international conference on Multimedia, pages 101--110, New York, NY, USA, 2008. ACM.

Digital Library

[10]

D. Kirk, A. Sellen, C. Rother, and K. Wood. Understanding photowork. In CHI '06: Proceedings of the SIGCHI conference on Human Factors in computing systems, pages 761--770, New York, NY, USA, 2006. ACM Press.

Digital Library

[11]

M. S. Lew, N. Sebe, C. Djeraba, and R. Jain. Content-based multimedia information retrieval: State of the art and challenges. ACM Trans. Multimedia Comput. Commun. Appl., 2(1):1--19, February 2006.

Digital Library

[12]

J. Luo, M. Boutell, and C. Brown. Pictures are not taken in a vacuum. IEEE Signal Processing Magazine, 23(2):101--114, 2006.

[13]

B. S. Manjunath, P. Salembier, and T. Sikora. Introduction to MPEG-7. Multimedia Content Description Interface.: Multimedia Content Description Interface. Wiley&Sons, 2002.

[14]

F. Monaghan and D. O'Sullivan. Leveraging ontologies, context and social networks to automate photo annotation. In SAMT, pages 252--255, 2007.

Digital Library

[15]

J. C. Platt, M. Czerwinski, and B. A. Field. Phototoc: Automatic clustering for browsing personal photographs. Technical Report MSR-TR-2002-17, Microsoft Research, 2002.

[16]

K. Rodden and K. R. Wood. How do people manage their digital photographs? In P. K. Gilbert Cockton, editor, Proc. of the Conference on Human Factors and Computing Systems, pages 409--416, 2003.

Digital Library

[17]

P. Sandhaus, S. Boll, and R. Fageth. Employing a photo's life cycle for multimedia retrieval. In MS '08: Proceeding of the 2nd ACM workshop on Multimedia semantics, pages 56--59, New York, NY, USA, 2008. ACM.

Digital Library

[18]

A. Scherp, S. Boll, and H. Cremer. Emergent semantics in personalized multimedia content. In Fourth special workshop on Multimedia Semantics (WMS), Chania, Greece, 2006.

[19]

A. Scherp and R. Jain. Towards an ecosystem for semantics. In MS '07: Workshop on multimedia information retrieval on The many faces of multimedia semantics, pages 3--12, New York, NY, USA, 2007. ACM Press.

Digital Library

[20]

A. W. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(12):1349--1380, 2000.

Digital Library

[21]

P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, 2001.

Cited By

Sandhaus PBoll S(2011)Semantic analysis and retrieval in personal and social photo collectionsMultimedia Tools and Applications10.1007/s11042-010-0673-151:1(5-33)Online publication date: 1-Jan-2011
https://dl.acm.org/doi/10.1007/s11042-010-0673-1
Henze NBoll S(2011)Who’s That Girl? Handheld Augmented Reality for Printed Photo BooksHuman-Computer Interaction – INTERACT 201110.1007/978-3-642-23765-2_10(134-151)Online publication date: 2011
https://doi.org/10.1007/978-3-642-23765-2_10

Index Terms

From usage to annotation: analysis of personal photo albums for semantic photo understanding
1. Information systems
  1. Information retrieval
    1. Document representation
  2. Information systems applications
    1. Multimedia information systems

Recommendations

Semantics, content, and structure of many for the creation of personal photo albums
MM '07: Proceedings of the 15th ACM international conference on Multimedia

Photos are often a means to remember personal events, and the creation of photo albums is the attempt to preserve our memories in a nice book. For a long time people have been creating such photo albums on the basis of prints from analog photos arranged ...
Detection of photos from the same event captured by distinct cameras
WebMedia '12: Proceedings of the 18th Brazilian symposium on Multimedia and the web

Currently one of the main features of events such as birthday party, wedding, conferences, and trips is the amount of photos taken from different digital cameras. The plethora of photo devices such as smartphones and tablets have contributed for this ...
Photo annotation: a survey

Due to the large number of photos that are currently being generated, it is very important to have techniques to organize, search for, and retrieve such images. Photo annotation plays a key role in these mechanisms because it can link raw data (photos) ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

WSM '09: Proceedings of the first SIGMM workshop on Social media

October 2009

104 pages

ISBN:9781605587592

DOI:10.1145/1631144

General Chairs:
Susanne Boll
University of Oldenburg, Germany
,
Steven C.H. Hoi
Nanyang Technological University, Singapore
,
Jiebo Luo
Kodak Research Labs, USA
,
Program Chairs:
Rong Jin
Michigan State University, USA
,
Irwin King
The Chinese University of Hong Kong, China
,
Dong Xu
Nanyang Technological University, Singapore

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM09

Sponsor:

SIGMM

MM09: ACM Multimedia Conference

October 23, 2009

Beijing, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
385
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sandhaus PBoll S(2011)Semantic analysis and retrieval in personal and social photo collectionsMultimedia Tools and Applications10.1007/s11042-010-0673-151:1(5-33)Online publication date: 1-Jan-2011
https://dl.acm.org/doi/10.1007/s11042-010-0673-1
Henze NBoll S(2011)Who’s That Girl? Handheld Augmented Reality for Printed Photo BooksHuman-Computer Interaction – INTERACT 201110.1007/978-3-642-23765-2_10(134-151)Online publication date: 2011
https://doi.org/10.1007/978-3-642-23765-2_10

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten