research-article

Supporting personal photo storytelling for social albums

Authors:

Rodrigo de Oliveira,

Nuria OliverAuthors Info & Claims

MM '10: Proceedings of the 18th ACM international conference on Multimedia

Pages 561 - 570

https://doi.org/10.1145/1873951.1874025

Published: 25 October 2010 Publication History

Abstract

Information overload is one of today's major concerns. As high-resolution digital cameras become increasingly pervasive, unprecedented amounts of social media are being uploaded to online social networks on a daily basis. In order to support users on selecting the best photos to create an online photo album, attention has been devoted to the development of automatic approaches for photo storytelling. In this paper, we present a novel photo collection summarization system that learns some of the users' social context by analyzing their online photo albums, and includes storytelling principles and face and image aesthetic ranking in order to assist users in creating new photo albums to be shared online. In an in-depth user study conducted with 12 subjects, the proposed system was validated as a first step in the photo album creation process, helping users reduce workload to accomplish such a task. Our findings suggest that a human audio/video professional with cinematographic skills does not perform better than our proposed system.

References

[1]

Facebook increases photo album limit to 200 pictures. Retrieved in 4/2010 from http://reface.me/news/ facebook-increases-photo-album-limit-to-200-pictures.

[2]

Nasa task load index. Retrieved in 4/2010 from http://humansystems.arc.nasa.gov/groups/TLX.

[3]

B. Adams, D. Phung, and S. Venkatesh. Extraction of social context and application to personal multimedia exploration. In Proc. of the 14th annual ACM international conference on Multimedia, pp. 987--996, 2006.

Digital Library

[4]

F. Bentley, C. Metcalf, and G. Harboe. Personal vs. commercial content: the similarities between consumer use of photos and music. In CHI '06: Proc. of the SIGCHI conference on Human Factors in computing systems, pp. 667--676. ACM, 2006.

Digital Library

[5]

C. Cerosaletti and A. Loui. Measuring the perceived aesthetic quality of photographic images. In Intl. Workshop on Quality of Multimedia Experience, 2009.

[6]

M. Cherubini et al. Social tagging revamped: Supporting the users' need of self-promotion through persuasive techniques. In Proc. ACM Int. Conf. on Human Factors in Computing Systems, CHI'10, 2010.

Digital Library

[7]

M. Cooper et al. Temporal event clustering for digital photo collections. ACM Trans. Multimedia Comput. Commun. Appl., 1(3):269--288, 2005.

Digital Library

[8]

R. Datta et al. Studying aesthetics in photographic images using a computational approach. Lec. Notes. in Comp. Sci., 3953:288, 2006.

Digital Library

[9]

D. Frohlich et al. Requirements for photoware. In Proc. of CSCW'02, pp. 166--175, 2002.

Digital Library

[10]

A. Graham et al. Time as essence for photo browsing through personal digital libraries. In Proc. of the second ACM/IEEE-CS Joint Conference on Digital libraries, pp. 326--335. ACM, 2002.

Digital Library

[11]

J. Hayes and L. Flower. Identifying the organization of the writing process. Lawrence Erlbaum associates, Hillsdale, New Jersey, 1980.

[12]

N. V. House et al. From "what?" to "why?": The social uses of personal photos. In Proc. of CSCW'04. ACM, 2004.

[13]

M. Jones et al. "narrowcast yourself": designing for community storytelling in a rural indian context. In Proc. of the 7th ACM conference on Designing interactive systems, pp. 369--378. ACM, 2008.

Digital Library

[14]

M. J. Jones and P. Viola. Face recognition using boosted local features. Tech. Report MERL TR-2003--25. Mitsubishi Electric Research Lab., 2003.

[15]

D. Joshi, J. Z. Wang, and J. Li. The story picturing engine|a system for automatic text illustration. ACM Trans. Multimedia Comput. Commun. Appl., 2(1):68--89, 2006.

Digital Library

[16]

D. Kirk et al. Understanding photowork. In Proc. of the SIGCHI conference on Human Factors in computing systems, CHI'06, pp. 761--770. ACM, 2006.

Digital Library

[17]

D. Lodge. The art of fiction. Secker & Warburg, London, U.K., 1992.

[18]

A. Loui et al. Multidimensional image value assessment and rating for automated albuming and retrieval. In Proc. IEEE Intl. Conf. Image Proc., pp. 97--100, 2008.

[19]

A. C. Loui and A. E. Savakis. Automated event clustering and quality screening of consumer pictures for digital albuming. IEEE Trans. on Multimedia, pp. 390--402, Sept. 2003.

Digital Library

[20]

D. Lowe. Distinctive image features from scale-invariant keypoints. Int. J. on Comput. Vision, 60(2):910--110, 2004.

Digital Library

[21]

M. Naaman et al. Automatic organization for digital photographs with geographic coordinates. In Proc. of the 4th ACM/IEEE-CS joint conference on Digital libraries, JCDL '04, pp. 53--62. ACM, 2004.

Digital Library

[22]

P. Obrador et al. The role of tags and image aesthetics in social image search. In Proc. of the 1st SIGMM workshop on Social media, WSM '09, pp. 65--72. ACM, 2009.

Digital Library

[23]

P. Obrador and N. Moroney. Low level features for image appeal measurement. In SPIE, Electronic Imaging, Image Quality and System Performance VI, volume 7242, pp. 72420T-1-12. IS&T/SPIE, 2009.

[24]

P. Obrador and N. Moroney. Automatic Image Selection by means of a Hierarchical Scalable Collection Representation. In SPIE, Electronic Imaging, Visual Communications and Image Processing, volume 7257, pp. 72570W-1-12. IS&T/SPIE, 2009.

[25]

J. C. Platt. Autoalbum: Clustering digital photographs using probabilistic model merging. In IEEE Workshop on Content-Based Access of Image and Video Libraries, pp. 96--100, 2000.

Digital Library

[26]

J. C. Platt, M. Czerwinski, and B. A. Field. Phototoc: Automatic clustering for browsing personal photographs. Microsoft Tech. Report, 2002.

[27]

K. Rodden and K. R. Wood. How do people manage their digital photographs? In Proc. of the SIGCHI conference on Human factors in computing systems, pp. 409--416. ACM, 2003.

Digital Library

[28]

L. Schafer, C. Valle, and W. Prinz. Group storytelling for team awareness and entertainment. In Proc. of the third Nordic conference on Human-computer interaction, NordCHI'04, pp. 441--444, 2004. ACM.

Digital Library

[29]

C. Shen et al. Sharing and building digital group histories. In Proc. of CSCW'02, pp. 324--333. ACM, 2002.

Digital Library

[30]

I. Simon, N. Snavely, and S. M. Seitz. Scene summarization for online image collections. Proc. 11th IEEE International Conference on Computer Vision, pp. 147--155, 2007.

[31]

J. R. Smith and S.-F. Chang. Tools and techniques for color image retrieval. In SPIE, Electronic Imaging, Storage & Retrieval for Image and Video Databases IV, pp. 426--437. IS&T/SPIE, 1996.

[32]

R. Thornhill and S. W. Gangestad. Facial attractiveness. Trends in Cognitive Science, 3:452--460, 1999.

[33]

X. wen Chen and T. Huang. Facial expression recognition: a clustering-based approach. Pattern Recognition Letters, 24:1295--1302, 2003.

Digital Library

[34]

S. Whittaker, O. Bergman, and P. Clough. Easy on that trigger dad: a study of long term family photo retrieval. Journal Personal and Ubiquitous Computing, 14,1:31--43, 2010

Digital Library

Cited By

Mousas CKrogmeier CWang Z(2021)Photo Sequences of Varying Emotion: Optimization with a Valence-Arousal Annotated DatasetACM Transactions on Interactive Intelligent Systems10.1145/345884411:2(1-19)Online publication date: 21-Jul-2021
https://dl.acm.org/doi/10.1145/3458844
Yan GBi RGuo YPeng W(2020)Image Aesthetic Assessment Based on Latent Semantic FeaturesInformation10.3390/info1104022311:4(223)Online publication date: 17-Apr-2020
https://doi.org/10.3390/info11040223
Vitale FChen JOdom WMcGrenere JWakkary RAndersen KOdom WDesjardins APetersen M(2020)Data DashboardProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395457(311-326)Online publication date: 3-Jul-2020
https://dl.acm.org/doi/10.1145/3357236.3395457
Show More Cited By

Index Terms

Supporting personal photo storytelling for social albums
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Information systems
  1. Information retrieval
    1. Document representation
    2. Search engine architectures and scalability
      1. Search engine indexing

Recommendations

Context in Photo Albums: Understanding and Modeling User Behavior in Clustering and Selection

Recent progress in digital photography and storage availability has drastically changed our approach to photo creation. While in the era of film cameras, careful forethought would usually precede the capture of a photo; nowadays, a large number of ...
Semantics, content, and structure of many for the creation of personal photo albums
MM '07: Proceedings of the 15th ACM international conference on Multimedia

Photos are often a means to remember personal events, and the creation of photo albums is the attempt to preserve our memories in a nice book. For a long time people have been creating such photo albums on the basis of prints from analog photos arranged ...
Automatic creation of photo books from stories in social media
WSM '10: Proceedings of second ACM SIGMM workshop on Social media

Photos are a special way to tell stories of our best memories. The representation of those photos in appealing physical photo books is highly appreciated by many people. Today, many photos are shared via social networking sites, where people upload ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '10: Proceedings of the 18th ACM international conference on Multimedia

October 2010

1836 pages

ISBN:9781605589336

DOI:10.1145/1873951

General Chairs:
Alberto del Bimbo
University of Florence, Italy
,
Shih-Fu Chang
Columbia University, USA
,
Program Chair:
Arnold Smeulders
University of Amsterdam, NL

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 October 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM '10

Sponsor:

SIGMM

MM '10: ACM Multimedia Conference

October 25 - 29, 2010

Firenze, Italy

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

31
Total Citations
View Citations
816
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)2

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mousas CKrogmeier CWang Z(2021)Photo Sequences of Varying Emotion: Optimization with a Valence-Arousal Annotated DatasetACM Transactions on Interactive Intelligent Systems10.1145/345884411:2(1-19)Online publication date: 21-Jul-2021
https://dl.acm.org/doi/10.1145/3458844
Yan GBi RGuo YPeng W(2020)Image Aesthetic Assessment Based on Latent Semantic FeaturesInformation10.3390/info1104022311:4(223)Online publication date: 17-Apr-2020
https://doi.org/10.3390/info11040223
Vitale FChen JOdom WMcGrenere JWakkary RAndersen KOdom WDesjardins APetersen M(2020)Data DashboardProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395457(311-326)Online publication date: 3-Jul-2020
https://dl.acm.org/doi/10.1145/3357236.3395457
Vitale FOdom WMcGrenere JHarrison SBardzell SNeustaedter CTatar D(2019)Keeping and Discarding Personal DataProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322300(1463-1477)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3322300
Singh AVirmani LSubramanyam A(2019)Image Corpus Representative Summarization2019 IEEE Fifth International Conference on Multimedia Big Data (BigMM)10.1109/BigMM.2019.00-46(21-29)Online publication date: Sep-2019
https://doi.org/10.1109/BigMM.2019.00-46
Jones JAckerman MMandryk RHancock MPerry MCox A(2018)Co-constructing Family MemoryProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173998(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173998
Guy INus APelleg DSzpektor IChang YZhai CLiu YMaarek Y(2018)Care to Share?Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining10.1145/3159652.3159713(207-215)Online publication date: 2-Feb-2018
https://dl.acm.org/doi/10.1145/3159652.3159713
Yang XZhang TXu C(2018)Deep-Structured Event Modeling for User-Generated PhotosIEEE Transactions on Multimedia10.1109/TMM.2017.278821020:8(2100-2113)Online publication date: Aug-2018
https://doi.org/10.1109/TMM.2017.2788210
He SZhou ZFarhat FWang J(2018)Discovering Triangles in Portraits for Supporting Photographic CreationIEEE Transactions on Multimedia10.1109/TMM.2017.274002620:2(496-508)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1109/TMM.2017.2740026
Merritt DJones JAckerman MLasecki WLee CPoltrock SBarkhuus LBorges MKellogg W(2017)KuratorProceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing10.1145/2998181.2998358(1835-1849)Online publication date: 25-Feb-2017
https://dl.acm.org/doi/10.1145/2998181.2998358
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten